Open main menu

Difference between revisions of "Release Testing"

104 bytes removed ,  13:17, 26 May 2007
m
mentioning that more people should test if there are multiple paths
m (adding link to 0.10.0 testing)
m (mentioning that more people should test if there are multiple paths)
Line 7: Line 7:
=== Testing Guidelines ===
=== Testing Guidelines ===


Note, that the guidelines were changed since 0.8.0 testing. New items are specifically marked with red stars. So, please, pay attention to them.
Note that the guidelines were changed a little since 0.9.0 testing. New items are specifically marked with red stars. So, please, pay attention to them.


* Use latest SVN build which you may find at bottom of our [http://www.scummvm.org/downloads.php download page].
* Use latest SVN build which you may find at bottom of our [http://www.scummvm.org/downloads.php download page].
* <font color=red>*</font> Use launcher to add your game and see if it was detected normally, even if you already have this game already added. Start newly added target.
* Use launcher to add your game and see if it was detected normally, even if you already have this game already added. Start newly added target.
* <font color=red>*</font> Preferably test detection of every game/demo you have, even when you're not going to play them
* Preferably test detection of every game/demo you have, even when you're not going to play them
* Play game from beginning through the end
* Play game from beginning through the end
* <font color=red>*</font> Preferably use of save/load facility
* Preferably use of save/load facility
* <font color=red>*</font> '''Do not''' skip cutscenes.
* '''Do not''' skip cutscenes.
* If you encounter any problems, please, submit a bug report at our [http://sourceforge.net/tracker/?atid=418820&group_id=37116&func=browse Bugtracker]
* If you encounter any problems, please, submit a bug report at our [http://sourceforge.net/tracker/?atid=418820&group_id=37116&func=browse Bugtracker]
* <font color=red>*</font> If game has several branches, test as many variants as you can
* If game has several branches, test as many variants as you can
* <font color=red>*</font> At least '''2''' distinct users should test each game, preferably but not obligatory on different platforms.
* At least '''2''' distinct users should test each game, preferably but not obligatory on different platforms.
** <font color=red>*</font>  However, more should test if it is a multiple path game (such as ''Fate of Atlantis'' or ''Maniac Mansion'')


=== What to provide when you encounter a bug ===
=== What to provide when you encounter a bug ===
Line 23: Line 24:
Information to provide on our bug tracker. Please, do not post bugs to our forums as that makes discussions and bug fixing progress tracking practically impossible
Information to provide on our bug tracker. Please, do not post bugs to our forums as that makes discussions and bug fixing progress tracking practically impossible


* <font color=red>*</font> Make sure that you have a working mail set up at your sf.net account. In this case you will receive our reply to your bug report
* Make sure that you have a working mail set up at your sf.net account. In this case you will receive our reply to your bug report
* Snapshot date (but please, always test with latest one)
* Snapshot date (but please, always test with latest one)
* Bug details, including instructions on reproducing it
* Bug details, including instructions on reproducing it
* Language of game (English, German, ...).  
* Language of game (English, German, ...).  
* <font color=red>*</font> Is it fan translation or not.
* Is it fan translation or not.
* Version of game (talkie, floppy, ...)
* Version of game (talkie, floppy, ...)
* <font color=red>*</font> Whether sound was compressed or not
* Whether sound was compressed or not
* Platform and compiler (Win32, Linux, MacOS, ...)
* Platform and compiler (Win32, Linux, MacOS, ...)
* Attach a save game if possible
* Attach a save game if possible
* <font color=red>*</font> Attach a screenshot to demonstrate graphics bugs if applicable
* Attach a screenshot to demonstrate graphics bugs if applicable


It may happen that at some point of our testing we break savegame compatibility, or do something which affect engine deeply. Then you could be asked to start the game you play from the beginning. You will be explicitly told to do so, so don't worry if we say nothing in this aspect.
It may happen that at some point of our testing we break savegame compatibility, or do something which affect engine deeply. Then you could be asked to start the game you play from the beginning. You will be explicitly told to do so, so don't worry if we say nothing in this aspect.
2,051

edits