Difference between revisions of "Release Testing"

From ScummVM :: Wiki
Jump to navigation Jump to search
m (Typo)
(Wording)
Line 9: Line 9:
Note that the guidelines were changed a little since 0.9.0 testing. New items are specifically marked with red stars. So, please, pay attention to them.
Note that the guidelines were changed a little since 0.9.0 testing. New items are specifically marked with red stars. So, please, pay attention to them.


* Use latest SVN build which you may find at bottom of our [http://www.scummvm.org/downloads.php download page].
* Use the latest SVN build which you may find at the bottom of our [http://www.scummvm.org/downloads.php download page].
* Use launcher to add your game and see if it was detected normally, even if you already have this game already added. Start newly added target.
* Use the launcher to add your game and see if it was detected normally, even if you already have this game already added. Start newly added target.
* Preferably test detection of every game/demo you have, even when you're not going to play them
* Preferably test detection of every game/demo you have, even when you're not going to play them
* Play game from beginning through the end
* Play game from beginning through the end
Line 16: Line 16:
* '''Do not''' skip cutscenes.
* '''Do not''' skip cutscenes.
* If you encounter any problems, please, submit a bug report at our [http://sourceforge.net/tracker/?atid=418820&group_id=37116&func=browse Bugtracker]
* If you encounter any problems, please, submit a bug report at our [http://sourceforge.net/tracker/?atid=418820&group_id=37116&func=browse Bugtracker]
* If game has several branches, test as many variants as you can
* If a game has several branches, test as many variants as you can
* <font color=red>*</font> At least 1 user should test each game, preferably but not obligatory on different platforms.
* <font color=red>*</font> At least 1 user should test each game, preferably but not obligatory on different platforms.
** <font color=red>*</font> However, more should test for one of the following reasons:
** <font color=red>*</font> However, more than one users should test games that satisfy one or more of the following conditions:
*** <font color=red>*</font> It is a multiple path game (such as ''Fate of Atlantis'' or ''Maniac Mansion'')
*** <font color=red>*</font> It is a multiple path game (such as ''Fate of Atlantis'' or ''Maniac Mansion'')
*** <font color=red>*</font> It is a new game for this release
*** <font color=red>*</font> It is a new game for this release
*** <font color=red>*</font> It is an AGOS game
*** <font color=red>*</font> It is an AGOS game
*** <font color=red>*</font> We designate such games designated by '''''#''''' (hash symbol)
*** <font color=red>*</font> We designate such games with a '''''#''''' (hash symbol)


=== What to provide when you encounter a bug ===
=== What to provide when you encounter a bug ===


Information to provide on our bug tracker. Please, do not post bugs to our forums as that makes discussions and bug fixing progress tracking practically impossible
Please provide information on our bug tracker. Please, do not post bugs to our forums as that makes discussions and bug fixing progress tracking practically impossible


* Make sure that you have a working mail set up at your sf.net account. In this case you will receive our reply to your bug report
* Make sure that you have a working mail set up at your sf.net account. In this case you will receive our reply to your bug report
Line 39: Line 39:
* Attach a screenshot to demonstrate graphics bugs if applicable
* Attach a screenshot to demonstrate graphics bugs if applicable


It may happen that at some point of our testing we break savegame compatibility, or do something which affect engine deeply. Then you could be asked to start the game you play from the beginning. You will be explicitly told to do so, so don't worry if we say nothing in this aspect.
It may happen that at some point of our testing we break savegame compatibility, or do something which affects a specific engine deeply. In that case, you could be asked to restart the game you're currently playing from the beginning. You will be explicitly told to do so, so don't worry if we say nothing in this aspect.


Please, report about your completion on scummvm-devel@lists.sourceforge.net, on our forums either talk to some developer (an op) at #scummvm on freenode.net. If you encountered some problem, provide bug report number too.
Please, report about your completion on scummvm-devel@lists.sourceforge.net, on our forums either talk to some developer (an op) at #scummvm on freenode.net. If you encountered some problem, provide the bug report number as well.


Thanks for your help.
Thanks for your help.

Revision as of 11:50, 31 May 2007

Release Testing for ScummVM

Testing Guidelines

Note that the guidelines were changed a little since 0.9.0 testing. New items are specifically marked with red stars. So, please, pay attention to them.

  • Use the latest SVN build which you may find at the bottom of our download page.
  • Use the launcher to add your game and see if it was detected normally, even if you already have this game already added. Start newly added target.
  • Preferably test detection of every game/demo you have, even when you're not going to play them
  • Play game from beginning through the end
  • Preferably use of save/load facility
  • Do not skip cutscenes.
  • If you encounter any problems, please, submit a bug report at our Bugtracker
  • If a game has several branches, test as many variants as you can
  • * At least 1 user should test each game, preferably but not obligatory on different platforms.
    • * However, more than one users should test games that satisfy one or more of the following conditions:
      • * It is a multiple path game (such as Fate of Atlantis or Maniac Mansion)
      • * It is a new game for this release
      • * It is an AGOS game
      • * We designate such games with a # (hash symbol)

What to provide when you encounter a bug

Please provide information on our bug tracker. Please, do not post bugs to our forums as that makes discussions and bug fixing progress tracking practically impossible

  • Make sure that you have a working mail set up at your sf.net account. In this case you will receive our reply to your bug report
  • Snapshot date (but please, always test with latest one)
  • Bug details, including instructions on reproducing it
  • Language of game (English, German, ...).
  • Is it fan translation or not.
  • Version of game (talkie, floppy, ...)
  • Whether sound was compressed or not
  • Platform and compiler (Win32, Linux, MacOS, ...)
  • Attach a save game if possible
  • Attach a screenshot to demonstrate graphics bugs if applicable

It may happen that at some point of our testing we break savegame compatibility, or do something which affects a specific engine deeply. In that case, you could be asked to restart the game you're currently playing from the beginning. You will be explicitly told to do so, so don't worry if we say nothing in this aspect.

Please, report about your completion on scummvm-devel@lists.sourceforge.net, on our forums either talk to some developer (an op) at #scummvm on freenode.net. If you encountered some problem, provide the bug report number as well.

Thanks for your help.