Difference between revisions of "Release Testing"

From ScummVM :: Wiki
Jump to navigation Jump to search
(→‎LucasArts SCUMM games: makred indy3 as blue too, 'cuz of minor glitches)
 
(68 intermediate revisions by 13 users not shown)
Line 1: Line 1:
== Release testing for ScummVM 0.9.0 ==
== Release Testing for ScummVM ==


Thank you for your participation in pre-0.9.0 testing. Your efforts will let us make ScummVM a better software. We, developers are just unable physically to test these piles of games. Moreover by some coincidence we prefer to hack C++ more than playing. So your help is very appreciated.
* [[Release Testing/2.7.0|2.7.0]]
* [[Release Testing/2.6.0|2.6.0]]
* [[Release Testing/2.3.0|2.3.0]]
* [[Release Testing/2.1.0|2.1.0]]
* [[Release Testing/2.0.0|2.0.0]]
* [[Release Testing/1.9.0|1.9.0]]
* [[Release Testing/1.8.1|1.8.1]]
* [[Release Testing/1.8.0|1.8.0]]
* [[Release Testing/1.7.0|1.7.0]]
* [[Release Testing/1.6.0|1.6.0]]
* [[Release Testing/1.5.0|1.5.0]]
* [[Release Testing/1.4.0|1.4.0]]
* [[Release Testing/1.3.0|1.3.0]]
* [[Release Testing/1.2.0|1.2.0]]/[[SCI/Testing|SCI]]
* [[Release Testing/1.1.0|1.1.0]]
* [[Release Testing/1.0.0|1.0.0]]
* [[Release Testing/0.13.0|0.13.0]]
* [[Release Testing/0.12.0|0.12.0]]
* [[Release Testing/0.11.0|0.11.0]]
* [[Release Testing/0.10.0|0.10.0]]
* [[Release Testing/0.9.0|0.9.0]]
* [[Release Testing/0.8.0|0.8.0]]


=== Testing guidelines ===
== Testing Guidelines ==


Note, that the guidelines were changed since 0.8.0 testing. New items are specifically marked with red stars. So, please, pay attention to them.
* Use the latest build which you may find at the bottom of our [http://scummvm.org/downloads/ download page]. After we branched please use the latest '''stable''' builds when downloading from our [http://buildbot.scummvm.org/builds.html Buildbot].
* Use the launcher to add your game and see if it was detected normally, even if you already have this game already added. Start newly added target.
* Preferably test detection of every game/demo you have, even when you're not going to play them.
* Play game from beginning through the end.
* Preferably use of save/load facility.
* '''Do not''' skip cutscenes.
* If you encounter any problems, please, submit a bug report at our [https://bugs.scummvm.org/ bug tracker].
* If a game has several branches, test as many variants as you can.
* At least 1 user should test each game, preferably but not obligatory on different platforms.
** However, more than one user should test games that satisfy one or more of the following conditions:
*** It is a multiple path game (such as ''Fate of Atlantis'' or ''Maniac Mansion''). We designate such games with a '''''#''''' (hash symbol).
*** It is a new game for this release. We designate such games with a '''''*''''' (star symbol).


* Use latest SVN build which you may find at bottom of our [http://www.scummvm.org/downloads.php download page].
== What to provide when you encounter a bug ==
* <font color=red>*</font> Use launcher to add your game and see if it was detected normally, even if you already have this game already added. Start newly added target.
* <font color=red>*</font> Preferably test detection of every game/demo you have, even when you're not going to play them
* Play game from beginning through the end
* <font color=red>*</font> Preferably use of save/load facility
* <font color=red>*</font> '''Do not''' skip cutscenes.
* If you encounter any problems, please, submit a bugreport at our [http://sourceforge.net/tracker/?atid=418820&group_id=37116&func=browse Bugtracker]
* <font color=red>*</font> If game has several branches, test as many variants as you can
* <font color=red>*</font> At least 2 distinct users should test each game, preferably but not obligatory on different platforms.


=== What to provide when you encounter a bug ===
Please provide information on our bug tracker. Please, do not post bugs to our forums as that makes discussions and bug fixing progress tracking practically impossible.


Information to provide on our bug tracker. Please, do not post bugs to our forums as that makes discussions and bugfixing progress tracking practically impossible
* Make sure that you have a working mail set up at your GitHub account. In this case you will receive our reply to your bug report.
* Snapshot date (but please, always test with the latest one).
* Bug details, including instructions on reproducing it.
* Language of game (English, German...).
* If it is a fan translation, mention it.
* Version of game (talkie, floppy...).
* Whether the sound was compressed or not.
* Platform and compiler (Linux, macOS, Windows, etc).
* Attach a save game if possible.
* Attach a screenshot to demonstrate graphics bugs if applicable.


* <font color=red>*</font> Make sure that you have a working mail set up at your sf.net account. In this case you will receive our reply to your bugreport
It may happen that at some point of our testing we break savegame compatibility, or do something which affects a specific engine deeply. In that case, you could be asked to restart the game you're currently playing from the beginning. You will be explicitly told to do so, so don't worry if we say nothing in this aspect.
* Snapshot date (but please, always test with latest one)
* Bug details, including instructions on reproducing it
* Language of game (English, German, ...). <font color=red>*</font> Is it fantranslation or not.
* Version of game (talkie, floppy, ...)
* <font color=red>*</font> Whether sound was compressed or not
* Platform and compiler (Win32, Linux, MacOS, ...)
* Attach a save game if possible
* <font color=red>*</font> Attach a screenshot to demonstrate graphics bugs if applicable


It may happen that at some point of our testing we break savegame compatibility, or do something which affect engine deeply. Then you could be asked to start the game you play from the beginning. You will be explicitely told to do so, so don't worry if we say nothing in this aspect.
Please, report about your completion on our forums (preferably in the thread linked by the testing announcement). If you encountered some problem, provide the bug report number as well.
 
Please, report about your completion on scummvm-devel@lists.sourceforge.net, on our forums either talk to some developer (an op) at #scummvm on freenode.net. If you encountered some problem, provide bugreport number too.


Thanks for your help.
Thanks for your help.
== Games to test ==
{| border="0"
|-
|Legend:
|-
|style="background:#ffff77;width:100px"|Testing
|-
|style="background:#77ffff;width:100px"|Needs retesting
|-
|style="background:lightgreen;width:100px"|Completable
|-
|style="background:#7777ff;width:100px"|Minor problems
|-
|style="background:#ff7777;width:100px"|Major problems
|}
Game turns into green only after second person tests it. If you see game yellow, but only one person's name specified, feel free to take it for testing as well.
=== LucasArts SCUMM games ===
{| border="1" cellpadding="2" width=100%
|+LucasArts SCUMM Game Testing for 0.9.0
|- style="background:silver"
|Game Name||Game Version||Status||Tester||Platform||Tested
|- style="background:#ffff77"
|Maniac Mansion v1||English PC||Completable. No regressions noted.||MetaFox||Win32||May 28
|- style="background:#ffff77"
|Maniac Mansion v2||English PC||Completable. No regressions noted.||MetaFox||Win32||May 29
|- style="background:#ffff77"
|Zak McKracken C64||N/A||N/A||Vorph||None||Jun 17
|-
|Zak McKracken v1||N/A||N/A||None||None||None
|- style="background:#ffff77"
|Zak McKracken v2||N/A||N/A||glokidd||None||None
|- style="background:#ffff77"
|Zak McKracken FM-TOWNS||English||Completable. No regressions noted.||Ender||Linux||May 29
|-
|Indiana Jones and the Last Crusade EGA||N/A||N/A||None||None||None
|- style="background:#7777ff"
|Indiana Jones and the Last Crusade VGA||English||Completable. Minor glitch. [https://sourceforge.net/tracker/index.php?func=detail&aid=1507133&group_id=37116&atid=418820 #1507133] [https://sourceforge.net/tracker/index.php?func=detail&aid=1507856&group_id=37116&atid=418820 #1507856]||bramvandijk<br/>clone2727||Linux<br/>Win32||Jun 16
|- style="background:#7777ff"
|Loom||English PC EGA (Expert)||Completable. Minor problem with Roland music. [https://sourceforge.net/tracker/index.php?func=detail&aid=1498785&group_id=37116&atid=418820 #1498785]||eriktorbjorn||Linux||Jun 1
|- style="background:#ffff77"
|Loom FM-TOWNS||English||Completable. Some known minor graphical glitches (fades and pink distaff).||MaverickGR||MacOSX||Jun 13
|- style="background:#ffff77"
|Loom CD||English||Completable. No regressions noted.||bramvandijk||Linux||Jun 3
|- style="background:#ffff77"
|The Secret of Monkey Island||English PC VGA||Completable. No regressions noted.||MetaFox||Win32||May 28
|- style="background:lightgreen"
|The Secret of Monkey Island CD||English SegaCD<br/>German PC CD||Completable. Minor control problems.<br/>Completable. No regressions noted.||MetaFox<br/>crowley||Win32<br/>Linux||May 29<br/>May 30
|- style="background:lightgreen"
|Monkey Island 2: LeChuck's Revenge||English PC<br/>German PC<br/>English PC (Light)||Completable. No regressions noted.||MetaFox<br/>Vorph<br/>eriktorbjorn||Win32<br/><br/>Linux||May 29<br/><br/>Jun 7
|- style="background:#ffff77"
|Indiana Jones and the Fate of Atlantis||English PC Floppy<br/>English PC CD||N/A||micahgeek<br/>Indiana Jones||Win32<br/>||None
|- style="background:lightgreen"
|Day of the Tentacle||English PC CD<br/>German PC CD||Completable. No regressions noted.||MetaFox<br/>crowley||Win32<br/>Linux||May 28<br/>May 30
|- style="background:lightgreen"
|Sam & Max Hit the Road||English PC CD<br>German PC CD||Completable. Minor graphics glitches. [https://sourceforge.net/tracker/index.php?func=detail&aid=1496577&group_id=37116&atid=418820 #1496577] [https://sourceforge.net/tracker/index.php?func=detail&aid=1496566&group_id=37116&atid=418820 #1496566]||Vorph<br/>MetaFox||Win32||May 28
|- style="background:lightgreen"
|Full Throttle||English PC||Completable. No regressions noted.||bramvandijk<br/>MetaFox||Linux<br/>Win32||May 30
|- style="background:lightgreen"
|The Dig||English PC<br/>German PC||Completable. No regressions noted.||evilgrug<br/>crowley||MacOSX<br/>Linux||Jun 1
|- style="background:lightgreen"
|The Curse of Monkey Island||English||Completable. No regressions noted.||MetaFox<br/>clone2727||Win32||May 30<br/>Jun 14
|-
|}
=== Non-SCUMM games ===
{| border="1" cellpadding="2" width=100%
|+Non-SCUMM Game Testing for 0.9.0
|- style="background:silver"
|Game Name||Game Version||Status||Tester||Platform||Tested
|- style="background:#7777ff"
|Beneath a Steel Sky||Talkie (UK) (0.0372)||Completable. No regressions noted.<br/>Completable with minor glitches. [https://sourceforge.net/tracker/index.php?func=detail&aid=1507835&group_id=37116&atid=418820 #1507835] [https://sourceforge.net/tracker/index.php?func=detail&aid=1507757&group_id=37116&atid=418820 #1507757] [https://sourceforge.net/tracker/index.php?func=detail&aid=1507756&group_id=37116&atid=418820 #1507756]||clem<br/>Adventureguy||Win32||May 29<br/>Jun 17
|- style="background:#ffff77"
|Broken Sword 1||German PC||Completable. No regressions noted.||Adventureguy||Win32||Jun 2
|- style="background:#ffff77"
|Broken Sword 2||German PC||Completable. No regressions noted.||Adventureguy||Win32||Jun 5
|- style="background:#ffff77"
|Flight of the Amazon Queen||Freeware CD||Completable. No regressions noted.||evilgrug||MacOSX||Jun 8
|- style="background:#ffff77"
|Gobliiins EGA||English PC Floppy||Completable. No regressions noted.||wjp||Linux||Jun 17
|- style="background:#ffff77"
|Gobliiins VGA/CD||English PC CD||Completable. No regressions noted.||bramvandijk||Linux||May 31
|- style="background:lightgreen"
|Inherit the Earth||English CD<br/>English Floppy||Completable. Glitches were fixed.||dreammaster<br/>dreammaster||Win32||Jun 15
|- style="background:#ffff77"
|Simon the Sorcerer 1||German DOS CD||Completable. Minor glitch with missing chest in Swampling's still occurs.||Vorph||Win32||Jun 10
|- style="background:#ffff77"
|Simon the Sorcerer 2||English Windows CD||Completable. No regressions noted.||evilgrug||MacOSX||Jun 6
|- style="background:#ffff77"
|The Feeble Files||English Windows 4CD||Completable. No regressions noted.||crowley||Linux||Jun 11
|- style="background:#7777ff"
|The Legend of Kyrandia||English PC CD||Completable with minor glitches. [http://sourceforge.net/tracker/index.php?func=detail&aid=1498221&group_id=37116&atid=418820 #1498221]||cappuchock||Win32||Jun 1
|-
|}
=== Humongous Entertainment games ===
<font color=red>*</font> Please, check [[HE Progress]] page before submitting a bugreport. Some bugs are known and we're aware of them.
{| border="1" cellpadding="2" width=100%
|+Humongous Entertainment SCUMM Game Testing for 0.9.0
|- style="background:silver"
|Game Name||Game Version||Status||Tester||Platform||Tested
|-
|Big Thinkers First Grade||N/A||N/A||None||None||None
|-
|Big Thinkers Kindergarten||N/A||N/A||None||None||None
|- style="background:lightgreen"
|Fatty Bears Birthday Surprise||English DOS||Completable. Minor glitch with the trampoline, and the piano does not work quite right. These are not regressions.||eriktorbjorn<br/>Raziel||Linux<br/>AmigaOS4||Jun 4<br/>Jun 5
|-
|Fatty Bears Fun Pack ||N/A||N/A||None||None||None
|- style="background:#ffff77"
|Freddi Fish 1: The Case of the Missing Kelp Seeds||English PC||Completable. No regressions noted.||clone2727||Win32||Jun 13
|- style="background:lightgreen"
|Freddi Fish 2: The Case of the Haunted Schoolhouse||English PC||Completable. No regressions noted.||Raziel<br/>clone2727||AmigaOS4<br/>Win32||Jun 11<br/>Jun 14
|- style="background:lightgreen"
|Freddi Fish 3: The Case of the Stolen Conch Shell||English PC<br/>Russian PC||Completable. No regressions noted.||Raziel<br/>sev||AmigaOS4<br/>Win32||Jun 13<br/>Jun 12
|- style="background:lightgreen"
|Freddi Fish 4: The Case of the Hogfish Rustlers of Briny Gulch||English PC<br/>Russian PC||Completable. Minor problems with lip sync that sum up.||Raziel<br/>sev||AmigaOS4<br/>Win32||Jun 13<br/>Jun 12
|-
|Freddi Fish and Luther's Maze Madness||N/A||N/A||None||None||None
|-
|Freddi Fish and Luther's Water Worries||N/A||N/A||None||None||None
|-
|Let's Explore the Airport with Buzzy||N/A||N/A||None||None||None
|-
|Let's Explore the Farm with Buzzy||N/A||N/A||None||None||None
|-
|Let's Explore the Jungle with Buzzy||N/A||N/A||None||None||None
|- style="background:lightgreen"
|Pajama Sam 1: No Need to Hide When It's Dark Outside||English PC<br/>English Mac||Completable. No regressions noted.||Raziel<br/>clone2727||AmigaOS4<br/>MacOSX||Jun 14<br/>Jun 16
|- style="background:#ffff77"
|Pajama Sam 2: Thunder and Lightning Aren't so Frightening||English PC||Completable. No regressions noted.||Raziel||AmigaOS4||Jun 15
|- style="background:lightgreen"
|Pajama Sam 3: You Are What You Eat From Your Head to Your Feet||English PC<br/>English PC||Completable. No regressions noted. [https://sourceforge.net/tracker/?func=detail&atid=418820&aid=1442099&group_id=37116 #1442099]||Raziel<br/>clone2727||AmigaOS4<br/>Win32||Jun 15<br/>Jun 16
|-
|Pajama Sam's Lost & Found||N/A||N/A||None||None||None
|-
|Pajama Sam's Sock Works||N/A||N/A||None||None||None
|- style="background:#ffff77"
|Putt-Putt Enters the Race||English PC||Completable. The Pinball mini-game doesn't work.||clone2727||Win32||Jun 13
|-
|Putt-Putt Goes to the Moon||N/A||N/A||None||None||None
|-
|Putt-Putt Joins the Circus||N/A||N/A||None||None||None
|-
|Putt-Putt Joins the Parade||N/A||N/A||None||None||None
|- style="background:#ffff77"
|Putt-Putt Saves the Zoo||English PC||Completable. Minor glitch with Kenya's back on the waterfall still occurs.||clone2727||Win32||Jun 9
|- style="background:#ffff77"
|Putt-Putt Travels Through Time||English (UK) PC<br/>English PC||Completable. No regressions noted.<br/>Completable, with glitches. The mouths of the characters are very odd. [https://sourceforge.net/tracker/index.php?func=detail&aid=1506002&group_id=37116&atid=418820 #1506002]||eriktorbjorn<br/>clone2727||Linux<br/>Win32||Jun 9<br/>Jun 14
|-
|Putt-Putt and Pep's Balloon-O-Rama||N/A||N/A||None||None||None
|-
|Putt-Putt and Pep's Dog on a Stick||N/A||N/A||None||None||None
|-
|Putt-Putt & Fatty Bear's Activity Pack||N/A||N/A||None||None||None
|-
|Putt-Putt's Fun Pack||N/A||N/A||None||None||None
|- style="background:lightgreen"
|SPY Fox 1: Dry Cereal||English PC<br/>German PC||Completable. No regressions noted.||clone2727<br/>Adventureguy||Win32||Jun 11<br/>Jun 17
|- style="background:lightgreen"
|SPY Fox 2: Some Assembly Required||English PC||Completable. No regressions noted. [https://sourceforge.net/tracker/?func=detail&atid=418820&aid=1441950&group_id=37116 #1441950]||clone2727<br/>Raziel||Win32<br/>AmigaOS4||Jun 11<br/>Jun 15
|-
|SPY Fox in Cheese Chase||N/A||N/A||None||None||None
|-
|SPY Fox in Hold the Mustard||N/A||N/A||None||None||None
|-
|}

Latest revision as of 11:07, 7 January 2023

Release Testing for ScummVM

Testing Guidelines

  • Use the latest build which you may find at the bottom of our download page. After we branched please use the latest stable builds when downloading from our Buildbot.
  • Use the launcher to add your game and see if it was detected normally, even if you already have this game already added. Start newly added target.
  • Preferably test detection of every game/demo you have, even when you're not going to play them.
  • Play game from beginning through the end.
  • Preferably use of save/load facility.
  • Do not skip cutscenes.
  • If you encounter any problems, please, submit a bug report at our bug tracker.
  • If a game has several branches, test as many variants as you can.
  • At least 1 user should test each game, preferably but not obligatory on different platforms.
    • However, more than one user should test games that satisfy one or more of the following conditions:
      • It is a multiple path game (such as Fate of Atlantis or Maniac Mansion). We designate such games with a # (hash symbol).
      • It is a new game for this release. We designate such games with a * (star symbol).

What to provide when you encounter a bug

Please provide information on our bug tracker. Please, do not post bugs to our forums as that makes discussions and bug fixing progress tracking practically impossible.

  • Make sure that you have a working mail set up at your GitHub account. In this case you will receive our reply to your bug report.
  • Snapshot date (but please, always test with the latest one).
  • Bug details, including instructions on reproducing it.
  • Language of game (English, German...).
  • If it is a fan translation, mention it.
  • Version of game (talkie, floppy...).
  • Whether the sound was compressed or not.
  • Platform and compiler (Linux, macOS, Windows, etc).
  • Attach a save game if possible.
  • Attach a screenshot to demonstrate graphics bugs if applicable.

It may happen that at some point of our testing we break savegame compatibility, or do something which affects a specific engine deeply. In that case, you could be asked to restart the game you're currently playing from the beginning. You will be explicitly told to do so, so don't worry if we say nothing in this aspect.

Please, report about your completion on our forums (preferably in the thread linked by the testing announcement). If you encountered some problem, provide the bug report number as well.

Thanks for your help.

Retrieved from "https://wiki.scummvm.org/index.php?title=Release_Testing&oldid=35756"