Difference between revisions of "Release Testing"

From ScummVM :: Wiki
Jump to navigation Jump to search
(COMI retesting is finished)
(0.9.0 release testing announce)
Line 1: Line 1:
== Release testing for ScummVM 0.8.0 ==
== Release testing for ScummVM 0.9.0 ==


Please use latest CVS build which you may find at bottom of our [http://www.scummvm.org/downloads.php download page]. Play game from beginning through the end. If you encounter any problems, please, submit a bugreport at our [http://sourceforge.net/tracker/?atid=418820&group_id=37116&func=browse Bugtracker] and provide following information:
Thank you for your participation in pre-0.9.0 testing. Your efforts will let us make ScummVM a better software. We, developers are just unable physically to test these piles of games. Moreover by some coincidence we prefer to hack C++ more than playing. So your help is very appreciated.


=== Testing guidelines ===
Note, that the guidelines were changed since 0.8.0 testing. New items are specifically marked with red stars. So, please, pay attention to them.
* Use latest SVN build which you may find at bottom of our [http://www.scummvm.org/downloads.php download page].
* <font color=red>*</font> Use launcher to add your game and see if it was detected normally, even if you already have this game already added. Start newly added target.
* <font color=red>*</font> Preferably test detection of every game/demo you have, even when you're not going to play them
* Play game from beginning through the end
* <font color=red>*</font> Preferably use of save/load facility
* <font color=red>*</font> '''Do not''' skip cutscenes.
* If you encounter any problems, please, submit a bugreport at our [http://sourceforge.net/tracker/?atid=418820&group_id=37116&func=browse Bugtracker]
* <font color=red>*</font> If game has several branches, test as many variants as you can
* <font color=red>*</font> At least 2 distinct users should test each game, preferably but not obligatory on different platforms.
=== What to provide when you encounter a bug ===
Information to provide on our bug tracker. Please, do not post bugs to our forums as that makes discussions and bugfixing progress tracking practically impossible
* <font color=red>*</font> Make sure that you have a working mail set up at your sf.net account. In this case you will receive our reply to your bugreport
* Snapshot date (but please, always test with latest one)
* Snapshot date (but please, always test with latest one)
* Bug details, including instructions on reproducing it
* Bug details, including instructions on reproducing it
* Language of game (English, German, ...)
* Language of game (English, German, ...). <font color=red>*</font> Is it fantranslation or not.
* Version of game (talkie, floppy, ...)
* Version of game (talkie, floppy, ...)
* Platform and Compiler (Win32, Linux, MacOS, ...)
* <font color=red>*</font> Whether sound was compressed or not
* Platform and compiler (Win32, Linux, MacOS, ...)
* Attach a save game if possible
* Attach a save game if possible
* <font color=red>*</font> Attach a screenshot to demonstrate graphics bugs if applicable
It may happen that at some point of our testing we break savegame compatibility, or do something which affect engine deeply. Then you could be asked to start the game you play from the beginning. You will be explicitely told to do so, so don't worry if we say nothing in this aspect.


Please, report about your completion on scummvm-devel@lists.sourceforge.net, on our forums either talk to some developer at #scummvm on freenode.net. If you encountered some problem, provide bugreport number too.
Please, report about your completion on scummvm-devel@lists.sourceforge.net, on our forums either talk to some developer (an op) at #scummvm on freenode.net. If you encountered some problem, provide bugreport number too.


Thanks for your help.
Thanks for your help.
== Games to test ==


{| border="0"
{| border="0"
Line 18: Line 43:
|Legend:
|Legend:
|-
|-
|style="background:#ffff77" style="width:100px"|Testing
|style="background:#ffff77;width:100px"|Testing
|-
|-
|style="background:#77ffff" style="width:100px"|Need retesting
|style="background:#77ffff;width:100px"|Needs retesting
|-
|-
|style="background:lightgreen" style="width:100px"|Completable
|style="background:lightgreen;width:100px"|Completable
|-
|-
|style="background:#7777ff" style=" width:100px"|Minor problems
|style="background:#7777ff;width:100px"|Minor problems
|-
|-
|style="background:#ff7777" style=" width:100px"|Major problems
|style="background:#ff7777;width:100px"|Major problems
|}
|}
Game turns into green only after second person tests it. If you see game yellow, but only one person's name specified, feel free to take it for testing as well.
=== LucasArts SCUMM games ===


{| border="1" cellpadding="2" width=100%
{| border="1" cellpadding="2" width=100%
|+LucasArts SCUMM Game Testing for 0.8.0
|+LucasArts SCUMM Game Testing for 0.9.0
|- style="background:silver"
|- style="background:silver"
|Game Name||Game Version||Status||Tester||Platform||Tested
|Game Name||Game Version||Status||Tester||Platform||Tested
|- style="background:lightgreen"
|Maniac Mansion v1||English?||Completable. No new issues||dfabulich||Win32||October 15
|- style="background:#ff7777"
|Maniac Mansion NES||English US?||Several major problems. Not completable with Bernard||dfabulich||Win32||October 15
|- style="background:lightgreen"
|Maniac Mansion v2||English EGA||Completable||Michael Kronsteiner||Fedora Core 3||October 15
|- style="background:#7777ff"
|Zak McKracken C64||English||Completable with numerous gfx glitches||Joachim Eberhard||Win32||October 16
|- style="background:#7777ff"
|Zak McKracken v1||English||Completable with gfx glitches, they are mostly same as C64 bugs||Joachim Eberhard||Win32||October 16
|- style="background:lightgreen"
|Zak McKracken v2||English||Completable||dfabulich||Win32||October 15
|- style="background:lightgreen"
|Zak McKracken FMTOWNS||English||Completable. No problems found.||Ender||Debian, unstable||October 12
|- style="background:lightgreen"
|Loom||English EGA||Completable. No regressions noted.||eriktorbjorn||Debian, unstable||October 1
|- style="background:lightgreen"
|Loom CD||English||Completable. No problems found.||crossbow777||Win32||October 12
|- style="background:lightgreen"
|Indy3 EGA||Spanish||Completable||dfabulich||Win32||October 14
|- style="background:lightgreen"
|Indy3 VGA||English||Completable. No glitches||dfabulich||Win32||October 14
|- style="background:lightgreen"
|Indy4||English CD||Completable. No glitches||dfabulich||Win32||October 14
|- style="background:lightgreen"
|Monkey1||German VGA||Completable.||nethopper||Win32||October 12
|- style="background:lightgreen"
|Monkey1 CD||English||Completable, no glitches noticed||cappuchok||Win32||October 14
|- style="background:lightgreen"
|Monkey2||English||Completable. with 2 iMUSE-related bugs||dfabulich||Win32||October 11
|- style="background:lightgreen"
|Monkey3||English||Completable with occasional masking issue||oorbinoo, andi_z||Gentoo Linux, SuSE Linux||October 12, October 25
|- style="background:lightgreen"
|DOTT||German CD||Completable.||frank_m24||Win32||October 12
|- style="background:lightgreen"
|Sam and Max||English CD||Completable.||dfabulich||Win32||October 14
|- style="background:lightgreen"
|Full Throttle||English||Completable with no regressions||crossbow777||Win32||October 12
|- style="background:lightgreen"
|The Dig||English||Completable. No new issues||crossbow777||Win32||October 12
|-
|-
|DOTT/Sam&amp;Max/FT/DIG Mac bundle versions (any of them)||N/A||N/A||None||None||None
|Maniac Mansion v1||N/A||N/A||None||None||None
|-
|Maniac Mansion v2||N/A||N/A||None||None||None
|-
|Zak McKracken C64||N/A||N/A||None||None||None
|-
|Zak McKracken v1||N/A||N/A||None||None||None
|-
|Zak McKracken v2||N/A||N/A||None||None||None
|-
|Zak McKracken FMTOWNS||N/A||N/A||None||None||None
|-
|Loom||N/A||N/A||None||None||None
|-
|Loom CD||N/A||N/A||None||None||None
|-
|Indy3 EGA||N/A||N/A||None||None||None
|-
|Indy3 VGA||N/A||N/A||None||None||None
|-
|Indy4||N/A||N/A||None||None||None
|-
|Monkey1||N/A||N/A||None||None||None
|-
|Monkey1 CD||N/A||N/A||None||None||None
|-
|Monkey2||N/A||N/A||None||None||None
|-
|Monkey3||N/A||N/A||None||None||None
|-
|DOTT||N/A||N/A||None||None||None
|-
|Sam and Max||N/A||N/A||None||None||None
|-
|Full Throttle||N/A||N/A||None||None||None
|-
|The Dig||N/A||N/A||None||None||None
|-
|-
|}
|}
=== Non-SCUMM games ===


{| border="1" cellpadding="2" width=100%
{| border="1" cellpadding="2" width=100%
|+Non-SCUMM Game Testing for 0.8.0
|+Non-SCUMM Game Testing for 0.9.0
|- style="background:silver"
|- style="background:silver"
|Game Name||Game Version||Status||Tester||Platform||Tested
|Game Name||Game Version||Status||Tester||Platform||Tested
|- style="background:lightgreen"
|Simon the Sorcerer 1||German DOS Talkie||Completable with minor gfx glitches||cirion81||Win32||October 12
|- style="background:lightgreen"
|Simon the Sorcerer 2||English Windows Talkie||Completable with minor gfx glitches||cirion81||Win32||October 19
|- style="background:lightgreen"
|Beneath a Steel Sky||CD||Completable||crossbow777||Win32||October 13
|- style="background:lightgreen"
|FOTAQ||CD||Completable||crossbow777||Win32||October 13
|- style="background:lightgreen"
|Broken Sword I||German||Completable||nachbarnebenan||Suse 10.0||October 16
|- style="background:lightgreen"
|Broken Sword II||English CD||Completable||wjp||Gentoo Linux||October 15
|- style="background:lightgreen"
|Inherit the Earth||German CD||Completable||Marcel Möller||Win32||October 16
|- style="background:lightgreen"
|Gobliiins||Multi-lingual CD version||Game is completable.||eriktorbjorn||Win32||October 12
|-
|-
|Gobliiins||EGA version||N/A||None||None||None
|Beneath a Steel Sky||N/A||N/A||None||None||None
|-
|Broken Sword I||N/A||N/A||None||None||None
|-
|Broken Sword II||N/A||N/A||None||None||None
|-
|Feeble Files||N/A||N/A||None||None||None
|-
|FOTAQ||N/A||N/A||None||None||None
|-
|Gobliiins||N/A||N/A||None||None||None
|-
|Gobliiins||N/A||N/A||None||None||None
|-
|Inherit the Earth||N/A||N/A||None||None||None
|-
|Legend of Kyrandia||N/A||N/A||None||None||None
|-
|Simon the Sorcerer 1||N/A||N/A||None||None||None
|-
|Simon the Sorcerer 2||N/A||N/A||None||None||None
|-
|-
|}
|}
=== Humongous Entertainment games ===
<font color=red>*</font> Please, check [[HE Progress]] page before submitting a bugreport. Some bugs are known and we're aware of them.


{| border="1" cellpadding="2" width=100%
{| border="1" cellpadding="2" width=100%
|+Humongous Entertainment SCUMM Game Testing for 0.8.0
|+Humongous Entertainment SCUMM Game Testing for 0.9.0
|- style="background:silver"
|- style="background:silver"
|Game Name||Game Version||Status||Tester||Platform||Tested
|Game Name||Game Version||Status||Tester||Platform||Tested
|-
|Big First Grade||N/A||N/A||None||None||None
|-
|-
|Big Thinkers Kindergarten||N/A||N/A||None||None||None
|Big Thinkers Kindergarten||N/A||N/A||None||None||None
|- style="background:lightgreen"
|-
|Fatty Bears Birthday Surprise||DOS||No glitches||vampir_raziel ||AmigaOS4||October 24
|Fatty Bears Birthday Surprise||N/A||N/A||None||None||None
|- style="background:lightgreen"
|-
|Fatty Bears Fun Pack ||DOS, 3DO||No glitches||sev||Win32||October 16
|Fatty Bears Fun Pack ||N/A||N/A||None||None||None
|-
|-
|Freddi Fish 1: The Case of the Missing Kelp Seeds||N/A||N/A||None||None||None
|Freddi Fish 1: The Case of the Missing Kelp Seeds||N/A||N/A||None||None||None
|-
|-
|Freddi Fish 2: The Case of the Haunted Schoolhouse||N/A||N/A||None||None||None
|Freddi Fish 2: The Case of the Haunted Schoolhouse||N/A||N/A||None||None||None
|-style="background:#7777ff"
|-
|Freddi Fish 3: The Case of the Stolen Conch Shell||English||Completable. one minor glitch||vampir_raziel ||AmigaOS4||October 25
|Freddi Fish 3: The Case of the Stolen Conch Shell||N/A||N/A||None||None||None
|- style="background:lightgreen"
|-
|Freddi Fish 4: The Case of the Hogfish Rustlers of Briny Gulch||English||No glitches||vampir_raziel ||AmigaOS4||October 26
|Freddi Fish 4: The Case of the Hogfish Rustlers of Briny Gulch||N/A||N/A||None||None||None
|-
|-
|Freddi Fish and Luther's Maze Madness||N/A||N/A||None||None||None
|Freddi Fish and Luther's Maze Madness||N/A||N/A||None||None||None
|- style="background:lightgreen"
|-
|Freddi Fish and Luther's Water Worries||Russian||No glitches||sev||Win32||October 14
|Freddi Fish and Luther's Water Worries||N/A||N/A||None||None||None
|-
|-
|Let's Explore the Airport with Buzzy||N/A||N/A||None||None||None
|Let's Explore the Airport with Buzzy||N/A||N/A||None||None||None
Line 131: Line 168:
|-
|-
|Let's Explore the Jungle with Buzzy||N/A||N/A||None||None||None
|Let's Explore the Jungle with Buzzy||N/A||N/A||None||None||None
|-style="background:#7777ff"
|-
|Pajama Sam 1: No Need to Hide When It's Dark Outside||English||Completable, singing glitches||vampir_raziel ||AmigaOS4||October 26
|Pajama Sam 1: No Need to Hide When It's Dark Outside||N/A||N/A||None||None||None
|- style="background:lightgreen"
|-
|Pajama Sam 2: Thunder and Lightning Aren't so Frightening||German||Completable||nachbarnebenan||Suse 10.0||October 16
|Pajama Sam 2: Thunder and Lightning Aren't so Frightening||N/A||N/A||None||None||None
|- style="background:lightgreen"
|-
|Pajama Sam's Lost &amp; Found||English||No glitches||sev||Win32||October 17
|Pajama Sam 3: You Are What You Eat From Your Head to Your Feet||N/A||N/A||None||None||None
|- style="background:lightgreen"
|-
|Pajama Sam's Sock Works||Russian||No glitches||sev||Win32||October 14
|Pajama Sam's Lost &amp; Found||N/A||N/A||None||None||None
|-style="background:#7777ff"
|-
|Putt-Putt Enters the Race||English Windows||Completable, two glitches||Dark-Star||Win32||October 22
|Pajama Sam's Sock Works||N/A||N/A||None||None||None
|-
|Putt-Putt Enters the Race||N/A||N/A||None||None||None
|-
|-
|Putt-Putt Goes To The Moon||N/A||N/A||None||None||None
|Putt-Putt Goes To The Moon||N/A||N/A||None||None||None
|- style="background:lightgreen"
|-
|Putt-Putt Joins the Circus||English Windows||Game is completable.||Kirben||Win32||October 14
|Putt-Putt Joins the Circus||N/A||N/A||None||None||None
|-
|-
|Putt-Putt Joins the Parade||N/A||N/A||None||None||None
|Putt-Putt Joins the Parade||N/A||N/A||None||None||None
|-style="background:#7777ff"
|-
|Putt-Putt Saves the Zoo||Russian||Completable. One minor glitch noted||sev||Win32||October 17
|Putt-Putt Saves the Zoo||N/A||N/A||None||None||None
|-style="background:#7777ff"
|-
|Putt-Putt Travels Through Time||UK version||Completable, two minor glitches||eriktorbjorn||Win32||October 19
|Putt-Putt Travels Through Time||N/A||N/A||None||None||None
|- style="background:lightgreen"
|-
|Putt-Putt and Pep's Balloon-O-Rama||English, Russian||No glitches||sev||Win32||October 14
|Putt-Putt and Pep's Balloon-O-Rama||N/A||N/A||None||None||None
|- style="background:lightgreen"
|-
|Putt-Putt and Pep's Dog on a Stick||English||No glitches||sev||FreeBSD||October 19
|Putt-Putt and Pep's Dog on a Stick||N/A||N/A||None||None||None
|- style="background:lightgreen"
|-
|Putt-Putts Fun Pack||DOS, 3DO||No glitches||sev||Win32||October 14
|Putt-Putts Fun Pack||N/A||N/A||None||None||None
|- style="background:lightgreen"
|-
|Putt-Putt & Fatty Bear's Activity Pack||Windows||No glitches||sev||Win32||October 14
|Putt-Putt & Fatty Bear's Activity Pack||N/A||N/A||None||None||None
|- style="background:lightgreen"
|-
|Spyfox 1: Dry Cereal||German||Completable||nachbarnebenan||Suse 10.0||October 16
|Spyfox 1: Dry Cereal||N/A||N/A||None||None||None
|- style="background:lightgreen"
|-
|Spyfox 2: Some Assembly Required||German||Completable||nachbarnebenan||Suse 10.0||October 16
|Spyfox 2: Some Assembly Required||N/A||N/A||None||None||None
|- style="background:lightgreen"
|-
|Spy Fox in Cheese Chase Game||Russian||No glitches||sev||Win32||October 17
|Spy Fox in Cheese Chase Game||N/A||N/A||None||None||None
|-
|-
|Spy Fox in Hold the Mustard||N/A||N/A||None||None||None
|Spy Fox in Hold the Mustard||N/A||N/A||None||None||None
|-
|-
|}
|}

Revision as of 21:52, 27 May 2006

Release testing for ScummVM 0.9.0

Thank you for your participation in pre-0.9.0 testing. Your efforts will let us make ScummVM a better software. We, developers are just unable physically to test these piles of games. Moreover by some coincidence we prefer to hack C++ more than playing. So your help is very appreciated.

Testing guidelines

Note, that the guidelines were changed since 0.8.0 testing. New items are specifically marked with red stars. So, please, pay attention to them.

  • Use latest SVN build which you may find at bottom of our download page.
  • * Use launcher to add your game and see if it was detected normally, even if you already have this game already added. Start newly added target.
  • * Preferably test detection of every game/demo you have, even when you're not going to play them
  • Play game from beginning through the end
  • * Preferably use of save/load facility
  • * Do not skip cutscenes.
  • If you encounter any problems, please, submit a bugreport at our Bugtracker
  • * If game has several branches, test as many variants as you can
  • * At least 2 distinct users should test each game, preferably but not obligatory on different platforms.

What to provide when you encounter a bug

Information to provide on our bug tracker. Please, do not post bugs to our forums as that makes discussions and bugfixing progress tracking practically impossible

  • * Make sure that you have a working mail set up at your sf.net account. In this case you will receive our reply to your bugreport
  • Snapshot date (but please, always test with latest one)
  • Bug details, including instructions on reproducing it
  • Language of game (English, German, ...). * Is it fantranslation or not.
  • Version of game (talkie, floppy, ...)
  • * Whether sound was compressed or not
  • Platform and compiler (Win32, Linux, MacOS, ...)
  • Attach a save game if possible
  • * Attach a screenshot to demonstrate graphics bugs if applicable

It may happen that at some point of our testing we break savegame compatibility, or do something which affect engine deeply. Then you could be asked to start the game you play from the beginning. You will be explicitely told to do so, so don't worry if we say nothing in this aspect.

Please, report about your completion on scummvm-devel@lists.sourceforge.net, on our forums either talk to some developer (an op) at #scummvm on freenode.net. If you encountered some problem, provide bugreport number too.

Thanks for your help.

Games to test

Legend:
Testing
Needs retesting
Completable
Minor problems
Major problems

Game turns into green only after second person tests it. If you see game yellow, but only one person's name specified, feel free to take it for testing as well.

LucasArts SCUMM games

LucasArts SCUMM Game Testing for 0.9.0
Game Name Game Version Status Tester Platform Tested
Maniac Mansion v1 N/A N/A None None None
Maniac Mansion v2 N/A N/A None None None
Zak McKracken C64 N/A N/A None None None
Zak McKracken v1 N/A N/A None None None
Zak McKracken v2 N/A N/A None None None
Zak McKracken FMTOWNS N/A N/A None None None
Loom N/A N/A None None None
Loom CD N/A N/A None None None
Indy3 EGA N/A N/A None None None
Indy3 VGA N/A N/A None None None
Indy4 N/A N/A None None None
Monkey1 N/A N/A None None None
Monkey1 CD N/A N/A None None None
Monkey2 N/A N/A None None None
Monkey3 N/A N/A None None None
DOTT N/A N/A None None None
Sam and Max N/A N/A None None None
Full Throttle N/A N/A None None None
The Dig N/A N/A None None None

Non-SCUMM games

Non-SCUMM Game Testing for 0.9.0
Game Name Game Version Status Tester Platform Tested
Beneath a Steel Sky N/A N/A None None None
Broken Sword I N/A N/A None None None
Broken Sword II N/A N/A None None None
Feeble Files N/A N/A None None None
FOTAQ N/A N/A None None None
Gobliiins N/A N/A None None None
Gobliiins N/A N/A None None None
Inherit the Earth N/A N/A None None None
Legend of Kyrandia N/A N/A None None None
Simon the Sorcerer 1 N/A N/A None None None
Simon the Sorcerer 2 N/A N/A None None None

Humongous Entertainment games

* Please, check HE Progress page before submitting a bugreport. Some bugs are known and we're aware of them.

Humongous Entertainment SCUMM Game Testing for 0.9.0
Game Name Game Version Status Tester Platform Tested
Big First Grade N/A N/A None None None
Big Thinkers Kindergarten N/A N/A None None None
Fatty Bears Birthday Surprise N/A N/A None None None
Fatty Bears Fun Pack N/A N/A None None None
Freddi Fish 1: The Case of the Missing Kelp Seeds N/A N/A None None None
Freddi Fish 2: The Case of the Haunted Schoolhouse N/A N/A None None None
Freddi Fish 3: The Case of the Stolen Conch Shell N/A N/A None None None
Freddi Fish 4: The Case of the Hogfish Rustlers of Briny Gulch N/A N/A None None None
Freddi Fish and Luther's Maze Madness N/A N/A None None None
Freddi Fish and Luther's Water Worries N/A N/A None None None
Let's Explore the Airport with Buzzy N/A N/A None None None
Let's Explore the Farm with Buzzy N/A N/A None None None
Let's Explore the Jungle with Buzzy N/A N/A None None None
Pajama Sam 1: No Need to Hide When It's Dark Outside N/A N/A None None None
Pajama Sam 2: Thunder and Lightning Aren't so Frightening N/A N/A None None None
Pajama Sam 3: You Are What You Eat From Your Head to Your Feet N/A N/A None None None
Pajama Sam's Lost & Found N/A N/A None None None
Pajama Sam's Sock Works N/A N/A None None None
Putt-Putt Enters the Race N/A N/A None None None
Putt-Putt Goes To The Moon N/A N/A None None None
Putt-Putt Joins the Circus N/A N/A None None None
Putt-Putt Joins the Parade N/A N/A None None None
Putt-Putt Saves the Zoo N/A N/A None None None
Putt-Putt Travels Through Time N/A N/A None None None
Putt-Putt and Pep's Balloon-O-Rama N/A N/A None None None
Putt-Putt and Pep's Dog on a Stick N/A N/A None None None
Putt-Putts Fun Pack N/A N/A None None None
Putt-Putt & Fatty Bear's Activity Pack N/A N/A None None None
Spyfox 1: Dry Cereal N/A N/A None None None
Spyfox 2: Some Assembly Required N/A N/A None None None
Spy Fox in Cheese Chase Game N/A N/A None None None
Spy Fox in Hold the Mustard N/A N/A None None None