Difference between revisions of "Release Testing"

From ScummVM :: Wiki
Jump to navigation Jump to search
(freddi4/pajama completed)
 
(161 intermediate revisions by 18 users not shown)
Line 1: Line 1:
== Release testing for ScummVM 0.8.0 ==
== Release Testing for ScummVM ==


Please use latest CVS build which you may find at bottom of our [http://www.scummvm.org/downloads.php download page]. Play game from beginning through the end. If you encounter any problems, please, submit a bugreport at our [http://sourceforge.net/tracker/?atid=418820&group_id=37116&func=browse Bugtracker] and provide following information:
* [[Release Testing/2.7.0|2.7.0]]
* [[Release Testing/2.6.0|2.6.0]]
* [[Release Testing/2.3.0|2.3.0]]
* [[Release Testing/2.1.0|2.1.0]]
* [[Release Testing/2.0.0|2.0.0]]
* [[Release Testing/1.9.0|1.9.0]]
* [[Release Testing/1.8.1|1.8.1]]
* [[Release Testing/1.8.0|1.8.0]]
* [[Release Testing/1.7.0|1.7.0]]
* [[Release Testing/1.6.0|1.6.0]]
* [[Release Testing/1.5.0|1.5.0]]
* [[Release Testing/1.4.0|1.4.0]]
* [[Release Testing/1.3.0|1.3.0]]
* [[Release Testing/1.2.0|1.2.0]]/[[SCI/Testing|SCI]]
* [[Release Testing/1.1.0|1.1.0]]
* [[Release Testing/1.0.0|1.0.0]]
* [[Release Testing/0.13.0|0.13.0]]
* [[Release Testing/0.12.0|0.12.0]]
* [[Release Testing/0.11.0|0.11.0]]
* [[Release Testing/0.10.0|0.10.0]]
* [[Release Testing/0.9.0|0.9.0]]
* [[Release Testing/0.8.0|0.8.0]]


* Snapshot date (but please, always test with latest one)
== Testing Guidelines ==
* Bug details, including instructions on reproducing it
* Language of game (English, German, ...)
* Version of game (talkie, floppy, ...)
* Platform and Compiler (Win32, Linux, MacOS, ...)
* Attach a save game if possible


Please, report about your completion on scummvm-devel@lists.sourceforge.net, on our forums either talk to some developer at #scummvm on freenode.net. If you encountered some problem, provide bugreport number too.
* Use the latest build which you may find at the bottom of our [http://scummvm.org/downloads/ download page]. After we branched please use the latest '''stable''' builds when downloading from our [http://buildbot.scummvm.org/builds.html Buildbot].
* Use the launcher to add your game and see if it was detected normally, even if you already have this game already added. Start newly added target.
* Preferably test detection of every game/demo you have, even when you're not going to play them.
* Play game from beginning through the end.
* Preferably use of save/load facility.
* '''Do not''' skip cutscenes.
* If you encounter any problems, please, submit a bug report at our [https://bugs.scummvm.org/ bug tracker].
* If a game has several branches, test as many variants as you can.
* At least 1 user should test each game, preferably but not obligatory on different platforms.
** However, more than one user should test games that satisfy one or more of the following conditions:
*** It is a multiple path game (such as ''Fate of Atlantis'' or ''Maniac Mansion''). We designate such games with a '''''#''''' (hash symbol).
*** It is a new game for this release. We designate such games with a '''''*''''' (star symbol).


Thanks for your help.
== What to provide when you encounter a bug ==
 
Please provide information on our bug tracker. Please, do not post bugs to our forums as that makes discussions and bug fixing progress tracking practically impossible.


{| border="0"
* Make sure that you have a working mail set up at your GitHub account. In this case you will receive our reply to your bug report.
|-
* Snapshot date (but please, always test with the latest one).
|Legend:
* Bug details, including instructions on reproducing it.
|-
* Language of game (English, German...).
|style="background:#ffff77" style="width:100px"|Testing
* If it is a fan translation, mention it.
|-
* Version of game (talkie, floppy...).
|style="background:#77ffff" style="width:100px"|Need retesting
* Whether the sound was compressed or not.
|-
* Platform and compiler (Linux, macOS, Windows, etc).
|style="background:lightgreen" style="width:100px"|Completable
* Attach a save game if possible.
|-
* Attach a screenshot to demonstrate graphics bugs if applicable.
|style="background:#7777ff" style=" width:100px"|Minor problems
|-
|style="background:#ff7777" style=" width:100px"|Major problems
|}


{| border="1" cellpadding="2" width=100%
It may happen that at some point of our testing we break savegame compatibility, or do something which affects a specific engine deeply. In that case, you could be asked to restart the game you're currently playing from the beginning. You will be explicitly told to do so, so don't worry if we say nothing in this aspect.
|+LucasArts SCUMM Game Testing for 0.8.0
|- style="background:silver"
|Game Name||Game Version||Status||Tester||Platform||Tested
|- style="background:lightgreen"
|Maniac Mansion v1||English?||Completable. No new issues||dfabulich||Win32||October 15
|- style="background:#ff7777"
|Maniac Mansion NES||English US?||Several major problems. Not completable with Bernard||dfabulich||Win32||October 15
|- style="background:lightgreen"
|Maniac Mansion v2||English EGA||Completable||Michael Kronsteiner||Fedora Core 3||October 15
|- style="background:#7777ff"
|Zak McKracken C64||English||Completable with numerous gfx glitches||Joachim Eberhard||Win32||October 16
|- style="background:#7777ff"
|Zak McKracken v1||English||Completable with gfx glitches, they are mostly same as C64 bugs||Joachim Eberhard||Win32||October 16
|- style="background:lightgreen"
|Zak McKracken v2||English||Completable||dfabulich||Win32||October 15
|- style="background:lightgreen"
|Zak McKracken FMTOWNS||English||Completable. No problems found.||Ender||Debian, unstable||October 12
|- style="background:lightgreen"
|Loom||English EGA||Completable. No regressions noted.||eriktorbjorn||Debian, unstable||October 1
|- style="background:lightgreen"
|Loom CD||English||Completable. No problems found.||crossbow777||Win32||October 12
|- style="background:lightgreen"
|Indy3 EGA||Spanish||Completable||dfabulich||Win32||October 14
|- style="background:lightgreen"
|Indy3 VGA||English||Completable. No glitches||dfabulich||Win32||October 14
|- style="background:lightgreen"
|Indy4||English CD||Completable. No glitches||dfabulich||Win32||October 14
|- style="background:lightgreen"
|Monkey1||German VGA||Completable.||nethopper||Win32||October 12
|- style="background:lightgreen"
|Monkey1 CD||English||Completable, no glitches noticed||cappuchok||Win32||October 14
|- style="background:lightgreen"
|Monkey2||English||Completable. with 2 iMUSE-related bugs||dfabulich||Win32||October 11
|- style="background:#ffff77"
|Monkey3||English||Completable with occasional masking issue||oorbinoo, andi_z||Gentoo Linux||October 12
|- style="background:lightgreen"
|DOTT||German CD||Completable.||frank_m24||Win32||October 12
|- style="background:lightgreen"
|Sam and Max||English CD||Completable.||dfabulich||Win32||October 14
|- style="background:lightgreen"
|Full Throttle||English||Completable with no regressions||crossbow777||Win32||October 12
|- style="background:lightgreen"
|The Dig||English||Completable. No new issues||crossbow777||Win32||October 12
|-
|DOTT/Sam&Max/FT/DIG Mac bundle versions (any of them)||N/A||N/A||None||None||None
|-
|}


{| border="1" cellpadding="2" width=100%
Please, report about your completion on our forums (preferably in the thread linked by the testing announcement). If you encountered some problem, provide the bug report number as well.
|+Non-SCUMM Game Testing for 0.8.0
|- style="background:silver"
|Game Name||Game Version||Status||Tester||Platform||Tested
|- style="background:lightgreen"
|Simon the Sorcerer 1||German DOS Talkie||Completable with minor gfx glitches||cirion81||Win32||October 12
|- style="background:lightgreen"
|Simon the Sorcerer 2||English Windows Talkie||Completable with minor gfx glitches||cirion81||Win32||October 19
|- style="background:lightgreen"
|Beneath a Steel Sky||CD||Completable||crossbow777||Win32||October 13
|- style="background:lightgreen"
|FOTAQ||CD||Completable||crossbow777||Win32||October 13
|- style="background:lightgreen"
|Broken Sword I||German||Completable||nachbarnebenan||Suse 10.0||October 16
|- style="background:lightgreen"
|Broken Sword II||English CD||Completable||wjp||Gentoo Linux||October 15
|- style="background:lightgreen"
|Inherit the Earth||German CD||Completable||Marcel Möller||Win32||October 16
|- style="background:lightgreen"
|Gobliiins||Multi-lingual CD version||Game is completable.||eriktorbjorn||Win32||October 12
|-
|Gobliiins||EGA version||N/A||None||None||None
|-
|}


{| border="1" cellpadding="2" width=100%
Thanks for your help.
|+Humongous Entertainment SCUMM Game Testing for 0.8.0
|- style="background:silver"
|Game Name||Game Version||Status||Tester||Platform||Tested
|-
|Big Thinkers Kindergarten||N/A||N/A||None||None||None
|- style="background:lightgreen"
|Fatty Bears Birthday Surprise||DOS||No glitches||vampir_raziel ||AmigaOS4||October 24
|- style="background:lightgreen"
|Fatty Bears Fun Pack ||DOS, 3DO||No glitches||sev||Win32||October 16
|-
|Freddi Fish 1: The Case of the Missing Kelp Seeds||N/A||N/A||None||None||None
|-
|Freddi Fish 2: The Case of the Haunted Schoolhouse||N/A||N/A||None||None||None
|-style="background:#7777ff"
|Freddi Fish 3: The Case of the Stolen Conch Shell||English||Completable. one minor glitch||vampir_raziel ||AmigaOS4||October 25
|- style="background:lightgreen"
|Freddi Fish 4: The Case of the Hogfish Rustlers of Briny Gulch||English||No glitches||vampir_raziel ||AmigaOS4||October 26
|-
|Freddi Fish and Luther's Maze Madness||N/A||N/A||None||None||None
|- style="background:lightgreen"
|Freddi Fish and Luther's Water Worries||Russian||No glitches||sev||Win32||October 14
|-
|Let's Explore the Airport with Buzzy||N/A||N/A||None||None||None
|-
|Let's Explore the Farm with Buzzy||N/A||N/A||None||None||None
|-
|Let's Explore the Jungle with Buzzy||N/A||N/A||None||None||None
|-style="background:#7777ff"
|Pajama Sam 1: No Need to Hide When It's Dark Outside||English||Completable, singing glitches||vampir_raziel ||AmigaOS4||October 26
|Pajama Sam 2: Thunder and Lightning Aren't so Frightening||German||Completable||nachbarnebenan||Suse 10.0||October 16
|- style="background:lightgreen"
|Pajama Sam's Lost & Found||English||No glitches||sev||Win32||October 17
|- style="background:lightgreen"
|Pajama Sam's Sock Works||Russian||No glitches||sev||Win32||October 14
|-style="background:#7777ff"
|Putt-Putt Enters the Race||English Windows||Completable, two glitches||Dark-Star||Win32||October 22
|-
|Putt-Putt Goes To The Moon||N/A||N/A||None||None||None
|- style="background:lightgreen"
|Putt-Putt Joins the Circus||English Windows||Game is completable.||Kirben||Win32||October 14
|-
|Putt-Putt Joins the Parade||N/A||N/A||None||None||None
|-style="background:#7777ff"
|Putt-Putt Saves the Zoo||Russian||Completable. One minor glitch noted||sev||Win32||October 17
|-style="background:#7777ff"
|Putt-Putt Travels Through Time||UK version||Completable, two minor glitches||eriktorbjorn||Win32||October 19
|- style="background:lightgreen"
|Putt-Putt and Pep's Balloon-O-Rama||English, Russian||No glitches||sev||Win32||October 14
|- style="background:lightgreen"
|Putt-Putt and Pep's Dog on a Stick||English||No glitches||sev||FreeBSD||October 19
|- style="background:lightgreen"
|Putt-Putts Fun Pack||DOS, 3DO||No glitches||sev||Win32||October 14
|- style="background:lightgreen"
|Putt-Putt & Fatty Bear's Activity Pack||Windows||No glitches||sev||Win32||October 14
|- style="background:lightgreen"
|Spyfox 1: Dry Cereal||German||Completable||nachbarnebenan||Suse 10.0||October 16
|- style="background:lightgreen"
|Spyfox 2: Some Assembly Required||German||Completable||nachbarnebenan||Suse 10.0||October 16
|- style="background:lightgreen"
|Spy Fox in Cheese Chase Game||Russian||No glitches||sev||Win32||October 17
|-
|Spy Fox in Hold the Mustard||N/A||N/A||None||None||None
|-
|}

Latest revision as of 11:07, 7 January 2023

Release Testing for ScummVM

Testing Guidelines

  • Use the latest build which you may find at the bottom of our download page. After we branched please use the latest stable builds when downloading from our Buildbot.
  • Use the launcher to add your game and see if it was detected normally, even if you already have this game already added. Start newly added target.
  • Preferably test detection of every game/demo you have, even when you're not going to play them.
  • Play game from beginning through the end.
  • Preferably use of save/load facility.
  • Do not skip cutscenes.
  • If you encounter any problems, please, submit a bug report at our bug tracker.
  • If a game has several branches, test as many variants as you can.
  • At least 1 user should test each game, preferably but not obligatory on different platforms.
    • However, more than one user should test games that satisfy one or more of the following conditions:
      • It is a multiple path game (such as Fate of Atlantis or Maniac Mansion). We designate such games with a # (hash symbol).
      • It is a new game for this release. We designate such games with a * (star symbol).

What to provide when you encounter a bug

Please provide information on our bug tracker. Please, do not post bugs to our forums as that makes discussions and bug fixing progress tracking practically impossible.

  • Make sure that you have a working mail set up at your GitHub account. In this case you will receive our reply to your bug report.
  • Snapshot date (but please, always test with the latest one).
  • Bug details, including instructions on reproducing it.
  • Language of game (English, German...).
  • If it is a fan translation, mention it.
  • Version of game (talkie, floppy...).
  • Whether the sound was compressed or not.
  • Platform and compiler (Linux, macOS, Windows, etc).
  • Attach a save game if possible.
  • Attach a screenshot to demonstrate graphics bugs if applicable.

It may happen that at some point of our testing we break savegame compatibility, or do something which affects a specific engine deeply. In that case, you could be asked to restart the game you're currently playing from the beginning. You will be explicitly told to do so, so don't worry if we say nothing in this aspect.

Please, report about your completion on our forums (preferably in the thread linked by the testing announcement). If you encountered some problem, provide the bug report number as well.

Thanks for your help.

Retrieved from "https://wiki.scummvm.org/index.php?title=Release_Testing&oldid=35756"