Plug-ins Testing Verification Check-list


Platforms:
Plug-in Groups:
PG#1: win95/win98/SE/ME
PG#2: winNT/win2K/winXP
PG#3: macOS9 & macOSX
PG#4: linux

Directions:
For each patch you will need to ensure that the following table is completed (either by you, Shrir, Beth, outside testers, other engineers -- as long as each plug-in is tested on all platforms). For each Plug-in Group, only one of the plug-in group platforms need to be tested for windows. For the mac, both OS9 and OSX need to be tested. If the plug-in is not available on the platform, then enter n/a. As discussed, if this is a byte range change, then special testing parameters must take place, those special changes must be recorded in the bug.

Testing Steps:
  1. pick a platform to test from the PG#1 group
  2. verify you have the appropriate plug-in version installed, if you do not then upgrade
  3. verify the plug-in is in the appropriate location
  4. access the smoketest page and navigate to the plug-ins test section
  5. run the tests Adobe, Flash, Quicktime and RealPlayer: note the testing results in the form
    If the test passes, enter "Pass." If the test failed, enter "Fail" and a brief explanation of the failure. If the application crashes, enter "CRASH"
  6. repeat steps 1 through 5 for each Platform Group
  7. pick a platform to test from the PG#1 group
  8. access the basic functional test page
  9. run the tests for each plug-in: note the testing results in the form
    If the test passes, enter "Pass." If the test failed, enter "Fail" and a brief explanation of the failure. If the application crashes, enter "CRASH"
  10. for each vendor test suite, test the appropriate plug-in, i.e. the Adobe test suite should be used with Acrobat. This step only needs to be done for the plug-in that is being fixed in the bug. A global change would require all plug-in vendor tests to be verified.

    Byte range changes require a more advanced set of testing.

Bug #
Plug-in
Smoketests
Basic Functional Testing
Vendor Testing









http://mozilla.org/quality/smoketests/
3(o). Browser Plugins (optional)
http://mozilla.org/quality/browser/front-end/testcases/plugins/
Acrobat
http://acroeng.adobe.com/BrowserTestSuite/
Flash
http://jazz/users/shrir/publish/flashacceptancesuite/
Media Player
QuickTime
Shockwave
http://poppy.macromedia.com/netlanski
RealPlayer
ViewPoint
http://cole.viewpoint.com/~compuserve/
Acrobat Reader
 (byte range)
PG#1
v5.05
PG#2
v5.05
PG#3
PG#4
v5 (4.5)





PG#1
v5.05
PG#2
v5.05
PG#3
PG#4
v5 (4.5)












Flash
PG#1
v6.0.29.0/ v5.0
PG#2
v6.0.29.0/ v5.0
PG#3
v6.0.29.0/v5.0
PG#4
v6.0.29.0/v5.0





PG#1
v6.0.29.0/ v5.0
PG#2
v6.0.29.0/ v5.0
PG#3
v6.0.29.0/ v5.0
PG#4
v6.0.29.0/ v5.0












Media Player
PG#1
w95:v6.4,
w98: v7.1
PG#2
wNT:v6.4
w2K:v7.1
wCE:v8.0
wXP:v?
PG#3
OS9 v6.4
OSX: n/a
PG#4
n/a





PG#1
w95:v6.4,
w98: v7.1
PG#2
wNT:v6.4
w2K:v7.1
wCE:v8.0
wXP:n/a
PG#3
OS9 v6.4
OSX: n/a
PG#4
n/a












QuickTime
PG#1
v5.02
PG#2
v5.02
PG#3
v5.02
PG#4
n/a





PG#1
v5.02
PG#2
v5.02
PG#3
v5.02
PG#4
n/a












Shockwave
PG#1
v8.5
PG#2
v8.5
PG#3
v8.5
PG#4
n/a (plugger)





PG#1
v8.5
PG#2
v8.5
PG#3
v8.5
PG#4
n/a (plugger)












RealPlayer8
win:  v6
macOS9: v6  OS10:n/a
linux: v6 (not xpcom)
PG#1
v6
PG#2
v6
PG#3
OS9: v6
OSX: n/a
PG#4
v6





PG#1
v6
PG#2
v6
PG#3
OS9: v6
OSX: n/a
PG#4
v6












ViewPoint (byte range)
win: v
mac: n/a
linux: n/a
PG#1
PG#2
PG#3
PG#4





PG#1
PG#2
PG#3
PG#4