This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
3.0_release_system_testing_dashboard [2016/05/20 09:32] Michael Jaeger |
3.0_release_system_testing_dashboard [2016/05/24 21:11] Michael Jaeger |
||
---|---|---|---|
Line 1: | Line 1: | ||
=== FOSSology System Testing for Version 3.0 === | === FOSSology System Testing for Version 3.0 === | ||
- | ^ "Feature" to Test ^ System (Yes, No, Partial) ^ Issues ^ Tester ^ Status (PASS/FAIL) ^ | + | ^ "Feature" to Test ^ System Test Relevant (Yes, No, Partial) ^ Issues ^ Tester ^ Status (PASS/FAIL) ^ |
- | | Agents ||||| | + | |Agents ||||| |
|Adj2Nest | N/A | | | | | |Adj2Nest | N/A | | | | | ||
- | |Buckets | [[Bucket_Test_Cases|Yes]] |"#494":https://github.com/fossology/fossology/issues/494 highlight fail | BobG |PASS (issue is acceptable for release)| | + | |Buckets | Yes [[http://www.fossology.org/projects/fossology/wiki/Bucket_Test_Cases|Bucket_Test_Cases]] | [[https://github.com/fossology/fossology/issues/494|#494]] highlight fail | BobG |PASS (issue is acceptable for release)| |
- | |.Copyright | "Partial":http://www.fossology.org/projects/fossology/wiki/Copyright_Test_Cases | "#496":https://github.com/fossology/fossology/issues/496 Micromenu not displayed, "#497":https://github.com/fossology/fossology/issues/497 View link for copyrights, "#498":https://github.com/fossology/fossology/issues/498 copyright data is not truncated | Shaheem, Anupam | PASS (issues are acceptable for release) | | + | |Copyright | Yes [[http://www.fossology.org/projects/fossology/wiki/Copyright_Test_Cases|Copyright_Test_Cases]] | [[https://github.com/fossology/fossology/issues/496|#496]] Micromenu not displayed, [[https://github.com/fossology/fossology/issues/497|#497]] View link for copyrights, [[https://github.com/fossology/fossology/issues/498|#498]] copyright data is not truncated | Shaheem, Anupam | PASS (issues are acceptable for release) | |
- | |Delagent | "Partial":http://www.fossology.org/projects/fossology/wiki/Delagent_Test_Cases | | Shaheem | PASS | | + | |Delagent | Yes [[http://www.fossology.org/projects/fossology/wiki/Delagent_Test_Cases|Delagent_Test_Cases]] | | Shaheem | PASS | |
- | |Maintagent | "Partial":http://www.fossology.org/projects/fossology/wiki/Maintagent_Test_Cases | | Shaheem, Anupam | PASS | | + | |Maintagent | Yes [[http://www.fossology.org/projects/fossology/wiki/Maintagent_Test_Cases|Maintagent_Test_Cases]]| | Shaheem, Anupam | PASS | |
- | |Mimetype | "Partial":http://www.fossology.org/projects/fossology/wiki/Mimetype_Test_Cases| | Paul | | | + | |Mimetype | Yes [[http://www.fossology.org/projects/fossology/wiki/Mimetype_Test_Cases|Mimetype_Test_Cases]] | | Paul | | |
- | |Nomos | "Partial":http://www.fossology.org/projects/fossology/wiki/Nomos_Test_Cases | will require changes in the UI (change license test cases), unclear "functional test mail" | Shaheem, Anupam | PASS | | + | |Nomos | Yes [[http://www.fossology.org/projects/fossology/wiki/Nomos_Test_Cases|Nomos_Test_Cases]] | will require changes in the UI (change license test cases), unclear "functional test mail" | Shaheem, Anupam | PASS | |
- | |Package Agent | "Partial":http://www.fossology.org/projects/fossology/wiki/Mimetype_Test_Cases | | Paul | | | + | |Package Agent | Yes [[http://www.fossology.org/projects/fossology/wiki/Mimetype_Test_Cases|Mimetype_Test_Cases]] | | Paul | | |
- | |Scheduler | "Yes":http://www.fossology.org/projects/fossology/wiki/Scheduler_Test_Cases | "#504":https://github.com/fossology/fossology/issues/504 phpunit stress test failure, "#505":https://github.com/fossology/fossology/issues/505 cp2foss unpack problem | Shaheem, Anupam | PASS (need a solution for #505) | | + | |Scheduler | Yes [[http://www.fossology.org/projects/fossology/wiki/Scheduler_Test_Cases|Scheduler_Test_Cases]] | [[https://github.com/fossology/fossology/issues/504|#504]] phpunit stress test failure, [[https://github.com/fossology/fossology/issues/505|#505]] cp2foss unpack problem | Shaheem, Anupam | PASS (need a solution for #505) | |
- | |Ununpack | "Yes":http://www.fossology.org/projects/fossology/wiki/Ununpack_Test_Cases | clicking the file link brings 403, but can be found on the Web (or take other o-file). Actually, there is no viewable name anymore which changes the test case a bit. | Michael | PASS | | + | |Ununpack | Yes [[http://www.fossology.org/projects/fossology/wiki/Ununpack_Test_Cases|Ununpack_Test_Cases]] | clicking the file link brings 403, but can be found on the Web (or take other o-file). Actually, there is no viewable name anymore which changes the test case a bit. | Michael | PASS | |
- | |Wget_Agent | N/A - test by automated testing ||| | | + | |Wget_Agent | N/A - test by automated testing | | | | |
- | |Monk | "Need to add test cases" ||| | | + | |Monk | Yes - Need to add test cases | | | | |
- | | UI (Please perform tests using latest IE browser, firefox and chrome) ||||| | + | |UI (Please perform tests using latest IE browser, firefox and chrome) ||||| |
- | |BucketsDiff | [[Bucket_diff|Yes]] | | Anupam | PASS | | + | |BucketsDiff | [[Bucket_diff|Yes]] | | Anupam | PASS | |
- | |NomosDiff | [[Nomos_diff|Yes]] | | Shaheem | PASS | | + | |NomosDiff | [[Nomos_diff|Yes]] | | Shaheem | PASS | |
- | |Homepage | [[Basic_functional_Test_Cases#Homepage|Yes]] | Opposed to test desc, debug menue is only visible at login, which appears even better | Michael | PASS (FF,IE only)| | + | |Homepage | [[Basic_functional_Test_Cases#Homepage|Yes]] | Opposed to test desc, debug menue is only visible at login, which appears even better | Michael | PASS (FF,IE only)| |
- | |Upload | [[Basic_functional_Test_Cases#Upload|yes]] | Set bug for 3.0.1 milestone that wildcard at "upload from server" does not work: "#512":https://github.com/fossology/fossology/issues/512 Also IE seems to have trouble with jquery: "#511":https://github.com/fossology/fossology/issues/511 | Michael | PASS (barely? IE,FF only)| | + | |Upload | [[Basic_functional_Test_Cases#Upload|yes]] | Set bug for 3.0.1 milestone that wildcard at "upload from server" does not work: [[https://github.com/fossology/fossology/issues/512|#512]] Also IE seems to have trouble with jquery: [[https://github.com/fossology/fossology/issues/511|511]] | Michael | PASS (barely? IE,FF only)| |
|Jobs | [[Basic_functional_Test_Cases#Jobs|Yes]] | | Michael | PASS (IE,FF only) | | |Jobs | [[Basic_functional_Test_Cases#Jobs|Yes]] | | Michael | PASS (IE,FF only) | | ||
- | |Search | [[Basic_functional_Test_Cases#Search|Yes]] | IE has trouble to display the job details "#513":https://github.com/fossology/fossology/issues/513 | Michael | PASS (barely? IE,FF only) | | + | |Search | [[Basic_functional_Test_Cases#Search|Yes]] | IE has trouble to display the job details [[https://github.com/fossology/fossology/issues/513|#513]] | Michael | PASS (barely? IE,FF only) | |
- | |Browse | [[Basic_functional_Test_Cases#Browse|Yes]] | "#507":https://github.com/fossology/fossology/issues/507 upload url problem in instructions | Shaheem | FAIL (upload from git repo does not seem to work)| | + | |Browse | [[Basic_functional_Test_Cases#Browse|Yes]] | [[https://github.com/fossology/fossology/issues/507|#507]] upload url problem in instructions | Shaheem | FAIL (upload from git repo does not seem to work)| |
|License Browse | [[Basic_functional_Test_Cases#License-Browse|Partial]] | some of the UI changed of course | Michael | PASS (IE,FF) | | |License Browse | [[Basic_functional_Test_Cases#License-Browse|Partial]] | some of the UI changed of course | Michael | PASS (IE,FF) | | ||
- | |Organize | [[Basic_functional_Test_Cases#Organize|Yes]] | opened an enhancement: "#514":https://github.com/fossology/fossology/issues/514 | Michael | PASS (IE,FF only) | | + | |Organize | [[Basic_functional_Test_Cases#Organize|Yes]] | opened an enhancement: [[https://github.com/fossology/fossology/issues/514|#514]] | Michael | PASS (IE,FF only) | |
- | |Help | [[Basic_functional_Test_Cases#Homepage|Yes]] | | Michael | PASS (IE,FF only) | | + | |Help | [[Basic_functional_Test_Cases#Homepage|Yes]] | | Michael | PASS (IE,FF only) | |
- | |User Permissions | [[User_Permissions|Yes]] | "#499":https://github.com/fossology/fossology/issues/499 monk-oneshot for readonly user | Shaheem, Anupam | PASS (issue is acceptable for release) | | + | |User Permissions | [[User_Permissions|Yes]] | [[https://github.com/fossology/fossology/issues/499|#499]] monk-oneshot for readonly user | Shaheem, Anupam | PASS (issue is acceptable for release) | |
- | |Group Permissions | [[Perms|uses cases]] | | Shaheem, Anupam | PASS | | + | |Group Permissions | [[Perms|uses cases]] | | Shaheem, Anupam | PASS | |
- | |Upload Permissions | [[Perms|uses cases]] "Partial":http://www.fossology.org/projects/fossology/wiki/Admin#Upload-Permissions || Shaheem, Anupam | PASS | | + | |Upload Permissions | [[Perms|uses cases]] Yes [[http://www.fossology.org/projects/fossology/wiki/Admin#Upload-Permissions|Admin#Upload-Permissions]] | | Shaheem, Anupam | PASS | |
- | |Admin | [[Admin|Yes]] | "#500":https://github.com/fossology/fossology/issues/500 Logo Image URL not updating, "#502":https://github.com/fossology/fossology/issues/502 add the new license not working | Shaheem, Anupam | PASS (issues are acceptable for release) | | + | |Admin | [[Admin|Yes]] | [[https://github.com/fossology/fossology/issues/500|#500]] Logo Image URL not updating, [[https://github.com/fossology/fossology/issues/502|#502]] add the new license not working | Shaheem, Anupam | PASS (issues are acceptable for release) | |
|Tagging | [[TaggingManualTests|Yes]] | | Shaheem | PASS | | |Tagging | [[TaggingManualTests|Yes]] | | Shaheem | PASS | | ||
- | | | + | |Other ||||| |
- | | Other ||||| | + | |fo_postinstall | N/A - automated functional | | | | |
- | |fo_postinstall | N/A - automated functional | ||| | + | |fo-installdeps | N/A - automated functional | | | | |
- | |fo-installdeps | N/A - automated functional | | || | + | |cp2foss | Yes | | | | |
- | |cp2foss | Yes | ||| | + | |dbcreate | N/A - tested by automated install testing | | | | |
- | |dbcreate | N/A - tested by automated install testing | || | | + | |fossinit | N/A - tested by automated install testing | | | | |
- | |fossinit | N/A - tested by automated install testing | || | | + | |fossjobs | Yes | missing link or description | | | |
- | |fossjobs | Yes | missing link or description || | | + | |fo_cli | N/A - automated functional | | | | |
- | |fo_cli | N/A - automated functional | | | | | + | |fo-cleanold | N/A - automated functional | | | | |
- | |fo-cleanold | N/A - automated functional | | | | | + | |schema_export | [[Schema-export|Yes]] | | Shaheem, Anupam | PASS| |
- | |schema_export | [[Schema-export|Yes]] | | Shaheem, Anupam | PASS| | + | |fo_nomos_license_list| Yes | just execute? src/cli/ fo_nomos_license_list.php (yes, testing all the options - BobG) | || |
- | |fo_nomos_license_list| Yes | just execute? src/cli/ fo_nomos_license_list.php (yes, testing all the options - BobG) | || | + | |fo_copyright_list | Yes | see above | | | |
- | |fo_copyright_list| Yes | see above | | | | + | |RESTful UI | [[REST_Test_Cases|Yes]] | Requires authentication | BobG |FAIL| |
- | |RESTful UI |=. [[REST_Test_Cases|Yes]] | Requires authentication | BobG |FAIL| | + | |Siteminder and Mail | [[Admin#Customize|Yes]] | | Anupam | PASS | |
- | |Siteminder and Mail | [[Admin#Customize|Yes]] | | Anupam | PASS | | + | |Source Install | Yes [[http://www.fossology.org/projects/fossology/wiki/Install_2_0#Installation-from-source|Installation-from-source]] | should have second tester (non Ubuntu 14.04) | Shaheem, Anupam, Paul | PASS (tested on ububtu 14.04(64 bit )) | |
- | |Source Install | "Yes":http://www.fossology.org/projects/fossology/wiki/Install_2_0#Installation-from-source | should have second tester (non Ubuntu 14.04) | Shaheem, Anupam, Paul | PASS (tested on ububtu 14.04(64 bit )) | | + | |Package Build | Tested by CI | | | | |
- | |Package Build | Tested by CI || | | | + | |Package Install | [[Install_2_0|Yes]] |tested by CI | BobG, Paul iff Pkg avail | | |
- | |Package Install | [[Install_2_0|Yes]] |tested by CI | BobG, Paul iff Pkg avail | | | + | |Package Purge | | | | | |
- | |Package Purge |=. | || | | + | |Continuous Integration | Yes [[http://fotest.fc.hp.com:8080|HP internal server]] | | BobG | | |
- | |Continuous Integration | "Yes":http://fotest.fc.hp.com:8080 | | BobG | | | + | |Migration 2.6 -> 3.0 | Yes [[Automation_Testing_Migration|Automation_Testing_Migration]] | | Paul | | |
- | |Migration 2.6 -> 3.0 | [[Automation_Testing_Migration|Yes]] || Paul | | | + | |
|fossology.fc.hp.com migration | | | | | | |fossology.fc.hp.com migration | | | | | | ||
- | |Cluster Testing | [[Automation_Testing_Cluster|Yes]] | |BobG | | | + | |Cluster Testing | [[Automation_Testing_Cluster|Yes]] | |BobG | | |
- | |Performance/Load | [[Automation_Testing_Performance_and_Load|Yes]] | Large upload license browse 2x slower and no report cache. Discussing on fo-devel |BobG | | | + | |Performance/Load | [[Automation_Testing_Performance_and_Load|Yes]] | Large upload license browse 2x slower and no report cache. Discussing on fo-devel |BobG | | |
- | |Git support|=. | | | | | + | |Git support | | | | | |
- | | Dependency Certification ||||| | + | |Dependency Certification ||||| |
- | |PostgreSQL | N/A | | | | | + | |PostgreSQL | N/A | | | | |
- | |Apache httpd | N/A | | | | | + | |Apache httpd | N/A | | | | |
- | |Glib | N/A | | | | | + | |Glib | N/A | | | | |
- | | Documentation & Processes ||||| | + | |Documentation & Processes ||||| |
- | | Postgresql support definition & process | N/A | | | | | + | |Pos definition & process | N/A | | | | |
- | | Documentation for 3.0 | | | | | | + | |Documentation for 3.0 | Release notes | | | | |