...
| Info |
|---|
| title | Additional Items slated for testing |
|---|
|
- Manually update provider Id for a site
- Need to be done as a an admin user, or one that has access to admin realm
- -See the results of the realms being refreshed (Jon's patch)-
|
KNOWN ISSUES / PREVIOUS BUGS FIXED
...
Test | User | User Acting As | Result | Expected Result | Pass/Fail |
|---|
Site xxxxx: Provider Id Update Results | samerson | admin | provider id is ....., roster is same as CRN for provider id | provider id updated and seen in site tool under "provider id", roster reflects provider id roster | P |
results: https://confluence.ucdavis.edu:8443/confluence/display/UCDSAKAI/Batch+Course+Creation+Integration+Test+Results%2C+Sept+5%2C+2006
Site Functionality
| Note |
|---|
|
Description = Test the capability of the system to add sites with the correct pages, tools, tabs, and look and feel. Category of Testing = unit, integration, functionality Prerequisite Steps
Results Recording Steps summarized in:
**perform functionality test https://confluence.ucdavis.edu:8443/confluence/display/UCDSAKAI/Course+Site+Functionality+Tests%2C+SmartSite+Batch+Integration+Testing+Matrix for each site
looking for expected results
Test Scenario | Panel |
|---|
| borderColor | #ccc |
|---|
| bgColor | F7D6C1 |
|---|
| titleBGColor | #efefef |
|---|
| borderStyle | dashed |
|---|
| title | Individual Functionality Tests | borderStyle | dashed |
|---|
| - -Look and Feel- *
- Pages *
- Tools on each page *
- Click-through on tools *
- Order *
- Tabs *
|
Test Cleanup - Scott will remove all sites created in this step when all test cases are completed.
|
| Info |
|---|
| borderColor | #ccc |
|---|
| bgColor | white |
|---|
| titleBGColor | efefef |
|---|
| title | Site Functionality Test Results |
|---|
| borderStyle | dashed |
|---|
|
Test | User | User Acting As | Page Results | Tool Results | Click Through Results | Order of Pages Results | Tab Results | Pass/Fail |
|---|
Site xxxxx: Functionality Test Results, white list testcase | samerson | admin | x | x | x | x | x | P |
Test | User | User Acting As | Page Results | Tool Results | Click Through Results | Order of Pages Results | Tab Results | Pass/Fail |
|---|
Site xxxxx: Functionality Test Results, white list testcase | smavocet | admin | x | x | x | x | x | P |
Test | User | User Acting As | Page Results | Tool Results | Click Through Results | Order of Pages Results | Tab Results | Pass/Fail |
|---|
Site xxxxx: Functionality Test Results, white list testcase | ccjon | admin | x | x | x | x | x | P |
Test | User | User Acting As | Page Results | Tool Results | Click Through Results | Order of Pages Results | Tab Results | Pass/Fail |
|---|
Site xxxxx: Functionality Test Results, white list testcase | tpa | admin | x | x | x | x | x | P |
Test | User | User Acting As | Page Results | Tool Results | Click Through Results | Order of Pages Results | Tab Results | Pass/Fail |
|---|
Site xxxxx: Functionality Test Results, white list testcase | bdonnell | admin | x | x | x | x | x | P |
|
Course Management Data Presented in Admin Tools
| Note |
|---|
| title | Course Management data present |
|---|
|
Description = Test the course management content displayed in admin tools. Category of Testing = unit, integration, functionality Prerequisite Steps
Results Recording Steps summarized in:
**perform course management test https://confluence.ucdavis.edu:8443/confluence/display/UCDSAKAI/SmartSite+Course+Site%2C+Course+Management+Integration+Test+Matrix for each site
looking for expected results | Panel |
|---|
| borderColor | #ccc |
|---|
| bgColor | white |
|---|
| titleBGColor | efefef |
|---|
| title | Test Scenario |
|---|
| borderStyle | dashed |
|---|
| - Site navigation *
- WorkSite Setup navigation *
- Site Info tool *
|
Test Cleanup - Scott will remove all sites created in this step when all test cases are completed.
|
| Info |
|---|
| borderColor | #ccc |
|---|
| bgColor | white |
|---|
| titleBGColor | efefef |
|---|
| title | Course Management Test Results |
|---|
| borderStyle | dashed |
|---|
|
Test | User | User Acting As | Site Info Tool Navigation | WorkSite Setup Navigation | Site Info Tool | Pass/Fail |
|---|
Site xxxxx: Course Management Test Results, white list testcase | samerson | admin | x | x | P |
Test | User | User Acting As | Site Info Tool Navigation | WorkSite Setup Navigation | Site Info Tool | Pass/Fail |
|---|
Site xxxxx: Course Management Test Results, white list testcase | smavocet | admin | x | x | P |
Test | User | User Acting As | Site Info Tool Navigation | WorkSite Setup Navigation | Site Info Tool | Pass/Fail |
|---|
Site xxxxx: Course Management Test Results, white list testcase | ccjon | admin | x | x | P |
Test | User | User Acting As | Site Info Tool Navigation | WorkSite Setup Navigation | Site Info Tool | Pass/Fail |
|---|
Site xxxxx: Course Management Test Results, white list testcase | bdonnell | admin | x | x | P |
Test | User | User Acting As | Site Info Tool Navigation | WorkSite Setup Navigation | Site Info Tool | Pass/Fail |
|---|
Site xxxxx: Course Management Test Results, white list testcase | tpa | admin | x | x | P |
|
Full Batch Run on Term
| Note |
|---|
|
Description = Test the batch method for a whole term Category of Testing = unit, integration, performance Prerequisite Steps - After all tests have been run, Scott will recompile the Batch code to run for 2004 Winter
- Scott will add the black list file that contains one CRN from Winter 2004 into the /var/sakai/ucd-data directory.
- This test will run in the evening of test day
- Scott and Thomas will analyze the Sakai internal db to check for errors in creation
- Data to Use:
Scenario | Course | Roster Count | Instructor Kerb Name | Course Details (Catalog Root, Suffix, Section, Description) | Term Identifier | Test Case Used In | File Associated |
|---|
Valid Term | Term with large number CRNs | 2004-01 | NA | NA | 32573 sites | Winter Quarter 2004 | Full Batch Run | NA | Valid CRN | 2004-01-40200,2004-01-42003 | NA | NA | NA | NA | White List | black-list.txt |
Test Cleanup - Scott will ask Geeta to drop the devel schema when this test is completed.
|
...
| borderColor | #ccc |
|---|
| bgColor | white |
|---|
| titleBGColor | efefef |
|---|
| title | Full Batch Run Test Results |
|---|
| borderStyle | dashed |
|---|
...
Test
...
User Role
...
User Acting As
...
Sites Created Successfully
...
Total Time
...
Average Time Per Site
...
Spot Check Number of Sites
...
Any Sites with Worksite Setup detail incorrect?
...
BlackList CRN Not Created?
...
Pass/Fail
...
Full Batch Run Test Results
...
samerson
...
ssbatchadmin
...
??/32573
...
x
...
x
...
x
...
N?
...
N?
...
results: https://confluence.ucdavis.edu:8443/confluence/display/UCDSAKAI/Batch+Course+Creation+Integration+Test+Results%2C+Sept+5%2C+2006
Course Management Data Presented in Admin Tools
| Note |
|---|
| title | Course Management data present |
|---|
|
Description = Test the course management content displayed in admin tools. Category of Testing = unit, integration, functionality Prerequisite Steps
Results Recording Steps summarized in:
**perform course management test https://confluence.ucdavis.edu:8443/confluence/display/UCDSAKAI/SmartSite+Course+Site%2C+Course+Management+Integration+Test+Matrix for each site
looking for expected results | Panel |
|---|
| borderColor | #ccc |
|---|
| bgColor | white |
|---|
| titleBGColor | efefef |
|---|
| borderStyle | dashed |
|---|
| title | Test Scenario |
|---|
| - Site navigation *
- WorkSite Setup navigation *
- Site Info tool *
|
Test Cleanup - Scott will remove all sites created in this step when all test cases are completed.
|
results: https://confluence.ucdavis.edu:8443/confluence/display/UCDSAKAI/Batch+Course+Creation+Integration+Test+Results%2C+Sept+5%2C+2006
Full Batch Run on Term
| Note |
|---|
|
Description = Test the batch method for a whole term Category of Testing = unit, integration, performance Prerequisite Steps - After all tests have been run, Scott will recompile the Batch code to run for 2004 Winter
- Scott will add the black list file that contains one CRN from Winter 2004 into the /var/sakai/ucd-data directory.
- This test will run in the evening of test day
- Scott and Thomas will analyze the Sakai internal db to check for errors in creation
- Data to Use:
Scenario | Course | Roster Count | Instructor Kerb Name | Course Details (Catalog Root, Suffix, Section, Description) | Term Identifier | Test Case Used In | File Associated |
|---|
Valid Term | Term with large number CRNs | 2004-01 | NA | NA | 32573 sites | Winter Quarter 2004 | Full Batch Run | NA | Valid CRN | 2004-01-40200,2004-01-42003 | NA | NA | NA | NA | White List | black-list.txt |
Test Cleanup - Scott will ask Geeta to drop the devel schema when this test is completed.
|
results: https://confluence.ucdavis.edu:8443/confluence/display/UCDSAKAI/Batch+Course+Creation+Integration+Test+Results%2C+Sept+5%2C+2006
Recording Results
The test results will be recorded in the above summary tables by integration testers, and a summary of this data will be ready for QA and the Sakai Development team to review.
...