...
Courses
...
Created
...
By
...
Batch
...
Process
...
(Quartz),
...
Test
...
Results
...
Summary
...
White
...
List
...
Testing
...
(case
...
1)
...
Changes made to the plan:
Test | Noted Change or Update in Plan | Change Effected |
|---|
White List | CRN 2006-03-60024 |
...
...
...
...
...
...
...
...
...
...
...
Plan had CRN 60024 as invalid course, |
...
...
...
...
...
...
...
...
...
file |
White List Batch Re-Run | White List Batch script re-run after above change to adding 2006-03-99999 CRN to white-list file | Created/Validated White List Re-Run Test Case for this series of tests. Note Case 5 below |
Results:
| Info |
|---|
| borderColor | #ccc |
|---|
| bgColor | efefef |
|---|
| titleBGColor | ffffcc |
|---|
| borderStyle | dashed |
|---|
| title | Test Results, White List |
|---|
|
Test | User | User Acting As | Result | Expected Result | Pass/Fail |
|---|
Site 19950176288 (created): Functionality Test Results | bdonnell | fzthorn | No course site for instructor, had to click update participants in admin site tool | course created successfully | https://jira.ucdavis.edu:8444/jira/browse/SAK-185 | Site 19950176288 (created): CM Test Results | bdonnell | fzthorn | All tests pass | course created successfully | P | Site 19950176288 (created): Provider Id Test Results | bdonnell | fzthorn | All tests pass | course created successfully | P |
Test | User | User Acting As | Result | Expected Result | Pass/Fail |
|---|
Site 20060660005 (created): Functionality Test Results | smavocet | admin | tests pass, provisioned | course created successfully | P | Site 20060660005 (created): CM Test Results | smavocet | admin | tests pass, provisioned | course created successfully | P | Site 20060660005 (created): Provider Id Test Results | smavocet | admin | tests pass, provisioned | course created successfully | P | Site 2006-03-60024 (created):Test Results | tpa | tpa | All tests pass, provisioned | course not created, correct | P |
Test | User Role | User Acting As | Result | Expected Result | Pass/Fail |
|---|
Site 2006106111 (not created):Test Results | tpa | tpa | All tests pass, not provisioned | course not created, correct | P | Site 2006-03-99999 (not created):Test Results | samerson | samerson | All tests pass, provisioned | course not created, correct | P |
Test | User Role | User Acting As | Result | Expected Result | Pass/Fail |
|---|
Site 2006sfssfsfdfsdfsfsfs (not created):Test Results | ccjon | ccjon | All tests pass, not provisioned | course not created, correct | P |
|
Black List Testing (cases 2a and 2b)
Changes made to the plan:
Test | Noted Change or Update in Plan | Change Effected |
|---|
Black List (scenario a) | scenario referred to as "a" instead of "#1" as originally documented | scenario results reflected as "a" |
Black List (scenario b) | scenario referred to as "b" instead of "#2" as originally documented | scenario results reflected as "b" |
Black List (scenario a) | CRN 2006-01-40018 was checked by Scott Amerson instead of Sandra | No change in scenario |
| Info |
|---|
| borderColor | #ccc |
|---|
| bgColor | efefef |
|---|
| titleBGColor | ffffcc |
|---|
| borderStyle | dashed |
|---|
| title | Test Results, Black List Scenario a |
|---|
|
Test | User | User Acting As | Result | Expected Result | Pass/Fail |
|---|
Site w/CRN 2004-03-60097 (created):Test Results | jrenfro | dlmiller | site created with incorrect ECN | site created in UI | https://jira.ucdavis.edu:8444/jira/browse/SAK-184 | Site w/CRN 2006-01-60001 (not created?):Test Results | bdonnell | admin | no site exists | site not created in UI or db | Pass | Site w/CRN 2006-01-40018 (not created?):Test Results | samerson | samerson | no site exists | site not created in UI or db | P | Site w/CRN 2006-03-82882 (not created?):Test Results | tpa | x | x | site not created in UI or db | x | Site w/CRN 2006-03-83634 (not created?):Test Results | tpa | x | x | site not created in UI or db | x |
|
| Info |
|---|
| borderColor | #ccc |
|---|
| bgColor | efefef |
|---|
| titleBGColor | ffffcc |
|---|
| borderStyle | dashed |
|---|
| title | Test Results, Black List Scenario b |
|---|
|
Test | User | User Acting As | Result | Expected Result | Pass/Fail |
|---|
Site w/provider id 2006-03-69857 (not created):Test Results | ccjon | ccjon | no site | site not created in UI or db | P | Site w/provider id 2006-03-65306 (not created):Test Results | bdonnell | admin | No site exists | site not created in UI or db | P | Site w/provider id 2006-06-60435 (not created):Test Results | bdonnell | admin | No site exists | site not created in UI or db | P |
|
*Note, pass/fail depends on db check also for this test! Jon,Brian/Sandra will consult with Thomas and Scott about test case result, to check db results.
Provider Id Testing (cases 3a and 3b)
Changes made to the plan:
Test | Noted Change or Update in Plan | Change Effected |
|---|
Provider Id (scenario a = auto update) | scenario referred to as "a" instead of "batch" as originally documented | scenario results reflected as "a" |
Provider Id (scenario b = manual) | scenario referred to as "b" instead of "manual" as originally documented | scenario results reflected as "b" |
Provider Id tests | samerson checked these results for batch | originally ccjon and smavocet were assigned |
| Info |
|---|
| borderColor | #ccc |
|---|
| bgColor | efefef |
|---|
| titleBGColor | ffffcc |
|---|
| borderStyle | dashed |
|---|
| title | Test Results, Provider Id Update, Batch and Manual (3a and 3b) |
|---|
|
Test | User | User Acting As | Result | Expected Result | Pass/Fail |
|---|
Site w/provider id 2006-03-93327 : Provider Id Update Results (batch, 3a) | samerson | samerson | site has provider id 2006-03-93327, valid roster | provider id updated and seen in realm tool and site info tool under "provider id", roster reflects provider id roster | P | Site w/provider id 2006-03-92472: Provider Id Update Results (batch,3a) | samerson | samerson | site has provider id 2006-03-92472: valid roster | provider id updated and seen in realm tool and site info tool under "provider id", roster reflects provider id roster | P | Site w/provider id: 2006-03-83569 Provider Id Update Results (batch,3a) | samerson | samerson | site has provider id 2006-03-83569 valid roster | no roster appears because provider id invalid | P | Test | User | User Acting As | Result | Expected Result | Pass/Fail |
|---|
Site ref Second Course Site Example: Provider Id Update Results (manual,3b) | samerson | samerson | provider id 2006-03-76517 set, roster appears | provider id updated via realm edit with accurate data (provider id=) | P | Site ref Third Course Site Example: Provider Id Update Results (manual,3b) | samerson | samerson | provider id 2006-03-75796 set, roster appears | provider id updated via realm edit with accurate data (provider id=) | P |
|
Full Batch Run Winter Quarter 2004, Testing (case 4)
Changes made to the plan:
None
| Info |
|---|
| borderColor | #ccc |
|---|
| bgColor | white |
|---|
| titleBGColor | efefef |
|---|
| borderStyle | dashed |
|---|
| title | Full Batch Run Test Results |
|---|
|
Test | User | User Acting As | Sites Created Successfully | Total Time | Average Time Per Site | Spot Check Number of Sites | Any Sites with Worksite Setup detail incorrect? | BlackList CRN Not Created? | Pass/Fail |
|---|
Full Batch Run Test Results | ssbatchadmin | ssbatchadmin | 25264/32573 | 12:38 - 10:25 A = ~9hr 45min=585min | 1.32 s/site | Y | N, no SHORT_DESC is null check | NA, didn't finish because of archivelog error on server | P |
|
White List Batch Re-Run, Testing (case 5)
Changes made to the plan:
Test | Noted Change or Update in Plan | Change Effected |
|---|
White List Batch Re-Run | White List Batch script re-run after above change to adding 2006-03-99999 CRN to white-list file | bdonnell validated that no site with CRN 99999 was created, documented in case 1, also samerson validated no additional sites were created from white-list.txt file |
Site Functionality Test Results (no case given, included in White List test scenario)
| Info |
|---|
| borderColor | #ccc |
|---|
| bgColor | white |
|---|
| titleBGColor | efefef |
|---|
| borderStyle | dashed |
|---|
| title | Site Functionality Test Results |
|---|
|
Note: Functionality tests covered in case 1 above Test | User | User Acting As | Page Results | Tool Results | Click Through Results | Order of Pages Results | Tab Results | Pass/Fail |
|---|
Site 19950176288: Functionality Test Results, white list testcase | bdonnell | admin | x | x | x | x | x | P |
Test | User | User Acting As | Page Results | Tool Results | Click Through Results | Order of Pages Results | Tab Results | Pass/Fail |
|---|
Site 20060660005: Functionality Test Results, white list testcase | smavocet | admin | x | x | x | x | x | P |
|
Course Management in Admin Tools Test Results (no case given, included in White List test scenario, and provider id test scenario)
| Info |
|---|
| borderColor | #ccc |
|---|
| bgColor | white |
|---|
| titleBGColor | efefef |
|---|
| borderStyle | dashed |
|---|
| title | Course Management Test Results |
|---|
|
Note: Course Management tests covered in case 1 above Test | User | User Acting As | Site Info Tool Navigation | WorkSite Setup Navigation | Site Info Tool | Pass/Fail |
|---|
Site 19950176288: Course Management Test Results, white list testcase | bdonnell | admin | see above | see above | P |
Test | User | User Acting As | Site Info Tool Navigation | WorkSite Setup Navigation | Site Info Tool | Pass/Fail |
|---|
Site 20060660005: Course Management Test Results, white list testcase | smavocet | admin | see above | see above | P |
Test | User | User Acting As | Site Info Tool Navigation | WorkSite Setup Navigation | Site Info Tool | Pass/Fail |
|---|
Site w/provider id 2006-03-93327 (3a): Course Management Test Results, provider id testcase | samerson | samerson | P | P | P | Site w/provider id 2006-03-92472 (3a): Course Management Test Results, provider id testcase | samerson | samerson | P | P | P | Site w/provider id 2006-03-83569 (3a): Course Management Test Results, provider id testcase | samerson | samerson | P | P | P | Site w/provider id 2006-03-75796 (3b): Course Management Test Results, provider id testcase | samerson | samerson | P | P | P | Site w/provider id 2006-03-76517 (3b): Course Management Test Results, provider id testcase | samerson | samerson | P | P | P |
|