Courses Created By Batch Process (Quartz), Test Results Summary
White List Testing (case 1)
Changes made to the plan:
Test | Noted Change or Update in Plan | Change Effected |
|---|
White List | CRN 2006-03-60024 is valid (had no enrollment, but is valid CRN) | Test Plan had CRN 60024 as invalid course, however replaced this CRN with 99999 (2006-03-99999) in white-list.txt file |
White List Batch Re-Run | White List Batch script re-run after above change to adding 2006-03-99999 CRN to white-list file | Created/Validated White List Re-Run Test Case for this series of tests. Note Case 5 below |
Results:
| Info |
|---|
| borderColor | #ccc |
|---|
| bgColor | efefef |
|---|
| titleBGColor | ffffcc |
|---|
| borderStyle | dashed |
|---|
| title | Test Results, White List | borderStyle | dashed |
|---|
|
Test | User Role | User Acting As | Result | Expected Result | Pass/Fail |
|---|
Site 19950176288 (created): Functionality Test Results | bdonnell | fzthorn | No course site for instructor, had to click update participants in admin site tool | course created successfullyF | https://jira.ucdavis.edu:8444/jira/browse/SAK-185 | Site 19950176288 (created): CM Test Results | bdonnell | fzthorn | All tests pass | course created successfully | P | Site 19950176288 (created): Provider Id Test Results | bdonnell | fzthorn | All tests pass | course created successfully | P |
Test | User Role | User Acting As | Result | Expected Result | Pass/Fail |
|---|
Site 20060660005 (created): Functionality Test Results | smavocet | adminx | tests pass, provisioned | course created successfully | P | Site 20060660005 (created): CM Test Results | smavocet | admin | tests pass, not provisioned | course created successfully | P | Site 20060660005 (created): Provider Id Test Results | smavocet | admin | tests pass, not provisioned | course created successfully | P | Site 2006-03-60024 (created):Test Results | tpa | tpa | All tests pass, provisioned | course not created, correct | P |
Test | User Role | User Acting As | Result | Expected Result | Pass/Fail |
|---|
Site 2006-03-60024 2006106111 (not created):Test Results | tpa | tpa | All tests pass, not provisioned | course not created, correct | P | Site 2006106111 2006-03-99999 (not created):Test Results | tpasamersontpa | samerson | All tests pass, not provisioned | course not created, correct | P |
Test | User Role | User Acting As | Result | Expected Result | Pass/Fail |
|---|
Site 2006sfssfsfdfsdfsfsfs (not created):Test Results | ccjon | ccjon | All tests pass, not provisioned | course not created, correct | P |
|
Black List Testing (cases 2a and 2b)
Changes made to the plan:
Test | Noted Change or Update in Plan | Change Effected |
|---|
Black List (scenario a) | scenario referred to as "a" instead of "#1" as originally documented | scenario results reflected as "a" |
Black List (scenario b) | scenario referred to as "b" instead of "#2" as originally documented | scenario results reflected as "b" |
Black List (scenario a) | CRN 2006-01-40018 was checked by Scott Amerson instead of Sandra | No change in scenario |
| Info |
|---|
| borderColor | #ccc |
|---|
| bgColor | efefef |
|---|
| titleBGColor | ffffcc |
|---|
| borderStyle | dashed |
|---|
| title | Test Results, Black List Scenario a |
|---|
|
Test | User | User Acting As | Result | Expected Result | Pass/Fail |
|---|
Site w/CRN 2004-03-60097 (created):Test Results | jrenfro | dlmiller | site created with incorrect ECN | site created in UI | https://jira.ucdavis.edu:8444/jira/browse/SAK-184 | Site w/CRN 2006-01-60001 (not created?):Test Results | bdonnell | admin | no site exists | site not created in UI or db | Pass | Site w/CRN 2006-01-40018 (not created?):Test Results | samerson | samerson | no site exists | site not created in UI or db | P | Site w/CRN 2006-03-82882 (not created?):Test Results | tpa | x | x | site not created in UI or db | x | Site w/CRN 2006-03-83634 (not created?):Test Results | tpa | x | x | site not created in UI or db | x |
|
| Info |
|---|
| borderColor | #ccc |
|---|
| bgColor | efefef |
|---|
| titleBGColor | ffffcc |
|---|
| borderStyle | dashed |
|---|
| title | Test Results, Black List Scenario b |
|---|
|
Test | User | User Acting As | Result | Expected Result | Pass/Fail |
|---|
Site w/provider id 2006-03-69857 (not created):Test Results | ccjon | ccjon | no site | site not created in UI or db | P | Site w/provider id 2006-03-65306 (not created):Test Results | bdonnell | admin | No site exists | site not created in UI or db | P | Site w/provider id 2006-06-60435 (not created):Test Results | bdonnell | admin | No site exists | site not created in UI or db | P |
|
*Note, pass/fail depends on db check also for this test! Jon,Brian/Sandra will consult with Thomas and Scott about test case result, to check db results.
Provider Id Testing (cases 3a and 3b)
Changes made to the plan:
Test | Noted Change or Update in Plan | Change Effected |
|---|
Provider Id (scenario a = auto update) | scenario referred to as "a" instead of "batch" as originally documented | scenario results reflected as "a" |
Provider Id (scenario b = manual) | scenario referred to as "b" instead of "manual" as originally documented | scenario results reflected as "b" |
Provider Id tests | samerson checked these results for batch | originally ccjon and smavocet were assigned |
| Info |
|---|
| borderColor | #ccc |
|---|
| bgColor | efefef |
|---|
| titleBGColor | ffffcc |
|---|
| borderStyle | dashed |
|---|
| title | Test Results, Provider Id Update, Batch and Manual (3a and 3b) |
|---|
|
Test | User | User Acting As | Result | Expected Result | Pass/Fail |
|---|
Site w/provider id 2006-03-93327 : Provider Id Update Results (batch, 3a) | samerson | samerson | site has provider id 2006-03-93327, valid roster | provider id updated and seen in realm tool and site info tool under "provider id", roster reflects provider id roster | P | Site w/provider id 2006-03-92472: Provider Id Update Results (batch,3a) | samerson | samerson | site has provider id 2006-03-92472: valid roster | provider id updated and seen in realm tool and site info tool under "provider id", roster reflects provider id roster | P | Site w/provider id: 2006-03-83569 Provider Id Update Results (batch,3a) | samerson | samerson | site has provider id 2006-03-83569 valid roster | no roster appears because provider id invalid | P | Test | User | User Acting As | Result | Expected Result | Pass/Fail |
|---|
Site ref Second Course Site Example: Provider Id Update Results (manual,3b) | samerson | samerson | provider id 2006-03-76517 set, roster appears | provider id updated via realm edit with accurate data (provider id=) | P | Site ref Third Course Site Example: Provider Id Update Results (manual,3b) | samerson | samerson | provider id 2006-03-75796 set, roster appears | provider id updated via realm edit with accurate data (provider id=) | P |
|
Full Batch Run Winter Quarter 2004, Testing (case 4)
Changes made to the plan:
None
| Info |
|---|
| borderColor | #ccc |
|---|
| bgColor | white |
|---|
| titleBGColor | efefef |
|---|
| borderStyle | dashed |
|---|
| title | Full Batch Run Test Results |
|---|
|
Test | User | User Acting As | Sites Created Successfully | Total Time | Average Time Per Site | Spot Check Number of Sites | Any Sites with Worksite Setup detail incorrect? | BlackList CRN Not Created? | Pass/Fail |
|---|
Full Batch Run Test Results | ssbatchadmin | ssbatchadmin | 25264/32573 | 12:38 - 10:25 A = ~9hr 45min=585min | 1.32 s/site | Y | N, no SHORT_DESC is null check | NA, didn't finish because of archivelog error on server | P |
|
White List Batch Re-Run, Testing (case 5)
Changes made to the plan:
Test | Noted Change or Update in Plan | Change Effected |
|---|
White List Batch Re-Run | White List Batch script re-run after above change to adding 2006-03-99999 CRN to white-list file | bdonnell validated that no site with CRN 99999 was created, documented in case 1, also samerson validated no additional sites were created from white-list.txt file |
Site Functionality Test Results (no case given, included in White List test scenario)
| Info |
|---|
| borderColor | #ccc |
|---|
| bgColor | white |
|---|
| titleBGColor | efefef |
|---|
| borderStyle | dashed |
|---|
| title | Site Functionality Test Results |
|---|
|
Note: Functionality tests covered in case 1 above Test | User | User Acting As | Page Results | Tool Results | Click Through Results | Order of Pages Results | Tab Results | Pass/Fail |
|---|
Site 19950176288: Functionality Test Results, white list testcase | bdonnell | admin | x | x | x | x | x | P |
Test | User | User Acting As | Page Results | Tool Results | Click Through Results | Order of Pages Results | Tab Results | Pass/Fail |
|---|
Site 20060660005: Functionality Test Results, white list testcase | smavocet | admin | x | x | x | x | x | P |
|
Course Management in Admin Tools Test Results (no case given, included in White List test scenario, and provider id test scenario)
| Info |
|---|
| borderColor | #ccc |
|---|
| bgColor | white |
|---|
| titleBGColor | efefef |
|---|
| borderStyle | dashed |
|---|
| title | Course Management Test Results |
|---|
|
Note: Course Management tests covered in case 1 above Test | User | User Acting As | Site Info Tool Navigation | WorkSite Setup Navigation | Site Info Tool | Pass/Fail |
|---|
Site 19950176288: Course Management Test Results, white list testcase | bdonnell | admin | see above | see above | P |
Test | User | User Acting As | Site Info Tool Navigation | WorkSite Setup Navigation | Site Info Tool | Pass/Fail |
|---|
Site 20060660005: Course Management Test Results, white list testcase | smavocet | admin | see above | see above | P |
Test | User | User Acting As | Site Info Tool Navigation | WorkSite Setup Navigation | Site Info Tool | Pass/Fail |
|---|
Site w/provider id 2006-03-93327 (3a): Course Management Test Results, provider id testcase | samerson | samerson | P | P | P | Site w/provider id 2006-03-92472 (3a): Course Management Test Results, provider id testcase | samerson | samerson | P | P | P | Site w/provider id 2006-03-83569 (3a): Course Management Test Results, provider id testcase | samerson | samerson | P | P | P | Site w/provider id 2006-03-75796 (3b): Course Management Test Results, provider id testcase | samerson | samerson | P | P | P | Site w/provider id 2006-03-76517 (3b): Course Management Test Results, provider id testcase | samerson | samerson | P | P | P |
|