Courses Created By Batch Process (Quartz), Test Results Summary
White List Testing (case 1)
Changes made to the plan:
Test |
Noted Change or Update in Plan |
Change Effected |
---|---|---|
White List |
CRN 2006-03-60024 is valid (had no enrollment, but is valid CRN) |
Test Plan had CRN 60024 as invalid course, however replaced this CRN with 99999 (2006-03-99999) in white-list.txt file |
White List Batch Re-Run |
White List Batch script re-run after above change to adding 2006-03-99999 CRN to white-list file |
Created/validated re-run Test Case in test plan note Case 5 below |
Results:
Test Results, White List
Test |
User |
User Acting As |
Result |
Expected Result |
Pass/Fail |
---|---|---|---|---|---|
Site 19950176288 (created): Functionality Test Results |
bdonnell |
fzthorn |
No course site for instructor, had to click update participants in admin site tool |
course created successfully |
F |
Site 19950176288 (created): CM Test Results |
bdonnell |
fzthorn |
All tests pass |
course created successfully |
P |
Site 19950176288 (created): Provider Id Test Results |
bdonnell |
fzthorn |
All tests pass |
course created successfully |
P |
Test |
User |
User Acting As |
Result |
Expected Result |
Pass/Fail |
---|---|---|---|---|---|
Site 20060660005 (created): Functionality Test Results |
smavocet |
admin |
tests pass, provisioned |
course created successfully |
P |
Site 20060660005 (created): CM Test Results |
smavocet |
admin |
tests pass, provisioned |
course created successfully |
P |
Site 20060660005 (created): Provider Id Test Results |
smavocet |
admin |
tests pass, provisioned |
course created successfully |
P |
Site 2006-03-60024 (created):Test Results |
tpa |
tpa |
All tests pass, provisioned |
course not created, correct |
P |
Test |
User Role |
User Acting As |
Result |
Expected Result |
Pass/Fail |
---|---|---|---|---|---|
Site 2006106111 (not created):Test Results |
tpa |
tpa |
All tests pass, not provisioned |
course not created, correct |
P |
Site 2006-03-99999 (not created):Test Results |
samerson |
samerson |
All tests pass, provisioned |
course not created, correct |
P |
Test |
User Role |
User Acting As |
Result |
Expected Result |
Pass/Fail |
---|---|---|---|---|---|
Site 2006sfssfsfdfsdfsfsfs (not created):Test Results |
ccjon |
ccjon |
All tests pass, not provisioned |
course not created, correct |
P |
Black List Testing (cases 2a and 2b)
Changes made to the plan:
Test |
Noted Change or Update in Plan |
Change Effected |
---|---|---|
Black List (scenario a) |
scenario referred to as "a" instead of "#1" as originally documented |
scenario results reflected as "a" |
Black List (scenario b) |
scenario referred to as "b" instead of "#2" as originally documented |
scenario results reflected as "b" |
Black List (scenario a) |
CRN 2006-01-40018 was checked by Scott Amerson instead of Sandra |
No change in scenario |
Test Results, Black List Scenario a
Test |
User |
User Acting As |
Result |
Expected Result |
Pass/Fail |
---|---|---|---|---|---|
Site w/CRN 2004-03-60097 (created):Test Results |
jrenfro |
dlmiller |
site created with incorrect ECN |
site created in UI |
Fail |
Site w/CRN 2006-01-60001 (not created?):Test Results |
bdonnell |
admin |
no site exists |
site not created in UI or db |
Pass |
Site w/CRN 2006-01-40018 (not created?):Test Results |
samerson |
samerson |
no site exists |
site not created in UI or db |
x |
Site w/CRN 2006-03-82882 (not created?):Test Results |
tpa |
x |
x |
site not created in UI or db |
x |
Site w/CRN 2006-03-83634 (not created?):Test Results |
tpa |
x |
x |
site not created in UI or db |
x |
Test Results, Black List Scenario b
Test |
User |
User Acting As |
Result |
Expected Result |
Pass/Fail |
---|---|---|---|---|---|
Site w/provider id 2006-03-69857 (not created):Test Results |
ccjon |
ccjon |
x |
site not created in UI or db |
x |
Site w/provider id 2006-03-65306 (not created):Test Results |
bdonnell |
admin |
No site exists |
site not created in UI or db |
P |
Site w/provider id 2006-06-60435 (not created):Test Results |
bdonnell |
admin |
No site exists |
site not created in UI or db |
P |
*Note, pass/fail depends on db check also for this test! Jon,Brian/Sandra will consult with Thomas and Scott about test case result, to check db results.
Provider Id Testing (cases 3a and 3b)
Changes made to the plan:
Test |
Noted Change or Update in Plan |
Change Effected |
---|---|---|
Provider Id (scenario a = auto update) |
scenario referred to as "a" instead of "batch" as originally documented |
scenario results reflected as "a" |
Provider Id (scenario b = manual) |
scenario referred to as "b" instead of "manual" as originally documented |
scenario results reflected as "b" |
Provider Id tests |
samerson checked these results for batch |
originally ccjon and smavocet were assigned |
Test Results, Provider Id Update, Batch and Manual (3a and 3b)
Test |
User |
User Acting As |
Result |
Expected Result |
Pass/Fail |
---|---|---|---|---|---|
Site w/provider id 2006-03-93327 : Provider Id Update Results (batch, 3a) |
samerson |
samerson |
site has provider id 2006-03-93327, valid roster |
provider id updated and seen in realm tool and site info tool under "provider id", roster reflects provider id roster |
P |
Site w/provider id 2006-03-92472: Provider Id Update Results (batch,3a) |
samerson |
samerson |
site has provider id 2006-03-92472: valid roster |
provider id updated and seen in realm tool and site info tool under "provider id", roster reflects provider id roster |
P |
Site w/provider id: 2006-03-83569 Provider Id Update Results (batch,3a) |
samerson |
samerson |
site has provider id 2006-03-83569 valid roster |
no roster appears because provider id invalid |
P |
Test |
User |
User Acting As |
Result |
Expected Result |
Pass/Fail |
Site ref Second Course Site Example: Provider Id Update Results (manual,3b) |
samerson |
samerson |
provider id 2006-03-76517 set, roster appears |
provider id updated via realm edit with accurate data (provider id=) |
P |
Site ref Third Course Site Example: Provider Id Update Results (manual,3b) |
samerson |
samerson |
provider id 2006-03-75796 set, roster appears |
provider id updated via realm edit with accurate data (provider id=) |
P |
Full Batch Run Winter Quarter 2004, Testing (cases 4)
Changes made to the plan:
None
Full Batch Run Test Results
Test |
User |
User Acting As |
Sites Created Successfully |
Total Time |
Average Time Per Site |
Spot Check Number of Sites |
Any Sites with Worksite Setup detail incorrect? |
BlackList CRN Not Created? |
Pass/Fail |
---|---|---|---|---|---|---|---|---|---|
Full Batch Run Test Results |
ssbatchadmin |
ssbatchadmin |
??/32573 |
incomplete, didn't finish |
? |
? |
? |
? |
P |
White List Batch Re-Run, Testing (case 5)
Changes made to the plan:
Test |
Noted Change or Update in Plan |
Change Effected |
---|---|---|
White List Batch Re-Run |
White List Batch script re-run after above change to adding 2006-03-99999 CRN to white-list file |
bdonnell validated that no site with CRN 99999 was created, in case 1 |
Site Functionality Test Results (no case given, included in White List test scenario)
Course Management Test Results (no case given, included in White List test scenario)
Course Management Test Results
Test |
User |
User Acting As |
Site Info Tool Navigation |
WorkSite Setup Navigation |
Site Info Tool |
Pass/Fail |
---|---|---|---|---|---|---|
Site xxxxx: Course Management Test Results, white list testcase |
samerson |
admin |
x |
x |
P |
Test |
User |
User Acting As |
Site Info Tool Navigation |
WorkSite Setup Navigation |
Site Info Tool |
Pass/Fail |
---|---|---|---|---|---|---|
Site xxxxx: Course Management Test Results, white list testcase |
smavocet |
admin |
x |
x |
P |
Test |
User |
User Acting As |
Site Info Tool Navigation |
WorkSite Setup Navigation |
Site Info Tool |
Pass/Fail |
---|---|---|---|---|---|---|
Site xxxxx: Course Management Test Results, white list testcase |
ccjon |
admin |
x |
x |
P |
Test |
User |
User Acting As |
Site Info Tool Navigation |
WorkSite Setup Navigation |
Site Info Tool |
Pass/Fail |
---|---|---|---|---|---|---|
Site xxxxx: Course Management Test Results, white list testcase |
bdonnell |
admin |
x |
x |
P |
Test |
User |
User Acting As |
Site Info Tool Navigation |
WorkSite Setup Navigation |
Site Info Tool |
Pass/Fail |
---|---|---|---|---|---|---|
Site xxxxx: Course Management Test Results, white list testcase |
tpa |
admin |
x |
x |
P |