Batch Course Creation Integration Test Results, Sept 5, 2006

Courses Created By Batch Process (Quartz), Test Results Summary

White List Testing (case 1)

Changes made to the plan:

Test	Noted Change or Update in Plan	Change Effected
White List	CRN 2006-03-60024 is valid (had no enrollment, but is valid CRN)	Test Plan had CRN 60024 as invalid course, however replaced this CRN with 99999 (2006-03-99999) in white-list.txt file
White List Batch Re-Run	White List Batch script re-run after above change to adding 2006-03-99999 CRN to white-list file	Created/Validated White List Re-Run Test Case for this series of tests. Note Case 5 below

Results:

Test Results, White List

Test	User	User Acting As	Result	Expected Result	Pass/Fail
Site 19950176288 (created): Functionality Test Results	bdonnell	fzthorn	No course site for instructor, had to click update participants in admin site tool	course created successfully	https://jira.ucdavis.edu:8444/jira/browse/SAK-185
Site 19950176288 (created): CM Test Results	bdonnell	fzthorn	All tests pass	course created successfully	P
Site 19950176288 (created): Provider Id Test Results	bdonnell	fzthorn	All tests pass	course created successfully	P

Test	User	User Acting As	Result	Expected Result	Pass/Fail
Site 20060660005 (created): Functionality Test Results	smavocet	admin	tests pass, provisioned	course created successfully	P
Site 20060660005 (created): CM Test Results	smavocet	admin	tests pass, provisioned	course created successfully	P
Site 20060660005 (created): Provider Id Test Results	smavocet	admin	tests pass, provisioned	course created successfully	P
Site 2006-03-60024 (created):Test Results	tpa	tpa	All tests pass, provisioned	course not created, correct	P

Test	User Role	User Acting As	Result	Expected Result	Pass/Fail
Site 2006106111 (not created):Test Results	tpa	tpa	All tests pass, not provisioned	course not created, correct	P
Site 2006-03-99999 (not created):Test Results	samerson	samerson	All tests pass, provisioned	course not created, correct	P

Test	User Role	User Acting As	Result	Expected Result	Pass/Fail
Site 2006sfssfsfdfsdfsfsfs (not created):Test Results	ccjon	ccjon	All tests pass, not provisioned	course not created, correct	P

Black List Testing (cases 2a and 2b)

Changes made to the plan:

Test	Noted Change or Update in Plan	Change Effected
Black List (scenario a)	scenario referred to as "a" instead of "#1" as originally documented	scenario results reflected as "a"
Black List (scenario b)	scenario referred to as "b" instead of "#2" as originally documented	scenario results reflected as "b"
Black List (scenario a)	CRN 2006-01-40018 was checked by Scott Amerson instead of Sandra	No change in scenario

Test Results, Black List Scenario a

Test	User	User Acting As	Result	Expected Result	Pass/Fail
Site w/CRN 2004-03-60097 (created):Test Results	jrenfro	dlmiller	site created with incorrect ECN	site created in UI	https://jira.ucdavis.edu:8444/jira/browse/SAK-184
Site w/CRN 2006-01-60001 (not created?):Test Results	bdonnell	admin	no site exists	site not created in UI or db	Pass
Site w/CRN 2006-01-40018 (not created?):Test Results	samerson	samerson	no site exists	site not created in UI or db	P
Site w/CRN 2006-03-82882 (not created?):Test Results	tpa	x	x	site not created in UI or db	x
Site w/CRN 2006-03-83634 (not created?):Test Results	tpa	x	x	site not created in UI or db	x

Test Results, Black List Scenario b

Test	User	User Acting As	Result	Expected Result	Pass/Fail
Site w/provider id 2006-03-69857 (not created):Test Results	ccjon	ccjon	no site	site not created in UI or db	P
Site w/provider id 2006-03-65306 (not created):Test Results	bdonnell	admin	No site exists	site not created in UI or db	P
Site w/provider id 2006-06-60435 (not created):Test Results	bdonnell	admin	No site exists	site not created in UI or db	P

*Note, pass/fail depends on db check also for this test! Jon,Brian/Sandra will consult with Thomas and Scott about test case result, to check db results.

Provider Id Testing (cases 3a and 3b)

Changes made to the plan:

Test	Noted Change or Update in Plan	Change Effected
Provider Id (scenario a = auto update)	scenario referred to as "a" instead of "batch" as originally documented	scenario results reflected as "a"
Provider Id (scenario b = manual)	scenario referred to as "b" instead of "manual" as originally documented	scenario results reflected as "b"
Provider Id tests	samerson checked these results for batch	originally ccjon and smavocet were assigned

Test Results, Provider Id Update, Batch and Manual (3a and 3b)

Test	User	User Acting As	Result	Expected Result	Pass/Fail
Site w/provider id 2006-03-93327 : Provider Id Update Results (batch, 3a)	samerson	samerson	site has provider id 2006-03-93327, valid roster	provider id updated and seen in realm tool and site info tool under "provider id", roster reflects provider id roster	P
Site w/provider id 2006-03-92472: Provider Id Update Results (batch,3a)	samerson	samerson	site has provider id 2006-03-92472: valid roster	provider id updated and seen in realm tool and site info tool under "provider id", roster reflects provider id roster	P
Site w/provider id: 2006-03-83569 Provider Id Update Results (batch,3a)	samerson	samerson	site has provider id 2006-03-83569 valid roster	no roster appears because provider id invalid	P
Test	User	User Acting As	Result	Expected Result	Pass/Fail
Site ref Second Course Site Example: Provider Id Update Results (manual,3b)	samerson	samerson	provider id 2006-03-76517 set, roster appears	provider id updated via realm edit with accurate data (provider id=)	P
Site ref Third Course Site Example: Provider Id Update Results (manual,3b)	samerson	samerson	provider id 2006-03-75796 set, roster appears	provider id updated via realm edit with accurate data (provider id=)	P

Full Batch Run Winter Quarter 2004, Testing (case 4)

Changes made to the plan:
None

Full Batch Run Test Results

Test	User	User Acting As	Sites Created Successfully	Total Time	Average Time Per Site	Spot Check Number of Sites	Any Sites with Worksite Setup detail incorrect?	BlackList CRN Not Created?	Pass/Fail
Full Batch Run Test Results	ssbatchadmin	ssbatchadmin	25264/32573	12:38 - 10:25 A = ~9hr 45min=585min	1.32 s/site	Y	N, no SHORT_DESC is null check	NA, didn't finish because of archivelog error on server	P

White List Batch Re-Run, Testing (case 5)

Changes made to the plan:

Test	Noted Change or Update in Plan	Change Effected
White List Batch Re-Run	White List Batch script re-run after above change to adding 2006-03-99999 CRN to white-list file	bdonnell validated that no site with CRN 99999 was created, documented in case 1, also samerson validated no additional sites were created from white-list.txt file

Site Functionality Test Results (no case given, included in White List test scenario)

Site Functionality Test Results

Note: Functionality tests covered in case 1 above

Test	User	User Acting As	Page Results	Tool Results	Click Through Results	Order of Pages Results	Tab Results	Pass/Fail
Site 19950176288: Functionality Test Results, white list testcase	bdonnell	admin	x	x	x	x	x	P

Test	User	User Acting As	Page Results	Tool Results	Click Through Results	Order of Pages Results	Tab Results	Pass/Fail
Site 20060660005: Functionality Test Results, white list testcase	smavocet	admin	x	x	x	x	x	P

Course Management in Admin Tools Test Results (no case given, included in White List test scenario, and provider id test scenario)

Course Management Test Results

Note: Course Management tests covered in case 1 above

Test	User	User Acting As	Site Info Tool Navigation	WorkSite Setup Navigation	Site Info Tool	Pass/Fail
Site 19950176288: Course Management Test Results, white list testcase	bdonnell	admin	see above	see above	P

Test	User	User Acting As	Site Info Tool Navigation	WorkSite Setup Navigation	Site Info Tool	Pass/Fail
Site 20060660005: Course Management Test Results, white list testcase	smavocet	admin	see above	see above	P

Test	User	User Acting As	Site Info Tool Navigation	WorkSite Setup Navigation	Site Info Tool
Site w/provider id 2006-03-93327 (3a): Course Management Test Results, provider id testcase	samerson	samerson	P	P	P
Site w/provider id 2006-03-92472 (3a): Course Management Test Results, provider id testcase	samerson	samerson	P	P	P
Site w/provider id 2006-03-83569 (3a): Course Management Test Results, provider id testcase	samerson	samerson	P	P	P
Site w/provider id 2006-03-75796 (3b): Course Management Test Results, provider id testcase	samerson	samerson	P	P	P
Site w/provider id 2006-03-76517 (3b): Course Management Test Results, provider id testcase	samerson	samerson	P	P	P