Course Batching QA Test Plan

The automatic course creation mechanism for SmartSite. Course sites, when done automatically via chron jobs, can be created and/or updated in several ways

1. On-Demand List of courses (White list)
   • Will create only a pre-defined list of course sites
   • Not specific to a Term
2. Excluded List of courses (Black list)
   • Will not be created by any mechanism
3. Auto-update of existing course sites with group update (e.g. provider id)
   • Sets existing sites with the assigned provider id value, and will not provision a duplicate site with same provider id from full other batch run

Description = Test the capability of the system to add "on-demand" course sites that are listed in a file. Courses are not required to have any enrollment in order to be created.

Category of Testing = unit, integration,functionality,regression

Prerequisite Steps

1. Scott will add a list of CRNs (valid or not) as the white-list.txt file in /var/sakai/ucd-data folder on the server, in the form of TERMYR-TERMCD-CRN for each entry. Use this file file to use here
2. Scott will que the batch job to run, only for the above list (5 min elapsed time needed)
3. Scott will give maintain permissions on the applicable sites, to the appropriate users

• QA team = look up CRN as instructor for 2006-03-93158
• QA team = look up CRN as instructor for 2006-06-60005
• Scott will assist users in accessing the site(s) if needed
• QA team = look for CRN 20061-06-111, 2006-03-99999
• QA team = look up CRN 2006-sfs-sfsfdfsdfsfsfs

1. Scott will advise testers that the batch has been run and sites have been created
2. Scott and other programmers will monitor server activity while testers are using sakai-test.

Test Scenario

1. Above users will perform functionality testing for each CRN, including :
   **perform functionality test https://confluence.ucdavis.edu:8443/confluence/display/UCDSAKAI/SmartSite+Course+Site+Tests%2C+Site+Functionality+Integration+Test+Results+Matrix for each site
   **perform course management test https://confluence.ucdavis.edu:8443/confluence/display/UCDSAKAI/SmartSite+Course+Site%2C+Course+Management+Integration+Test+Results+Matrix for each site
   **perform provider id test https://confluence.ucdavis.edu:8443/confluence/display/UCDSAKAI/SmartSite+Provider+Id+Update+of+Existing+Sites%2C+Integration+Test+Results+Matrix for each site

• Data to Be Used:

  Scenario	Course	Roster Count	Instructor Kerb Name	Course Details (Catalog Root, Suffix, Section, Description)	Term Identifier	Test Case Used In	File Associated
  Invalid CRNs
  Invalid CRN (Number)	20061-06-111	NA	NA	NA	NA	White List	white-list.txt
  Invalid CRN (Number)	2006-03-99999	NA	NA	NA	NA	White List	white-list.txt
  Invalid CRN (Bogus Text)	2006-sfs-sfsfdfsdfsfsfs	NA	NA	NA	NA	White List	white-list.txt
  *additional data (see attachment),may used for this testing* Invalid CRN (Number) available	2006-03-67952	10 (all valid knames)	shershow (Scott Shershow)	CRI 200B 002 Problems in Crit Theory	Spring Quarter 2006	White List	white-list.txt
  Valid CRNs
  CRN with no enrollment	2006-03-93158	10 (all valid knames)	klradke (Kathryn Radke)	SAS 197T 001 Tutoring Sci & Society	Spring Quarter 2006	White List	white-list.txt
  CRN with enrollment	2006-06-60005	11 (all valid knames)	acham (Christine Acham)	AAS, 198, S01, Directed Gp Study	Summer Special Session 2006	White List	white-list.txt
  CRN with enrollment	2006-03-93307	large enrollment (all valid knames)	fzvasili (S Spyridakis)	HIS 111C 001 Ancient History	Spring Quarter 2006	White List	white-list.txt,black-list.txt

Test Cleanup

1. Scott will remove all sites created in this step when all test cases are completed.

Description = Test the capability of the system to not add course sites that are listed in a file. Courses in this list will never be batch created.

Category of Testing = unit, integration, functionality,regression

Prerequisite Steps

1. Scott will add a list of CRNs (valid or not) to the white-list.txt file in /var/sakai/ucd-data folder on the server, in the form of TERMYR-TERMCD-CRN for each entry. This list will be different than that used for the White List Test Scenario. Use this white list
2. Scott will add a list of CRNs (valid or not) to the black-list.txt file in /var/sakai/ucd-data folder on the server, in the form of TERMYR-TERMCD-CRN for each entry. Use this black list file file to use here
3. Scott will que the batch job to run (White List), (5 min time elapse needed)
4. Scott will advise QA team that the batch has been run
5. Scott will monitor server activity while testers are using sakai-test.

-Prerequisite Steps needed for Scenario #2b only (in addition to Scenario #2a steps)-
-# Scott will update existing hand created sites manually (TBD site ids) with an associated CRN as the provider id-

Test Scenarios
*Scenario #2a = Black list consulted when white list batch run is executed*

• QA team = will look for CRN 2006-06-60245 as user admin. This CRN will be listed in the White List files only
• QA team = will look for CRN 2006-01-60001 that is listed both in the white-list.txt and black-list.txt files
• QA team = will look for both CRN 2006-01-40018 that are listed both in the white-list.txt and black-list.txt files
• Scott = view logs, internal sakai db, will look for both CRN 2006-03-82882, 2006-03-83634 that are listed in the black-list.txt files only
• Scott = help as needed
• Data to Be Used:

  Scenario	Course	Roster Count	Instructor Kerb Name	Course Details (Catalog Root, Suffix, Section, Description)	Term Identifier	Test Case Used In	File Associated
  Valid CRNs
  CRN with no enrollment	2006-06-60245	0	fzduts (Dennis Dutschke)	ITA 198 S01 Dir Group Study	Summer Special Session 2006	Black List	white-list.txt
  CRN with large enrollment number	2006-01-60001	84 (all valid knames)	ewlarsen (Eric Larsen)	LDA, 190 , 001, ProSeminar	Winter Quarter 2006	Black List	white-list.txt,black-list.txt
  CRN with enrollment	2006-01-40018	14 (all valid knames)	calymos (Calvin Lymos)	AAS, 154, 001, University Gospel Choir	Winter Quarter 2006	Black List	white-list.txt,black-list.txt
  CRN with enrollment	2006-03-82882	10	ltcmwc (Mark Connelly)	MSC 141 002 Army Mngmt Systems	Spring Quarter 2006	Black List	black-list.txt
  CRN with enrollment	2006-03-83634	10 (all valid knames)	eschang (Ernest Chang)	NPB 141P 001 Res In Physio Adapt	Spring Quarter 2006	Black List	black-list.txt

Description = Test the capability of the system to update existing course sites with associated provider ids. This functionality can be done either in the UI or batch, however we want to
test the ability to run this at any time.

Category of Testing = unit, integration, functionality,regression

Prerequisite Steps
Results Recording Steps summarized in:
**perform provider id test https://confluence.ucdavis.edu:8443/confluence/display/UCDSAKAI/SmartSite+Provider+Id+Update+of+Existing+Sites%2C+Integration+Test+Matrix for each site

1. Scott will add a list of sites and provider ids (valid or not) to the provider-id.txt file in /var/sakai/ucd-data folder on the server, in the form of site id, TERMYR-TERMCD-CRN for each entry. Use this file use file here
2. Scott will que the batch jobs to run, just the provider id que batch run, (5 min time elapse needed)
3. Scott will advise testers that the batch has been run
4. Scott will monitor server activity while testers are using sakai-test.

*Data To Be Used:

Scenario 3a (Batch updates existing sites provider id)
Test Scenario

• QA team = will look for site First Test Course To Be Updated By Batch's providerid and roster, logging in as admin
• QA team = will look for site Second Test Course To Be updated By Batch's providerid and roster, logging in as admin
• QA team= will look for site Third Test Course To Be Updated By Batch's providerid and roster, logging in as admin
• QA team = will validate provider ids and rosters
• QA team = perform manual updates of provider ids
• Scott = help as needed

Scenario 3b (Manual Process Check (update provider ids for sites manually)
Test Scenario
*Scott will have create 3 sites:
First Test Course To Have Manual Provider Id
Second Test Course To Have Manual Provider Id
Third Test Course To Have Manual Provider Id
-# After site First Test Course To Have Manual Provider Id,Second Test Course To Have Manual Provider Id, and Third Test Course To Have Manual Provider Id's provider ids are validated,-

QA will update site First Test Course To Have Manual Provider Id with:
providerId = 2006-03-73656 (10 enrolled)
and site Second Test Course To Have Manual Provider Id with:
providerId = 2006-03-F0001 made up of 2006-03-62179,2006-03-62178,2006-03-62180 (51 enrolled, multi-crn)
and site Third Test Course To Have Manual Provider Id with
providerId = 2006-03-80102 (178 enrolled)

1. Scott and Pat Kava will check all sites rosters based on their associated provider id

Test Cleanup

1. Scott will remove all sites created in this step when all test cases are completed.

Description = Test the capability of the system to add sites with the correct pages, tools, tabs, and look and feel.

Category of Testing = unit, integration, functionality, regression

Prerequisite Steps
Results Recording Steps summarized in:
**perform functionality test https://confluence.ucdavis.edu:8443/confluence/display/UCDSAKAI/SmartSite+Course+Site+Tests%2C+Site+Functionality+Integration+Test+Results+Matrix for each site
looking for expected results
Test Scenario

Test Cleanup

1. Scott will remove all sites created in this step when all test cases are completed.

Description = Test the course management content displayed in admin tools.

Category of Testing = unit, integration, functionality, regression

Prerequisite Steps
Results Recording Steps summarized in:
**perform course management test https://confluence.ucdavis.edu:8443/confluence/display/UCDSAKAI/SmartSite+Course+Site%2C+Course+Management+Integration+Test+Results+Matrix for each site
looking for expected results

Test Cleanup

1. Scott will remove all sites created in this step when all test cases are completed.