...
Test | User Role | User Acting As | Result | Expected Result | Pass/Fail |
|---|
Site xxxxx (created): Functionality Results | samerson | fzolupon | All tests pass | batching of course succeeded | P |
Site xxxxx (created): Course Management Test Results | samerson | QA Admin | All tests pass | course content correct | P |
Site xxxxx (created): Provider Id Test Results | samerson | QA Admin | All tests pass | provider id correct, roster number correct | P |
or..
Test | User Role | User Acting As | Result | Expected Result | Pass/Fail |
|---|
Site xxxxy (not created):Test Results | samerson | QA Admin | All tests pass, not provisioned | course not created, correct | P |
...
Black List Test Results
Would yield an example Summary Test Result of:
Test | User Role | User Acting As | Result | Expected Result | Pass/Fail |
|---|
Site xxxxy (not created):Test Results | samerson | QA Admin | All tests pass, not provisioned | course not created, correct | P |
...
| Note |
|---|
| title | Update existing sites with appropriate provider id, enabling dynamic rosters (**When CourseManagementProvider enabled**) |
|---|
|
Description = Test the capability of the system to update existing course sites with associated provider ids. This functionality can be done either in the UI or batch, however we want to
test the ability to run this at any time. Category of Testing = unit, integration Prerequisite Steps
Results Recording Steps summarized in:
**perform provider id test https://confluence.ucdavis.edu:8443/confluence/display/UCDSAKAI/SmartSite+Provider+Id+Update+of+Existing+Sites%2C+Integration+Test+Matrix for each site - Scott will add a list of sites and provider ids (valid or not) to the provider-id.txt file in /var/sakai/ucd-data folder on the server, in the form of site id, TERMYR-TERMCD-CRN for each entry. Use this file use file here
- Scott will que the batch jobs to run, just the provider id que batch run, (5 min time elapse needed)
- Scott will advise programmers that the batch has been run
- Thomas and Scott will monitor server activity while testers are using sakai-dev.
*Data To Be Used: Scenario | Course | SiteId or Title | Instructor Kerb Name | Course Details (Catalog Root, Suffix, Section, Description) | Term Identifier | Test Case Used In | File Associated |
|---|
InValid CRNs | No CRN (null CRN value) | null | NA | NA | NA | NA | Provider Id | provider-id.txt | Valid CRNs and Sites | CRN valid | 2006-03-93327 | Scott's Test Course To Be Provided | stenzel (John Stenzel) | MST 020C A02 Late Med & Early Modern (roster=10) | Spring Quarter 2006 | Provider Id | provider-id.txt | CRN valid | 2006-03-92472 | A Second Course To Be updated By Batch | paully (Paul Manriquez) | WLD 910 001 Wkload - Math Pre 16A (roster=10) | Spring Quarter 2006 | Provider Id | provider-id.txt | CRN valid | 2006-03-83569 | Third Course Site Example | goldberg (Jack Goldberg) | NPB 101 001 Systemic Physiology | Spring Quarter 2006 | Provider Id | provider-id.txt |
Test Scenario - Jon G. = will look for site Scott's Test Course To Be Provided's providerid and roster, logging in as admin
- Sandra = will look for site A Second Course To Be updated By Batch's providerid and roster, logging in as ssbatchadmin
- James= will look for site Third Course Site Example's providerid and roster, logging in as admin (after Jon G. done)
- Brian = will validate provider ids and rosters
- Thomas = view logs, internal sakai db
- Scott = help Sandra, Jon, and log in as himself for manual updates
Manual Process Check (update provider ids for sites manually): - After site Scott's Test Course To Be Provided,A Second Course To Be updated By Batch, and Third Course Site Example's provider ids are validated,
Scott will update site Second Course Site Example with:
providerId = 2006-03-76517
and.. site Third Course Site Example with:
providerId = 2006-03-75796 - Thomas will check site Second Course Site Example and site Third Course Site Example's provider id and rosters
Test Cleanup - Scott will remove all sites created in this step when all test cases are completed.
|
Provider Id Update Test Results
Would yield an example Summary Test Result of (both batch and manual updates):
Test | User Role | User Acting As | Result | Expected Result | Pass/Fail |
|---|
Site xxxxx: Provider Id Update Results | samerson | admin | provider id is ....., roster is same as CRN for provider id | provider id updated and seen in site tool under "provider id", roster reflects provider id roster | P |
...
Site Functionality
borderColor| Note |
|---|
| Note |
|---|
|
Description = Test the capability of the system to add sites with the correct pages, tools, tabs, and look and feel.
Category of Testing = unit, integration, functionality
Prerequisite Steps
Results Recording Steps #ccc| title | | bgColor | efefef |
|---|
| titleBGColor | ffffcc |
|---|
| title | Test Results, Provider Id Update, Batch and Manual |
|---|
| borderStyle | dashed |
|---|
|
Test | User Role | User Acting As | Result | Expected Result | Pass/Fail |
|---|
Site w/provider id 2006-03-93327 : Provider Id Update Results (batch) | ccjon | admin | x | provider id updated and seen in realm tool and site info tool under "provider id", roster reflects provider id roster | P | Site w/provider id 2006-03-92472: Provider Id Update Results (batch) | smavocet | ssbatchadmin | x | provider id updated and seen in realm tool and site info tool under "provider id", roster reflects provider id roster | P | Site w/provider id: 2006-03-83569 Provider Id Update Results (batch) | smavocet | ssbatchadmin | x | no roster appears because provider id invalid | P | Test | User Role | User Acting As | Result | Expected Result | Pass/Fail |
|---|
Site xxxxx: Provider Id Update Results (manual) | samerson | samerson | x | provider id updated via realm edit with accurate data, that from provider id of site yyyyy (provider id=) | P | Site yyyyy: Provider Id Update Results (manual) | samerson | samerson | x | provider id updated via realm edit with accurate data, that from provider id of site yyyyy (provider id=) | P |
|
Site Functionality
|
Description = Test the capability of the system to add sites with the correct pages, tools, tabs, and look and feel. Category of Testing = unit, integration, functionality Prerequisite Steps
Results Recording Steps summarized in:
**perform functionality test https://confluence.ucdavis.edu:8443/confluence/display/UCDSAKAI/Course+Site+Functionality+Tests%2C+SmartSite+Batch+Integration+Testing+Matrix for each site
looking for expected results
Test Scenario | Panel |
|---|
| borderColor | #ccc |
|---|
| bgColor | F7D6C1 |
|---|
| titleBGColor | #efefef |
|---|
| title | Individual Functionality Tests |
|---|
| borderStyle | dashed |
|---|
| - -Look and Feel- *
- Pages *
- Tools on each page *
- Click-through on tools *
- Order *
- Tabs *
|
Test Cleanup - Scott will remove all sites created in this step when all test cases are completed.
|
| Info |
|---|
| borderColor | #ccc |
|---|
| bgColor | white |
|---|
| titleBGColor | efefef |
|---|
| title | Site Functionality Test Results |
|---|
| borderStyle | dashed |
|---|
|
Test | User Role | User Acting As | Page Results | Tool Results | Click Through Results | Order of Pages Results | Tab Results | Pass/Fail |
|---|
Site xxxxx: Functionality Test Results, white list testcase | samerson | admin | x | x | x | x | x | P |
Test | User Role | User Acting As | Page Results | Tool Results | Click Through Results | Order of Pages Results | Tab Results | Pass/Fail |
|---|
Site xxxxx: Functionality Test Results, white list testcase | smavocet | admin | x | x | x | x | x | P |
Test | User Role | User Acting As | Page Results | Tool Results | Click Through Results | Order of Pages Results | Tab Results | Pass/Fail |
|---|
Site xxxxx: Functionality Test Results, white list testcase | ccjon | admin | x | x | x | x | x | P |
Test | User Role | User Acting As | Page Results | Tool Results | Click Through Results | Order of Pages Results | Tab Results | Pass/Fail |
|---|
Site xxxxx: Functionality Test Results, white list testcase | tpa | admin | x | x | x | x | x | P |
Test | User Role | User Acting As | Page Results | Tool Results | Click Through Results | Order of Pages Results | Tab Results | Pass/Fail |
|---|
Site xxxxx: Functionality Test Results, white list testcase | bdonnell | admin | x | x | x | x | x | P |
|
...
| Info |
|---|
| borderColor | #ccc |
|---|
| bgColor | white |
|---|
| titleBGColor | efefef |
|---|
| title | Course Management Test Results |
|---|
| borderStyle | dashed |
|---|
|
Test | User Role | User Acting As | Site Info Tool Navigation | WorkSite Setup Navigation | Site Info Tool | Pass/Fail |
|---|
Site xxxxx: Course Management Test Results, white list testcase | samerson | admin | x | x | P |
Test | User Role | User Acting As | Site Info Tool Navigation | WorkSite Setup Navigation | Site Info Tool | Pass/Fail |
|---|
Site xxxxx: Course Management Test Results, white list testcase | smavocet | admin | x | x | P |
Test | User Role | User Acting As | Site Info Tool Navigation | WorkSite Setup Navigation | Site Info Tool | Pass/Fail |
|---|
Site xxxxx: Course Management Test Results, white list testcase | ccjon | admin | x | x | P |
Test | User Role | User Acting As | Site Info Tool Navigation | WorkSite Setup Navigation | Site Info Tool | Pass/Fail |
|---|
Site xxxxx: Course Management Test Results, white list testcase | bdonnell | admin | x | x | P |
Test | User Role | User Acting As | Site Info Tool Navigation | WorkSite Setup Navigation | Site Info Tool | Pass/Fail |
|---|
Site xxxxx: Course Management Test Results, white list testcase | tpa | admin | x | x | P |
|
...