SmartSite 2.5.x Upgrade
QA Test Plan - Upgrade 2.4.x to 2.5.x
Directions
- Report the full results of QAQC tests in appropriate sub-story on SAK-1935 (add sub-story if needed):
- Report failures, UFO's and documentation errors in the Reports section below.
- If no failures, UFO's or documentation errors are found please indicate this in the report; ie, "No errors found (plp 7/3/08)", to indicate the status of our QA efforts to date.
Reports
- QA FAILURES- Extraction of failures from testing (sorted by tool or functional area)
details of failures, by tool. for consolidation of all failings from assorted JIRAs. - QA UFOs - Extraction of unexplained functionality and oddities from testing (sorted by tool or functional area)
details of odd results, etc, by tool. for consolidation of all strange results from assorted JIRAs. not failures, but unexpected... - QA DOCnFUTA- Extraction of QA documentation errors and oddities from testing (sorted by tool or functional area)
details of documentation errors (page level, help, etc) by tool. These results will be used to prioritize the documentation fixes and rewrites.
Test Materials
- v2.4.x Regression Tests
- v2.4.x Regression Test Plan (patches) - regression for patches applied to Smartsite 2.4.x
- /wiki/spaces/QAG/pages/98467846 - regression tests for tools on Smartsite 2.4.x
- QAQC Test plan page. will have testing results. will have redundancy w/table at the bottom of this page.
- v2.4.x UCD-specific Code Integration - integration of UCD-specific functionality, such as integrating UCD data providers with course management features and final grade submission
- v2.5.x Validation Tests
- v2.5.x Simple Functionallity Test - preliminary functionality testing to confirm system testing readiness
- v2.5.x Patches (by tool) - patch tests for maintenance and fixes
- v2.5.x Enhancement and Features - new enhancements and features in existing tools or new tools
- v2.5.x New QA Tests* - New tests from Foundations QA site
Jiras and References
- Additional and Informational Links
- Foundation Filters - useful filters at the Foundation jira site
- v2.5.x Foundation Bug Fixes(SAK11267)- list of all bugs fixed in v2.5.x (1200 plus total)
- Smartsite 2.5.x Related Jiras:
Supplemental Legacy Tests and Results from Summer 2007
General v2.4.x Tests
General tests for initial discovery phase after the June 23rd upgrade to Sakai 2.4.x
Jira |
Description |
Test Plan |
Released to QA |
QA Results/Date |
---|---|---|---|---|
Syllabus tool rejects link style attribute |
All QA testers can participate: Verify issue and investigate solutions. |
2/11/08 |
Pass (w/note)/07-02-2008/VOC |
|
Sakai Foundation Vendor Drop to bring us up to R41066 |
All QA testers can participate: TBD - see Vendordropfeb72008.mod.doc for current list |
2/11/08 |
Pass/07-10-2008/VOC |
|
Contact Us presents Category drop down on initial click of Contact Us button in smartsite |
All QA testers can participate: Data updated via JMS in smartsite-test as of now. |
2/09/08 |
PASS/07-02-2008/VOC |
|
Cannot upload grade.csv files in Assignments if they have ^M in them instead of newlines. |
All QA testers can participate: Submitted to QA to identify work arounds for both Mac and PC platforms as well as a recommended way to edit the csv files on both platforms to minimize the risk. |
2/08/08 |
Ongoing/07-11-2008/VOC |
|
Smartsite user reported issues with WebDAV in Resources. QA will test to repeat and verify the issue and report to Kirk. |
QA testers will repeat the actions specified by the user and verify the results. |
smartsite-test 9/24/07 |
Results documented 10/1/07 |
|
This asset documents changes to the sakai database which affect current tools. Primary: Gradebook, Samigo, Assignment, Roster (we use now the UCB roster tool), MesssageCenter (Messages & Forums); and Secondary: Chat, Podcasts |
A test plan will be assigned here to cover additional tools not tested separately in other Jiras. Will be considered a pass if the following Jiras all pass: SAK-858, SAK-870, SAK-876, SAK-926, etc. |
Included in other tests |
Pass 8/17/07 |
|
Retest Resources with a new test document to verify whether the upcoming 2.4.x patch fixes the email notification bug or introduces any new bugs. |
All QA testers can participate. Follow the directions given in General Test Plans for Smartsite 2.4.x#Resources |
sakai-test 7/25/07 smartsite-test 8/1/07 |
Pass 8/13/07 |
|
This test plan includes a series of general tasks to determine if there are any obvious issues with the integration of Gradebook, Assignments, Tests & Quizzes, and Message Center in this release. |
All QA testers can participate. Follow the directions given in General Test Plans for Smartsite 2.4.x#Gradebook-Assignments-Samigo-MC Integration |
sakai-test 7/24/07 smartsite-test 8/1/07 |
Pass 8/6/07 |
|
General UI post-upgrade testing. This is a sub-task of SAK-806: QA Test Plan for SmartSite 2.4.x post-upgrade testing assigned to the QA group. |
All QA testers can participate. General test directions are in the Jira. |
smartsite.ucdavis.edu 6/25/07 |
Closed 7/18/07 |
|
Verify general functionality and specific functions. This is a sub-task of SAK-806: QA Test Plan for SmartSite 2.4.x post-upgrade testing assigned to the QA group. |
All QA testers can participate. General test directions are in the Jira. |
smartsite.ucdavis.edu 6/25/07 |
Closed 7/18/07 |
Sakai v2.4.x patches for Smartsite
Listed here are Foundation patches made to Smartsite after the June 23rd upgrade to Sakai 2.4.x
Jira |
Description |
Test Plan |
Released to QA |
QA Results/Date |
---|---|---|---|---|
|
|
|
|
|
Bug fix for issue where student joined and cannot unjoin courses. This makes new course sites unjoinable on creation. |
Follow the brief test in the jira to test this bug fix. Requires SU access. |
smartsite-test 9/24/07 |
Pass 9/28/07 |
|
QA Test Plan for Site Info as part of the Smartsite 2.4.x HEAD upgrade. |
Includes bug fix testing for Foundation Jiras listed under Site Info and Site Management. There is a(n extremely) rough draft of a Site Info which is probably not useful for this test run - so, try accessing each function in Site Info (Edit Tools, Add Participants, Manage Groups, etc.) When those tests are completed, verify against the list of fixes SIte Info and Site Management for 2.4.x HEAD upgrade. |
smartsite-test 9/19/07 |
Pass 9/28/07 |
|
Test the fix for gradebook error generated on sites which used letter grade entries. This will verify that other courses which used letter grade entry will be functional. |
Access gradebook for sites previously known to generate errors upon saving grades and verify that the grades can be saved successfully now. |
smartsite-test 9/20/07 |
Pass 9/21/07 |
|
Test Chat to confirm tool functionality with the HEAD upgrade. |
Create and respond to a message as a basic test. Check a couple of large volume sites using the QA 2.4.1 Test Plan for Chat |
smartsite-test 9/18/07 |
Pass 9/21/07 |
|
Test Section Info to establish baseline of current functionality and check Foundation fix. |
Run through the beta standard test plan found at: QAQC SmartSite Test Plans. After completing this test, review the list of issues fixed in the HEAD upgrade for the 1 fix to test against. Report any issues with the test to Nancy as this is our first run of this test. |
smartsite-test 9/13/07 |
Pass 9/24/07 |
|
Regression test and test bug fixes for Tests & Quizzes. Some fixes are for Vernon's last name (apostrophes!) |
Run through the standard test plan at QAQC SmartSite Test Plans and then review the "fixes" on the HEAD list. |
smartsite-test 9/13/07 |
Pass 9/28/07 |
|
Due to course management changes, Site Info did not show any students in our early release of HEAD. |
Verify that students are displayed in Site Info. Simple test steps in the Jira. |
smartsite-test 9/12/07 |
Pass 9/18/07 |
|
Test bug fix in HEAD release for Syllabus. |
Test described in the Jira. |
smartsite-test 9/11/07 |
Pass 9/24/07 |
|
Test bug fixes in HEAD release for Messages and Forums. |
Run through both the Messages and Forums tests at QAQC SmartSite Test Plans |
smartsite-test 9/18/07 |
Pass 9/24/07 |
|
Test bug fixes in HEAD release for Gradebook. |
Run through the standard QA_Gradebook.xls test from QAQC SmartSite Test Plans AND the simple Gradebook-Assignments-Samigo-MC Integration test (not including Resources.) |
smartsite-test 9/11/07 |
Pass 9/24/07 |
|
Test bug fixes in HEAD release for Assignments. |
Run through the Assignments test plan at QAQC SmartSite Test Plans |
smartsite-test 9/10/07 |
Pass 9/18/07 |
|
Test bug fixes in HEAD release for Resources and WebDAV. |
Run through the Resources test plan at QAQC SmartSite Test Plans |
smartsite-test 9/10/07 |
Pass 9/14/07 |
|
Our upgrade to 2.4 course management includes pre-selected of tools when an instructor creates a new site. Two of the tools are not in alphabetical order when the course is created with default settings. This fixes the display order on the menu. |
Test plan is to repeat steps 1-3 of CM Tests#Test for Tools options and to verify that when the pre-selected tools are left as the default, they appear in alphabetical order when a course is created. |
7/11/07 |
Pass 7/16/07 Note: Section Info tool is pre-selected now |
UCD-specific User-Interface Test Plans
Test Plans for post-upgrade of Smartsite 2.4.x, summer 2007, to correct text content or other display issues
Jira |
Description |
Test Plan |
Released to QA |
QA Results/Date |
---|---|---|---|---|
Odd mouseover behavior detected on Support & Training page. Previously reported by QA. Will need to be retested when the fix is applied. |
Review the Jira and repeat the mouseover action, especially in the browsers listed. Verify the fix and that no new errors are detected on the screen. |
|
7/2/2008 by SMS. Not a pass but not a priority all now. |
|
Test the migration process for exporting links from a faculty course site and adding them to Smartsite Resources. |
Requires SU capabilities on the test system for MyUCDavis. Run through the QA Test Plan for Content Migration from MyUCDavis. |
bumbus.ucdavis.edu to smartsite-test 10/2/07 |
7/3/2008 by SMS. Pass for migrating a file. |
UCD-specific v2.4.x Code Integration
Tests for UCD-specific code modifications implemented for Smartsite after the June 23rd upgrade to Sakai 2.4.x
Jira |
Description |
Test Plan |
Released to QA |
QA Results/Date |
---|---|---|---|---|
|
|
|
|
|
UCD-specific code to retain a site's information even after deletion to ensure that courses removed in error may be restored. |
Create a course (or use an existing course) and note the content and student activity in the course. In Worksite Setup, select the course and set through the deletion process. When complete, email James at jrenfro@ucdavis.edu and request that he restore your site. Verify that the course content is as it was and there was no loss of instructor or student data. |
|
Pass 7/3/2008 by SMS. I used BIS oo2A A04-A06 FQ 2008. The site was restored and all the data. |
|
New list of default tools for course creation. |
Compare the default selected tools for a new course with those listed in the referring jira SAK-1017. Test details listed in SAK-1089. |
smartsite-test 9/24/07 |
Pass 9/24/07 |
|
Make CM provider aware of new "Open Campus" role. Smartsite roster and other tools will automatically include "Open Campus" or University Extension students. |
The test will be coordinated with Brian Donnelly of Middleware and is currently scheduled Friday, around 10:00am, 9/21/07. Follow the steps listed in: Open Campus Test Plan. |
smartsite-test 9/21/07 |
Pass 9/24/07 |
|
Review and test Mike's Stats queries for Smartsite statistics reporting to system admins. |
Vernon to work on test documentation with Sandra |
|
Not a priority for 2.5.x |
|
Confirm the functionality of the Calculate Final Grades feature after Jon's code change to reset converted blanks to zeros back to blanks. Store test results for comparison with baseline results of SAK-956. |
Repeat Nancy's test |
smartsite-test 8/30/07 |
Pass 8/30/07 |
|
Create a new course site manually using the "Still cannot find your course/section" link. This is a fix to stop the addition of a long URL string and underscores and also to add the course term to the course name. A sample is in the jira. |
Test steps are in the Jira. Make sure you are entering a course - not selecting a course, to test this fix. |
smartsite-test 8/27/07 |
Pass 8/30/07 |
|
Confirm that you can access Resources content without error on both smartsite-test and smartsite. |
Verify that no errors occur when accessing your content or when editing content. Test against content created prior to August 6. |
8/9/07 |
Pass 8/9/07 |
|
Confirm that you can create a course for another faculty member or SU'd as a faculty member. List any issues or problems in course creation with this Jira. Save the SU'd course for an additional test of the Roster tool. |
Any QA tester can complete the first part of the test; the second part requires SU capabilites. |
smartsite-test 8/7/07 |
Pass 8/17/07 Note that 3 bug Jiras were created: SAK902, SAK-909, SAK-913 |
|
Confirm that with this fix an instructor can now see which sections a student is in on the Student Membership screen in Section Info. |
Test on smartsite-test server. SU as an instructor into a multi-section course or create a multi-section course, if needed. Add the Section Info tool if it is not listed on the menu. In Section Info, access Student Memberships. Verify that you can see a section listed for each student and that you can sort by the Combined-Scheduled column. Report your results in the jira. |
7/16/07 |
Pass 7/16/07 |
|
Bug test for Training Site Tool duplicates Support & Training link and gives wrong tools. Unclear if we're to test the bug or the asset, so both Jiras are listed here. |
Use xlogin URL to log in with login/password 'trainer1' to access the Trainer account on smartsite-test. Follow the steps in Test Plan - Site Creation Tool for Trainers#Acceptance Tests. Key issue to verify: the tools generated are correct. |
7/10/07 |
Pass 7/11/07 |
Sakai v2.4.x Enhancements
These tests include the following:
- new features or enhancements we did not have time to test prior to June 23rd upgrade
- new features added post-upgrade, such as Assignments 2.4.x
Jira |
Description |
Test Plan |
Released to QA |
QA Results/Date |
---|---|---|---|---|
Confirm the existing functionality of the Calculate Final Grades feature. Store test results as a baseline of functionality to compare to results after implementing SAK-955. |
this is it and it's different than the one on the JIRA SAK-956 site.nw |
smartsite-test 8/28/07 |
Results documented 10/1/07 |
|
Confirm the new stealthed Roster tool is functional. Because the tool is stealthed, admin access is required to provide the tool to any course. |
All QA testers can perform some of the test. Testers with SU capability can perform the test against a copy of a live course. Follow the test plan at: QA_roster.xls |
smartsite-test 8/17/07 |
Failed 8/17/07 |
|
Confirm Chat is functional - specifically for courses with large Chat message volume. |
Requires QA tester with SU capabilities. Follow the test plan at QA 2.4.1 Test Plan for Chat. |
smartsite-test 8/14/07 |
Failed on Mac OSX/FF 1.5 and 2.0.0.6 on 8/15/07 |
|
Gradebook 2.4.1 testing for categories and weighting. |
Run through the GB 2.5 weighted categories and percentages test and document any issues or oddities with this new feature. |
smartsite-test 8/14/07 |
Pass 8/17/07 Issues noted in report |
|
Standard Gradebook functionality testing. |
Nancy's current draft of a standard Gradebook test: QA_gradebook.xls. |
smartsite-test 8/14/07 |
Pass 8/17/07 Issues noted in report |
|
Nancy discovered an issue on production with the "Show this item" radio button in Resources. Once selected and populated with a date range, the date ranges cannot be unchecked/removed except by selecting the other radio button, and then reselecting "Show this item". |
Verify that this workaround is eliminated in 2.4.1 and that unchecking the date range boxes and saving will remove the date range. |
8/9/07 |
Pass 8/10/07 |
|
Test new features in Assignments to verify and become familiar with latest upgrade enhancements. |
Run through the test steps in QA_assignments.xls |
sakai-test 7/31/07 smartsite-test 8/1/07 |
Pass 8/10/07 Issues noted in report |
|
Verification that using WebDAV on a Mac no longer generates alerts or error messages. |
Brian - specifically check to see if the Mac gives you any alerts or error messages when you upload files via WebDAV. Check SAK-464 for graphics and more details about this problem. We want to verify if the problem has been resolved with the 2.4.x upgrade. |
7/11/07 |
Pass 7/11/07 |
|
Tests & Quizzes section bug. |
Retest the course listed in the bug on smartsite-test or find another course with sections on the test server. Determine whether this bug still occurs. |
7/9/07 |
Not Reproducible 7/10/07 |
|
Tests & Quizzes bug. SAK-86: Mac OSX, Safari: No edit tools for questions created in T&Q*. |
Create an assessment using Mac OSX-Safari and compare the screens and functionality when using Firefox on a Mac. Brian to repeat testing on Safari 3. |
7/02/07 |
7/9/07 Failed |