SmartSite 2.5.x Upgrade
QA Test Plan - Upgrade 2.4.x to 2.5.x
Directions
- Report the full results of QAQC tests in appropriate sub-story on SAK-1935 (add sub-story if needed):
- Report failures, UFO's and documentation errors in the Reports section below.
- If no failures, UFO's or documentation errors are found please indicate this in the report; ie, "No errors found (plp 7/3/08)", to indicate the status of our QA efforts to date.
Reports
- QA FAILURES- Extraction of failures from testing (sorted by tool or functional area)
details of failures, by tool. for consolidation of all failings from assorted JIRAs. - QA UFOs - Extraction of unexplained functionality and oddities from testing (sorted by tool or functional area)
details of odd results, etc, by tool. for consolidation of all strange results from assorted JIRAs. not failures, but unexpected... - QA DOCnFUTA- Extraction of QA documentation errors and oddities from testing (sorted by tool or functional area)
details of documentation errors (page level, help, etc) by tool. These results will be used to prioritize the documentation fixes and rewrites.
Test Materials
- v2.4.x Regression Tests
- v2.4.x Regression Test Plan (patches) - regression for patches applied to Smartsite 2.4.x
- /wiki/spaces/QAG/pages/98467846 - regression tests for tools on Smartsite 2.4.x
- QAQC Test plan page. will have testing results. will have redundancy w/table at the bottom of this page.
- v2.4.x UCD-specific Code Integration - integration of UCD-specific functionality, such as integrating UCD data providers with course management features and final grade submission
- v2.5.x Validation Tests
- v2.5.x Simple Functionallity Test - preliminary functionality testing to confirm system testing readiness
- v2.5.x Patches (by tool) - patch tests for maintenance and fixes
- v2.5.x Enhancement and Features - new enhancements and features in existing tools or new tools
- v2.5.x New QA Tests* - New tests from Foundations QA site
Jiras and References
- Additional and Informational Links
- Foundation Filters - useful filters at the Foundation jira site
- v2.5.x Foundation Bug Fixes(SAK11267)- list of all bugs fixed in v2.5.x (1200 plus total)
- Smartsite 2.5.x Related Jiras:
Supplemental Legacy Tests and Results from Summer 2007
General v2.4.x Tests
General tests for initial discovery phase after the June 23rd upgrade to Sakai 2.4.x
Jira |
Description |
Test Plan |
Released to QA |
QA Results/Date |
---|---|---|---|---|
Syllabus tool rejects link style attribute |
|
2/11/08 |
Pass (w/note)/07-02-2008/VOC |
|
Sakai Foundation Vendor Drop to bring us up to R41066 |
|
2/11/08 |
Pass/07-10-2008/VOC |
|
Contact Us presents Category drop down on initial click of Contact Us button in smartsite |
|
2/09/08 |
PASS/07-02-2008/VOC |
|
Cannot upload grade.csv files in Assignments if they have ^M in them instead of newlines. |
|
2/08/08 |
Ongoing/07-11-2008/VOC |
|
Smartsite user reported issues with WebDAV in Resources. QA will test to repeat and verify the issue and report to Kirk. |
QA testers will repeat the actions specified by the user and verify the results. |
smartsite-test 9/24/07 |
Results documented 10/1/07 |
|
This asset documents changes to the sakai database which affect current tools. Primary: Gradebook, Samigo, Assignment, Roster (we use now the UCB roster tool), MesssageCenter (Messages & Forums); and Secondary: Chat, Podcasts |
|
Included in other tests |
Pass 8/17/07 |
|
Retest Resources with a new test document to verify whether the upcoming 2.4.x patch fixes the email notification bug or introduces any new bugs. |
|
sakai-test 7/25/07 smartsite-test 8/1/07 |
Pass 8/13/07 |
|
This test plan includes a series of general tasks to determine if there are any obvious issues with the integration of Gradebook, Assignments, Tests & Quizzes, and Message Center in this release. |
|
sakai-test 7/24/07 smartsite-test 8/1/07 |
Pass 8/6/07 |
|
General UI post-upgrade testing. This is a sub-task of SAK-806: QA Test Plan for SmartSite 2.4.x post-upgrade testing assigned to the QA group. |
|
smartsite.ucdavis.edu 6/25/07 |
Closed 7/18/07 |
|
Verify general functionality and specific functions. This is a sub-task of SAK-806: QA Test Plan for SmartSite 2.4.x post-upgrade testing assigned to the QA group. |
|
smartsite.ucdavis.edu 6/25/07 |
Closed 7/18/07 |
Sakai v2.4.x patches for Smartsite
Listed here are Foundation patches made to Smartsite after the June 23rd upgrade to Sakai 2.4.x
Jira |
Description |
Test Plan |
Released to QA |
QA Results/Date |
---|---|---|---|---|
|
|
|
|
|
Bug fix for issue where student joined and cannot unjoin courses. This makes new course sites unjoinable on creation. |
|
smartsite-test 9/24/07 |
Pass 9/28/07 |
|
QA Test Plan for Site Info as part of the Smartsite 2.4.x HEAD upgrade. |
Includes bug fix testing for Foundation Jiras listed under Site Info and Site Management. There is a(n extremely) rough draft of a Site Info which is probably not useful for this test run - so, try accessing each function in Site Info (Edit Tools, Add Participants, Manage Groups, etc.) When those tests are completed, verify against the list of fixes SIte Info and Site Management for 2.4.x HEAD upgrade. |
smartsite-test 9/19/07 |
Pass 9/28/07 |
|
Test the fix for gradebook error generated on sites which used letter grade entries. This will verify that other courses which used letter grade entry will be functional. |
Access gradebook for sites previously known to generate errors upon saving grades and verify that the grades can be saved successfully now. |
smartsite-test 9/20/07 |
Pass 9/21/07 |
|
Test Chat to confirm tool functionality with the HEAD upgrade. |
Create and respond to a message as a basic test. Check a couple of large volume sites using the QA 2.4.1 Test Plan for Chat |
smartsite-test 9/18/07 |
Pass 9/21/07 |
|
Test Section Info to establish baseline of current functionality and check Foundation fix. |
Run through the beta standard test plan found at: QAQC SmartSite Test Plans. After completing this test, review the list of issues fixed in the HEAD upgrade for the 1 fix to test against. Report any issues with the test to Nancy as this is our first run of this test. |
smartsite-test 9/13/07 |
Pass 9/24/07 |
|
Regression test and test bug fixes for Tests & Quizzes. Some fixes are for Vernon's last name (apostrophes!) |
Run through the standard test plan at QAQC SmartSite Test Plans and then review the "fixes" on the HEAD list. |
smartsite-test 9/13/07 |
Pass 9/28/07 |
|
Due to course management changes, Site Info did not show any students in our early release of HEAD. |
|
smartsite-test 9/12/07 |
Pass 9/18/07 |
|
Test bug fix in HEAD release for Syllabus. |
|
smartsite-test 9/11/07 |
Pass 9/24/07 |
|
Test bug fixes in HEAD release for Messages and Forums. |
|
smartsite-test 9/18/07 |
Pass 9/24/07 |
|
Test bug fixes in HEAD release for Gradebook. |
|
smartsite-test 9/11/07 |
Pass 9/24/07 |
|
Test bug fixes in HEAD release for Assignments. |
|
smartsite-test 9/10/07 |
Pass 9/18/07 |
|
Test bug fixes in HEAD release for Resources and WebDAV. |
|
smartsite-test 9/10/07 |
Pass 9/14/07 |
|
Our upgrade to 2.4 course management includes pre-selected of tools when an instructor creates a new site. Two of the tools are not in alphabetical order when the course is created with default settings. This fixes the display order on the menu. |
|
7/11/07 |
Pass 7/16/07 Note: Section Info tool is pre-selected now |
UCD-specific User-Interface Test Plans
Test Plans for post-upgrade of Smartsite 2.4.x, summer 2007, to correct text content or other display issues
Jira |
Description |
Test Plan |
Released to QA |
QA Results/Date |
---|---|---|---|---|
Odd mouseover behavior detected on Support & Training page. Previously reported by QA. Will need to be retested when the fix is applied. |
|
|
7/2/2008 by SMS. Not a pass but not a priority all now. |
|
Test the migration process for exporting links from a faculty course site and adding them to Smartsite Resources. |
|
bumbus.ucdavis.edu to smartsite-test 10/2/07 |
7/3/2008 by SMS. Pass for migrating a file. |
UCD-specific v2.4.x Code Integration
Tests for UCD-specific code modifications implemented for Smartsite after the June 23rd upgrade to Sakai 2.4.x
Jira |
Description |
Test Plan |
Released to QA |
QA Results/Date |
---|---|---|---|---|
|
|
|
|
|
UCD-specific code to retain a site's information even after deletion to ensure that courses removed in error may be restored. |
Create a course (or use an existing course) and note the content and student activity in the course. In Worksite Setup, select the course and set through the deletion process. When complete, email James at jrenfro@ucdavis.edu and request that he restore your site. Verify that the course content is as it was and there was no loss of instructor or student data. |
|
Pass 7/3/2008 by SMS. I used BIS oo2A A04-A06 FQ 2008. The site was restored and all the data. |
|
New list of default tools for course creation. |
Compare the default selected tools for a new course with those listed in the referring jira SAK-1017. Test details listed in SAK-1089. |
smartsite-test 9/24/07 |
Pass 9/24/07 |
|
Make CM provider aware of new "Open Campus" role. Smartsite roster and other tools will automatically include "Open Campus" or University Extension students. |
The test will be coordinated with Brian Donnelly of Middleware and is currently scheduled Friday, around 10:00am, 9/21/07. Follow the steps listed in: Open Campus Test Plan. |
smartsite-test 9/21/07 |
Pass 9/24/07 |
|
Review and test Mike's Stats queries for Smartsite statistics reporting to system admins. |
|
|
Not a priority for 2.5.x |
|
Confirm the functionality of the Calculate Final Grades feature after Jon's code change to reset converted blanks to zeros back to blanks. Store test results for comparison with baseline results of SAK-956. |
|
smartsite-test 8/30/07 |
Pass 8/30/07 |
|
Create a new course site manually using the "Still cannot find your course/section" link. This is a fix to stop the addition of a long URL string and underscores and also to add the course term to the course name. A sample is in the jira. |
|
smartsite-test 8/27/07 |
Pass 8/30/07 |
|
Confirm that you can access Resources content without error on both smartsite-test and smartsite. |
|
8/9/07 |
Pass 8/9/07 |
|
Confirm that you can create a course for another faculty member or SU'd as a faculty member. List any issues or problems in course creation with this Jira. Save the SU'd course for an additional test of the Roster tool. |
|
smartsite-test 8/7/07 |
Pass 8/17/07 Note that 3 bug Jiras were created: SAK902, SAK-909, SAK-913 |
|
Confirm that with this fix an instructor can now see which sections a student is in on the Student Membership screen in Section Info. |
|
7/16/07 |
Pass 7/16/07 |
|
Bug test for Training Site Tool duplicates Support & Training link and gives wrong tools. Unclear if we're to test the bug or the asset, so both Jiras are listed here. |
|
7/10/07 |
Pass 7/11/07 |
Sakai v2.4.x Enhancements
These tests include the following:
- new features or enhancements we did not have time to test prior to June 23rd upgrade
- new features added post-upgrade, such as Assignments 2.4.x
Jira |
Description |
Test Plan |
Released to QA |
QA Results/Date |
---|---|---|---|---|
Confirm the existing functionality of the Calculate Final Grades feature. Store test results as a baseline of functionality to compare to results after implementing SAK-955. |
|
smartsite-test 8/28/07 |
Results documented 10/1/07 |
|
Confirm the new stealthed Roster tool is functional. Because the tool is stealthed, admin access is required to provide the tool to any course. |
|
smartsite-test 8/17/07 |
Failed 8/17/07 |
|
Confirm Chat is functional - specifically for courses with large Chat message volume. |
|
smartsite-test 8/14/07 |
Failed on Mac OSX/FF 1.5 and 2.0.0.6 on 8/15/07 |
|
Gradebook 2.4.1 testing for categories and weighting. |
Run through the GB 2.5 weighted categories and percentages test and document any issues or oddities with this new feature. |
smartsite-test 8/14/07 |
Pass 8/17/07 Issues noted in report |
|
Standard Gradebook functionality testing. |
|
smartsite-test 8/14/07 |
Pass 8/17/07 Issues noted in report |
|
Nancy discovered an issue on production with the "Show this item" radio button in Resources. Once selected and populated with a date range, the date ranges cannot be unchecked/removed except by selecting the other radio button, and then reselecting "Show this item". |
|
8/9/07 |
Pass 8/10/07 |
|
Test new features in Assignments to verify and become familiar with latest upgrade enhancements. |
|
sakai-test 7/31/07 smartsite-test 8/1/07 |
Pass 8/10/07 Issues noted in report |
|
Verification that using WebDAV on a Mac no longer generates alerts or error messages. |
|
7/11/07 |
Pass 7/11/07 |
|
Tests & Quizzes section bug. |
|
7/9/07 |
Not Reproducible 7/10/07 |
|
Tests & Quizzes bug. SAK-86: Mac OSX, Safari: No edit tools for questions created in T&Q*. |
|
7/02/07 |
7/9/07 Failed |