v2.4.x Regression Test Plan (patches)

v2.4.x Regression Test Plan (patches)

2.4.x Regression Test Plan (patches)

All associated test assets are linked to this topic.

Foundation Jiras included in 2.4.x Head upgrade per Thomas Jira list and first Jira list with titles and second Jira list with titles

Tools to be tested for this update include:
#Assignments
#Schedule
#Chat
Resources: #Citations (in Resources), #Resources, #Resources (metaobj)
#Gradebook
#Messages and Forums
#Podcasts
#Tests and Quizzes (Samigo)
#Sections
#Site Info
#Syllabus

Announcements

No Jira asset - no testing required.

Module Name: announcement

Jira

QA Test

Description

Jira

QA Test

Description

sak-8977

N/A

Update (Simplified) Chinese Translation for Sakai 2.4

sak-8464

N/A

Announcements i18n (internationalization) notifications and tool properties revision

sak-9641

N/A

Update Spanish Translation for Sakai 2.4.x

Assignments

Jira test asset SAK-1000

Module Name: assignment

Jira

QA Test

Description

Jira

QA Test

Description

sak-8977

N/A

Update (Simplified) Chinese Translation for Sakai 2.4

sak-9641

N/A

Update Spanish Translation for Sakai 2.4.x

sak-9935

N/A

Update Japanese translation for 2.4.x

sak-10683

Yes

Assignment tool corrupted .doc files. When using the "Download All" functionality of assignments, an attached .doc file was corrupted upon re-upload. This corruption appeared to only affect .doc files.
this is the problem discovered by our current assignments test (item 1.23), used in sak-876, as reported in my chapter 75.  nw
Verified as corrected. LJW

sak-9112

Yes

Grades, Inline, and Comments missing from upload. After upload, grades can be seen for each student listed in the page where you see the list of students and their grades for an assignment, but when clicking on an individual student, one doesn't see their grade or any of the inline or extra comments that had been added off line. I cannot verify these issues are fixed. Team will retest. LJW 9/14/07

sak-10806

N/A

Event asn.read not logged for Student/access role

sak-11232

N/A

Incorrect vm file reference in assignments. In chef_assignments_student_view_assignment.vm there is a reference to the vm file chef_assignment_tags_list.vm. That file does not exist. The reference should be to chef_assignments_tags_list.vm.

sak-9634

Yes

If one edits an assignment that had been associated to a gradebook entry, the drop down for association shows "Select a gradebook entry" instead of the already associated entry.
in editing an assignment that's associated w/a gradebook item ...MY version shows the dropdown defaulted to the correct GB assignment, with the rest of the GB items also in the dropdown (if you want to change the association, I suppose).  nw
This is expected behaviour - which does not work on production, so this fix is functioning properly. LJW

sak-11267

Yes

NPE in AssignmentAction.build_student_view_submission_confirmation_context. Seems like the submission object's submit time was recorded as "null." Since once the student sees the confirmation page, he must have just completed the submission... there should be a recorded submission time.
Non-repeatable error and not enough detail in jira- cannot verify fix. LJW

sak-11283

Yes

Previewing assignment showed all buttons as inactive. A student reported the following problem: "I had a problem submitting today. After I uploaded, I hit "preview". I ended up with all buttons dimmed and nowhere to go! I logged out and re-uploaded and it worked ok (no preview this time)." Upon further investigation, it appears that he was previewing an assignment that he was resubmitting.
on smartsite-test - ran through this as student.  worked fine for me, but there was an oddity.  for the INITIAL submission, the original status was not started and when submitted for the FIRST time, status changed to RE-submitted.  I had not previewed at this point, because above says the problem was with re-submission.  as IOR, graded and allowed re-submission.  as student, updated assignment, previewed, all buttons were active and re-submit worked fine.  repeated grading and submitted multiple times.  worked each time.  nw
on production - creation, preview, initial submission, re-submission all work as expected.  additionally, status reflects reality and buttons are appropriately labeled.
Per Nancy's report, it appears there are no functional change with this fix. LJW

SAK-11180

N/A

Assignment event tracking needs revision. Assignments is currently logging too many events of "asn.read.assignment" (EVENT_ACCESS_ASSIGNMENT).
When an Instructor or TA views the list of submissions for an assignment, all the assignments submissions are read, and one event is logged for every submission. For large sites, this can lead to huge numbers of events being logged.
Our production stats show that asn.read.assignment is the 3rd-most frequent event (42021 events in 24 hours).
OTOH EVENT_ACCESS_ASSIGNMENT_SUBMISSION which you'd expect to see logged if a TA/Instructor clicks through to a specific assignment is not logged at all.
Assignment event logging needs to be reviewed urgently, as this is a performance issue for large sites.
The QA for this should involve carrying out a number of typical operations as a student, TA and lecturer in a course site with existing assignments with submissions (say an assignment with 100 submissions) and examining the event log records in SAKAI_EVENT that result.
The event tracking lines are commented out. Fixed in r34693 for trunk, and merged into post-2-4 in r34694.
And merged into 2-4-x in r34704.
Further fix to remove the asn.read log from the Assignment tool is checked in as r34841 for trunk, r34847 for 2-4-x and r34849 for post-2-4.
Logging issues will not be tested by QA team. LJW

Blog

No Jira asset - no testing required.

Jira

QA Test

Description

Jira

QA Test

Description

sak-10734

N/A

Bad Jira. We are stealthing this tool and will not test it.

Schedule

Jira test asset pending

Module Name: calendar

Jira

QA Test

Description

Jira

QA Test

Description

sak-10590

???

1. Event A is created in Schedule in site X 2. Schedule is removed in site X 3. Accessing the event in (another site) generated the Null Pointer Exception error 4. Adding the Schedule tool again in site X fixes it

sak-8977

N/A

Update (Simplified) Chinese Translation for Sakai 2.4

sak-9673

N/A

Several i18n properties files have invalid or duplicate locales.

sak-9641

N/A

Update Spanish Translation for Sakai 2.4.x.

sak-10734

???

Bad Jira.

sak-11078

Yes

Schedule (Calendar) tool - critical performance issues. Extreme slowdown with the schedule tool in a production environment, especially for student's My Workspace schedule. Rendering a week with zero events takes over 20 seconds, perhaps all schedule events that have ever taken place are being loaded from the db on each view? Performance is also terrible in course sites with lots of schedule events (again, even if you are viewing a month with no events on it, but the course has had many events in the past). Problem is most noticeable with several hundred calendar events, which I was able to test by importing several years worth of Outlook or Meeting Maker exported events. Fixed by leveraging SQL to get events within specified time range. This should be tested/verified with an Oracle database (my testing used MySql).

sak-11213

Yes

Calendar uses wrong format in date select.

sak-11204

Yes

Schedule (frequency not working). Newly created events with frequency only display once. Existing events with frequency only display once. Note: in this particular case the problem appears to be human error. The instructor was misinterpreting the frequency settings so instead of once a week for 16 weeks, she was asking for once every 16 weeks. The confusion is by selecting 'weekly" the instructor still needs to select the period as 1 week.

SAK-10599

Yes new 9/10/07

Orphan events are visible in CalSum (Calendar Summary). Schedule events are displayed in CalSum after removing the Schedule tool in which they were created.
These (orphan) events should not be visible.

SAK-11286

Yes new 9/10/07

Inactive sites should not send entries to the synopsis calendar. If a user decides to make a site inactive (My Workspace - Preferences - Customize tabs), then entries from that site's calendar should not continued to be displayed on the calendar in My Workspace. This corrected behaviour will make Calendar consistent with Messages which already does this.

Chat

Jira test asset pending

Module Name: chat

Jira

QA Test

Description

Jira

QA Test

Description

sak-8977

N/A

Update (Simplified) Chinese Translation for Sakai 2.4

sak-9641

N/A

Update Spanish Translation for Sakai 2.4.x

sak-9935

N/A

Update Japanese translation for 2.4.x

sak-10734

???

Bad Jira.

sak-10969

Yes

Chat scrolls the browser window to the bottom right corner on page load. "Note: Make your browser window small, something 800 by 600 for maximum impact of the bug. Steps to reproduce: 1. Click on Chat Room in the Tool List. 2. Observe: The focus will move to the message textarea, and the browser window will scroll to the bottom of the page.
Unfortunately this loses the context for the page. This is especially funky in the Berkeley bSpace skin where we lose the left side of the skin as well as the top.
Seems that this is a combination of the setFocus() function and the setMainFrameHeight() function. Because setMainFrameHeight() has a delay in it, it gets called after setFocus(). Because it's getting called after setFocus() it's picking up an unnecessary scroll for the frame.
Additionally, it appears that setFocus is being called by both the room frame and the roomControl frame. I don't know if this is having an effect or not on the bug. setMainFrameHeight() is also be called on both frames, but that might be necessary."

sak-10424

N/A

Chat2 tool has some extra and confusing source code.
Simply verify that Chat still works - regression testing. LJW

sak-8678

???

Work on Conversion/Migration of legacy chat data into new schema. "The migration code is in place."

Citations (in Resources)

Jira test asset SAK-999

Module Name: citations

Jira

QA Test

Description

Jira

QA Test

Description

sak-9671

N/A

Citations i18n issues. Special characters not displayed. However, "it's not a citations trouble. It was a Tomcat bad configuration trouble." No bug in Sakai software per se!

sak-9641

N/A

Update Spanish Translation for Sakai 2.4.x

sak-9935

N/A

Update Japanese translation for 2.4.x

sak-11143

N/A

autoddl for Citations causes schema errors on repeated restarts. If autoddl is set to true, on repeated restarts of tomcat, each restart inserts all schema fields again. Over a period of time, each field will be duplicated multiple times - once for each time the server has been restarted. This is not generally a problem in production because autoddl is turned off. It is mostly a problem for developers who restart frequently. Proposed solution (revision 34009): drop schema tables if they already exist.

sak-11153

N/A

Citations Helper uses Oracle LONG and LONG RAW datatypes (obsolete). Can we replace LONG with CLOB, LONG RAW with BLOB? Yes! Done, this has been merged to 2.4.x and post-2.4.

Programming Issue

No Jira asset - no testing required.
Module Name: component

Jira

QA Test

Description

Jira

QA Test

Description

sak-10097

N/A

Spring 1 programming issue. General regression testing will test this change. LJW

Resources

Jira test asset SAK-999

Module Name: content

Jira

QA Test

Description

Jira

QA Test

Description

sak-9365

Yes

WebDAV instructions not provided to users unless they have site.revise permissions. The "Upload-Download Multiple Resources" link in the Resources tool is only displayed if a user has site.revise permissions.
Test by confirming that WebDAV works in My Workspace. LJW

sak-10428

Yes

Performance issues listing resources when there are a large number of resources in a folder.
No performance testing due to RAC issues. LJW

sak-10308

Yes

Resources: upload new version email. When a user goes in and uploads a new version of the file, there is not an option to not email everyone in the site, or to email everyone. But when you do change it, it does email everyone in the site. Need to be able to let the person decide whether to email everyone or not. Users greatly notice notifications not being sent out when they want them and notifications being sent out when they don't want them...fixed  nw

sak-10356

Yes

Resources: email notifications. The resource tool is not sending out emails when setting priority on high.For initial creation of an item, appropriate notifications (high, low, none) are being sent for:

  • file uploads

  • txt documents

  • html documents

  • urls
    Uploaded a new version for the following, appropriate notification was sent for:

  • file uploads

  • txt documentation

  • html documentation
    Tested 'Editing Content' and always received notification for the following types:

  • html pages

  • txt documents

  • urls
    ...fixed to here EXCEPT after e-mail is sent out, notification defaults to NONE.
    do we have the forms option??  nw
    Forms - no notification is ever sent.
    To test this one needs to add the Forms tool to the site, select an xsd file (I used one called feedback that I will attach) and publish it to the site. After that, you will be able to create a form item within resources. I created three - one to send out high notification, one for low and one for none. As I stated above, I have not received any notification.
    Citations - no notification ever received.
    To be fair, I was having trouble just creating a citation list. Each time I attempted to create a new citation I would receive an exception, however a list appeared to be created. As for notifications, I was only able to go in to test by 'Editing Details' and setting the notification to high. |

sak-3790

N/A

The language of the File Selection Helper should be more configurable.

sak-10568

Yes

Notifications always sent when revising content for text, html and url resources. Tested 'Editing Content' and always received notification for the following types:

  • html pages

  • txt documents

  • urls
    ...fixed  nw

sak-10579

Yes

Notifications widget appears when revising content for text, html and url resources. ...fixed  nw

sak-10021

Yes

DropBox Performance Problems. The response Time of the Dropbox tool for medium-large sites is very slow. On our test it was:

  • With a course of 600 students it took 5 minutes to reply and the IE needed 100Mb of RAM.

  • With a course of 370 students it took 3 minutes to reply and the IE needed 80Mb of RAM.

  • With a course of 180 students it took 2.5 minutes to reply and the IE needed 65Mb of RAM.

  • With a course of 50 students it took 35 sec to reply and the IE needed 35Mb of RAM.
    No performance testing due to RAC issues. LJW

sak-8977

N/A

Update (Simplified) Chinese Translation for Sakai 2.4

sak-9641

N/A

Update Spanish Translation for Sakai 2.4.x

sak-9935

N/A

Update Japanese translation for 2.4.x

sak-6976

Yes

WebDAV does not recognize UTF-8 characters (I18N). WebDAV does not correctly represent pathnames (filenames and directory names) with UTF-8 characters. This affects file uploads, downloads and access ... (resource-file-name) as well.
Testing:
1. Create both ascii & unicode test files, e.g. test.doc ¿¿¿¿.doc Español .doc
2. Verify files can be viewed, downloaded, and revised from Resources tool
3. Verify files can be viewed, downloaded and revised from WebDAV client
4. Set the copyright notice on the files and again verify files can be viewed, downloaded & revised from Resources tool. (note WebDav does not currently recognized copyright restrictions - this should be written up separately if desired)
5. Verify above with both Mozilla and MS IE browsers (Note: Windows O/S needs to support the specified language before testing).

sak-10145

N/A

Resources can not be seen in admin resources area. Admin users must test. Unable to verify any difference between test and production functionality. LJW

sak-8449

N/A

NPE in buildMainPanelContext

sak-10359

N/A

exceptions thrown when accessing resources tool. Noted as not repeatable. LJW

sak-10614

N/A

Null pointer exception editing details of top-level folder for site with copied resources. Noted as not repeatable. LJW

sak-10737

Yes

Adding Resources tool after site setup causes blank root folder name in revise details.
Create a site, but do not add Resources.
Add resource via Site Info.
Attempt to Edit Details on the root Resources folder (e.g. to reset the quota).
You get an error that cannot be resolved because the folder name is both locked and empty.
However, once the user clicks cancel from that screen, the root resource folder name will be auto assigned.
...fixed  nw  but reset the quota is not an option for me??

sak-10290

Yes

Resources: cognitive mismatch with implementation of copy and paste functionality. Our users have reported that the implementation of the copy and paste functionality requires a mental shift. The users choose to copy an item from the action menu and so they expect to paste the item using the same action menu. When they are unable to do so, they then search and find the paste icon that has been added next to the add menu. If we were to include paste on the action menu and only make it selectable when the copy action has been invoked, this would be in line with the way operating systems such as the Mac OS and Windows handle copy and paste. Is it feasible to use this familiar approach rather than what is currently implemented?
Desired action:

  • After copying a resource, a 'Paste' option should appear at the top of the 'actions' list, above 'Copy'.

  • The paste icon should continue to appear where it is as an alternative.
    ...fixed nw