Test Results
The following is a summary of the testing results, and description of any modification(s) to the test plan followed.
Technical details
Refresh times for materialized views were determined to be approximately 3 minutes around 15 past the hour. For example, for the first view to refresh it started around 1.5 minutes before the top of the hour, and the last view to refresh happened 1.5 minutes after the top of the hour.
Time Start/Stop
Time Testing Started:
10:39
Time Testing Ended:
11:16, last refresh
11:30, time stopped
Sequence of events:
Libby and I followed the testing plan, and I notified Thomas once scenario(s) were completed. Scenarios 2,3,4,5,1 were completed. An additional add of a student occured for CRN 80054 after these events because the course was not seen on the Sakai application (due to zero enrollment), as described in Scenario 1 below.
Scenario 1 (drop student from a course):
Libby and I made a modification to this scenario, because the original student (PIDM 2207697) was ineligible to be dropped from the course. The student was an athlete, not registered. So, we modified this scenario so that PIDM 2099488 (Kerb bccarrol) was dropped from CRN 80054 instead.
--This scenario ultimately led to there being no enrollment in CRN 80054, which Brian saw. Libby and I added another student to CRN 80054 so that the course would appear again.
Changes noticed in Sakai at approx 11:30
Scenario 2 (add student to a course):
In this scenario the only modification made was that Libby had to drop an associated class from PIDM 2099488 schedule to resolve a time conflict.
Changes noticed in Sakai at approx 11:02
Scenario 3 (replaced "The Staff" with a real instructor):
No modifications were made to the test plan, however this scenario uncovered a funcationality issue with Sakai.
Issue: Thomas and Sandra noticed that both "The Staff" and the substituted instructor still appeared in the roster information for the course site. After posting a question on the Sakai collab site, I found that this is a functionality issue with the Sakai framework. The changes that should be propogated from an external source (mViews) to the grants (e.g. providers/authZGroupService) are reflected upon login change or a explicit update of the Realm in question. Due to this current functionality, we may have to list this as a known issue until the community can resolve it.
Changes noticed in Sakai at approx 11:02
Scenario 4 (add additional instructor to a course):
Thomas and I modified this scenario so that he would log in to Sakai as admin. This was because PIDM 1964432 did not appear as enrolled in the course, as given by the test scenario. As an admin, he was then able to see that Donald Dudley was added as an instructor.
Changes noticed in Sakai at approx 11:16
Scenario 5 (remove an instructor from a course ):
The prerequisite from Banner is that there is an instructor listed, so Libby and I changed PIDM 170453 as the instructor for the course, to 999999, or the staff.
Changes were reflected in Sakai at approx 11:16
Test Outcome
Overall, the testing went very well. The only hiccup in the testing was Scenario 3, where both "The Staff" and the instructor name appeared in the roster via the Site Info tool in Sakai.