Personnel:

•    Pete Peterson, QA verification
•     David Woods, QA verification
•    Sandra Stewart, QA verification
•     Anand Metha, Support
•    James Renfro, Gradebook2 programmer.

Communication  

•    server: irc.freenode.net
•    channel: #ucdsakai
•  

During Maintenance Window
Pre Implementation tasks

•     (David Woods) Create RSN ticket and update with verification fix documentation and other documentation of the problem.
•     (James Renfro) Create patch 1.1.4.1 and attach to RSN ticket 8307178.  Notify rSmart of this.
•     (John Bush, rSmart) vendor drop the patch and merge to UCD base code.
•     (Anand Mehta,rSmart) build the code and copy the binaries to the home directory on each server.

During the Implementation rollout (all times are PST)

•     (5:00am, UCD and rSmart) open IRC.
•     (5:01am to 5:10 am, Anand Metha) Place SmartSite in maintenance mode.
•    (5:11 – 5:18, Anand Mehta) will back up the deployed GB2 binaries
•    (5:19 – 5:25, Anand Mehta) will copy the new binaries to Tomcat 
•     (5:26 – 5:30, Anand Metha) Bring up one SmartSite server in maintenance mode for QA verification.

Content and Function Verification Testing

•  (5:31 – 5:45am, Sandra Stewart or Pete Peterson) QA verify that the problem has been fixed as follows:
  • Select screen shots from sak-3151 for coursesite entitled  simple test site - test26 - postpatch - scaling on.jpg
  • Go to course site DLW rSmart testgb1 WQ 2010 on smartsite-Prod.
  •    Verify that value for Course Grade for Sakai Stu4 is F (55.00%).

Vote on our readiness to bring the system back up

•     (5:49 – 5:50, rSmart and UCD) vote on readiness to bring the system back up assuming we’re going forward.  See rollback section for retreating.

Release the system to public

•     (5:51am – 6:00am, rSmart) Bring up rest of SmartSite servers, return to normal mode.
•      (6:01 am – 6:05am, rSmart)  Update RSN ticket to notify SmartSite team that the system is back up.  
•    (6:06 am – 6:15am, UCD)   Change the MOTD and send release management notice to UCD SmartSite Community.

Rollback (system should still be in maintenance mode with one server up)

•    (5:48 am – 6:05 am Anand Metha ), roll back the upgrade by doing the following:
  •    Delete the GB2 binaries from Tomcat)
  •    (Copy the backed up binaries to Tomcat)
•    (6:06 am – 6:15am Sandra Stewart or Pete Peterson) Log in and verify that the fix has been removed by doing the following:
  •        Select screen shots from SAK-3151 entitled simple test site - prod - prepatch - scaling on .jpg for original values.
  •     Open course site DLW rSmart testgb1 WQ 2010 smartsite-Prod.  Go to Gradebook.
  •     Verify that value for Course Grade Sakai Stu4 has a 100% increase in grade, an A (100.00%) with scaling turned on.
•     (6:16 am – 6:20 am, Anand Metha) Bring up rest of SmartSite servers, return to normal mode.
•     (6:21 am – 6:23am, Anand Metha)  Release application to public.Update RSN ticket that upgrade was rolled back.
•     (6:24am – 6:30am, Sandra Stewart)  Send email notification to our SmartSite community to say the system is back up.  Change MOTD.