Implementation Plan February 26, 2010

Personnel:

  •    Pete Peterson, QA verification
  •     David Woods, QA verification
  •    Sandra Stewart, QA verification
  •     Anand Metha, Support
  •    James Renfro, Gradebook2 programmer.

Communication  

  •    server: irc.freenode.net
  •    channel: #ucdsakai
  •  

During Maintenance Window
Pre Implementation tasks

  •     (David Woods) Create RSN ticket and update with verification fix documentation and other documentation of the problem.
  •     (James Renfro) Create patch 1.1.4.1 and attach to RSN ticket 8307178.  Notify rSmart of this.
  •     (John Bush, rSmart) vendor drop the patch and merge to UCD base code.
  •     (Anand Mehta,rSmart) build the code and copy the binaries to the home directory on each server.

During the Implementation rollout (all times are PST)

  •     (5:00am, UCD and rSmart) open IRC.
  •     (5:01am to 5:10 am, Anand Metha) Place SmartSite in maintenance mode.
  •    (5:11 – 5:18, Anand Mehta) will back up the deployed GB2 binaries
  •    (5:19 – 5:25, Anand Mehta) will copy the new binaries to Tomcat 
  •     (5:26 – 5:30, Anand Metha) Bring up one SmartSite server in maintenance mode for QA verification.

Content and Function Verification Testing

  •  (5:31 – 5:45am, Sandra Stewart or Pete Peterson) QA verify that the problem has been fixed as follows:

Vote on our readiness to bring the system back up

  •     (5:49 – 5:50, rSmart and UCD) vote on readiness to bring the system back up assuming we’re going forward.  See rollback section for retreating.

Release the system to public

  •     (5:51am – 6:00am, rSmart) Bring up rest of SmartSite servers, return to normal mode.
  •      (6:01 am – 6:05am, rSmart)  Update RSN ticket to notify SmartSite team that the system is back up.  
  •    (6:06 am – 6:15am, UCD)   Change the MOTD and send release management notice to UCD SmartSite Community.

Rollback (system should still be in maintenance mode with one server up)

  •    (5:48 am – 6:05 am Anand Metha ), roll back the upgrade by doing the following:
    •    Delete the GB2 binaries from Tomcat)
    •    (Copy the backed up binaries to Tomcat)
  •    (6:06 am – 6:15am Sandra Stewart or Pete Peterson) Log in and verify that the fix has been removed by doing the following:
    •        Select screen shots from SAK-3151 entitled simple test site - prod - prepatch - scaling on .jpg for original values.
    •     Open course site DLW rSmart testgb1 WQ 2010 smartsite-Prod.  Go to Gradebook.
    •     Verify that value for Course Grade Sakai Stu4 has a 100% increase in grade, an A (100.00%) with scaling turned on.
  •     (6:16 am – 6:20 am, Anand Metha) Bring up rest of SmartSite servers, return to normal mode.
  •     (6:21 am – 6:23am, Anand Metha)  Release application to public.Update RSN ticket that upgrade was rolled back.
  •     (6:24am – 6:30am, Sandra Stewart)  Send email notification to our SmartSite community to say the system is back up.  Change MOTD.