Implementation Plan September 19, 2009

Personnel

  • Programmer is Thomas Amsler
  • QC is Sandra
  • DBA is Prabhu

Preparation for production release

During maintenance window

S = maintenance window + 30 mins

  • (S - 10 min ProjManmgt) Set database marker.
  • (S - 5 min Programmer) Put all application servers into maintenance mode and shutdown Sakai on each one
  • (S + 5m Prabhu) Backup the full database
  • (S + 35m Prabhu) Apply DB scripts (These are both alter table commands)
  • (S + 40m Programmer) Deploy sakai release tag via setup-sakai-node.sh to sakaiprod1.
  • (S + 45m Programmer) Restart sakaiprod1 sakai instance
  • (S + 50m QC) Verification
    • Verify that letter grading IS an option for Gradebook 2. (This is a change as of 9/18/2009 per Liz Gibson)
    • Verify that port 8443 does not appear in the url.
    • Verify that student view is the new spiffy one as evidence that the correct version of gb2 was rolled to prod.
    • Kirk to Change options on several sites to enable point mode scaling for categories to be consistent with GB 1.  No need to wait for him, he will login around 6:00 a.m. and can do this work while the rest of the deployment proceeds.
  • (S + 70m Programmer) Deploy release tag via setup-sakai-node.sh to sakaiprod2 . . . sakaiprod6, and sakaiprodmail1.
  • (S + 80m Programmer) Start Sakaiprod2 . . . sakaiprod6, and sakaiprodmail1.
  • (S + 85m Programmer) Take smartsite-prod out of maintenance mode 
  • (S + 90m Sandra) Send Release Management email

Fall-back Procedure (If needed) Time D is the decision time made to fallback

  • (D + 0m Programmer) Shutdown Sakai on smartsite-prod
  • (D + 2m Prabhu)  Restore the following tables:
    • GB_GRADEBOOK_T
    • GB_CATEGORY_T
  • (D + 2m Programmer) Remove sakai.properties from config-staging and rename sakai.properties.020 to sakai.properties
  • (D + 4m Programmer) Run mvn sakai:deploy from previous tag directory
  • (D + 15m Programmer) Deploy previous tag on head node and all other app servers via setup-sakai-node.sh
  • (D + 20m Programmer) Restart sakai on head node
  • (D + 25m QC) Verify the database marker is in place
  • (D + 40m Programmer) Restart sakai on remaining nodes
  • (D + 25m Programmer) Take application servers out of maintenance mode