Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

During maintenance window

S = maintenance window + 30 mins

  • (S - 10 min + 0m Programmer) Put all application servers into maintenance mode and shutdown Sakai on each one
  • (S + 1m DBA) Run SQL script TBD to modify external DB
  • (S + 0m 10m Programmer) Deploy sakai release tag via setup-sakai-node.sh to sakaiprod1 and restart sakai instance
    No Format
    ~/config-staging/stop.sh
    jps
    [verify that sakai instance is down]
    ~/config-staging/setup-sakai-node.sh
    cd $CATALINA_HOME/logs
    ~/config-staging/start.sh ; tail -f catalina.out
    [wait until server has started up successfully]
    
  • (S + 20m 17m QC) Verification
    • Use ANT 001, Section A01 for Open Campus students.  Check to verify student Webb Derek and Wong Rainbow are no longer identified as Open Campus on Site Info but are flagged with OC on the roster.
    • Use site UWP 101 011 SQ 2009 to observe the affect of removing removing the option for manually managed sections has on a site that currently is making use of this option.
    • Observe other sites to verify that the option to manually manage sites has been removed.
    (S + 30m
    • TBD
  • (S + 25m Programmer) Deploy release tag via setup-sakai-node.sh to sakaiprod2 . . . sakaiprod6, and sakaiprodmail1.
  • (S + 40m 35m Programmer) Start Sakaiprod2 . . . sakaiprod6, and sakaiprodmail1.
  • (S + 45m 38m Programmer) Take smartsite-prod out of maintenance mode 
  • (S + 50m 45m Sandra) Send Release Management email

Fall-back Procedure (If needed) Time D is the decision time made to fallback

  • (D + 0m DBA) No clue on rolling back Mview change
  • (D + 0m Programmer) Shutdown Sakai on smartsite-prod and clean out catalina staging
    No Format
    ~/config-staging/stop.sh
    jps
    [verify that sakai instance is down]
    ~/config-staging/tomcatclean.sh
    
  • (D + 2m Programmer) On sakaiprod1 remove sakai.properties from config-staging and rename sakai.properties.023 to sakai.properties
    No Format
    cd ~/config-staging
    rm sakai.properties
    rm toolOrder.xml
    cp sakai.properties-prod-023 sakai.properties
    cp toolOrder.xml-prod-023 toolOrder.xml
    
  • (D + 4m Programmer) Run mvn sakai:deploy from previous tag directory
    No Format
    cd ~/src/sakai_2-5-x-prod-023024
    mvn sakai:deploy
    
  • (D + 15m Programmer) Deploy previous tag on head node and restart sakai
    No Format
    ~/config-staging/setup-sakai-node.sh
    cd $CATALINA_HOME/logs
    ~/config-staging/start.sh ; tail -f catalina.out
    
  • (D + 25m QC) Verify correct version of sakai is running on head node
  • (D + 40m Programmer) Run setup-sakai-node.sh and restart sakai on remaining nodes
  • (D + 50m Programmer) Take application servers out of maintenance mode