Versions Compared

Old Version 2

changes.mady.by.user Mike Wenk

Saved on

compared with

New Version Current

changes.mady.by.user Thomas Amsler

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migrated to Confluence 5.3

Personnel

  • Programmer is Mike Wenk
  • DBA is Prabhu
  • QC is Sandra

Preparation for production release

  • (Programmer) On local system: copy over sakai, gb2, and properties tags to non-release-candidate version
    No Format
    svn copy https://mware.ucdavis.edu/svn/ucd-sakai/sakai/tags/sakai_2-5-x-prod-025-RC1 https://mware.ucdavis.edu/svn/ucd-sakai/sakai/tags/sakai_2-5-x-prod-025 -m "NOJIRA : Cutting sakai_2-5-x-prod-025 from release candidate 1"
svn copy https://source.sakaiproject.org/contrib/gradebook2/tags/1.1.4-rc1 https://source.sakaiproject.org/contrib/gradebook2/tags/1.1.4 -m "NOJIRA : Cutting 1.1.4 from release candidate 1"
svn copy https://mware.ucdavis.edu/svn/ucd-sakai/sakai-properties/tags/sakai-properties-2-5-x-prod-025-RC1 https://mware.ucdavis.edu/svn/ucd-sakai/sakai-properties/tags/sakai-properties-2-5-x-prod-025 -m "NOJIRA : Cutting sakai-properties-2-5-x-prod-024025 from release candidate 1"
  • (Programmer) On sakaiprod1: backup sakai.properties and toolOrder.xml, export new files, checkout tag, build
    No Format
    cd ~/config-staging
./tomcatclean.sh &
mv sakai.properties sakai.properties-prod-024
mv toolOrder.xml toolOrder.xml-prod-024
svn export https://mware.ucdavis.edu/svn/ucd-sakai/sakai-properties/tags/sakai-properties-2-5-x-prod-025/sakai.properties
svn export https://mware.ucdavis.edu/svn/ucd-sakai/sakai-properties/tags/sakai-properties-2-5-x-prod-025/toolOrder.xml
cd ~/src
rm -rf sakai_2-5-x-prod-023 &
svn co https://mware.ucdavis.edu/svn/ucd-sakai/sakai/tags/sakai_2-5-x-prod-025 > ~/co.log
^Z
bg
tail -f ~/co.log
[wait until tinyurl is checked out]
^C
cd sakai_2-5-x-prod-025
patches/scripts/apply_patches.pl all
mvn install sakai:deploy -Pwith-jsmath > ~/build.log &
tail -f ~/build.log
[wait until build successful]
^C

During maintenance window

S = maintenance window + 30 mins

  • (S - 10 min + 0m Programmer) Put all application servers into maintenance mode and shutdown Sakai on each one
  • (S + 0m 1m DBA) Run SQL script (https://mware.ucdavis.edu/svn/ucd-sakai/ucd-database/branches/sakai_2-5-x/mviews/ucd_cm_enrollmentstatus_mv.sql) to modify external DB
  • (S + 10m Programmer) Deploy sakai release tag via setup-sakai-node.sh to sakaiprod1 and restart sakai instance
    No Format
    ~/config-staging/stop.sh
jps
[verify that sakai instance is down]
~/config-staging/setup-sakai-node.sh
cd $CATALINA_HOME/logs
~/config-staging/start.sh ; tail -f catalina.out
[wait until server has started up successfully]
  • (S + 20m 17m QC) Verification
    • Use ANT 001, Section A01 for Open Campus students.  Check to verify student Webb Derek and Wong Rainbow are no longer identified as Open Campus on Site Info but are flagged with OC on the roster.
    • Use site UWP 101 011 SQ 2009 to observe the affect of removing removing the option for manually managed sections has on a site that currently is making use of this option.
    • Observe other sites to verify that the option to manually manage sites has been removed.
    (S + 30m --QA will use two of the following cases:
    • ANT 001 A01-A23 SQ 2009
      Webb, Derek    dwebb    dwebb@ucdavis.edu
      ANT 120 001 FQ 2009
      Clark, Jonathan    jcdclark    jcdclark@ucdavis.edu
      ARE 112 001 FQ 2009
      Moghbel, Neda    nmoghbel    nmoghbel@ucdavis.edu
      CHE 008A 001 FQ 2009
      Gerken, Alison    aegerken    aegerken@ucdavis.edu
      pol 150 001 sq 2009
      Mckinnon, Tara    tcmckinnon    tcmckinnon@ucdavis.edu
      por 003 001 sq 2009
      Leonard, Michael    maleonard    maleonard@ucdavis.edu
  • (S + 27m Programmer) Deploy release tag via setup-sakai-node.sh to sakaiprod2 . . . sakaiprod6, and sakaiprodmail1.
  • (S + 40m 37m Programmer) Start Sakaiprod2 . . . sakaiprod6, and sakaiprodmail1.
  • (S + 45m 41m Programmer) Take smartsite-prod out of maintenance mode 
  • (S + 50m Sandra) Send Release Management email

Fall-back Procedure (If needed) Time D is the decision time made to fallback

  • (D + 0m DBA) No clue on rolling back Mview change
  • (D + 0m Programmer) Shutdown Sakai on smartsite-prod and clean out catalina staging
    No Format
    ~/config-staging/stop.sh
jps
[verify that sakai instance is down]
~/config-staging/tomcatclean.sh
  • (D + 2m Programmer) On sakaiprod1 remove sakai.properties from config-staging and rename sakai.properties.023 024 to sakai.properties
    No Format
    cd ~/config-staging
rm sakai.properties
rm toolOrder.xml
cp sakai.properties-prod-023024 sakai.properties
cp toolOrder.xml-prod-023024 toolOrder.xml
  • (D + 4m Programmer) Run mvn sakai:deploy from previous tag directory
    No Format
    cd ~/src/sakai_2-5-x-prod-023024
mvn sakai:deploy
  • run previous revision of enrollmentstatus mview DDL
    No Format
    svn export -r7837 https://mware.ucdavis.edu/svn/ucd-sakai/ucd-database/branches/sakai_2-5-x/mviews/ucd_cm_enrollmentstatus_mv.sql
  • (D + 15m Programmer) Deploy previous tag on head node and restart sakai
    No Format
    ~/config-staging/setup-sakai-node.sh
cd $CATALINA_HOME/logs
~/config-staging/start.sh ; tail -f catalina.out
  • (D + 25m QC) Verify correct version of sakai is running on head node
  • (D + 40m Programmer) Run setup-sakai-node.sh and restart sakai on remaining nodes
  • (D + 50m Programmer) Take application servers out of maintenance mode