Setup Sakai Cluster
Tasks and Issues
- Create smartsite-test.ucdavis.edu dns entry, which points at load balancer
- Use IP based balancing
- Does this mean that a given client IP will always connect to the same node or is there some timeout?
If there is a timeout, what is the TTL?
- Does this mean that a given client IP will always connect to the same node or is there some timeout?
- On a node, we need to find a common location for tomcat. Each node will retrieve a "ready to run" tomcat
instance from AFS space and put it on local disk. Right now, tomcat is located in "/ucd/pkg/". Can we
use that location? If not what is the location where the sakai user has "rw" access to? - What is the best way get a copy of the "ready to run" tomcat instance from AFS onto each node's local disk?
- rsync, cp, ..?
Load Balancer
- Name: ?
- IP: ?
- Test Name: smartsite-test.ucdavis.edu pointing at the load balancer
- Setup:
- Sticky session
- WebDAV problem:
- Can we also have IP based balancing?
- Can balancer detect WebDAV requests and only forward them to Head Node?
Nodes
- littlejohn (Head Node: For possible WebDAV workaround)
- walton
- braddock
System (Node) User
- User name: sakai
- Home: /ucd/opt/sakai
AFS staging volume
- /afs/.ucdavis.edu/app/sakai/staging
- /afs/.ucdavis.edu/app/sakai/staging/tomcat
- /afs/.ucdavis.edu/app/sakai/staging/config
- /afs/.ucdavis.edu/app/sakai/staging/src
AFS Content links
- The following soft links need to be created on each node
var/sakai/content --> /afs/.ucdavis.edu/app/sakai/misc/content/smartsite /var/sakai/archive --> /afs/.ucdavis.edu/app/sakai/misc/archive/smartsite /var/sakai/ucd-data --> /afs/.ucdavis.edu/app/sakai/misc/ucd-data/smartsite /var/melete --> /afs/.ucdavis.edu/app/sakai/misc/melete/smartsite/melete /var/meleteDocs --> /afs/.ucdavis.edu/app/sakai/misc/melete/smartsite/meleteDocs /var/uploads --> /afs/.ucdavis.edu/app/sakai/misc/melete/smartsite/uploads /var/samigo --> /afs/.ucdavis.edu/app/sakai/misc/samigo/smartsite
Environment Setup
- /ucd/pkg/jdk1.5.0_09
- Create soft-link: /ucd/opt/java5 --> /ucd/pkg/jdk1.5.0_09
- /ucd/pkg/1.4.2_12
- Create soft-link: /ucd/opt/java --> /ucd/pkg/1.4.2_12
- /ucd/pkg/maven-1.0.2
- Create soft-link: /ucd/opt/maven --> /ucd/pkg/maven-1.0.2
Common Files
- Tomcat
- tomcat/conf/server.xml
- tomcat/webapps/ROOT/index.html
- sakai.properties
- .bash_profile
PATH=/ucd/opt/java/bin:/ucd/opt/maven/bin:$PATH MAVEN_HOME=/ucd/opt/maven CATALINA_HOME=/ucd/opt/tomcat JAVA_HOME=/ucd/opt/java JAVA_OPTS=" -d64 -server -Xmx6144m -Xms6144m -XX:PermSize=128m -XX:MaxPermSize=512m -XX:+UseAdaptiveSizePolicy -XX:GCTimeRatio=49 -Dfile.encoding=utf-8 -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps" export PATH MAVEN_HOME CATALINA_HOME JAVA_HOME JAVA_OPTS
- Start and stop scripts
- ~/bin/start-smartsite.sh
#!/bin/sh JAVA_HOME=/ucd/opt/java5 CATALINA_HOME=/ucd/pkg/apache-tomcat-5.5.17 export JAVA_HOME CATALINA_HOME /ucd/pkg/apache-tomcat-5.5.17/bin/startup.sh
- ~/bin/stop-smartsite.sh
#!/bin/sh JAVA_HOME=/ucd/opt/java5 CATALINA_HOME=/ucd/pkg/apache-tomcat-5.5.17 export JAVA_HOME CATALINA_HOME /ucd/pkg/apache-tomcat-5.5.17/bin/shutdown.sh
- ~/bin/start-smartsite.sh