MyUCDavisCourseWebsiteExport
MyUCDavis Course Website Resource Export Tool
Jira: SAK-209
The purpose of this project is to create a tool to allow faculty to migrate their existing course website materials from the MyUCDavis course management system (cms) to the Resources section of the UC Davis implementation of Sakai.
#Background
#Out of Project Scope
#Analysis
Glossary Export
#Design
#Releases - #Release for Links as HTML download
Website Export Screen shots
#Download Stats
Background
IET intends to move faculty and staff using the MyUCDavis cms to using a UC Davis Sakai implementation by Winter 2007. MyUCDavis is a custom-coded, locally-supported ColdFusion application, while Sakai is an open source, collaborative Java application.
To encourage faculty to adopt the new cms, it is imperative that we enable course content migration for both faculty and support staff. Migration must be a smooth and opaque process for faculty. It is also desirable that the migration be consistent with existing functionality in Sakai and be well documented for ease of use by faculty and staff.
Out of Project Scope
The following issues are out of scope of this project:
Migration of Gradebooks
Migration of Quizzes
Migration of Discussion Boards, Chatrooms, Course Email Lists, or Announcements
Analysis
Analysis of Course Website usage data was completed to determine the scope and character of resource content.
Given that Course Website content will be exported in file form, it will be directly compatible with the current Sakai resources tool.
MyUCDavis Course Website Usage Analysis
As of 8/8/2006 there are 10,453 course sites that have resources created in the MyUCDavis Course Website Builder, comprising 221,029 distinct resources. The breakdown of content by type is:
Folders: 28,239
Links: 14,758
Glossaries: 264
Text Files: 4,765
Html Files: 5,941
Uploaded Files: 166,008
PDF Files: 83,346
Word Documents: 46,907
Excel Files: 2,775
Powerpoint Files: 13,989
Images: 7,098
Other Files: 11,893
As of 12/18/06, there are 1685 distinct users in the page_metadata table. The majority represent WebSite Builder users. A list of users from the dev/test system is available for testing on request.
File Size Data Analysis
As of 3/14/07, there are 11,562 course sites listed in the page-metadata table with files of 1Kb or greater stored in Website Builder. Nearly half of the sites in WB contain less than 1 MB of content and two-thirds of sites contain less than 5 MB. Only 6% of sites contain more than 50 MB of content.
Total File Size (x) | Number of Courses | Percent of Overall Count |
|---|---|---|
x >= 500 MB | 7 | na |
100 MB <= x < 500 MB | 246 | 2.1% |
50 MB <= x < 100 MB | 475 | 4.1% |
10 MB <= x < 50 MB | 1981 | 17.1% |
5 MB <= x < 10 MB | 1047 | 9.1% |
1 MB <= x < 5 MB | 2375 | 20.5% |
500 KB <= x < 1 MB | 1009 | 8.7% |
1 KB <= x < 500 KB | 4422 | 38% |
Link Data Analysis
As of 3/19/07, there are 13,605 links stored in Website Builder. Almost all of these links are external links - only 5 links have references to my.ucdavis.edu, so the links are exportable and useful to faculty outside the context of MyUCDavis. A breakdown of the database count indicates that the most active usage is within the last two years and during the Fall-Winter-Spring quarters as shown by the top 6 counts (from highest):
Winter Qtr 2007, Winter Qtr 2006, Spring Qtr 2005, Winter Qtr 2005, Fall Qtr 2005, Spring Qtr 2006
TERM_CODE | TERM | LINKCOUNT |
| TERM_CODE | TERM | LINKCOUNT |
| TERM_CODE | TERM | LINKCOUNT |
|---|---|---|---|---|---|---|---|---|---|---|
200710 | Fall Quarter 2007* | 37 |
| 200503 | Spring Quarter 2005 | 1013 |
| 200302 | Spring Semester 2003 | 16 |
200703 | Spring Quarter 2007* | 203 |
| 200502 | Fall Quarter 2005 | 34 |
| 200301 | Winter Quarter 2003 | 434 |
200702 | Spring Semester 2007* | 39 |
| 200501 | Winter Quarter 2005 | 999 |
| 200210 | Fall Quarter 2002 | 376 |
200701 | Winter Quarter 2007 | 1347 |
| 200410 | Winter Quarter 2004 | 756 |
| 200209 | Fall Semester 2002 | 8 |
200610 | Fall Quarter 2006 | 772 |
| 200410 | Fall Quarter 2004 | 756 |
| 200207 | Summer SII 2002 | 11 |
200609 | Fall Semester 2006 | 40 |
| 200409 | Fall Semester 2004 | 23 |
| 200205 | Summer SI 2002 | 54 |
200608 | Summer Quarter 2006 | 25 |
| 200408 | Summer Quarter 2004 | 16 |
| 200203 | Spring Quarter 2002 | 275 |
200607 | Summer SII 2006 | 719 |
| 200407 | Summer SII 2004 | 60 |
| 200201 | Winter Quarter 2002 | 202 |
200606 | Summer Special 2006 | 34 |
| 200405 | Summer SI 2004 | 69 |
| 200110 | Fall Quarter 2001 | 97 |
200605 | Summer SI 2006 | 80 |
| 200403 | Spring Quarter 2004 | 772 |
| 200109 | Fall Semester 2001 | 5 |
200603 | Spring Quarter 2006 | 807 |
| 200402 | Spring Semester 2004 | 14 |
| 200107 | Summer SII 2001 | 7 |
200602 | Spring Semester 2006 | 32 |
| 200401 | Winter Quarter 2004 | 682 |
| 200106 | Summer Special 2001 | 1 |
200601 | Winter Quarter 2006 | 1047 |
| 200310 | Fall Quarter 2003 | 549 |
| 200105 | Summer SI 2001 | 4 |
200510 | Fall Quarter 2005 | 834 |
| 200309 | Fall Semester 2003 | 1 |
| 200103 | Spring Quarter 2001 | 17 |
200509 | Fall Semester 2005 | 77 |
| 200307 | Summer SII 2003 | 91 |
| 200102 | Spring Semester 2001 | 1 |
200508 | Summer Quarter 2005 | 25 |
| 200306 | Summer Quarter 2003 | 1 |
| 200101 | Winter Quarter 2001 | 58 |
200507 | Summer SII 2005 | 100 |
| 200305 | Summer SI 2003 | 35 |
| 200010 | Fall Quarter 2000 | 48 |
200505 | Summer SI 2005 | 88 |
| 200303 | Spring Quarter 2003 | 569 |
| 200006 | Summer Special 2000 | 1 |
*Counts for 2007 are not complete except for Winter quarter since this reflects the future.
Course Management / Sakai Resource Mapping
The mapping of Course Management Website resources to Sakai resources is as follows:
CM Type | CM Storage | Sakai Type | Sakai Storage | Mapping |
|---|---|---|---|---|
Template Page | Database | Simple Text Document | Filesystem | WB-generated HTML file must be transferred. |
HTML Page | Database | HTML Page | Filesystem | WB-generated HTML file must be transferred. |
Folder | Database | Empty Folder | Filesystem | DB entry must be converted to physical directory. |
Link | Database | URL (link to website) | Filesystem? | DB entry must be somehow transferred. |
File Upload | Filesystem | File Upload | Filesystem | File must be transferred. |
Sakai Import/Export Analysis
There appear to be several methods currently available for a user to import resource content into Sakai:
Site Info Tool - Import from Site
This import process looks for a folder on the server's local disk with the target site id. The folder to be imported is in the Sakai site export process format, which consists of files and xml settings documents.Site Info Tool - Import from File
This process allows the user to upload a zip file containing archived site content. The file to be imported should consist of a zipped site archive folder, including the requisite xml files.
NOTE: This feature does not currently work in any of our Sakai environments. Based on Zack Thomas' migration research, "the only archive files this tool understood were those produced by Sakai's proprietary archival functionality and Indiana University's legacy Oncourse system." Use of this tool may require using the Import Service Zack designed.Resource Tool - Add/Add Item(s)
The resource tool provides a set of file upload fields, providing the ability to upload multiple files to a site's resources area. However, this method requires the user to specifically select each file to be uploaded.Resource Tool - Upload-Download Multiple Resources/WebDAV
The Sakai webdav service allows users to directly connect to resource sections, allowing for multiple simultaneous file uploads. Additionally, entire folder structures may be imported using this tool.