...
- export a question pool from MyUCDavis
- export/import associated media files from MyUCDavis
- import a question pool to Samigo
...
As of 8/11/06 there are 10,423 questions stored in the MyUCDavis equivalent of question pools.
Some of the content will not be migrated because the original owners are no longer valid Kerberos/UCD personnel; other questions are not valid, that is, were incompletely formed. A portion of these questions are calculated question type which has no equivalent in Samigo.
The question pool numbers break down as follows:
- Total number of questions in the database: 10,423
- Total number of valid questions with valid owners: 9514
- Number of calculated question types: 238
- Total number of valid questions, not calculated type, with valid owners: 96509297
- Total number of distinct owners: 335
- Total number of valid owners: 281
- Question count/valid owners breakdown:
- 1 - largest question count: Harold Davis, VetMed - 1181 questions
- 1 - second largest question count: Beth Post, Psych - 638 questions
- 4 - instructors in 300 - 400 count range
- 19 - instructors in 100 - 299 count range
- 21 - instructors in 50 - 99 count range
- 34 - instructors in 25 - 49 count range
- 27 - instructors in 11 - 24 count range
- 174 - instructors in 1 - 10 count range
...
Question Pool Function | MyUCDavis | Samigo | Funtion Loss / Gain |
|---|---|---|---|
create a question | Questions are created in the pool and may then be added to a quiz or a collection | Questions may be created either in a pool or in a quiz. A question is shared from a quiz to a pool, but it is duplicated from a pool to a quiz. | Samigo questions are primarily associated by their relationship to a quiz or a pool. Creation is more flexible and can be shared from either creation point. |
edit a question | Modifications to a question in the pool are displayed in the quiz the question appears in. The exception is that a question cannot be modified if it is on a quiz that has been taken. | A quiz question shared to a pool shares modifications; a pool question copied to a quiz does not share modifications. Published quizzes use copies of questions, not the original. | User should be aware of the question origination point depending on whether they want a copy or the original. |
delete a question | Questions can be removed from a quiz, but cannot be deleted from the pool | Questions can be deleted from a quiz or a pool; once shared, the question must be deleted in both locations if complete removal is desired. | Deletion is a feature gained. Users should be aware of deletion specifics based on question origin; the program requires confirmation on every deletion request. |
question pool hierarchy | QB consists of a single pool; collections offer a single subpool level of organization. | Samigo allows for multiple pools/subpools in unlimited number of levels. | Unlimited subpool design may change due to issues with performance and after usage studies. Even if subpool hierarchy is limited in the future, this is a gain. |
pool/collection features | Questions may be sequentially stored in collections. | Multiple and multiple-level subpools are allowed. | Even if subpool hierarchy is limited in the future, this is a gain. |
question/pool ownership | Questions, pools and collections are owned by a single individual. | Questions, pools and subpools are owned by a single individual. | No gain or loss. |
sharing questions, pools | Question pools/collections cannot be shared through the UI, but individual questions or quizzes can be shared by 'publishing'. This function allows the user to select to publish to all users, to all courses within a subject, to a single course, or to a specific person. You can not edit a question you did not create, but you can make your own copy. Shared quizzes are always copies, not the original. | Quizzes may be shared with anyone who has 'maintain' access to your course, i.e., the ability to author quizzes. Questions pools and sharing quizzes with users who do not have authoring access is only available via import/export functions. | While the current 'sharing' model is limited in Samigo, we are currently interviewing within the community to design various access levels for sharing among faculty and other support personnel.Developing question pool import and export functions will also allow question pool sharing. |
question types | QB has the following types: multiple choice, fill in the blank (ordered and unordered), matching, essay, and calculated | Samigo has the following importable types: multiple choice, survey, fill in the blank, matching, true/false, and essay. | All question types except for calculated questions are importable from QB to Samigo. |
Export/Import Media Files
There is a separate project to export quiz media files from MyUCDavis into a single zip file. Development was completed in July and testing will be performed concurrent with the export question pool function.
Media files are exported as standalone files contained in a single zip file. In the export quiz function, the question each file is associated with is documented on the export screen. In MyUCDavis, media are associated with a question, while in Samigo, media are embedded. Because of this difference and because there is no successful import media within a process, adding media to a quiz (or question pool) in Samigo will require a separate manual process.
The suggested process is to store the media files in a Resources folder and to add the url link to each question individually. This process may change once QTI standards for content packaging import/export are applied to Samigo.
Sakai Import Pool Function
...
Authoring performance issues when the user has multiple question pools and subpools were reported for local Davis Sakai versioin version 2.1.x. The issues was identified with generating the question pool tree for display. This suggests that importing a number of large pools may cause difficulty in authoring. In addition, not much is known about the affect of importing large (+300 question) pools or the performance of pool management, such as copying, moving or adding subpools. It is unkown at this time whether the authoring issue will affect importing or if the issue persists in version 2.2.
Details and graphics for import question pool functionality are found under Samigo-Davis Projects as Import question pools
Analysis Conclusions
Analysis of current MyUCDavis data indicates that there are 281 potential faculty who would desire the ability to export their question pools. At least 60 of these faculty also have some questions organized in collections for ease of management.
Important numbers to consider:
- 281 question pool owners of 9650 total questions
- 98% of owners manage question pools containing 1-299 questions
- 60 owners of 197 collections
- 98% of collections contain 1-43 questions
- 2% of questions are non-importable calculated questions
The six instructors with question pools of more than 300 questions may require assistance to successfully import and manage their question pool migration to Samigo. Those instructors with collections may find migration easier if there is an export function for collections, since they will be able to organise their content into subpools immediately after import.
The gap analysis concludes that most features will be neutral or show a gain as instructors move from using Quiz Builder to using Samigo.
The positives of question pool migration include:
- the ability to delete a question allowing for better question pool management
- more flexible, multi-level question pool design
- future potential for sharing question pools via an export/import or access management process
- all question types, except for the 2% calculated types, will migrate
- media files will migrate to Samigo - although a manual process is required to add media to questions
Design
The question pool and collection export processes will be made available for each individual with access to MyUCDavis cms and content in his/her question pool. The export function will check that questions or collections are available, respectively, before it is available on the screen.
The migration path will exist of a function in Quiz Builder to download/export a single xml and/or a zip file containing question media. The process will mirror the existing Export Quiz function by opening up a new window with export information and a description of how to export from Quiz Builder and import into Samigo. Faculty and/or staff can then import the xml file in Samigo's pending Import Pool function or copy the zip file media to their Sakai course website via WebDav.
Desired features of a migration tool are:
- Faculty, staff and TAs can export and import questions by question pools or collections
- The process closely models existing processes, providing for maximum ease of use.
Proposed Question Pool/Collection Export/Import Process
...
How can qpools be exported from my and imported into sakai?
...
- The user chooses the Quiz Builder link on their MyUCDavis cms navigation.
- Clicks on either the Edit/Browse Questions or Edit/Browse Collections from the Quiz Builder sub-menu.
- The link Export All Questions or Export Collection appears on the respective screen if questions and collections exist.
- After selecting either link, a new window will open with the following information:
- the title 'Export All Questions as Question Pool' or the name of the collection at the top of the screen
- export/import instructions for migration from MyUCDavis to Samigo
- single button labeled 'Download' for downloading the question pool/collection as an xml file
- question pool/collection export notes detailing the differences between question types in the two systems
- question pool/collection export notes listing media files available for download via a 'Download Zip File' button
- After selecting the 'Download' or 'Download Zip File' button, the user is prompted to choose a download location for the file.
- The user saves the xml or zip file to their local machine.
- The user opens Sakai, and then Tests & Quizzes, if importing a question pool or collection xml file, and then:
- user selects Import on Question Pools screen after selecting Question Pools
- user selects Browse to select the xml file from their local system
- user selects Import to import the question pool
- The user opens Sakai, and then Resources, if importing a media zip file, and then:
- user selects Upload-Download Multiple Resources
- user follows instructions for using WebDav
- user unzips his/her media file to export the files into Resources
- user may then manually add each image to each question as desired