Page Comparison

Authoring

What's authoring?To

...

In addition to providing instructors with the ability to build assessments of the six built-in types: Formative Assessment, Problem Set, Quiz, Survey, Test, and Timed Test, the authoring tool also allows for these types themselves to be customized, and for new assessment types to be created. Of course, there is still plenty of functionality that could be added – and most of the effort out there in the community seems to be either fixing bugs with the existing functionality or adding new functionality in this spaceto this authoring tool (in place of considering other methods of authoring assessments or allowing instructors to upload simple text files, as has been suggested in several JIRA tickets).

Currently, the instructor can control, for exampleamong other things, how many times an assessment can be submitted, whether late submissions will be accepted, whether to provide the user with feedback after an answer is submitted, and even whether the program should accept submissions only from specific IP addresses. It's also possible to break up an assessment into discrete sections and to control how questions are presented to the user – i.e. one per page or in batches.

Unfortunately, the user interface itself is neither exactly intuitive or nor streamlined. For example, in order to 'publish' an assessment – a necessary step if you want anyone to be able to use it – it's necessary to click on 'Settings' before you can find or select the 'Publish' button. This, and other counterintuitive design choices, introduce what I consider to be significant pressure to formally train instructors on the authoring tool before any kind of a large-scale release. AlsoMaybe even more importantly, the effort to allow users to include rich text and images in their questions has produced a very ugly user interface, where text editor windows are scattered across a very large scrolling browser page, posing an intimidating series of undocumented actions for even the most basic user of the tool to take.

As a result of this design decision, the process of creating an assessment also requires each question to be entered one-at-a-time and on its own screen. This means that there's no easy way for an instructor to simply copy and paste a list of questions that she's written up in a word processor. This strikes me as the biggest hurdle on the authoring side, since the awkwardness of this current method pushes it closer to the 'power-user' side of things and makes the hurdle bigger for non-technical instructors who simply want to put their existing paper assessments online. The choice in designing Samigo has obviously been to sacrifice ease-of-use for comprehensiveness of functionality, and I think this will ultimately limit the number of instructors who are willing to use the tool.

Tasks/Feature Requests

• There's some interest in sharing assessment types so they could be modified on a departmental basis, for example SAK-5199 and SAK-3526
• Request for more flexibility to accommodate students with special needs - allow instructor to adjust time available on a student-by-student basis SAK-3427

Limitations

...

• Big thing is adding new question types – adding calculated/algorithmic questions
• Currently, to share question pools between users requires import/export - can't do it staying within the authoring tool itself
• Copying question pools doesn't actually copy questions, it creates links SAK-3526
• During authoring the list of question-types available is not context-sensitive SAK-1379 – this could be a feature or a limitation depending on POV.

Reports

Minimal functionality at the moment.

• For example: School of Medicine wants to have "how long did student spend on each question"?

Importing/Exporting

Obviously, being able to bring existing quizzes and tests into SmartSite is crucial for all the current users of MyUCDavis Quizbuilder.

Currently, you can only import and export assessments to and from Samigo and MyUCDavis materials – even though it's QTI compliant, it's specific to Samigo. You can import assessments now from MyUCDavis to Samigo. You can also export/import assessments between sites within SmartSite.

One way: Samigo -> UCDavis.

Limitations:

1. Can't export question pools yet, except with workaround – create a quiz that pulls a random selection from a pool, when export it exports all questions. Bug fix may make that no longer work.
2. Calculated questions can't be imported from MyUCDavis
3. Also, some things lost - documented in this gap analysis
   • e.g. Matching questions in other systems have distractors may need a link/description
   • MyUCDavis allows you

• There seems to be an upper limit on the number of questions you can have in a question pool SAK-61 – this may be an authoring limitation as well

Some things that are ahead in the import/export space:

On the horizon:
First thing: import question pools, which will take exported quizzes from Samigo. Key thing is that you can export a quiz and hand it to somebody else (share with other faculty), import to pool. Main thing, initially.
Second thing: export question pools and collections from MyUCDavis (new feature for MyUCDavis).

Futuristic:
In design phase: importing Respondus quizzes or question pools – the advantage of R. is that it's a nice authoring environment - desktop app, less than $100 a copy.

QTI: Interoperability standard. Predecessor to Common Cartridge. Distinct from Zach's effort to implement CC. Part of Sakai's committment to IMS standards for compatibility.

Consider expanding QTI import/export to look at IMS Content Packaging – includes capability to import/export media with a quiz, possibly importing/exporting subpools. Still gathering use cases from the community for this.

Common Cartridge: Still unclear when this will be incorporated into Sakai Foundation core. Prob. sign. work to draw into our world. But, it could make it possible to bring in various outside data...
Outside tool from Sakai Foundation, does migration via SiteInfo, long-term effort to bring in textbook publisher data, etc.

• Performance problems when clicking on 'Add Part' SAK-5323

Continue to Delivery >