Prominent bugs and tasks in the Foundation and UCDavis JIRAs

SAK-5199 Make system-wide assessment types that admins could create/update

Marc Brierley: "Yeah, I was thinking that if these assess types were system-wide, it would be cool if admins could add others and/or modify them. Essentially, after the first load of the assess types with Sakai OOTB, then the admin could edit them directly rather than any config file or anything - just like the default assess type (template) right?
This would be a good step on the way to having local admins (i.e. departments) being able to have "system" assess types. This would was part of the original AAM design that has been waiting on Sakai groups/hierarchy.
Anyway, if only the six additional non-editable, but removable assessment types are what get in for 2.2 that would be great.
Let me know...thanks!"

Lydia indicates 13-Jun-2006 that this will be added post 2.2

SAK-3526 Change the question-pool 'copy' function to actually copy data, not just make links

Marc Brierley: "Currently in question pool , when you copy a pool or copy questions from one pool to another, only new links between items and pools are created. No real copies are made. This has some unwanted affect on the usage of 'Assgined to' and 'random draw part' in authoring. While we have workarounds for them , we need to document all the scenarios and see if it makes sense to change the 'copy' behavior, so that when a copy is a made, a new item object is created.
See SAK-3096 for one of the scenarios"

Nothing more added since 03-Aug-2006

SAK-6697 Import question pools into Samigo

This is Lisa's task

She's on top of this. Last comment 05-Oct-2006

SAK-6325 Add a new question type: Numeric Response in Range

Request to allow students to provide a number in reponse, which then would be checked against a range of potential answers

Looks like this one might already have been implemented, Lydia commited 14-Sep-2006 to nightly build

SAK-3427 Accessibility--Timed quiz extensions for students with disabilities

Instructors should be able to adjust the length of time available for quizzes to accommodate students with disabilities. Usually the amount of additional time is established by the student with the institution prior to attending classes, although this probably varies by institution.

Nothing has been done on this since it was suggested 06-Jan-2006

SAK-4005 New Samigo feedback

Donald Siegel: "For me to use Samigo, I need students to get feedback UPON SUBMISSION. Not at a later date, and not immediately. I get students a set of questions to answer, and 3 tries to get it correct. Let's say I had 4 questions. Student submits his answers. He got question 1 correct, q. 2 incorrect, q. 3 incorrect, and q. 4 correct. Currently, I could have show feedback immediately. In which case, he could ask for feedback and only submit when he has them all correct or when he's out of time whichever comes first. Or I could give feedback at a later time, so that he'll know he got 2 wrong, but he'd have to guess which 2 were wrong. Neither of these serves my purpose. Either there is a way to do this, or I'm going to have to go back to commercial software that DOES do this."

Nothing has been done on this since it was suggested 27-Feb-2006

SAK-4103 Context sensitive help for student taking test

Lydia Li: "When a student is taking an assessment and clicks the ? icon in the upper right, the help should be context-sensitive, and open to 'Using Sakai 2.0, how do I take an assessment?' Currently, if a student clicks the ? icon, she sees, "Sakai 2.0 Tests & Quizzes: Overview" which discusses topics suitable for someone creating a test."

Peter Knoop commented 09-Mar-2006: "Since Lance's group is no loner working on Help issues like this, we'll have to wait to identify a new resource before it can be addressed."

SAK-1379 SAMigo customized by use case

Lance Speelmon: "We would like to see the SAMigo UI customized at runtime by passing a flag of sorts. The use case is as follows:

1. If the tool placement of SAMigo is in a survey only mode, then the question types available in authoring would be specific to survey use.
2. If the tool placement of SAMigo is in assessment mode, then only assessment question types would be displayed during authoring.
   In fact, we would like to be able to have separate instances of the SAMigo tool available. For example, in worksite setup one would see a tool called "Surveys" and another tool called "Assessments". SAMigo could then customize its behavior as described above (#1 and #2) based on whether it is the Survey tool or Assessment tool. We are finding that the term "Tests & Quizzzes" does not have the right semantic meaning in a project site. In addition, the term "Tests & Quizzes" is not ideal when used in a formative assessment methodology."

No comments since opened 29-Oct-2005

SAK-1749 Need a high-stakes timed assessment type

Based off of an email from Thomas 16-Aug-2005, reported by Margaret Petit - the gist is that there is a problem with students taking a quiz without being able to stop the clock.

No updates since 27-Oct-2005

SAK-1905 Security features

Luke Fernandez: "

1. Include features that allow instructors to easily specify that a test is only available at a testing center or a group of testing centers without password protecting the test or entering a range of IPs. The instructor should be able to select from a select list of testing centers.
2. Securely and automatically disseminate test passwords to appropriate proctors through the Web rather than through email.
3. Disseminate test passwords that are only valid for a particular student's test attempt (as opposed to a general test password that, if shared, would allow all the students into a test).
4. Alerting utilities which can email instructors when a student takes over a certain amount of time to finish a test.
5. Allow course evaluation surveys to be taken anonymously so that a student's identity is protected from the instructor.
6. Allow a testing center admin to securely check a student into an online test without having to walk back to the testing terminal and enter the test password.
7. Include certification options which will allow a proctor to certify a test after it has been completed.
8. Enable a proctor admin to track and approve proctors and automatically disseminate appropriate passwords to these proctors.

Nothing added since Peter Knoop suggested breaking this up into separate tickets 27-Oct-2005

SAK-6560 Sort/Hide inactive assessments

Jeff Narvid: "For instructors who use Samigo a lot, the "Inactive Assessments" area gets real cluttered, real fast. It also becomes very difficult to determine which assessments were retracted and which are past the due date. Some suggestions:

• The ability to hide quizzes from the main view (I think it would be
  nice to be able to hide any quizzes from view, not just
  inactive/retracted ones)
• The ability to sort the "Inactive Assessments" area by fields such as
  "Retracted" and "Past Due" so that everything isn't mixed together
  With more 20 or 30 assessments in the "Inactive Assessments" area, this becomes critical for instructors."

No comments since updated 02-Oct-2006

SAK-6288 Add "send scores to gradebook" button instead of setting

Suggestion from Margaret Petit to send all submission scores to gradebook at once - this to get around earlier bug with sending when the student submits

Nothing added since 12-Sep-2006

SAK-5875 Allow ad hoc groups to share question pools

Lydia Li: "Currently question pools can only be view/accessed by the creator. There is no way for 2 instructors to share their question pools. We would like to be able to create ad-hoc groups for people to share pools."

Nothing added since 02-Oct-2006

SAK-5794 Allow students to see all submissions in review list

Margaret Petit: "Students can only see their most recent submission for each assessment in the review list. Unfortunately, in practice it turns out students submit a test many times, and the most recent submission isn't always their best one or the one they want to keep. Or the one the instructor grades. (See SAK-5793)"

Nothing added since 02-Aug-2006

SAK-3943 Allow instructors to change feedback settings after publishing

This points to a more general limitation on modification once something has been published

Last comment 31-May-2006

SAK-3942 Add warning popup prior to submission and/or allow resubmission

Vivie Sinou: "Way too many students seem to submit assessment prematurely and when instructors allow only 1 submission, there is no way to allow them to retake it without publishing a duplicate copy. It gets messy. The main reason for the problem is two-fold: a) users don't read closely and b) the location of the "submit for grading" button is in the same spot as "save and continue" so when student reach the last page, the click on "submit for grading" automatically, without reading.
I think that a javascript pop-up warning would be a nice gesture. How about something along the lines of: "WARNING! You are about to submit your test for grading. Are you sure you want to proceed? You will not be able to return to the assessment. Cancel to return to the assessment or click on 'submit for grading' to finish. Thank you."
Another solution would be to allow instructors to reset the assessment for a student so that they can resubmit. This is also along the lines of what the Assignments tool offers. I think both features would strengthen the tool."

Others agree this is an issue, last comment 03-Apr-2006

SAK-2641 Re-implement outside links in questions as popups

Laura Burchard: "Right now, links in questions forward the 'question box' to the site. Since you can't use the back button to get back into Sakai, this results in the user having to reenter tests and quizzes and then the assessment and question they were working on – not ideal."

No comments since 27-Jan-2006

SAK-3211 Linear assessment should be high-stakes

Margaret Petit: "When you take an assessment with linear organization, you can only view the questions in order; there is no "previous" button or table of contents to let you return to previous questions. This implies a high-stakes test.
However, you can easily get around this by exiting the assessment in the middle with "save and exit", or by closing your browser. When you return to Sakai and retake the assessment, you'll start back at the beginning, with your previous answers saved.
We should decide whether linear assessments should be high-stakes or not. If not, there's no reason not to have a previous button. If they are, then when you exit the assessment and return you should return to the page you left and not the start."

No comments since update 11-Aug-2006

SAK-2965 Importing a test using a simpler text format

Luke Fernandez suggests a simpler authoring method for instructors

Last comment 16-Oct-2006

SAK-2709 Delay sending scores to gradebook in some circumstances

Margaret Petit:
"Tests & Quizzes sends the autogenerated score for an assessment to the gradebook as soon as the student submits it. This may not be desirable in all cases. Examples:

• Questions that can't be auto-scored, like short answer or file upload, will be scored as 0 points until the instructor has a chance to manually grade them. So a student who submits her answers for an essay test and then goes to the gradebook to view it will always see an F.
• Tests&Quizzes allows you to turn off the score components of feedback, or delay them, so a student can't see their assessment score before a specified date. But the insta-scoring of gradebook nullifies this, doesn't it? The student can view her score in gradebook even if it's been turned off in T&Q."

Joshua Baron concurs and suggests that this is a major issue 24-Apr-2006

SAK-1907 Ability to "add to schedule" for quizzes/tests

Vivie Sinou: "Include the option to add a test or quiz to the site's schedule, much like assignments can be added to the schedule by checking a chek-box. Perhaps a check box for this could be added under the "delivery date" option in the settings of a quiz right below the retract date. It seems like an appropriate place."

No comments since added 29-Oct-2005, but it sounds a lot like a request made at the Faculty Mentoring Faculty meeting on Friday 10/13/06