Response Management

Ultra Mashup Studio allows users to embed Feedback Forms into Mashups. Common uses of such forms are Level 1 and Level 2 evaluations for eLearning content, Quizzes, Polls, Surveys, Satisfaction Feedback, Gathering data, comments or information of any other type.

When a user plays a Mashup that contains a feedback form, the Ultra Mashup Player pops up the form at the specified point(s) in time. A Mashup can contain any number of such forms. The user is required to fill in the form and hit Submit to proceed.

At this event, besides storing how much time the viewer spent on the form, the responses are stored in a central database, and are associated to the user who submitted them. The system calculates score/marks on the responses based on the information given at the time of quiz design.

Content Authors can easily view aggregated and summarized, as well as detailed reports of feedback responses and scores. They can use these reports to gauge, for examples: how many people voted for an option in an opinion poll; how many people enjoyed the mashup; how many students grasped the lesson well; what interesting comments have been entered by viewers in the descriptive field; etc.

The responses entered by a user become part of their profile and can be used later on for other kinds of analyses and reports. For example, in the case of Corporate eLearning, it is important for HR Managers to know the general score for a particular staff in a team.

Scoring

Users can design scorable quizzes in a Mashup, using Ultra Mashup Studio. The Feedback Form designer allows users to add any number of questions, and any number of answers for each question for multiple-choice scenarios. Users must also specify the correct response(s) for a question. For each question, users can identify the number of marks or score assigned to it.

When viewers submit their responses to a form, the system compares these responses to those marked as correct by the author. Based on whether the response was correct or partially correct or completely incorrect, the system assigns the appropriate points to the user.

Ratings

The Ultra Mashup Player page allows viewers to rate a Mashup on a scale of 1 to 5, 5 being the best score. This feature provides viewers an ability to express their satisfaction or dissatisfaction on a Mashup. Other viewers can use this rating to possibly skip this particular Mashup. Authors can get valuable insight into their content's popularity, via this method. In Training and Learning scenarios, this tool is essential to evaluate a trainer / instructor / teacher, and to improve the training contents if people give it low rating.

Comments

Qualitative Feedback can be gathered from viewers on Mashups, via Comments. Descriptive feedback provides invaluable insight into viewers' appreciation of a Mashup. Many viewers may suggest ways to improve a Mashup maybe by referring to other external contents that the Author might use.

The Comments feature can also be used for asking questions and providing answers by the Author. As such, it becomes a small knowledge base related to a Mashup and its individual contents. In eLearning scenarios, the Comments section can be used for Q&A on a training lesson.

Reports

Content Authors get to see feedback form responses, ratings and comments via Reports. Aggregated and summarized reports can be used to display the number of people attempting a feedback form over the total number of people who viewed a Mashup; number of people who got a certain percentile of answers correct; the question that was answered incorrectly by most viewers; a ratio of ratings and number of viewers etc.

Detailed reports would be used for drill-down into a single viewer's responses. Detailed reports are also required for qualitative feedback via comments. This may be more important in eLearning situations.