Auto Analysis™ and PhraseGen™ Overview

Follow

Demonstrates the workflow of Bongo's Auto Analysis™ feature, and explains how Evaluators can view the reports for their Learners. Depending on the organization’s membership with Bongo, this may be a premium feature. 

About Auto Analysis™

Auto Analysis is an automated reporting feature that provides deeper insight into an individual’s performance and progress. By generating metrics like rate of speech, speech clarity, and use of filler words, Auto Analysis gives the presenter a better sense of what to focus on and helps the evaluator provide more targeted feedback.

Auto Analysis™ is currently available to all learner's videos submitted to Individual Project assignments. It works with the following spoken languages: English, Dutch, French, Canadian French, German, Spanish, and Portuguese. 

2019-10-24_13-41-48.png

Value Points

  • Encourages Repeated Practice—Individuals can view their analysis before submitting an Individual Assignment, giving them a chance to continuously self-assess, practice, and improve.
  • Enhances Review Process—Auto Analysis helps evaluators identify potential problem areas faster and provides metrics that can serve as an additional layer of assessment.
  • Enables Better Feedback—Evaluators can use data from the auto-generated report to make their feedback more targeted and actionable.
  • Builds Critical Skills—The Auto Analysis process helps individuals develop skills like communication and critical thinking that are crucial to lifelong success.
How Auto Analysis™ Works
  • Auto Analysis™ automatically transcribes all Individual Project videos and analyzes them for rate of speech, speech clarity, and use of filler words.
  • Instructors can also specify Key Terms to measure how often content-related terms (such as industry terminology, vocabulary terms, and brand names) are said.
  • It compiles this data into an easy-to-read report that learners can use for reflection before they decide to re-record or submit their video.
  • These reports contain delivery ratings (and content ratings, if enabled) that evaluators can use for reference in the assessment process.
  • Evaluators can also elect whether to include a numerical score with the color-based rating.
Accessing the Auto Analysis™ Report 

To access a learner's Auto Analysis™ report, first, navigate to the grade book and find the appropriate submission then click Grade Student Submission.

gradestudentsubmission.png

Next to the student's video, click the Auto Analysis™ icon. Note: if you do not see the icon, you may need to turn on Auto Analysis™ within the assignment configurations

accessingautoanalysisreport.png

From here, you can review the Auto Analysis™ report for the learner. By default, the report will measure clarity, filler words, and speaking rate to create a Delivery rating.

If Key Terms are enabled, the report will display an additional rating for Content based on how well the learner met the specified targets for those terms. The ratings for Delivery and Content will be combined to create an overall rating.

Default Report Key Terms Enabled

Click the image below to view larger. 

autoanalysisdescription__1_.png

This report provides a fantastic snapshot of how the learner delivered their message. There are several ways you can interact with this report:

  1. You can download a transcript in the form of a text file for the video.
  2. The individual ratings for each of the delivery metrics - clarity, filler words, and speaking rate, are located above the transcript. The metrics are accompanied by gauges so users can get a quick visualization of where they fall for each metric. Numerical scoring can be turned on or off within the assignment's settings. The default is “off”.
  3. Highlighting of top words and phrases, filler words and unclear words on the transcript are toggled by a drop-down menu. 
  4. Clicking on words in this list will show the user where they appear in the transcript. This list does not include stop words, which are small common words such as “the”, “a”, and “and”.

Important

When accessing the report, users will be notified if Bongo is not confident it can accurately analyze the video due to poor video quality or different languages spoken. Videos shorter than 30 seconds are more likely to encounter inaccuracies in their analysis.

2019-06-25_14-10-06.png

Auto Analysis™ as a Grade Type

If this grade type is selected, the Auto Analysis overall score for the submitted video will be used as the grade and does not require any user with an instructor role to assign the grade. This functionality is supported in both Individual Assignment and Question & Answer assignments. Click here for more information regarding Auto Analysis™ as a grade type.

Screen_Shot_2022-08-03_at_11.33.57_AM.png 

Example of Auto Analysisas a grade type.

 

About PhraseGen™

Configuring Key Terms

Instructors can configure Key Terms and phrases they would like learners to use in their videos. These key terms are used to generate a content rating that is presented in the Auto Analysis™ report in addition to the delivery ratings. If Auto Analysis™ scores are enabled, users will see a delivery score, a content score, and a combined score at the top of the report.

Instructors can set key terms and the desired frequency that they would like learners to use in their videos. To facilitate this process, instructors can use PhraseGen™ where they can paste in the contents of any document and the system will use AI to extract the most relevant terms and phrases to automatically populate Key Terms. Instructors can run PhraseGen™ multiple times or fine tune the results before saving. Instructors can also add terms manually if they want.

image1.png

The list of Key Terms will show those items that were found using PhraseGen™ so an instructor can easily determine how the list was populated.

image2.png

Please note, Key Term configuration is not set until the assignment settings are saved.

autoanalysis.png

8 out of 8 found this helpful

Comments

0 comments

Article is closed for comments.