Evaluations: Getting started

A step-by-step guide on setting up an evaluation process for the sessions submitted for your event

This article is here to help you. While we strive to make it as informative as possible, that doesn't mean it's perfect. Feedback and constructive criticism are greatly appreciated.

Deciding which sessions will be a part of your event is essential. Sessionize offers an elaborate session evaluation system, which you and your team can use to help you with this daunting yet important task. 

Here's a step-by-step guide to help you build your first evaluation plan, assign evaluators to it, and comb through the submitted sessions with ease. A single evaluation plan is sufficient to handle your entire event, but you can also create an unlimited number of evaluation plans for a more thorough session evaluation.

Create a new evaluation plan

The evaluation plans are created on the Evaluation page. Once you're on the page, simply click on the New evaluation plan button to get started. 

You and your team could technically start evaluating the sessions as soon as they start pouring in, but it's a better idea to wait for your Call for Speakers to end, as that way, you'll have a complete overview of all of the sessions at your disposal.

When using the Comparison evaluation mode, it's not possible to add sessions to it once the evaluation has started, so make sure you don't start it until all sessions have been submitted.

 

Select the appropriate evaluation mode

Sessionize offers three ways to evaluate the submitted sessions, called evaluation modes. Learn about their features and key differences in the following article: Evaluation modes explained

Once you select the evaluation mode that suits you best, you have to decide which members of your team will be able to do the evaluation. By default, all team members are evaluators, but you can uncheck the All Team members are evaluators in this evaluation plan box and manually select the ones you want to be able to do the evaluations.

You can write them instructions, which they'll see once they start the evaluation, as well as set a deadline - the date at which the evaluation automatically closes, even if not all evaluators have done the evaluation.

Use the advanced options to your advantage

To build a more elaborate evaluation plan, expand the Advanced options menu, found at the bottom of the evaluation plan creation menu.

Here you'll find several session filtering options that enable you to set up an evaluation of sessions of a certain category. For example, this is what you'll use when you want to evaluate only those sessions that were submitted for a specific track. We're using AND/OR filtering logic for added fine-tuning.

 
 

Once everything's done, simply click on the Create evaluation plan button. 

Open the evaluation

Once your evaluation plan has been created, you still have an unlimited amount of time to check if it's been set up properly and if your list of evaluators looks good. The evaluation plan won't be available to your evaluators until you click on the Open Evaluation button.

Once your evaluation plan has been opened, you'll be unable to change the evaluation mode. As soon as the first evaluation has been made, you can no longer manually delete the evaluation plan in question. This is to protect the completed evaluations from accidental deletion. If you're sure you want the evaluation plan removed from your event, use the Contact Support button at the top of the page.

 

Manage your evaluators

You can add, remove and manage your evaluators on the Team page. Unless you have already assigned the evaluator roles during the evaluation plan creation process, here, you can directly decide who will be able to evaluate the submitted sessions. All team roles except for Developer can evaluate the sessions.

Anonymous mode: What it is and how to use it

Anonymous mode: What it is and how to use it

If for any reason you want certain evaluators to do blind evaluations, meaning th

If for any reason you want certain evaluators to do blind evaluations, meaning they're not able to see the names, photos, and details of speakers whose sessions they're evaluating, you can turn on the Anonymous mode for such evaluators. For the evaluator with the Anonymous mode activated, real speaker names are replaced with made-up ones, and speaker photos, biographies, taglines, and all other speaker fields are hidden.

When inviting a new team member on the Teams page, simply tick the Anonymous mode box before sending the invitation. By doing so, your team member will join your event with the Anonymous mode already active, making it impossible for them to see any speaker information at all. This can be done regardless of the role you're assigning to your team member. In other words, the Anonymous mode isn't limited only to team members with the Evaluator role.

You can also activate the Anonymous mode for your existing team members, i.e., when you're launching a second round of evaluations or at any other moment that you find fitting.

Activating the Anonymous mode for an evaluator as the event organizer

On the Team page, click on Edit and check the Anonymous box next to the team member to which you want to assign the Anonymous mode to. Confirm your choice by clicking on Save changes. That's all there is to it!

The evaluator's normal view of a session (left), and with the Anonymous mode activated (right)
 
 
 

Keep track of the statistics

Detailed evaluation statistics are available to event organizers

During and after the evaluation process, Sessionize provides you with detailed statistics, where you have a clear view of which evaluator made what amount of progress (and in what time) and, most importantly, what's the final ranking of the sessions. 

Export the evaluation data as Excel file(s)

By clicking on the evaluator's name, you can even get a more detailed breakdown of the job they did, including how they rated every session. 

The ranks and ratings, as well as the raw data for the selected or all users, can be exported as Excel files. Simply click on the Export button at the top of the page.

Related articles

Evaluation modes explained

An overview of three different ways to evaluate the sessions submitted for your event

  • September 19th, 2022
  • 124 views
  • 0 likes