<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>Scoring &amp; Comments &#8211; Nucleus Help</title>
	<atom:link href="https://nucleus-help.bmt.bafta.org/help-articles-category/scoring-and-comments/feed/" rel="self" type="application/rss+xml" />
	<link>https://nucleus-help.bmt.bafta.org</link>
	<description>Help Articles and FAQs for the BAFTA Nucleus Awards and  Grants Management System</description>
	<lastBuildDate>Fri, 28 Feb 2025 13:15:31 +0000</lastBuildDate>
	<language>en-GB</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=6.9.1</generator>

<image>
	<url>https://nucleus-help.bmt.bafta.org/wp-content/uploads/2021/07/bafta-mask_favicon_website21-1.png</url>
	<title>Scoring &amp; Comments &#8211; Nucleus Help</title>
	<link>https://nucleus-help.bmt.bafta.org</link>
	<width>32</width>
	<height>32</height>
</image> 
	<item>
		<title>How to Manage Scoring and Comments for Judges</title>
		<link>https://nucleus-help.bmt.bafta.org/help-articles/how-to-manage-scoring-and-comments-for-judges/</link>
		
		<dc:creator><![CDATA[David Lortal]]></dc:creator>
		<pubDate>Wed, 20 Sep 2023 16:17:39 +0000</pubDate>
				<guid isPermaLink="false">http://54.226.12.186/?post_type=lsvr_kba&#038;p=171</guid>

					<description><![CDATA[Admins have a variety of features in the Viewing Interface that Judges can use to provide feedback on Entries. One of the most popular is Scoring, where Judges provide scores on criteria set by Admin Users. Admins can fully customise the number of scores per Entry, and the range of each score, allowing detailed feedback [&#8230;]]]></description>
										<content:encoded><![CDATA[
<p>Admins have a variety of features in the Viewing Interface that Judges can use to provide feedback on Entries. One of the most popular is Scoring, where Judges provide scores on criteria set by Admin Users. Admins can fully customise the number of scores per Entry, and the range of each score, allowing detailed feedback from Judges. In addition, Admins can request comments from Judges to use as quotes in the brochure or to have a greater understanding of their decisions. Scores and comments can be set independently of one another, so there is no need to set both.</p>



<p>Once scores have been supplied, reports can be run to extract the results allowing Admins to identify winners, runners up and nominees. Scores can be set to be mandatory by requiring Judges to submit. Alternatively, they can be set as optional, where Judges can chose if they want to provide a comment or a score. </p>



<h3 class="wp-block-heading">How to Enable Submission of Scoring and Comments</h3>



<p>Selecting this option will mean that Judges are required to submit their scores and comments. This means they will see messaging that informs them that their scores are not complete until they have been submitted. <br>Note there is no functionality to set a deadline, so Admins must chase users to submit. <br>Automated emails can be sent via Nucleus, and there are tools for Admins to see the status of each Judges scoring progress. In addition, there are features which assist Judges in managing their scores and comments, as this can become complex if Judges are reviewing many Entries in multiple Categories &#8211; these are described in the below sections. It would be a good practise for Admins to consider beforehand how many Entries each Judge is required to review. </p>



<p>If you do not want your Judges to submit the scores and comments then you can skip this section.</p>



<ol style="list-style-type:1" id="block-1f4ef041-74c8-471f-874f-ce7dfd70b937" class="wp-block-list">
<li>Log into the<strong> Admin Interface</strong></li>



<li>Go to <strong>Awards</strong>.</li>



<li>From the <strong>Awards List</strong>, find the Award where you want to enable Scoring and Commenting </li>



<li>Click <strong>Overview > Settings</strong></li>



<li>Scroll down to the <strong>Viewing</strong> section</li>



<li>Select <strong>Yes </strong>for <strong>Require scores &amp; comments</strong> to be submitted</li>



<li>You will need to provide mandatory copy for the following instructions that will be displayed to Jurors at key stages during their scoring process (150 characters max):
<ul class="wp-block-list">
<li><strong>Not started scoring message</strong> &#8211; displayed when the Judge has not started scoring</li>



<li><strong>Please finish scoring message&nbsp;</strong>&#8211; displayed when the Judge has scored one or more entries but has not completed the process</li>



<li><strong>Please submit scores message </strong>&#8211; displayed when the Judge has scored all entries and needs to submit</li>



<li><strong>Thanks for scoring message</strong> &#8211; displayed when the Judge has submitted their scores</li>
</ul>
</li>



<li>Click <strong>Save and Close</strong></li>
</ol>



<h3 class="wp-block-heading">How to Set Up Scoring and Comments for a Category</h3>



<p>Scoring is set up on each individual Category. This allows Admins to set up different scoring criteria on a per Category basis, or to opt not to allow Scoring on particular Categories. Scoring can be set up on a Category regardless whether the Award is set to mandate that Judges submit their scores or not. <br>The first time Admins will need to set up Scoring on each Category. This setup will be then copied when the Award is copied in the following year. Note that if an Award is to submit scores, then Judges will need to submit all of their scores for all Categories in one action. To set up scores:</p>



<ol style="list-style-type:1" id="block-1f4ef041-74c8-471f-874f-ce7dfd70b937" class="wp-block-list">
<li>Log into the <strong>Admin Interface</strong></li>



<li>Go to <strong>Awards &lt; Overview >Categories</strong></li>



<li>Click on the <strong>&#8230; to</strong> <strong>Edit </strong>button in the right hand column for the Category where you wish to set the scores</li>



<li>Scroll down to the <strong>Scoring With Viewing</strong> section</li>



<li>Edit the <strong>Section title</strong> of the Scoring and Comments section as you want it to appear to your Judges on the Viewing Interface</li>



<li>Decide if you want to include <strong>Scoring</strong>. If you select <strong>Yes</strong>, some new fields will open enabling you to:
<ul class="wp-block-list">
<li>Name the <strong>New Score Title</strong> – which may be a criteria, such as ‘Creativity’, ‘Originality’, ‘Budgetability’ etc. Please note that if you want to display text in bold you can add &lt;b&gt; between words, or &lt;br&gt; to go on a new line;</li>



<li>Select the <strong>Min Score</strong> – i.e. the minimum score an Entry may be given on a scale;</li>



<li>Select the <strong>Max Score</strong> – i.e. the maximum score an Entry may be given on a scale;</li>
</ul>
</li>



<li>To add another, simply click <strong>Save </strong>and another score will be available to create</li>



<li>To enable comments set <strong>Commenting</strong> to <strong>Yes</strong></li>



<li>Provide a <strong>Comments title</strong> for this section or leave the default</li>



<li>Set the <strong>Max Comment Length</strong> in characters</li>



<li>When you have created your <strong>Scoring </strong>and <strong>Commenting </strong>settings, click <strong>Save &amp; Close</strong></li>
</ol>



<h3 class="wp-block-heading">How to Enable Judges to Flag a Conflict of Interest</h3>



<p>There will be occasions where Judges have an attachment to an Entry which constitutes a conflict of interest. This could be because the Judge has worked on the Entry, or works for the same company that produced the Entry, or is related to one of the Entrants. Depending on your Awards workflow, there will be different mechanisms to deal with this. Nucleus provides Judges with a simple mechanism that allows them to alert Admins of any conflicts.</p>



<p>Switching on this feature will display a checkbox next to each Entry, which Judges can use to confirm their conflict. Once confirmed, the Entry is highlighted in red for Viewers and the scores and comments are locked. The scores for an Entry that is marked as a conflict of interest will not be included in the results file. The file will also highlight where a Judge has marked an Entry as a conflict. To enable this feature:</p>



<ol class="wp-block-list">
<li>Log into the <strong>Admin Interface</strong></li>



<li>Go to <strong>Awards</strong></li>



<li>In the table click <strong>Overview > Settings </strong>on the relevant Award</li>



<li>In the <strong>Viewing </strong>section set <strong>Allow Jurors to Flag Conflict of Interest</strong> to <strong>Yes</strong></li>



<li>Click <strong>Save</strong></li>
</ol>



<p><strong>Note </strong>&#8211; at least <strong>one </strong>category in the Award must have Scores or Comments enabled in order for this feature to appear on the Awards Setting page. Once enabled, the conflict of interest will appear for all Categories in an Award.</p>



<h3 class="wp-block-heading">How to Set Up Functionality that Assists Judges with their Scoring and Comments</h3>



<p>Nucleus provides a range of functionality in the UI that assists Judges with managing their scores and comments. If a Judge is reviewing one Category with 10 Entries, then it is easy to track progress.<br>If a Judge has multiple Categories and many Entries, it can be easy to lose progress, especially between sessions. Therefore, Nucleus provides default and optional functionality to assist Judges:</p>



<ul class="wp-block-list">
<li><strong>Entry Confirmation Tick</strong> &#8211; a tick will appear in the scoring section for each Entry when Judges have completed all score dropdowns and comments</li>



<li><strong>Category Progress Bar</strong> &#8211; a bar and a percentage is shown on each Category block so that Judges can easily see their progress in any Category</li>



<li><strong>Scoring Summary Screen</strong> &#8211; A screen which displays all Entries in each Category a Judge is scoring which details the progress and highlights Entries that are missing scores and comments</li>



<li><strong>Save Button for Each Score</strong> &#8211; Allows Judges to save and update their progress regularly</li>
</ul>



<p><strong>Optional Functionality</strong>:</p>



<ul class="wp-block-list">
<li><strong>Viewing Site Order </strong>&#8211; allows Judges to filter Entries by scored/not scored and a range of other options</li>



<li><strong>Alphabetical Navigation</strong> &#8211; allows Judges to to filter for Entries alphabetically</li>



<li><strong>Tagging</strong> &#8211; create tags for Judges to filter Entries</li>
</ul>



<p>For more information on the above features and many more Viewing Interface features see the <a href="https://nucleus-help.bmt.bafta.org/help-articles/how-to-set-up-the-viewing-interface/">Viewing Interface guide</a>.</p>



<h3 class="wp-block-heading">How to Review Judges Scoring Progress</h3>



<p>If needed, during the Judging process you can check on how far your Viewers have progressed through the scoring/commenting of their allocated Categories. To see the progress of your Viewers’ activity during the scoring/commenting stage, do as follows:</p>



<ol class="wp-block-list">
<li>Log into the&nbsp;<strong>Admin Interface</strong></li>



<li>Go to <strong>Awards > Overview > Settings</strong> <strong>> Viewers</strong></li>



<li>The&nbsp;<strong>Viewers List</strong>&nbsp;displays. Select the Award you want to check by filtering it from the&nbsp;<strong>Award(s)</strong>&nbsp;column.</li>



<li>If required, do likewise with the&nbsp;<strong>Category</strong>&nbsp;dropdown menu</li>



<li>The ‘<strong>% complete</strong>’ column displays. Here you can find your Viewers’ progress expressed as a percentage</li>
</ol>



<p>You can also filter the list to display only those Viewers by scoring percentage.<br>a) To select those who have viewed&nbsp;<strong>less&nbsp;</strong>than a certain percentage:</p>



<ol class="wp-block-list">
<li>Select the&nbsp;<strong>&lt;</strong>&nbsp;under the&nbsp;<strong>% complete</strong>&nbsp;filter</li>



<li>Type in the percentage figure in the box alongside</li>
</ol>



<p>b) To select those who have viewed&nbsp;<strong>more&nbsp;</strong>than a certain percentage:</p>



<ol class="wp-block-list">
<li>Select the&nbsp;<strong>&gt;</strong>&nbsp;under the&nbsp;<strong>% complete</strong>&nbsp;filter</li>



<li>Type in the percentage figure in the box alongside</li>
</ol>



<h3 class="wp-block-heading">How to Contact Judges based on their Scoring Progress</h3>



<p>Admins can contact Judges based on their scoring progress to remind them to submit scores or chase based on an upcoming Submission Deadline. It is possible to set up recurring emails triggered at a pre-set time and recurrence or to create one off email jobs.  For more information about using the Entrant Mailout functionality, read this <a href="https://nucleus-help.bmt.bafta.org/help-articles/contact-groups-of-entrants-and-viewers-using-entrant-mailout/">guide</a>.</p>



<h3 class="wp-block-heading">How to Unsubmit Scores for Judges to Edit</h3>



<p>Once a Judge has submitted their scores and comments, they become read-only. Judges can still see their scores and comments, but they are unable to edit them. If a Judge contacts Admins to request that they update their scores, Nucleus facilitates this by allowing Judges to edit and resubmit their scores so long as Admin Users approve this action.</p>



<ol class="wp-block-list">
<li>Log into the <strong>Admin Interface</strong></li>



<li>Go to <strong> <strong>Awards > Overview > Settings</strong> <strong>> Viewers</strong></strong></li>



<li>Filter for the relevant user and click <strong>Edit</strong> in the actions menu</li>



<li>In the right hand column search for the relevant Award</li>



<li>Click on the <strong>Unsubmit Scores and Comments</strong> button</li>



<li>The Judge will be able to edit the scores again</li>
</ol>



<p>Note &#8211; the unsubmission process will trigger the <strong>viewer/unsubmitScoresComments</strong> email template. Please review and update or disable the template before unsubmitting the scores. More information about editing email templates can be found in this <a href="https://nucleus-help.bmt.bafta.org/help-articles/how-to-manage-your-email-templates/">guide</a>.</p>



<h3 class="wp-block-heading">How to Run Reports for Judges&#8217; Scores</h3>



<p>There are two reports available for Admins to be able to extract score data:</p>



<ul class="wp-block-list">
<li><strong>Full Score Details</strong> &#8211; exports all score data submitted by judges</li>



<li><strong>Summary (Average scores) </strong>&#8211; combines the Judges&#8217; scores for each Entry and outputs an average score</li>
</ul>



<p>If you require a bespoke report to assist in your workflows, please <a href="https://baftaresearch.atlassian.net/servicedesk/customer/portals">raise a support ticket</a> as this can be commissioned.</p>



<p>To export a Report:</p>



<ol class="wp-block-list">
<li>Log into the <strong>Admin Interface</strong></li>



<li>Go to <strong>Control Centre</strong></li>



<li>Click on Viewer Score <strong>Download </strong>in the Reports section</li>



<li>Select the relevant <strong>Award</strong></li>



<li>Select the <strong>Categories </strong>to export</li>



<li>Choose the<strong> Report format</strong></li>



<li>Click <strong>Download</strong></li>
</ol>
]]></content:encoded>
					
		
		
			</item>
		<item>
		<title>Setting Viewing guidelines and requirements</title>
		<link>https://nucleus-help.bmt.bafta.org/help-articles/setting-viewing-guidelines-and-requirements/</link>
		
		<dc:creator><![CDATA[David Lortal]]></dc:creator>
		<pubDate>Tue, 27 Jul 2021 17:39:15 +0000</pubDate>
				<guid isPermaLink="false">http://54.226.12.186/?post_type=lsvr_kba&#038;p=169</guid>

					<description><![CDATA[It is important to ensure that your Viewers/Judges are clear on what is expected of them and that they carry out their duties consistently and fairly. Therefore, the Viewing Portal Intro sections on each Category set up page gives you the ability to communicate this information in as much detail as you require. There are [&#8230;]]]></description>
										<content:encoded><![CDATA[
<p class="has-normal-font-size" id="block-e991aac0-4383-481a-a35c-fb4ba53ef9a1">It is important to ensure that your Viewers/Judges are clear on what is expected of them and that they carry out their duties consistently and fairly.</p>



<p class="has-normal-font-size" id="block-98b1f7fc-4db5-4321-b91f-abf91c1af2d0">Therefore, the Viewing Portal Intro sections on each Category set up page gives you the ability to communicate this information in as much detail as you require.</p>



<p class="has-normal-font-size" id="block-f83b4a54-7d78-4b8a-bb55-794b3352f97b">There are two distinct fields for this:</p>



<ol id="block-551c841c-f924-4320-a152-f820fe9776ef" class="wp-block-list">
<li><strong>Viewing Portal Intro (Full)</strong> &#8211; This appears at the top of the Viewing pane for each Category that your Viewers/Judges are viewing. This is an unlimited space that will expand to accommodate as much information as you require. Information that you might include here: clarification of what they are viewing and how they should evaluate them, explanation of your scoring scales, terms and conditions, deadlines for submitting their scores, a reminder to Submit their scores when finished, links to any further external information they may need. Because this section will expand as much as you require, the Viewer will not be able to see the entries until they have read all of it. They can refer back to this intro at any time during the viewing by scrolling back up to the top of the page.</li>



<li><strong>Viewing Portal Intro (Floated Summary)</strong> &#8211; This appears at the top of the Viewing pane for each Category, and tracks down (or &#8216;floats&#8217; down) the page as the Viewer scrolls through the entries. Because of this, the content you input here should be kept to the bare minimum &#8211; or none at all &#8211; as it will otherwise impinge upon the Viewing pane where they view the actual entries if it is too long. Information that you might include here should be kept to the absolute essential, must-see info that the Viewer should be aware of at all times such as the deadline for submitting their scores. Limit it to 1-2 lines max.</li>
</ol>



<p class="has-normal-font-size" id="block-6d1678f3-46e4-4de3-8cc7-66258a9e2702">To edit each of the above:</p>



<ol id="block-39f2a81e-1a7f-463a-8268-01d94f5c37c9" class="wp-block-list">
<li>Go to <strong>Awards > Overview > Categories.</strong></li>



<li>The <strong>Category List</strong> opens. Alongside each Category, click on the<strong> Edit </strong>link.</li>



<li>The <strong>Category Edit</strong> page opens. Scroll down to the <strong>Viewing Portal</strong> section and edit each of the above as you require.</li>



<li>Click <strong>Save and Close</strong>.</li>
</ol>
]]></content:encoded>
					
		
		
			</item>
	</channel>
</rss>
