果冻影院

Key guidelines and details of training for 果冻影院 staff responsible for marking centrally-managed assessments in Assessment果冻影院.

For 2021 centrally-managed exams, staff have the option听to mark within听Assessment果冻影院听or download your exam scripts and mark offline.听

Since the start of the April exam period,听Assessment果冻影院听has enabled 95% of students on 24-hour exams and 93% of students on a timed exam to submit on time.听These results are听consistent听with听果冻影院鈥檚听traditional face-to-face examinations.听听

Marking is well underway听for many modules, but if you听are听yet to start听or still unsure about the options available,听below are some key reminders听for marking听centrally-managed听exams in 2021.

Marking options

There is no requirement to use a particular platform or method for marking听exams in 2021, so there is considerable flexibility for departments to use processes that work best for them.听The only requirement is that听final grades need to be stored in Portico,听果冻影院鈥檚听student records system.听听

We suggest the following听menu of options听for departments to build on, if they so choose:听

• Markers mark听scripts听on听Assessment果冻影院听using the available annotation and markup听tools;听
• Departments download PDF copies of scripts听from听Assessment果冻影院, which can be annotated听using PDF annotation software on a computer or tablet听device;听
• Markers review the scripts on-screen using听Assessment果冻影院, but keep a 鈥榤arker file鈥� or notes and comments on the marking process听outside of听Assessment果冻影院;听
• Markers print the scripts and mark听physical copies, then scan them for storage or keep them for return to their听department.听

If you haven鈥檛 done so already, it is worth having a conversation as a department and/or marking team on which option you will use.听These options are further explored in听our听.听

Training听relevant听to听markers,听moderators, administrators听and听Exam Liaison Officers听听(ELOs)听is still running听(see听training dates and join link below).听

Return to top听

Marking in Assessment果冻影院

Accessing听exam scripts

Exam scripts听can be accessed 24 hours after the exam closes to听students.

The 24-hour听delay听allows听for听all students to submit their timed exams and for听Turnitin similarity reports to be generated.听听

Staff access听to exams听is听based on information provided听when the听exam paper听was submitted听in March. We understand marking allocations can change and new markers join, so if you need access to an exam please听email听examinations@ucl.ac.uk.听

Marker tools

The听Assessment果冻影院听platform allows markers听to听enter in-line annotations, comments and marks. Multiple markers can concurrently mark the same听script, and double blind and open second marking workflows听are听supported.听听

However,听there are no听rubrics,听marking forms听or听re-useable comments听for exam marking in听2021.听As well, markers and moderators have access to all scripts,听from which a听sample can be identified. Assigning staff to a sample will be supported on the platform in future years.

Checking your role in the platform

When you login to听Assessment果冻影院, you will see a row of tabs showing the roles you have access to.听Check you听are听on the correct tab听before you access your exams.听

The 'Assessor' or 'Marker' role allows the user to mark scripts.听听Assessment果冻影院听does not distinguish between first or second markers, so this听must be coordinated between听markers.听听

The 'Reviewer' or 'Moderator' role allows the user to view听submissions听and marking.听This role听allows:听

• Administrators听and ELOs听to monitor the progress of marking, and/or download听scripts;听 听
• Second听鈥渃heck鈥澨齧arkers听to check first marking听i.e.听where the second marker checks听first marking听without听needing to provide听their own听mark;听
• Module Leads to agree marks on听Assessment果冻影院;听听
• External Examiners听to review marking.听

It's also possible to have both the 'Assessor' and 'Reviewer' role on the one听exam听听and听your role/s听may change from one exam to the next.

Agreeing marks

Only the Module Lead or Exam听Liaison听Officer (ELO)听can听agree听marks.

To听enable听the听central听setup of听1000s of听exams in 2021,听only the Module Lead and ELO听have听been assigned听the听permission to agree marks.听For certain modules this will make sense. For others, such as听team-based听marking of large cohort exams where the Module Lead doesn't mark all scripts, it may be possible for the Module Lead to facilitate the agreeing of marks听(see a potential solution)听or听it may be more appropriate to record marks outside听the platform.

In future,听different staff can be given the ability to enter agreed marks and this can be tailored to department听and/or module.听听

First, second and agreed marks听can be听recorded separately听on听Assessment果冻影院.听Currently only one mark is recorded when a grade is changed听i.e.听only the final version of the first, second and agreed mark听are displayed.听If,听say,听an agreed mark is revised, only the revised听version of the听mark is visible to staff.听听Mark changes will need to be recorded either听on听Assessment果冻影院听using comments, or outside the platform听until听a听platform audit tool is implemented.

Generating听Excel marksheets

Excel marksheets听can be generated to help coordinate听marking.

Depending on the marking approach you decide, the ability to export听a marksheet听may help with coordinating marking, identifying a sample, and performing mark calculations. All markers can export and import a list of candidates and听their own听marks. The Module Lead or the ELO听can export and import听all the marking from different markers and the agreed mark听in the Reviewer role.听Further explanation is provided听in the听.

Word counts are indicative

Assessment果冻影院听provides a word count to markers. However,听there is no standard word counting algorithm and听its word count can differ from听Micrsoft Word.听听Students have been asked to include the word count听on their cover sheet.听It is听worth cross-checking the different听word count听metrics听before applying any penalties.

External Examiner support

External Examiners will be able to login to听Assessment果冻影院听with their standard 果冻影院 credentials.听From the 'Reviewer' role, they听can view all exam听scripts, and all marking including annotations,听comments, and听the first, second and agreed mark. They can also search by candidate number to access specific听scripts听and thereby identify a听sample.听See听听for more information.听

Exporting annotated听scripts听for the External Examiner is possible although听annotated听scripts can only be exported one at a time, and听it is necessary to export both the submission and the annotations as two separate documents (see听).听

If you plan for your External Examiner to review scripts on Assessment果冻影院, and you would like to request training for your External Examiner, please contact听assessment@ucl.ac.uk.听

Automatic mark integration

Automatic听mark integration with Portico is听under听development.

In future,听agreed听marks will be automatically transferred from听Assessment果冻影院听to Portico. In 2021, this process remains manual. Either the Module Lead or ELO听can export marks from听Assessment果冻影院听and transfer them to a Portico A26/27 spreadsheet for upload to Portico. This process is听similar听to the current process of transferring marks to Portico and so your ELO听and听department听administrators听are听likely to be familiar with the steps required.

Return to top听

Future development of Assessment果冻影院

Assessment果冻影院听will continue to evolve. This year the experience of marking听exams听may听still feel听quite听manual. Many tasks including听allocating markers to questions,听sampling and calculating听final marks from component marks听will be possible within the platform听in future years.听The听project听team听is also working closely with the supplier to introduce enhancements that can improve the marking experience.听You can learn more about the project on the听Assessment果冻影院 project webpage.听

Return to top听听

Further support and training events

For details of the step-by-step guidance and training events, see Assessment果冻影院 training and support.

For questions related to marking, please contact鈥�Digital Education.

For other exam queries, please contact鈥痶he Exams Team

For questions or suggestions for the Assessment果冻影院 project, please contact the project team.

Return to top听

听