User Guide2026-03-15·7 min read

How to Use MAPLES OSM: Part 3 — Moderation & Verification

A guide for moderators on verifying evaluations, comparing evaluator marks, issuing warnings, reallocating workloads, and admin answer book assignment in MAPLES OSM.

How to Use MAPLES OSM: Part 3 — Moderation & Verification

Overview

Moderators play a critical role in MAPLES OSM — they verify that evaluators have marked answer sheets accurately and consistently. This guide covers the complete moderation workflow, from selecting evaluations to verify, through the verification process itself, to issuing warnings and managing workloads.

If you haven't read the earlier parts, start with Part 1: Getting Started for login and dashboard basics, and Part 2: Evaluating Answer Sheets to understand how evaluation works.

The Moderator Dashboard

After logging in as a moderator, your dashboard shows three key metrics:

Moderator dashboard
Moderator dashboard
MetricDescription
Evaluations to VerifyNumber of completed evaluations waiting for your review
Warnings IssuedTotal warnings you've given to evaluators
Total SubjectsNumber of subjects under your supervision

If your institution allows it, moderators can also evaluate answer books themselves. In that case, you'll have access to both the evaluator and moderator dashboards.

Viewing Evaluators

Select a subject from the dropdown to see the evaluators working on that subject. The evaluators table shows:

ColumnDescription
Evaluator NameThe evaluator's name
AssignedTotal answer books assigned
CompletedNumber finished
PendingNumber remaining
Verification Required?Whether completed books need your review
ActionsVerify, View Details, or Reallocate buttons

Action Buttons

  • "Verify"Opens the verification page for that evaluator's completed answer books.
  • "View Details"See detailed information about the evaluator's progress.
  • "Reallocate"Redistribute expected evaluation counts between evaluators (see below).
  • The Verification Process

    Step 1: Select Evaluations to Verify

    Click "Verify" next to an evaluator's name. This opens the verification page showing all of that evaluator's completed answer books for the selected subject.

    The verification page displays the evaluator name, subject, a progress bar showing completed vs total assigned, and the expected evaluation count.

    Step 2: Choose an Answer Book

    The verification table lists answer books with their ID, status (Pending Verification, In Progress, or Verified), marks awarded, last modified date, and action button.

    Books are sorted with priority: In Progress (yours) then Pending then Verified then In Progress (others).

    Action buttons change based on status:

  • Pending"Verify" to start verification
  • In Progress (by you)"Continue Verification" to resume
  • In Progress (by another moderator)Button disabled with tooltip showing who has it
  • Verified"View" to review (if enabled)
  • Step 3: Verify the Evaluation

    Verification overlay with evaluator marks
    Verification overlay with evaluator marks

    When you open an answer book for verification, you'll see the same evaluation interface from Part 2, with some key differences:

  • Evaluator's Marks Visible — The evaluator's tick and cross marks are displayed on the answer sheet in a distinct color.
  • Toggle Evaluator Marks — You can show or hide the evaluator's marks to form your own independent assessment.
  • Your Own Marks — You can place your own marks as an overlay to compare with the evaluator's work.
  • Edit Scores — You have the ability to adjust the scores if you disagree with the evaluator's marking.
  • Step 4: Issue Warnings (If Needed)

    Warning dialog for evaluators
    Warning dialog for evaluators

    If you find issues with the evaluator's work, you can issue warnings during verification. Check the applicable warning types:

    Warning TypeDescription
    Over-valuationAward of excessive marks — evaluator gave more marks than deserved
    Under-valuationAward of inadequate marks — evaluator gave fewer marks than deserved
    Lack of adherence to answer keyEvaluator did not follow the official answer key
    Inadequate knowledge on subjectEvaluator appears to lack sufficient subject knowledge
    Any other warningCustom warning with a text description

    Warnings are sent to the evaluator and appear as notifications (bell icon) in their dashboard. Multiple warnings may trigger administrative review.

    Step 5: Complete Verification

    Once you've reviewed the evaluation:

  • Make any necessary score adjustments.
  • Select any applicable warnings.
  • Click "Complete Verification" to finalize.
  • Or click "Back" to return to the verification list without completing.

    Reallocating Workloads

    As a moderator, you can redistribute evaluation workloads between evaluators within a subject. This is useful when an evaluator is unavailable or overloaded.

    How to Reallocate

  • Click "Reallocate" next to an evaluator's name.
  • In the "Reallocate Expected Count" dialog:
  • - From Evaluator — Select the evaluator to take work from.

    - To Evaluator — Select the evaluator to give work to.

    - Amount — Enter the number of evaluations to transfer.

    - Reason — Select a reason: Evaluator unavailable, Workload rebalancing, Subject expertise mismatch, Evaluator request, Deadline adjustment, or Administrative correction.

  • Click "Reallocate" to confirm, or "Cancel" to go back.
  • You cannot reallocate more answer books than the "From" evaluator has remaining (unevaluated). The system validates this automatically.

    Admin: Assigning Answer Books

    Administrators have additional capabilities for managing answer book assignments.

    The Admin Dashboard

    The admin assignment page shows:

  • Subject SelectorChoose which subject to manage.
  • Stats Cards: Total Unassigned (answer books not yet assigned), Total Evaluators (number available for the subject), and Total Assigned (answer books already distributed).
  • Assigning Books

  • Select evaluators using the checkboxes (or "Select All").
  • Click "Assign Books".
  • In the dialog, choose the number of books to assign (1–25 or custom) and optionally set a deadline using the calendar picker.
  • Click "Assign to Selected" to distribute.
  • Unassigning Books

  • Select evaluators with unevaluated books.
  • Click "Unassign Books".
  • Confirm in the dialog.
  • Use bulk operations (select all + assign) to quickly distribute answer books across your evaluator team.

    Best Practices for Moderators

  • Be consistent — Apply the same standards to all evaluators you verify.
  • Use the answer key — Always compare against the official answer key, not your personal judgment.
  • Toggle evaluator marks — Try hiding the evaluator's marks first to form your own opinion, then compare.
  • Provide constructive warnings — Warnings help evaluators improve. Use them when genuinely needed, not punitively.
  • Monitor completion rates — Check the progress bars regularly and reallocate workloads before deadlines approach.
  • Verify samples — If time is limited, prioritize verifying a representative sample across all evaluators rather than exhaustively checking one evaluator.
  • Quick Reference: Evaluation Statuses

    StatusMeaningWho Sets It
    UnevaluatedNot yet startedSystem (default)
    StartedEvaluator has begun markingEvaluator
    ProcessingEvaluation in progressSystem
    CompletedEvaluation submittedEvaluator
    ModeratedVerified and approved by moderatorModerator
    RevaluatedRe-evaluated after moderator reviewSystem
    RejectedEvaluator rejected the answer bookEvaluator
    MalpracticeMalpractice reportedEvaluator

    Summary

    MAPLES OSM streamlines the entire answer sheet evaluation process:

  • Evaluators mark answer sheets digitally with a clear, efficient interface.
  • Moderators verify quality and maintain standards through the verification workflow.
  • Administrators manage assignments and workload distribution.
  • The platform eliminates the need for physical evaluation camps, reduces errors through digital tracking, and provides complete transparency with audit trails for every mark, warning, and verification.

    *This guide is part of a 3-part series:*

  • [Part 1: Getting Started](/blog/guide-getting-started)
  • [Part 2: Evaluating Answer Sheets](/blog/guide-evaluating-answer-sheets)
  • Part 3: Moderation & Verification (You are here)
  • Have questions? Contact your institution's Controller of Examinations (COE) or reach out through the in-app support chat.

    Related Reading

  • [End-to-End Evaluation Workflow](/blog/end-to-end-exam-evaluation-workflow) — The complete pipeline from inwarding to results
  • [DOTE Case Study](/case-studies/dote) — Moderation at scale across 467 institutions
  • Ready to digitize your evaluation process?

    See how MAPLES OSM can transform exam evaluation at your institution.