Participant information and consent
Consent to take part
AI Scores on Trial: A Human-in-the-Loop Validity Lab for Writing Assessment.
- What this workshop is. A forty-five minute conference session in which you mark one anonymised student essay against a three-criterion rubric, and then compare your judgement with two other human examiners and two artificial intelligence systems that marked the same script.
- What taking part involves. Reading the essay, entering three scores (content and argument out of eight, organisation and coherence out of six, language and expression out of six), a short written comment, and an opening and a closing verdict. This takes about fifteen minutes of the session.
- Taking part is entirely voluntary. You may take part, or observe without entering anything, or stop at any point. You do not have to give a reason, nothing follows from declining, and no one will ask you why.
- What is shown to the room. The name or role label you choose, together with your scores and your comment, is displayed on the facilitator's screen so that everyone present can see and discuss the spread of judgements. Please use the label you are comfortable being seen with. A role label such as “AUC Human Examiner 4” is an equally professional choice, and no one will be asked to explain their choice.
- What is not done with it. Nothing you enter is used for research, publication, reporting, institutional or individual evaluation, marketing, or the training of any artificial intelligence system. Nothing is attributed to you outside this room.
- What is collected. Only what you type: a label, three scores, a comment, and a verdict. There is no account, no login, no email address, no file upload, no analytics, no cookies used for tracking, and no identification by IP address or device.
- Storage and deletion. Entries are held on the workshop server for the duration of the session only, and are deleted by the facilitator when the workshop ends.
- Withdrawal. You may ask the facilitator to remove your entry at any time during the session. It will be removed before anything is displayed again, and you do not need to give a reason.
- Risks. There are no anticipated risks beyond the ordinary professional discomfort of finding that your judgement differs publicly from a colleague's. Disagreement between examiners is the subject of the workshop, not a failing on anyone's part.
- The essay. The script is a genuine examination paper, used with permission and fully anonymised. All names and identifying details were removed before it was shared, and the writer cannot be identified from it.
- Questions. Ask the facilitator at any point during the session, or write to contact@upskilling1.com.
Declaration
I have read this statement. I understand that taking part is voluntary, that the label, scores and comment I enter will be shown to this room and used for no other purpose, and that the record will be deleted after the session. I consent to take part.
You confirm this declaration on the site at the moment you submit your judgement, not before. Until then nothing you type is sent anywhere. This page can be printed or saved for your records.
Back to the workshop hub