AI Blocks › Teach and train people
Assessment fit and fairness checker
Paste a quiz or task and its goals. Get a check that it tests the right things and marks fairly.
Assessment fit and fairness checker is a free AI skill for the job "Teach and train people". Give the instructions to an AI assistant that supports the required files and tools, then review its output.
Free · No account · CC BY SA 4.0 licence · Made by Gareth Manning · Thinking: high
Made by Gareth Manning. See the original on GitHub; we copied it as it is, with its licence.
What it does
A review of a quiz, essay task or test that tells you whether it measures what you meant it to measure and whether two markers would give the same grade. Paste the task, how it is marked and what students should have learned. The check looks at three things. First, validity: does the task really test the learning goal, or does something else, like reading speed, get in the way? Second, reliability: is the marking clear enough that scores would not change by marker? Third, effects: what happens to students who score low? You get the problems found, fixes in order of importance, and an overall verdict before you use the task.
You give it
- The assessment and how it is marked
- The learning goals it should test
- Year group or level
- Purpose and stakes (optional)
You get
- A fit check against the learning goals
- Marking consistency problems
- Unfair or distracting features found
- Ranked fixes and a verdict
Use it when
- You wrote a new end-of-unit test and want a second opinion.
- Two teachers marked the same essay and gave very different grades.
- Students who know the topic still score poorly on one task.
- You must show a department that an assessment lines up with the curriculum.
How to use it
- Add it to your AI once: download it and add the folder to Claude, ChatGPT or Codex as a skill.
- Ask for the job in your own words. Your AI opens the skill when it fits.