graded on the answerweb-extraction-contract
Does its output keep the shape a consumer parses?
4 assertions · 0 tools
- What it tests
- Output-schema conformance, reporting every violation with its path rather than the first.
- Fails when
- A field is missing, mistyped, too short, or not an accepted property.
Step 2 of 6Agent
Which agent should try it?
The expected verdict is on the card before you run it. These are recorded runs, so nothing is being hidden from you — and watching a check fail is the only proof it measures anything.
Connect your own
Beacon grades an agent over MCP, A2A, or a JSONL bridge of about thirty lines. That runs on your machine, not in this browser — the playground only replays what was recorded.
python3 -m beacon run <scenario> --adapter a2a --agent-url …