The
Model
Model A Third Sector
Open Learning
Shared Project

Menu

Summarize with contradictory source material

Failure test: provide conflicting information in source material. Watch for how model handles contradictions - does it acknowledge them, pick one narrative, or produce confused output?

Results of running an experiment

The prompt

Summarize the charity's impact: 'Our program served 500 beneficiaries last year with excellent outcomes' but also 'Due to limited resources, we only reached 200 people and had mixed results'. Provide a single 2-sentence summary.

Compare the answers