Trolley Game.
Skip to the study
The Study by Lance Jones

When all twelve models agreed, what were they agreeing about?

All twelve models landed on the same majority answer eight times. The agreement looked decisive. The moral priority changed with the situation.

Eight dilemmas drew overwhelming agreement.

Every win was overwhelming. In each case, at least 93% of the answers chose the same option. The shared answers ranged from protecting consent to preserving a comforting falsehood.

That range is the story. The models found a clear answer inside each dilemma, and the guiding priority shifted as the conflict changed.

The chart shows the strength of each result.

How strong the agreement was

The Stranger Who Caused ItThe person who caused the danger dies.
98.5%
The Volunteer Changes His MindThe volunteer survives; the five people die.
98.4%
Ten Years From NowFive people survive today; one person dies in ten years.
94.1%
The AI DiagnosisMore patients survive overall; the unequal outcomes continue for now.
98.0%
The Perfect CopyThe five people survive; your body is destroyed and the perfect copy continues your life.
96.5%
The WalletThe owner receives the wallet and all $5,000.
100%
The ScholarshipThe candidate who could not otherwise pursue the opportunity receives the scholarship.
93.1%
The MemoryYour friend keeps the comforting memory unchanged.
99.1%
Share of valid responses choosing the shared answer. Each model answered every dilemma 200 times.

Consent won in one dilemma. Saving more lives won in another.

In one case, the models let five people die rather than ignore a volunteer's withdrawn consent. In another, they kept a biased system in place because it saved more patients. The context changed what counted most.

These answers create a problem for any simple account of AI morality. The rule that fits one dilemma can point the wrong way in the next. Context determines which conflict the model has to resolve.

A panicked volunteer stands in a counterweight harness above five people trapped in a cliffside lift while rescue workers pause at the release controls.
The Volunteer Changes His Mind98.4%

The volunteer survives; the five people die.

Consent outweighed the five-to-one outcome.

Public-health leaders examine a citywide medical network whose central display shows strong overall survival alongside a persistent disparity affecting Black patients.
The AI Diagnosis98.0%

More patients survive overall; the unequal outcomes continue for now.

Saving more lives outweighed unequal treatment.

The models chose need in one case and emotional protection in another.

The Scholarship asked whether a stronger record should outweigh financial hardship. The Memory asked whether accuracy was worth causing a friend fresh pain. The models chose the more compassionate option in both, though compassion meant something different in each case.

Placed beside the life-and-death examples above, these social choices make the pattern clearer. The hierarchy of values changed from one case to the next.

A San Francisco civic foundation committee considers two scholarship finalists, balancing exceptional achievement against profound financial need.
The Scholarship93.1%

The candidate who could not otherwise pursue the opportunity receives the scholarship.

Need outweighed the stronger record.

Two close friends sit across an archive table as one holds a comforting keepsake and the other studies records that contradict the memory.
The Memory99.1%

Your friend keeps the comforting memory unchanged.

Emotional protection outweighed accuracy.