Concert ticket study: the original 40 attempts
This page is the record of my first collection, kept as it was reported. The current results, with 40 completed negotiations, are on the expanded results page.
Archive · 40 attempts · 38 completed · 2 interrupted, outcomes unknownResults, uncertainty and limitations · Pairing table · Opener table · All 40 assigned outcomes
Scientific registration · Frozen roster · Independent replay/accounting audit · Methods and reproduction
Results at a glance
I ran 40 concert-ticket negotiations: 20 between Haiku pairs and 20 between Opus pairs. Thirty-eight completed. Two runs were interrupted, so their outcomes are unknown. Each pairing has 19 completed agreements and one unknown; both interrupted runs were buyer-first. There were no known no-deals. I report the interrupted outcomes as unknown, not zero.
| Pairing | Known of assigned | Mean | Median | Sample SD | Range | All-assigned mean bounds |
|---|---|---|---|---|---|---|
| HH (Haiku with Haiku) | 19 of 20 | 57.97 | 57.94 | 3.45 | 50.63–66.75 | 55.07–59.57 |
| OO (Opus with Opus) | 19 of 20 | 83.41 | 83.81 | 2.42 | 78.00–86.63 | 79.24–83.74 |
Source: pairing-summary.csv. No known outcome left either owner below fallback, and no known run used a format repair.
Difference and uncertainty
Among the 38 completed negotiations in this collection, OO mean joint gain is 25.44 points higher than HH. Because one assigned outcome in each pairing is unknown, the prespecified rule reports no sampling confidence interval. Instead, the bounds let each unknown take any value from 0 to 90 points. Over all 40 assignments, the OO minus HH difference is then between 19.67 and 28.67 points. These are missing-outcome bounds, not confidence intervals. The sample SD describes spread among known runs; it is not a sampling interval.
Who gained: buyer and seller, by opener
| Pairing | Opener | Known of assigned | Joint gain | Buyer gain | Seller gain |
|---|---|---|---|---|---|
| HH | Buyer | 9 of 10 | 57.12 | 46.52 | 10.60 |
| HH | Seller | 10 of 10 | 58.73 | 35.59 | 23.14 |
| HH | All | 19 of 20 | 57.97 | 40.77 | 17.20 |
| OO | Buyer | 9 of 10 | 82.96 | 42.87 | 40.09 |
| OO | Seller | 10 of 10 | 83.81 | 40.66 | 43.15 |
| OO | All | 19 of 20 | 83.41 | 41.70 | 41.70 |
Source: opener-summary.csv and pairing-summary.csv.
Buyers gained about the same in both pairings. Most of the joint difference is on the seller side. Within HH, buyers received more gain than sellers under either opener, most clearly when the buyer opened, while OO splits were close to even. By opener, the known-case OO minus HH difference is 25.84 points with a buyer opener and 25.08 with a seller opener. These role and opener comparisons are exploratory: they carry no significance test, do not resolve missingness and say nothing about motives.
What this does and does not show
- I used one constructed ticket scenario and a fresh context for each run. These results describe that setup; they do not establish how the models would negotiate in other markets.
- I did not test human negotiators, general intelligence or improvement over time. This study does not establish a general model ranking or a causal effect of capability.
- “Net value creation” means combined synthetic owner gain above both no-deal fallbacks. It is not dollars, net compute cost or social welfare.
- Models: claude-haiku-5-5 and claude-opus-5-5, adaptive thinking at low effort, a 4,096-token output allowance, standard_only tier. Collected 27–28 October 2026. No immutable dated weight snapshot was returned.
Data and reproduction
RESULTS.md · per-assignment.csv (all 40 run IDs, unknown values blank) · REGISTRATION_SCIENTIFIC.json · AUDIT_SUMMARY.json · TRANSCRIPTS.jsonl (exact delivered public texts) · README.md
The supported reproduction command is python reproduce.py; see README.md. prespecified_analysis.py is archived source only, not an entrypoint. A deterministic replay and accounting audit passed 1,983 checks, including all 38 known final offers and utilities.
The 40 original conversations, including the two interrupted attempts
- negotiation-c3rep40-20261027-b01-p01-oo-a4 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b01-p02-oo-a3 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b01-p03-hh-a4 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b01-p04-oo-a1 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b01-p05-oo-a2 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b01-p06-hh-a2 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b01-p07-hh-a1 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b01-p08-hh-a3 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b02-p01-hh-a3 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b02-p02-oo-a2 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b02-p03-hh-a2 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b02-p04-oo-a1 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b02-p05-oo-a4 · INCOMPLETE (interrupted, outcome unknown)
- negotiation-c3rep40-20261027-b02-p06-oo-a3 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b02-p07-hh-a1 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b02-p08-hh-a4 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b03-p01-oo-a1 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b03-p02-hh-a1 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b03-p03-hh-a3 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b03-p04-oo-a3 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b03-p05-oo-a4 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b03-p06-hh-a4 · INCOMPLETE (interrupted, outcome unknown)
- negotiation-c3rep40-20261027-b03-p07-oo-a2 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b03-p08-hh-a2 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b04-p01-hh-a1 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b04-p02-hh-a3 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b04-p03-oo-a4 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b04-p04-oo-a3 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b04-p05-oo-a2 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b04-p06-hh-a2 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b04-p07-hh-a4 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b04-p08-oo-a1 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b05-p01-hh-a2 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b05-p02-oo-a1 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b05-p03-hh-a4 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b05-p04-hh-a1 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b05-p05-oo-a2 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b05-p06-oo-a3 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b05-p07-oo-a4 · AGREEMENT (completed)
- negotiation-c3rep40-20261027-b05-p08-hh-a3 · AGREEMENT (completed)