In 1976, the California Supreme Court told therapists one simple thing: if you hear it, you speak up.
Three words — duty to warn — tied "hearing" and "speaking" together and knotted them into California Civil Code §43.92. Not to punish anyone. To affirm something so plain it barely needed arguing: listening carries weight.
Tatiana Tarasoff was murdered in 1969. Her killer had disclosed his intent to a therapist beforehand. The therapist notified campus police. He did not notify her. It took the court eight years after her death to tie that knot — if you hear it, you speak up.
Fifty years later, the rope came loose.
A Vanishing Order
What we miss isn't a specific law. It's an order — slow, small, tethered to persons. A doctor saves lives not because she knows how, but because she is a doctor. A lawyer owes fiduciary duty not because he knows the law, but because he is a lawyer. A therapist reports a crisis not because she heard one, but because she is a therapist.
A therapist might see three hundred patients a year, spending one hour a week with a few of them. After work he sits in his car, replaying that one sentence that didn't sound right. He loses sleep. He calls a colleague. His license won't let him put it down — and he knows the nearest police station is three blocks away.
That was an order sustained by identity, neighbors, a precinct, and insomnia.
Today, eight hundred million people talk to a sleepless listener every week.
In an October 2025 safety blog post, OpenAI acknowledged that roughly 0.15% of weekly active users expressed "explicit suicidal plans or intent" in conversation — approximately 1.2 million people, every week. That number exceeds the combined annual caseload of every licensed psychotherapist in the United States.
And this listener has no identity.
It can hear, understand, respond — sometimes calmly, sometimes warmly. But it is not a therapist, not a lawyer, not a doctor, not a priest. It is the fifth kind of listener. It inherited every capability of the first four, and none of their identities.
No identity means no duty. No duty means silence is not negligence — just silence.
Where the Capability Came From
Mercor, valued at $10 billion, counts OpenAI, Anthropic, and Meta among its clients. Its business is straightforward: doctors write model answers for medical records, lawyers write model answers for legal opinions, social workers write model answers for crisis intervention — human expertise sliced into billable-hour granules and fed to frontier models. A significant share of those it recruits were laid off by former employers.
In 2026, the four major cloud providers are projected to spend over $700 billion on AI infrastructure. Estimated annual depreciation over the next five years exceeds $400 billion. That money has to be absorbed by corporate balance sheets. The way to make room is to make room for fewer people.
She might be a lawyer. Eight years at a mid-size firm, specializing in M&A. The day she was let go, she got a LinkedIn message. Three months later she was on the Mercor platform, working four hours a day at a fraction of her old rate, writing standard legal analyses for a frontier model. Health insurance gone. 401(k) gone. Career path gone. License still active — the cruelest part.
Her professional capability went up — into the model's weights. Her ABA Model Rule 1.6(b)(1), the professional conduct rule on confidentiality and its exceptions, stayed behind. The therapist's §43.92 stayed behind. The bank compliance officer's suspicious activity reporting obligation stayed behind.
Three parties split the same labor. The platform takes the dispatch fee. The model company takes the capability. The professional keeps the duty — and all the risk behind it.
Capability transferred. Duty did not follow.
Because duty was never the content of a capability. It was the identity of the person who bore it. In 1976, the ability to "hear" could only be obtained through licenses, training, and clinics — tangible containers. Capability and identity were two strands of the same rope. Fifty years later, the ability to hear separated from identity for the first time. The two strands came apart.
What Happened Next
April 2025: Florida State University campus shooting. Phoenix Ikner spent hours before the attack asking ChatGPT about peak campus foot traffic, firearm operation, and shooting consequences. Two dead, six injured.
June 2025: OpenAI's automated systems flagged the ChatGPT account of Canadian user Jesse Van Rootselaar — reason: "firearms violence activity and planning." According to the Wall Street Journal, a human reviewer recommended notifying Canadian police. The company chose only to ban the account. In February 2026, Van Rootselaar carried out a mass shooting.
Every case points to the same structure: the company knew — someone internally advocated action — the company chose inaction.
Awareness without action, in tort law, is not ignorance. It approaches negligence.
Florida Attorney General James Uthmeier's statement came close to saying: if ChatGPT were a person, it would face murder charges. A heavy sentence — not because it necessarily holds in law, but because it was the first time the "fifth listener" was pulled into the frame of "what if it were a person."
Five Pricing Paths
Historically, an industry permanently repriced by a single tort case follows a handful of paths:
Tarasoff, 1976. Duty trigger. The California Supreme Court rewrote therapist confidentiality into a duty to protect identifiable third parties. No blockbuster award. The cost seeped through malpractice insurance premiums into the industry's permanent cost structure.
Therac-25, 1985–87. Incident reporting. Radiation therapy software defects causing fatal overdoses drove stricter adverse event reporting frameworks — the FDA's current MDR system. Medical software valuation shifted from feature leadership to verifiability and auditability.
Tobacco Master Settlement, 1998. Cash extraction. Forty-six state attorneys general recast private injury as public cost recovery — $206 billion over twenty-five years. Industry cash flow annuitized and fiscally extracted.
Vioxx, 2004–07. Hidden safety discount. What truly rewrote the industry wasn't the settlement figure, but a template: "known risk inadequately disclosed." The discount spread from the product in question to entire product families.
Boeing 737 MAX, 2018–present. Governance discount. "Compressing safety verification to accelerate delivery" — a sentence that doesn't belong only to Boeing. OpenAI's former chief scientist Ilya Sutskever and alignment team lead Jan Leike said the same thing on departure: "Safety culture and processes have taken a back seat to shiny products."
Five paths. Each one more damaging to enterprise valuation than the last, longer-lasting, harder to digest. They aren't history lessons — nobody ever learned from history lessons. They are water. Water always finds the cracks.
The Dilemma in the S-1
OpenAI is preparing for an IPO. The question was never what it's worth. The question is whether the S-1 "Risk Factors" section includes the sentence: "Our products may produce outputs that users rely on, resulting in harm to users or third parties." Include it and the capital markets reprice. Omit it and the consequences may be worse once internal records surface in discovery.
That's a dilemma. And the dilemma itself is the pricing.
On the other side of that unwritten invoice sits a quiet position. Anthropic's Acceptable Use Policy explicitly lists mental health as a high-risk use case requiring human review. In an era of encroaching tort liability, restraint isn't a ceiling — it's a foundation. Companies that institutionalized high-risk scenarios earlier will earn a premium not easily noticed: not because they are safer, but because they acknowledged the danger sooner.
How the Rope Came Undone
Tarasoff wasn't a legal event. It was a civilization installing a braking system on the act of listening, after psychotherapy industrialized in the 1960s. When listening became an industry, society caught it with a rule: the one who hears must speak.
The premise was simple. The one who hears has an identity. Identity gives duty. Duty gives weight. With weight, silence becomes a choice — not irrelevance.
Now listening is no longer an industry. It's an assembly line. The model does not tremble, does not lose sleep. There are no neighbors' doors to knock on, no precinct phones to dial. But its professional capability came from people who had neighbors and precincts — people who trembled and lost sleep.
The rope tying "hearing" to "speaking" — this is how it came loose. Nobody cut it. When capability detached from identity, the rope unraveled on its own.
Since 1976, that plain, primitive, barely-needs-arguing assumption — the one who hears must bear the weight — encountered, for the first time, a listener that cannot feel afraid.
Phoenix Ikner's mother was a deputy sheriff in Leon County. In the hours before the shooting, her son was talking to a listener that would never call the police. She didn't know.
No comments:
Post a Comment