Could a court really order the destruction of ChatGPT? The New York Times thinks so, and it may be right

On Dec. 27, 2023, The New York Times filed a lawsuit^[1] against OpenAI alleging that the company committed willful copyright infringement through its generative AI tool ChatGPT. The Times claimed both that ChatGPT was unlawfully trained on vast amounts of text from its articles and that ChatGPT’s output contained language directly taken from its articles.

To remedy this, the Times asked for more than just money: It asked a federal court to order the “destruction” of ChatGPT.

If granted, this request would force OpenAI to delete its trained large language models, such as GPT-4, as well as its training data, which would prevent the company from rebuilding its technology.

This prospect is alarming to the 100 million people^[2] who use ChatGPT every week. And it raises two questions that interest me as a law professor^[3]. First, can a federal court actually order the destruction of ChatGPT? And second, if it can, will it?

Destruction in the court

The answer to the first question is yes. Under copyright law^[4], courts do have the power to issue destruction orders.

To understand why, consider vinyl records. Their resurging popularity^[5] has attracted counterfeiters who sell pirated records^[6].

If a record label sues a counterfeiter for copyright infringement and wins, what happens to the counterfeiter’s inventory? What happens to the master and stamper disks used to mass-produce the counterfeits, and the machinery used to create those disks in the first place?

To address these questions, copyright law grants courts the power to destroy infringing goods and the equipment used to create them. From the law’s perspective, there’s no legal use for a pirated vinyl record. There’s also no legitimate reason for a counterfeiter to keep a pirated master disk. Letting them keep these items would only enable more lawbreaking.

So in some cases, destruction is the only logical legal solution. And if a court decides ChatGPT is like an infringing good or pirating equipment, it could order that it be destroyed. In its complaint, the Times offered arguments that ChatGPT fits both analogies.

Copyright law has never been used to destroy AI models, but OpenAI shouldn’t take solace in this fact. The law has been increasingly open to the idea of targeting AI.

Consider the Federal Trade Commission’s recent use of algorithmic disgorgement^[7] as an example. The FTC has forced companies such as WeightWatchers^[8] to delete not only unlawfully collected data but also the algorithms and AI models trained on such data.

Why ChatGPT will likely live another day

It seems to be only a matter of time before copyright law is used to order the destruction of AI models and datasets. But I don’t think that’s going to happen in this case. Instead, I see three more likely outcomes.

The first and most straightforward is that the two parties could settle. In the case of a successful settlement, which may be likely^[9], the lawsuit would be dismissed and no destruction would be ordered.

The second is that the court might side with OpenAI, agreeing that ChatGPT is protected by the copyright doctrine of “fair use^[10].” If OpenAI can argue that ChatGPT is transformative and that its service does not provide a substitute for The New York Times’ content, it just might win.

The third possibility is that OpenAI loses but the law saves ChatGPT anyway. Courts can order destruction only if two requirements are met: First, destruction must not prevent lawful activities, and second, it must be “the only remedy^[11]” that could prevent infringement.

That means OpenAI could save ChatGPT by proving either that ChatGPT has legitimate, noninfringing uses or that destroying it isn’t necessary to prevent further copyright violations.

Both outcomes seem possible, but for the sake of argument, imagine that the first requirement for destruction is met. The court could conclude that, because of the articles in ChatGPT’s training data, all uses infringe on the Times’ copyrights – an argument put forth in various other lawsuits^[12] against generative AI companies.

In this scenario, the court would issue an injunction ordering OpenAI to stop infringing on copyrights. Would OpenAI violate this order? Probably not. A single counterfeiter in a shady warehouse might try to get away with that, but that’s less likely with a US$100 billion company^[13].

Instead, it might try to retrain its AI models without using articles from the Times, or it might develop other software guardrails to prevent further problems. With these possibilities in mind, OpenAI would likely succeed on the second requirement, and the court wouldn’t order the destruction of ChatGPT.

Given all of these hurdles, I think it’s extremely unlikely that any court would order OpenAI to destroy ChatGPT and its training data. But developers should know that courts do have the power to destroy unlawful AI, and they seem increasingly willing to use it.

References

1. ^{^} filed a lawsuit (nytco-assets.nytimes.com)
2. ^{^} 100 million people (www.theverge.com)
3. ^{^} law professor (law.indiana.edu)
4. ^{^} copyright law (www.law.cornell.edu)
5. ^{^} resurging popularity (www.theverge.com)
6. ^{^} counterfeiters who sell pirated records (fortune.com)
7. ^{^} algorithmic disgorgement (www.jdsupra.com)
8. ^{^} such as WeightWatchers (www.dwt.com)
9. ^{^} may be likely (www.washingtonpost.com)
10. ^{^} fair use (www.copyright.gov)
11. ^{^} the only remedy (casetext.com)
12. ^{^} various other lawsuits (copyrightalliance.org)
13. ^{^} US$100 billion company (www.reuters.com)