Concern 991 · Working draft · editorial review in progress

Engineered pandemic risk

Engineered pandemic risk is the possibility that deliberate changes to a biological agent contribute to an outbreak that spreads widely, with AI potentially assisting part of that process.

Understanding the concern

This is different from saying an AI can create a pandemic by answering a question. A large outbreak depends on biological properties, physical work, access and public-health conditions. The concern is whether better scientific tools make dangerous work easier or create new opportunities for misuse alongside their medical benefits.

A powerful laboratory tool can support both healing and harm, so responsibility cannot rest on a warning label alone. WHO guidance treats biorisk management as a shared duty across research and funding. AI safety research adds questions about new capabilities. Prevention includes responsible research oversight and public-health preparedness, while claims about the probability of catastrophe remain uncertain.

An example

A research funder reviews a proposed AI biology project for both its health benefits and potential misuse before deciding how it should proceed.

Illustrative unless identified as a documented case.

Words in plain English

AI
Software that learns patterns from examples or uses rules to perform tasks such as recognizing images or generating text. It can make mistakes and does not understand every situation as a person would.
Agent
An AI system that can choose and carry out several steps toward a goal, using the tools and access people give it.

Evidence and its limits

The WHO framework concerns biorisks generally. The AI report discusses possible assistance and uncertainty, not evidence that an AI-caused pandemic has occurred.

Explore these sources in the library →
Broader frameworks and background

These resources provide context. They do not establish every claim in this concern.

A question to discuss

How can we support valuable biological research while strengthening oversight and readiness for serious outbreaks?

Keep track of different views, what needs checking, and any next step in your own discussion notes.

Open discussion notes →
Principles for the conversation

Before you finish · reflect together

Virtues and principles to consider

Virtues are qualities we practice in how we treat people and make choices. They are not scores for judging someone. Use these ideas to explore what a thoughtful response could look like.

Hope

Hope means seeing worthwhile possibilities and taking steps toward them, even when the outcome is uncertain. It does not require ignoring harm or promising that everything will work out.

Name the improvement you want in people's lives, then identify one realistic action and the conditions it needs. Keep room to revise the approach when evidence changes.

Ask together: What better outcome is worth working toward, and what can we do next?

Humility

Humility means recognizing the limits of our knowledge and being willing to learn from others. Expertise can be valuable without answering every question.

State where evidence is weak, invite criticism, and listen to people with different experience. Leave room to revise a decision when new information appears.

Ask together: What might we be missing, and who could help us see it?

Courage

Courage means acting on a well-grounded responsibility even when it is uncomfortable. It can mean trying something useful, admitting a mistake, or challenging pressure to move too fast.

Make it possible for people to raise concerns without punishment. Support those who point out harm, and be willing to pause a popular project when evidence gives a good reason.

Ask together: What important action are we avoiding because it is difficult?

Editorial ratings

These are editorial judgments from the register, not measured probabilities or predictions about your situation.

Severity
Catastrophic · 5/5
Likelihood
Plausible · 2/5
Time horizon
Mid
Register risk score
10
About the register and scoring →
More ways to explore

Search for more writing

For more specific or recent material, open a search below or ask for a web summary. AI-generated summaries can contain mistakes; open the original articles to check them.

Explore a proposed use of AI →