Concern 339 · Working draft · editorial review in progress
AI in aviation
AI aviation risk is the possibility that an AI-based aviation function gives unsafe information or behaves unreliably in flight or air-traffic operations.
Understanding the concern
Aviation includes many forms of automation, and an autopilot is not necessarily an AI system. AI may be proposed for particular tasks such as recognising conditions or supporting decisions. Each task needs evidence showing how the system behaves under demanding conditions and how it interacts with pilots, controllers and other equipment.
The central issue is assurance: how can people show that a system is safe enough for its actual role? A strong score on an ordinary test is not enough for every safety-critical situation. Operating limits, failure responses and changes after deployment all matter. A research demonstration should not be described as routine use in passenger flights.
An example
An experimental decision aid performs well in common situations but has limited testing for rare combinations of failures.
Illustrative unless identified as a documented case.
Words in plain English
- AI
- Software that learns patterns from examples or uses rules to perform tasks such as recognizing images or generating text. It can make mistakes and does not understand every situation as a person would.
Evidence and its limits
The FAA roadmap describes safety-assurance work. It is not evidence that ordinary autopilots are all AI or that autonomous air-traffic control is widely deployed.
Federal Aviation Administration · Technical roadmap
Roadmap for Artificial Intelligence Safety Assurance, Version I ↗ (opens in a new tab)2024 approach to assessing AI in aviation; not proof of deployed autonomous air traffic control.
Broader frameworks and background
These resources provide context. They do not establish every claim in this concern.
A question to discuss
What exact function uses AI, and what evidence supports its use in that safety-critical role?
Keep track of different views, what needs checking, and any next step in your own discussion notes.
Open discussion notes →Principles for the conversation
Before you finish · reflect together
Virtues and principles to consider
Virtues are qualities we practice in how we treat people and make choices. They are not scores for judging someone. Use these ideas to explore what a thoughtful response could look like.
Stewardship
Stewardship means caring for resources and systems that others depend on, including people who will use them later. It looks beyond the benefit of a quick launch.
Plan for maintenance, energy use, data protection, and eventual shutdown. Ask who will look after the tool when the original team moves on and how future users can avoid inheriting hidden costs.
Ask together: What are we responsible for caring for over time?
Justice
Justice means fair treatment, fair procedures, and attention to who receives benefits and burdens. It asks whether people with less power can be heard and seek repair.
Look at outcomes across different groups and individual cases. Provide a usable way to challenge decisions and correct harm. Equal wording in a policy does not guarantee equal treatment in practice.
Ask together: Who benefits, who bears the cost, and who can challenge the decision?
Reading reality
Reading reality means looking closely at the situation people actually face. A visible problem may be connected to habits, incentives, or rules beneath the surface.
If an AI tool gives a poor result, look at the task, data, workplace pressures, and available support. Do not assume that changing the software alone will solve the problem.
Ask together: What is happening here, and what conditions help explain it?
Editorial ratings
These are editorial judgments from the register, not measured probabilities or predictions about your situation.
About the register and scoring →More ways to explore
Search for more writing
For more specific or recent material, open a search below or ask for a web summary. AI-generated summaries can contain mistakes; open the original articles to check them.