Concern 999 · Working draft · editorial review in progress
Value lock-in by dominant actor
Value lock-in by a dominant actor is the risk that a powerful organization or government uses AI to make its own priorities difficult for others to change.
Understanding the concern
This concern adds a question of power to the broader problem of persistent rules. If one actor controls widely used systems, people may have little choice about the values built into decisions, recommendations or access. Formal consent means little when realistic alternatives are absent.
Imagine a landlord who controls every meeting space in town and sets the rules for all public discussion. The analogy shows why control and the ability to challenge it matter. Ethical alignment research asks whose values should guide systems, while institutional risk analysis considers how influence can become entrenched. Neither proves that permanent control is inevitable. Contestable decisions and viable alternatives preserve room for disagreement.
An example
A dominant service sets rules affecting many communities, while those communities have no meaningful route to appeal or choose another provider.
Illustrative unless identified as a documented case.
Words in plain English
- AI
- Software that learns patterns from examples or uses rules to perform tasks such as recognizing images or generating text. It can make mistakes and does not understand every situation as a person would.
- Alignment
- Trying to make a system act in line with intended goals and values. People may disagree about which goals and values should guide it.
- Lock-in
- Dependence on a tool or provider that is difficult or costly to leave.
Evidence and its limits
The sources support ethical and institutional analysis. This is a possible governance failure, not a documented permanent settlement of society's values.
Iason Gabriel · Google DeepMind, 2020 · Research explanation
Artificial Intelligence, Values and Alignment ↗ (opens in a new tab)Distinguishes technical alignment from the question of whose values should guide AI in a plural society.
Kulveit and colleagues · 2025 · Scenario analysis
Gradual Disempowerment: Systemic Existential Risks from Incremental AI Development ↗ (opens in a new tab)Develops a possible pathway to reduced human influence across institutions; not an observed irreversible outcome or probability estimate.
Broader frameworks and background
These resources provide context. They do not establish every claim in this concern.
A question to discuss
Who can challenge the values built into this system, especially if its owner holds most of the power?
Keep track of different views, what needs checking, and any next step in your own discussion notes.
Open discussion notes →Principles for the conversation
Before you finish · reflect together
Virtues and principles to consider
Virtues are qualities we practice in how we treat people and make choices. They are not scores for judging someone. Use these ideas to explore what a thoughtful response could look like.
Hope
Hope means seeing worthwhile possibilities and taking steps toward them, even when the outcome is uncertain. It does not require ignoring harm or promising that everything will work out.
Name the improvement you want in people's lives, then identify one realistic action and the conditions it needs. Keep room to revise the approach when evidence changes.
Ask together: What better outcome is worth working toward, and what can we do next?
Humility
Humility means recognizing the limits of our knowledge and being willing to learn from others. Expertise can be valuable without answering every question.
State where evidence is weak, invite criticism, and listen to people with different experience. Leave room to revise a decision when new information appears.
Ask together: What might we be missing, and who could help us see it?
Courage
Courage means acting on a well-grounded responsibility even when it is uncomfortable. It can mean trying something useful, admitting a mistake, or challenging pressure to move too fast.
Make it possible for people to raise concerns without punishment. Support those who point out harm, and be willing to pause a popular project when evidence gives a good reason.
Ask together: What important action are we avoiding because it is difficult?
Editorial ratings
These are editorial judgments from the register, not measured probabilities or predictions about your situation.
About the register and scoring →More ways to explore
Search for more writing
For more specific or recent material, open a search below or ask for a web summary. AI-generated summaries can contain mistakes; open the original articles to check them.