Concern 717 · Working draft · editorial review in progress

Consumer-surplus capture

Consumer-surplus capture occurs when a seller uses detailed predictions about a buyer to charge closer to the most that person is willing to pay.

Understanding the concern

Consumer surplus is the gap between what someone would have been willing to pay and what they actually pay. AI-based personalization may help a seller estimate that limit from behavior or other data. Two people could then receive different offers without understanding why or being able to compare them easily.

FTC research into surveillance pricing identifies tools and data practices that could support such differentiation. It does not establish that every retailer uses them or that every discount is harmful. The concern is about transparency, bargaining power and the use of sensitive inferences. A personalized price can be a genuine saving or a way to extract more from someone judged less able to shop around.

An example

A buyer sees a less favorable offer because a system predicts that urgency or limited alternatives make them more likely to accept it.

Illustrative unless identified as a documented case.

Words in plain English

AI
Software that learns patterns from examples or uses rules to perform tasks such as recognizing images or generating text. It can make mistakes and does not understand every situation as a person would.

Evidence and its limits

The FTC work examines intermediary capabilities and practices. The specific buyer scenario is illustrative, not evidence of universal personalized overcharging.

Explore these sources in the library →
Broader frameworks and background

These resources provide context. They do not establish every claim in this concern.

A question to discuss

What should buyers know about how their data affects the price or offer they receive?

Keep track of different views, what needs checking, and any next step in your own discussion notes.

Open discussion notes →
Principles for the conversation

Before you finish · reflect together

Virtues and principles to consider

Virtues are qualities we practice in how we treat people and make choices. They are not scores for judging someone. Use these ideas to explore what a thoughtful response could look like.

Seeing potential

Seeing potential means recognizing people's capacity to learn, contribute, and grow. It resists reducing someone to a score or to the tasks a machine can perform faster.

Use tools to support people's development. Give learners time, feedback, and real opportunities to practice. A prediction about someone's performance should not close off their future.

Ask together: How could this help people develop abilities they value?

Solidarity

Solidarity means standing with people whose lives are affected, especially when they have less power to protect their interests. It turns concern into a willingness to share responsibility.

Include affected people in decisions and support practical remedies when something goes wrong. Do not leave the cost of learning or repair entirely with those who were harmed.

Ask together: What would it mean to stand with the people carrying the greatest burden?

Dignity

Dignity means recognizing each person's worth regardless of usefulness, status, or a system's score. People deserve respect and a voice in matters that affect them.

Explain important decisions, avoid humiliating treatment, and keep room for a person's story. Do not treat a prediction as a complete account of who someone is.

Ask together: Does this use treat each person as someone whose experience matters?

Editorial ratings

These are editorial judgments from the register, not measured probabilities or predictions about your situation.

Severity
Serious · 3/5
Likelihood
Documented at scale · 5/5
Time horizon
Now
Register risk score
15
About the register and scoring →
More ways to explore

Search for more writing

For more specific or recent material, open a search below or ask for a web summary. AI-generated summaries can contain mistakes; open the original articles to check them.

Explore a proposed use of AI →