If every CEO in a competitive market knows that mass AI-driven layoffs will eventually reduce the wages of their own customers — why does each one do it anyway?
Equitable distribution of AI's benefits is the final — and hardest — question in responsible AI. It is hard not because organisations are malicious, but because the most harmful outcomes can arise from individually rational decisions that no single actor controls. Tsoukalas and Falk built a mathematical model of what happens when AI is used primarily to replace workers at scale in competitive markets. The finding is not that CEOs are bad. The finding is that the competitive structure makes the harmful outcome a dominant strategy: each firm has a stronger incentive to defect from collective restraint than to cooperate — even when every CEO can see the cliff.
The AI layoff trap is a classic prisoner's dilemma applied to labour markets. The structure of competitive markets means that self-restraint is individually irrational even when collective restraint is socially optimal.
| Market structure | CEO's incentive | Outcome |
|---|---|---|
| Monopoly | Restraint is rational: my workers are also my customers. If I fire my customers, demand for my product falls. The harm is internalised — the monopolist bears the cost of their own workers' reduced purchasing power. | CEO restrains AI-driven headcount reduction to protect their own market |
| Competitive market | Firing workers doesn't hurt me specifically: my employees spend their wages across the whole economy, not mainly with me. Competitors are doing the same thing. If I don't cut costs, I lose market share. | Each CEO fires workers. Wages fall economy-wide. Consumer demand falls. But the harm is distributed — no single firm feels the full cost of their own decision. |
Equitable distribution of AI benefits cannot be achieved by deciding fairly who gets the outputs of a system that was designed to exclude certain groups from the beginning. The design must be equitable first — before any distribution question arises.
Gender Shades is the clearest illustration. IBM's facial recognition system had error rates of up to 34.7% for darker-skinned women. That is not a distribution failure — it is a design failure that produced an equity failure. The system worked for lighter-skinned men. It did not work for darker-skinned women. No distribution mechanism could have corrected for a system that was fundamentally broken for one group of users from the start.
The implication: equity analysis must happen at the point of data selection, labelling, objective setting, and success definition — the same four upstream human decisions that determine whether bias enters the system. An equity review conducted after deployment is too late.
The CARE Principles for Indigenous Data Governance were developed to address a specific form of the equity problem: data about and from Indigenous communities has historically been used for others' benefit, without those communities controlling the terms of use or sharing in the value created. The principles apply beyond the Indigenous context to any community whose data is extracted without their meaningful participation in benefit or control.
Data ecosystems should enable Indigenous Peoples to benefit from their own data — not just contribute to it. The question is not whether data is collected with consent, but whether the community that generated it captures any of the value it creates. Most AI training data pipelines fail this test.
Indigenous communities have the right to govern their own data. This right must be recognised explicitly — not assumed away by terms of service or bundled consent. Authority to control means the right to decide what data is collected, how it is used, who accesses it, and when it is deleted.
Those who use Indigenous data have an active obligation to explain how it is being used and to ensure that use advances the wellbeing of the community it came from. Responsibility is not passive compliance — it is an ongoing obligation to the source community.
The rights and wellbeing of the community come before the convenience or commercial interest of the data user. Ethical data use is not a constraint on value creation — it is a condition for the legitimacy of value creation that rests on others' data.
Equitable AI outcomes cannot be achieved through organisational goodwill alone when the competitive structure produces dominant strategies that are individually rational but collectively harmful. Three policy-level levers are required.
| Lever | What it does | Why the market alone can't do it |
|---|---|---|
| Labour transition policy | Skills retraining investment, portable benefits, income support during displacement — paid for in part by the productivity gains AI enables | Each individual firm that invests in training workers creates a public good that competitors free-ride on; only collective action (policy) solves the coordination failure |
| Benefit distribution mechanisms | Mechanisms to distribute AI productivity gains more broadly — through tax policy, profit sharing, or sovereign AI funds | Markets distribute productivity gains to capital owners by default. Without policy intervention, AI amplifies existing wealth concentration rather than reducing it |
| Data governance frameworks | Mandatory requirements for equitable design, CARE Principle compliance in Indigenous data contexts, consent frameworks that match the actual scope of data use | Voluntary CARE compliance produces race-to-the-bottom dynamics where firms that extract data without community participation outcompete those that don't |
Equitable AI is not a values question that organisations can solve by trying harder. The dominant strategy structure of competitive markets means that individually rational AI deployment decisions can produce collective harm no matter how well-intentioned each actor is. Ethics must come first — before the market logic takes over. And where the market logic is structural, policy is the only intervention with sufficient reach. Organisations that wait for policy are already behind. Organisations that treat equity as a design requirement — not a post-deployment adjustment — are building what the mandatory regime will eventually require anyway.
What is the AI layoff trap — and why does the competitive market structure make self-restraint an irrational strategy for individual firms, even when CEOs can see the collective harm?
What are the four CARE Principles for Indigenous data governance — and how does each principle apply beyond the Indigenous context to any community whose data is used in AI systems?
Why is equitable AI a design problem before it is a distribution problem — and what does the Gender Shades study illustrate about where equity interventions must begin?