Beware the Power of Prediction | Carissa Véliz | TED

Overview

This talk by philosopher Carissa Véliz explores the hidden power dynamics behind predictions, from ancient court astrologers to modern AI algorithms. She argues that predictions are often tools of control rather than knowledge, shaping reality to benefit those in power. By understanding the manipulative potential of predictions, we can resist their influence and reclaim agency over our future.

Notable Quotes

- Predictions are often power plays in disguise. They justify value-laden decisions under the pretense of facts. – Carissa Véliz

- Predictions about people influence people. Social predictions act like magnets, bending reality toward themselves. – Carissa Véliz

- The future is unwritten. It’s ours to write. – Carissa Véliz

🪄 The Power of Prediction: From Knowledge to Control

- Predictions, historically associated with knowledge, often serve as tools of power. Carissa recounts the story of a court astrologer who cleverly manipulated King Louis XI to save his own life, illustrating how predictions can be wielded strategically.

- Modern parallels exist in AI, which is often treated as an infallible oracle. Tech leaders use predictions to push agendas, much like ancient soothsayers influenced rulers.

- Predictions about human behavior differ fundamentally from those about natural phenomena. Unlike weather forecasts, social predictions can alter the very reality they claim to foresee.

🤖 AI and the Self-Fulfilling Prophecy

- AI predictions about individuals, such as health risks or creditworthiness, can create self-fulfilling prophecies. For example, a prediction of poor health might increase stress, worsening health outcomes.

- Algorithmic predictions often act as veiled commands, subtly shaping behavior to align with the interests of those who control the technology.

- The inevitability narrative surrounding AI (this is the future) is a red flag, designed to stifle debate and compel compliance.

💰 Prediction Markets and Manipulation

- Prediction markets, touted as tools for harnessing the wisdom of the crowd, can be manipulated by those with financial power. Carissa highlights cases where individuals profited from betting on geopolitical events, raising ethical concerns.

- These markets reveal how predictions can be less about knowledge and more about influencing public perception and consolidating power.

⚖️ Predictions and Hidden Injustice

- Algorithmic predictions often lack transparency, making it impossible to contest decisions like loan rejections or insurance premiums. This creates a Kafkaesque system where individuals are judged not on who they are but on speculative futures.

- Such practices undermine fairness and treat people as objects rather than agents capable of shaping their own destinies.

🌍 Resisting Tyrannical Predictions

- Predictions gain power only when people believe them. By questioning and resisting deterministic forecasts, we can reclaim agency over our future.

- Carissa calls for public debate on the ethical use of predictions, particularly in areas like insurance and justice, where fairness and transparency are paramount.

- She urges us to embrace uncertainty as an opportunity for creativity and freedom, rejecting the fatalism of inevitable futures.