We're 99.9% sure this pattern is true, but no one can prove it

Overview

This episode dives into the fascinating history and mathematics behind the twin prime conjecture, one of the oldest unsolved problems in number theory. It explores the breakthroughs, setbacks, and the remarkable contributions of mathematicians like Yitang Zhang and James Maynard, who pushed the boundaries of what we know about prime numbers and their gaps.

Notable Quotes

- Mathematics culture works. We’re doing the right thing. Zhang was immediately made a hero as he should have been. – Alex Kontorovich, on the mathematical community's response to Zhang's proof.

- One half was a pure mirage. It was a red herring. – Derek Muller, on the surprising irrelevance of a long-assumed mathematical barrier.

- Maybe it’s because he was in isolation that he didn’t have the groupthink the rest of us did. – Derek Muller, on how Zhang’s outsider status helped him succeed.

🧮 The Twin Prime Conjecture and Early Approaches

- The twin prime conjecture posits that there are infinitely many pairs of prime numbers separated by just two (e.g., 11 and 13).

- Early 20th-century mathematicians like Hardy, Littlewood, and Viggo Brun developed tools like the sieve of Eratosthenes and inclusion-exclusion principles to estimate twin primes.

- Brun’s sieve proved there are infinitely many pairs of numbers two apart, where each has at most nine prime factors, but it couldn’t fully solve the conjecture due to overwhelming error terms.

🔍 Bounded Gaps Between Primes

- In 2005, Goldston, Pintz, and Yildirim (GPY) showed that prime gaps could be arbitrarily small relative to the average gap, but they couldn’t prove a fixed bounded gap.

- The challenge lay in overcoming a mathematical barrier known as the level of distribution (theta = 1/2), which limited their ability to weigh prime distributions in arithmetic progressions.

- A 2013 breakthrough by Yitang Zhang proved a bounded gap of 70 million, using a novel approach to reorganize error terms and push past the theta = 1/2 barrier.

🚀 Zhang’s Breakthrough and Its Impact

- Zhang, a previously unknown mathematician who once worked at Subway, solved the bounded gap problem in isolation, proving that primes infinitely often differ by no more than 70 million.

- His work inspired a global collaboration led by Terence Tao (Polymath Project), which reduced the gap to 4,680.

- Zhang’s story highlighted the value of perseverance and the importance of challenging impossible assumptions in mathematics.

🛠️ Maynard’s Method and the Redefinition of Limits

- James Maynard independently developed a new approach that bypassed the theta = 1/2 barrier entirely, proving a gap of 600 and showing that bounded gaps could be achieved without relying on this constraint.

- His method also demonstrated that multiple primes could exist within a bounded window, further advancing the field.

- Maynard’s work, combined with Polymath efforts, brought the gap down to 246, the current record.

🌌 The Future of the Twin Prime Conjecture

- Conditional results suggest the gap could drop to as low as 6 or 12 if certain conjectures (like the Elliott-Halberstam conjecture) are proven true.

- Mathematicians remain optimistic about solving the twin prime conjecture, emphasizing that even failed attempts have led to groundbreaking discoveries and new methods.

- The episode concludes with a reflection on the value of uncertainty in driving mathematical innovation.