PANOPTICON INDEX
U.S. Surveillance Index
The long view

The history of surveillance.

The history of surveillance is a ratchet, not a dial. A dial turns both ways; a ratchet only tightens. For 250 years — from Bentham's paper prison to the face-scanner on the squad car — nearly every watching power a society took on during a crisis it kept after the crisis passed. The reversals are rare enough to name: the Church Committee, the USA FREEDOM Act, and East Germany opening the Stasi's files. Everything else accumulated.

1791 → today · scroll the timeline →
1791

The Panopticon

Jeremy Bentham designs a prison where one unseen inspector could watch anyone at any time — the insight that the mere possibility of being watched disciplines behavior.

Bentham, Panopticon (Wikisource)
1883

The mug shot

Paris clerk Alphonse Bertillon builds the first systematic biometric ID — body measurements plus the standardized front-and-profile photograph.

Britannica: Alphonse Bertillon
1949

Big Brother

Orwell publishes Nineteen Eighty-Four — the two-way telescreen, the Thought Police, and 'BIG BROTHER IS WATCHING YOU' — giving the surveillance state its vocabulary before the tech existed.

Orwell, 1984 (full text)
1952

The NSA is born

The National Security Agency is founded in secret on November 4, 1952.

NSA: Origins (GPO)
1945–75

Project SHAMROCK

For 30 years the NSA obtains daily copies of essentially all international telegrams — 'probably the largest interception program affecting Americans ever undertaken.'

Church Committee, Book III (NSA)
1971

The Media burglary

Activists burgle an FBI office and mail the stolen files to the press — the accident that exposed COINTELPRO.

Zinn Education Project
1975

The Church Committee

↩ rollback

The Senate exposes COINTELPRO, SHAMROCK, and MINARET. Frank Church warns the NSA's power could leave 'no place to hide.' The one true rollback begins.

EFF: Church Committee findings
1978

FISA

↩ rollback

The Foreign Intelligence Surveillance Act requires a court order for foreign-intelligence wiretaps on U.S. soil — for a moment, the gear turns backward.

FISA of 1978 (GovInfo)
1981

Executive Order 12333

Reagan restructures and in key respects expands the intelligence community's authorities — the reversal starts re-tightening.

E.O. 12333 (National Archives)
1989

The Stasi files open

↩ rollback

A collapsing East Germany opens its secret police's ~111 km of files to its victims — the rarest reversal of all.

Stasi Records Agency (Wikipedia)
2001

USA PATRIOT Act

Passed 45 days after 9/11. Section 215's 'any tangible things' language becomes the legal basis for bulk collection of every American's phone records.

PATRIOT Act, full text (GovTrack)
2002

Total Information Awareness

DARPA proposes mining the credit-card, email, travel, and medical records of the entire population. Its seal: an all-seeing eye over the globe. Defunded in 2003 — its capabilities quietly moved elsewhere.

EPIC: Total Information Awareness
2005

Warrantless wiretapping revealed

The New York Times exposes 'Stellar Wind'; a year later an AT&T technician reveals 'Room 641A,' where fiber splitters copied internet traffic to the NSA.

Risen & Lichtblau, NYT (EFF copy)
2008

Section 702

The FISA Amendments Act legalizes warrantless targeting of non-U.S. persons abroad — the future legal home of PRISM — and grants telecoms retroactive immunity.

FISA Amendments Act (GovTrack)
2013

The Snowden disclosures

A court order forcing Verizon to hand over all call records — then PRISM, XKeyscore, and global fiber taps. The NSA's own slides described capturing 'nearly everything a typical user does on the internet.'

The Verizon FISC order (full text)
2015

USA FREEDOM Act

↩ rollback

Ends the government's own bulk collection of phone metadata — the ratchet's second reversal. But Section 702 remained, and the wider architecture endured.

ODNI: USA FREEDOM Act fact sheet
2018

Cambridge Analytica

A quiz app harvests up to 87 million Facebook profiles — its users and all their friends. Facebook later pays a record $5 billion FTC penalty.

FTC: $5B Facebook penalty
2019

Surveillance capitalism

Shoshana Zuboff names the private data engine — human experience claimed as free raw material and sold as 'prediction products' — now larger than the state's.

Harvard Gazette: Zuboff
2019

Turnkey totalitarianism

Philosopher Nick Bostrom argues that averting certain catastrophes 'would need a system of ubiquitous real-time worldwide surveillance' — a design he himself labels 'turnkey totalitarianism.'

Bostrom, The Vulnerable World Hypothesis
2020

Clearview AI

A company that scraped 3+ billion faces from the web sells a face-search engine to hundreds of police departments — 'the secretive company that might end privacy as we know it.'

Kashmir Hill, The New York Times
2024

The converged mesh

Flock's ~119,000 plate readers, Axon's acquisition of Fusus, and the data-broker loophole fuse corporate data, biometrics, and police into one searchable mesh.

ACLU: Get the Flock Out
How it happened

Ten turns of the ratchet.

Each era added a capability a society took on during a crisis — and kept after it passed. Read them in order and the modern surveillance state stops looking like a rupture and starts looking like an accumulation.

01The idea

The idea of the watched

Modern surveillance begins not with a machine but with a diagram.

In 1787 the English philosopher Jeremy Bentham sketched the Panopticon — a ring of cells around a central tower, lit so that a single unseen inspector could watch any inmate at any time, while no inmate could ever tell when he was being watched.

The genius was psychological, not optical: the guard need not actually watch; the prisoner need only believe he might be. Bentham meant it as a universal template — for prisons, factories, asylums, schools. In 1975 Michel Foucault revived it as the 'diagram' of modern power: watching that the watched person carries inside themselves.

Hence the major effect of the Panopticon: to induce in the inmate a state of conscious and permanent visibility that assures the automatic functioning of power.

Michel Foucault, Discipline and Punish (1975)
  • Bentham called it 'a new mode of obtaining power of mind over mind, in a quantity hitherto without example.'
  • Foucault: power made 'visible and unverifiable' — the inmate 'is seen, but he does not see.'
  • The first tooth of the ratchet: permanent potential visibility, designed to spread beyond the prison wall.
02Legibility

Making the population legible

The 19th century added surveillance as bureaucracy — the drive to make people countable, identifiable, and findable.

Anthropologist James C. Scott called this 'legibility': the censuses, standardized names, and maps that let a state 'see' its subjects. The body itself became a record — Bertillon's mug shot in 1883, then fingerprinting across four continents.

The pattern is the tell: identity systems only ever accrete. Fingerprint, then photograph, then DNA, then face — each layer added, none discarded. As identification went electronic, Roger Clarke coined 'dataveillance' (1988) for the systematic monitoring of people through their data trails.

  • 1883 — Bertillon introduces biometric ID and the standardized mug shot in Paris.
  • 1892–1901 — Galton and Henry make fingerprints a permanent, classifiable identity.
  • Legibility, once built, is never surrendered — only re-indexed.
03The canon

Big Brother in the imagination

Fiction handed the coming debates their vocabulary before the technology existed.

From Zamyatin's We (1921) to Orwell's Nineteen Eighty-Four (1949), the century made surveillance legible to the public. Orwell's telescreen was the Panopticon rendered electronic — a device that 'received and transmitted simultaneously' and could never be fully shut off.

Huxley's Brave New World offered the counter-model: control through pleasure, not fear. Together they set the terms of consent — teaching the public which surveillance to fear (the jackboot) and, by omission, which to accept (the convenience).

So long as he remained within the field of vision which the metal plaque commanded, he could be seen as well as heard.

George Orwell, Nineteen Eighty-Four (1949)
  • 'BIG BROTHER IS WATCHING YOU' — the master image of the surveillance state.
  • Postman: 'Orwell feared those who would deprive us of information; Huxley feared those who would give us so much we'd be reduced to passivity.'
  • 'Orwellian' became — and remains — the reflexive alarm word for any new watching technology.
04Cold War

The Cold War apparatus

The mid-20th century built the first true electronic mass-surveillance states — mostly in secret.

In the U.S., the FBI's COINTELPRO (1956–71) ran 2,370 covert actions to 'disrupt, discredit, or neutralize' dissidents. In parallel, the NSA's Project SHAMROCK copied nearly all international telegrams for 30 years, and MINARET watch-listed thousands of Americans by name.

Abroad, East Germany's Stasi built the most thoroughly informed police state in history for its size — ~91,000 officers, ~173,000–189,000 informants, and roughly 111 kilometres of files. Even when specific programs were shut down, the capability and the institutions remained.

  • The FBI mailed Martin Luther King Jr. a tape and a letter he read as urging him to kill himself.
  • SHAMROCK: 'probably the largest governmental interception program affecting Americans ever undertaken.'
  • The 1946 UKUSA Agreement bound the U.S., U.K., Canada, Australia, and New Zealand into the 'Five Eyes.'
05Rollback

The one partial reversal

The 1970s produced the single most important counter-example to the ratchet — the one time surveillance power was rolled back by law.

When the Media burglary and Watergate cracked the secrecy open, the Senate's Church Committee (1975–76) exposed COINTELPRO, SHAMROCK, MINARET, and CIA abuses. SHAMROCK was terminated; the 1978 FISA required, for the first time, a court order for foreign-intelligence wiretaps on U.S. soil.

But note how quickly it re-tightened: Reagan's Executive Order 12333 (1981) expanded intelligence authorities, and the FISA Court would in time approve nearly every application. The reversal was real — the exception that proves the rule.

That capability at any time could be turned around on the American people, and no American would have any privacy left.

Sen. Frank Church, 1975
  • Frank Church warned the NSA's capability 'could be turned around on the American people … There would be no place to hide.'
  • SHAMROCK ended (1975); FISA enacted (1978) — then eroded within a generation.
06Post-9/11

9/11 and the great ratchet

No single event tightened the ratchet more than September 11, 2001.

Within six weeks Congress passed the USA PATRIOT Act — 357–66 in the House, 98–1 in the Senate. Its Section 215 became the legal basis for bulk phone-metadata collection. DARPA proposed Total Information Awareness, to mine the records of the whole population; Congress defunded it in 2003, but exempted its tools and moved several components elsewhere.

They reappeared as 'Stellar Wind,' the NSA's warrantless wiretapping, revealed by the NYT in 2005. The permanent architecture kept accreting — DHS (2002), the DNI (2004), fusion centers, the No-Fly List, and in 2008 Section 702, the future legal home of PRISM.

  • TIA's official seal: an all-seeing eye atop a pyramid, motto 'scientia est potentia' — knowledge is power.
  • The program died; its capabilities did not.
  • 9/11 produced the largest and most durable single expansion of the American surveillance state — almost none of it repealed.
07Snowden

Collect it all: Snowden

In June 2013 an NSA contractor turned the classified architecture into public fact.

The first story: a secret court order forcing Verizon to hand over all call records, every day. Then a cascade — PRISM (stored communications from nine internet firms), XKeyscore ('nearly everything a typical user does on the internet'), MUSCULAR (tapping Google's and Yahoo's private fiber), and BULLRUN (undermining encryption itself).

It also exposed a lie: three months earlier, DNI James Clapper had told the Senate the NSA did not collect data on millions of Americans — 'not wittingly.' The reckoning was partial: the USA FREEDOM Act (2015) ended bulk telephone collection, but Section 702 and upstream collection remained.

Wyden: 'Does the NSA collect any type of data at all on millions of Americans?' — Clapper: 'No, sir. … Not wittingly.'

Senate Intelligence Committee, March 2013
  • An oversight board found the phone-records program never made 'a concrete difference' in any counterterrorism case.
  • A second genuine rollback — but narrow. The architecture endured.
08Surveillance capitalism

Surveillance capitalism

A second apparatus was built entirely in private — and grew larger than the government's.

Shoshana Zuboff dates it to Google around 2001, when the company learned to monetize the 'data exhaust' of search and sell 'prediction products.' The machinery beneath is the real-time ad economy: one 2022 study found it exposes a typical American's activity and location 747 times per day.

Most consequentially, this private apparatus became a back door into the state's. Because Carpenter (2018) requires a warrant for phone-location data, agencies simply bought it instead — the 'data-broker loophole.' ICE, CBP, and the FBI purchased location data from Venntel, Babel Street, and Fog Data Science.

Surveillance capitalism unilaterally claims human experience as free raw material for translation into behavioral data.

Shoshana Zuboff, The Age of Surveillance Capitalism (2019)
  • Cambridge Analytica harvested up to 87 million Facebook profiles → a record $5B FTC fine.
  • Fog Data Science sold location histories to 18+ agencies for under $10,000 a year, often searched without a warrant.
  • Surveillance capitalism became a warrantless supply line to the state.
09The converged state

The converged state

Today the biometric, the corporate, the municipal, and the state fuse into a single searchable mesh.

Its emblem is Clearview AI — 3+ billion faces scraped from the web, sold as a search engine to police. Around the citizen, a private sensor mesh has been built and rented to police: Flock's ~119,000 plate readers, Axon's acquisition of Fusus (cameras, gunshot detectors, drones into real-time crime centers).

Yet the vendors' claims collapse under audit: Chicago found only 9.1% of ShotSpotter alerts led to evidence of a gun crime; a study of 23,631 predictive-policing forecasts found a 0.1–0.6% hit rate, concentrated on Black and Latino neighborhoods. The authoritarian frontier is Xinjiang, where the IJOP platform fuses checkpoint, camera, and utility data to flag people for detention.

  • Clearview drew a €30.5M Dutch fine for an 'illegal database' of 30+ billion faces — penalties at the margins, not the end of the practice.
  • Be precise: China's 'social credit score' is a Western myth — fragmented pilots, not one national score. Xinjiang is the real prototype.
10The endpoint

The endpoint: Bostrom's vulnerable world

Where does the ratchet point? The most rigorous answer comes from a philosopher who endorses the destination.

In 'The Vulnerable World Hypothesis' (2019), Nick Bostrom argues that if technology will eventually yield a cheap weapon of mass death, civilization's only general defense is total, pre-emptive monitoring — in some scenarios, in place before the technology is invented.

He sketches it concretely: every person wears a 'freedom tag' with cameras and microphones, uploading encrypted audio-video machine-interpreted in real time, with flagged feeds sent to 'patriot monitoring stations' staffed by 'freedom officers.' At ~$140 per person per year, he estimates, the whole world could be monitored for under 1% of GDP. Every capability this history traces is a component of the system he describes.

Developing a system for turnkey totalitarianism means incurring a risk, even if one does not intend for the key to be turned.

Nick Bostrom, The Vulnerable World Hypothesis (2019)
  • This is Bentham's Panopticon and Orwell's telescreen made literal and global — stated in a peer-reviewed journal.
  • The history of surveillance is the history of that system being assembled, tooth by tooth, without anyone ever deciding to build the whole.
The ratchet in one table

What was added — and whether it was ever removed.

EraPeriodCapacity addedEver removed?
The Panopticon principle1791Architecture of permanent potential visibility; the self-policing subjectNo — became a universal template
Biometric legibility1883–1901Bertillon measurement, the mug shot, fingerprint identity filesNo — only augmented (DNA, face)
Cold War SIGINT1945–1975Bulk telegram interception (SHAMROCK); citizen watchlists (MINARET)Program ended 1975; capability retained
Church / FISA reform1975–1978Warrant requirement; statutory limitsThe one true rollback — then eroded by E.O. 12333
Post-9/11 architecture2001–2008PATRIOT §215; Total Information Awareness; warrantless wiretaps; §702No — reauthorized repeatedly
Snowden-era programs2007–2013PRISM; XKeyscore; bulk metadata; global fiber tapsBulk telephony ended 2015; §702 remains
Surveillance capitalism2001–presentBehavioral surplus; real-time bidding; data brokers feeding the stateNo — expanding
The converged state2016–presentFace recognition; ALPR mesh; geofence warrants; China's IJOPNo — expanding
Theorized endpoint2019'Ubiquitous real-time worldwide surveillance'Proposed as necessary
Honest caveats

Where the popular story is wrong.

A ratchet thesis is only credible if it's honest about the myths. These common claims are exaggerated — the documented core doesn't need them.

The myth: "One in 6.5 East Germans was a Stasi informant."

Reality · A contested, maximalist figure that counts the most casual occasional contacts. The defensible numbers are ~91,000 officers and ~173,000–189,000 informants.

Stasi (EBSCO Research Starters)

The myth: "China scores every citizen with one national social-credit number."

Reality · A Western misconception. The reality is a fragmented patchwork of business blacklists and limited municipal pilots — not a single national score.

MERICS: untangling myth from reality

The myth: "Gunshot detection and predictive policing work."

Reality · Independent audits contradict the vendors: 9.1% of ShotSpotter alerts found gun-crime evidence; predictive policing hit 0.1–0.6%. Some of the apparatus surveils without even working.

The Markup: predictive policing audit

The myth: "PRISM gave the NSA 'direct access' to tech companies' servers."

Reality · Disputed by the companies from day one. A leaked slide claimed 'directly from the servers'; a later document described equipment 'installed at company-controlled locations.' Don't overstate it.

PRISM (Washington Post reprint)

The honest conclusion isn't that a secret cabal built a surveillance state — it's something harder to reverse: a long series of reasonable-seeming responses to real crises, each defensible on its own terms, accumulated into an apparatus no one ever voted to construct. The ratchet turns because each individual tooth is defensible. That is precisely why it never turns back.