Kashmir was the journalist who broke the first story about Clearview’s existence, starting with a bombshell investigation report that blew the doors open on the company’s clandestine operations. As Kashmir reports, you simply plug a photo of someone into Clearview’s app, and it will find every photo of that person that’s ever been posted on the internet. A walk down the street will not feel quite the same again.Today, I’m talking to Kashmir Hill, a New York Times reporter whose new book, Your Face Belongs to Us: A Secretive Startup’s Quest to End Privacy as We Know It, chronicles the story of Clearview AI, a company that’s built some of the most sophisticated facial recognition and search technology that’s ever existed. So, too, is the way in which the building blocks needed to make it are so readily available, from open-source code to public databases of faces.

The scope and sophistication of the technology is striking. Another is that the author makes little effort to try to weigh the benefits of facial recognition (catching more criminals) against the disadvantages (an erosion of privacy). One shortcoming of this gripping book is that it only lightly touches on China and Russia, where the abuses of facial-recognition technology are most abhorrent. As part of one legal settlement, the firm agreed not to sell its software to individuals and private companies in America, though it still sells to law enforcement. Clearview’s app was banned in at least six countries. The press coverage triggered lawsuits and regulatory probes, which concluded that the firm must obtain consent from people whose images it uses. That changed when Ms Hill received a tip-off and doggedly investigated the company, publishing a front-page story in 2020.

Much of Clearview’s rise went on in secret. This problem is most prevalent among minorities, who are underrepresented in the databases used to teach the algorithm how to match faces. But misidentification has also led to wrongful arrests. “We Clearviewed the guy and then passed the information along to the right unit,” one officer told Ms Hill. By mid-2019, more than 200 law-enforcement agencies had used the tool, including the FBI and counterparts abroad. The app helped investigators match faces from surveillance footage with online profiles. Police teams often had databases of mugshots, which only contained people who had been arrested. (Some used it as a party trick, others to recognise acquaintances at conferences.) But Clearview found most success with law enforcement. Venture capitalists were given free trials, as Clearview wooed them. Eventually Clearview’s database grew to 30bn photos. Much of the web scraping was done by contractors, some of whom used fake names and were paid in cryptocurrency. Relying on a database of harvested images of people’s faces from popular websites, such as Facebook, the app managed to link people’s photos to their personal details. With the help of a friend, he designed an advanced face-matching algorithm. While Mr Schwartz provided connections, Mr Ton-That built the app. Along the way they were helped by a cast of right-wing characters, such as Peter Thiel, who put money in Clearview. The pair hit it off and founded Clearview AI. He then moved to New York, where he met Richard Schwartz, who had worked as an adviser to Rudy Giuliani, the former mayor of New York. He built a video-streaming site, which automatically emailed marketing material to users’ contacts. At the age of 19 the Australian university drop-out moved to Silicon Valley. Hoan Ton-That, co-founder of Clearview AI, a secretive startup, had no such qualms. (The event was nicknamed “Snooper Bowl”.) Big tech firms, including Google and Facebook, developed face-scanning systems but stopped short of releasing tools to others for fear of abuse. In 2001 police scanned Super Bowl attendees’ faces in Tampa and compared them to a database of known criminals. As computers became more powerful, the technology grew more useful. By the 1980s, experts could configure a face as a mathematical calculation based on how it differed from the average face.

With funding from the CIA, researchers built a system to match faces photographed at different angles. This type of technology is now popular among law-enforcement agencies. Software enables people’s photos to be instantly matched to online images and digital profiles. But owing to the growth of facial-recognition technology, norms around privacy are being eroded, Kashmir Hill, a journalist for the New York Times, argues in a new book. Passersby do not know fellow pedestrians’ names, jobs or what they just posted online. M ost people expect to walk down a street anonymously.

Look clearview ai johnsonhill