What can former U.S. president Richard Nixon possibly teach us about artificial intelligence today and the future of misinformation online? Nothing. The real Nixon died 26 years ago.<\/span><\/span><\/p>\n But an AI-generated likeness of him shines new light on a quickly evolving technology with sizable implications, both creative and destructive, for our current digital information ecosystem. Starting in 2019, media artists\u00a0Francesca Panetta<\/a> and Halsey Burgund at the Massachusetts Institute of Technology teamed up with two AI companies, Canny AI and Respeecher, to create a posthumous deepfake. The synthetic video shows Nixon giving a speech he never intended to deliver\u2014half a century after the subject it addresses.<\/p>\n Here\u2019s the (real) backstory: In July 1969, as the Apollo 11<\/em> astronauts glided through space on their trajectory toward the moon, William Safire, then one of Nixon\u2019s speechwriters, wrote \u201cIn Event of Moon Disaster\u201d as a contingency. The speech is a beautiful homage to Neil Armstrong and Edwin \u201cBuzz\u201d Aldrin, the two astronauts who descended to the lunar surface\u2014never to return in this version of history. It ends by saying, \u201cFor every human being who looks up at the moon in the nights to come will know that there is some corner of another world that is forever mankind.\u201d<\/p>\n The full deepfake speech can be viewed at https:\/\/moondisaster.org.\u00a0<\/p>\n \u201cDeepfakes\u201d are a class of AI-generated synthetic media. If you have seen one on the Internet before, it was likely an example of the \u201cface-swap\u201d variety. The term itself, a portmanteau of \u201cdeep learning\u201d and \u201cfake,\u201d has a horrific origin story involving a Reddit account with that name posting celebrity-face-swap pornography. And the problem remains: a 2019 report found that \u201cnon-consensual deepfake pornography … accounted for 96 [percent] of the total deepfake videos online.\u201d<\/p>\n Beyond this illegal and harmful use of face swapping, there are various other kinds of AI-based synthesized media. Deep learning has also been adapted to create audio fakes, lip syncing, and whole-head and whole-body puppetry. Many of these techniques purely exist as basic research, though AI-synthesized media is quickly evolving commercial uses\u2014including for Hollywood productions and even cancer patients who have lost their ability to speak.<\/p>\n The M.I.T. team did not set out to create a simple face swap. (Some machine-learning practitioners are now pushing the idea that with a bit of coding experience, almost anyone can make one of these deepfakes in as little as five minutes.) They\u00a0wanted to create the best technical fake possible while documenting the labor involved. The process took more than half a year.<\/p>\n To accomplish the visual part of the fake, Canny AI employed a technique called \u201cvideo dialogue replacement.\u201d Instead of face swapping, an AI system was trained to transfer facial movements for the \u201cIn Event of Moon Disaster\u201d speech to a realistic reconstruction of Nixon\u2019s visage and its surroundings.<\/p>\n For the sound portion, Respeecher processed training audio of an actor reading the speech, as well as recordings of Nixon\u2019s many televised appearances from the White House. The company then used a \u201cvoice conversion system\u201d to synthesize Nixon delivering the speech from the actor\u2019s performance.\u00a0<\/strong>(Both Canny AI\u2019s and Respeecher\u2019s techniques are proprietary, and the companies say they have never been used to make illegal fakes.)<\/p>\n The M.I.T. team also wanted to demonstrate such deepfakes\u2019 potential to raise questions about how they might affect our shared history and future experiences. To do so, they worked with Scientific American<\/em> to show their video to a group of experts on AI, digital privacy, law and human rights. In the short film To Make a Deepfake, <\/em>these experts provide necessary context on the technology\u2014its perils, its potential and the possibilities of this brave new digital world, where every pixel that moves past our collective eyes is potentially up for grabs.<\/p>\nScientific American Documentary: How the Nixon Deepfake Was Made<\/h2>\n
More on Deepfakes<\/h2>\n
![\"http:\/\/rss.sciam.com\/\"](\"https:\/\/static.scientificamerican.com\/sciam\/assets\/Image\/IEOMD-site2.jpg\")
\n
From M.I.T.: In Event of Moon Disaster<\/strong><\/h3>\n
![\"http:\/\/rss.sciam.com\/\"](\"https:\/\/static.scientificamerican.com\/sciam\/assets\/Image\/siwei-op-ed.jpg\")
\n
Op-Ed: Deepfakes and the New AI-Generated Fake Media Creation-Detection Arms Race
\n<\/strong><\/a><\/h3>\n![\"http:\/\/rss.sciam.com\/\"](\"https:\/\/static.scientificamerican.com\/sciam\/assets\/Image\/clicks-lies.jpg\")
\n
Related Story: Clicks, Lies and Videotape<\/strong><\/h3>\n
![\"http:\/\/rss.sciam.com\/\"](\"https:\/\/static.scientificamerican.com\/sciam\/assets\/Image\/new-world-disorder.jpg\")
\n
Related Story: Misinformation Has Created a New World Disorder<\/strong><\/h3>\n<\/div>\n