General Discussion

LiberalArkie

(15,739 posts) Sat Feb 16, 2019, 10:44 AM Feb 2019

Researchers, scared by their own work, hold back "deepfakes for text" AI

OpenAI, a non-profit research company investigating "the path to safe artificial intelligence," has developed a machine learning system called Generative Pre-trained Transformer-2 (GPT-2 ), capable of generating text based on brief writing prompts. The result comes so close to mimicking human writing that it could potentially be used for "deepfake" content. Built based on 40 gigabytes of text retrieved from sources on the Internet (including "all outbound links from Reddit, a social media platform, which received at least 3 karma" ), GPT-2 generates plausible "news" stories and other text that match the style and content of a brief text prompt.

The performance of the system was so disconcerting, now the researchers are only releasing a reduced version of GPT-2 based on a much smaller text corpus. In a blog post on the project and this decision, researchers Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever wrote:

Due to concerns about large language models being used to generate deceptive, biased, or abusive language at scale, we are only releasing a much smaller version of GPT-2 along with sampling code. We are not releasing the dataset, training code, or GPT-2 model weights. Nearly a year ago we wrote in the OpenAI Charter: “we expect that safety and security concerns will reduce our traditional publishing in the future, while increasing the importance of sharing safety, policy, and standards research,” and we see this current work as potentially representing the early beginnings of such concerns, which we expect may grow over time. This decision, as well as our discussion of it, is an experiment: while we are not sure that it is the right decision today, we believe that the AI community will eventually need to tackle the issue of publication norms in a thoughtful way in certain research areas.

OpenAI is funded by contributions from a group of technology executives and investors connected to what some have referred to as the PayPal "mafia"—Elon Musk, Peter Thiel, Jessica Livingston, and Sam Altman of YCombinator, former PayPal COO and LinkedIn co-founder Reid Hoffman, and former Stripe Chief Technology Officer Greg Brockman. Brockman now serves as OpenAI's CTO. Musk has repeatedly warned of the potential existential dangers posed by AI, and OpenAI is focused on trying to shape the future of artificial intelligence technology—ideally moving it away from potentially harmful applications.

snip

https://arstechnica.com/information-technology/2019/02/researchers-scared-by-their-own-work-hold-back-deepfakes-for-text-ai/?comments=1

4 replies

= new reply since forum marked as read

Highlight:

Researchers, scared by their own work, hold back "deepfakes for text" AI (Original Post) LiberalArkie Feb 2019 OP

AI is going to massively transform our world Arazi Feb 2019 #1

GOPers will vote for oligarchy even as they are replaced Hermit-The-Prog Feb 2019 #3

Their mea culpa is too late, the cats out of the bag. marble falls Feb 2019 #2

Which is what the computer/human GO game challenge shows dixiegrrrrl Feb 2019 #4

Arazi

(6,829 posts)

1. AI is going to massively transform our world

Reply to LiberalArkie (Original post)

Sat Feb 16, 2019, 10:53 AM

Feb 2019

We need a better grip on shaping this technology now before its turned against us.

Good post

Hermit-The-Prog

(33,596 posts)

3. GOPers will vote for oligarchy even as they are replaced

Reply to Arazi (Reply #1)

Sat Feb 16, 2019, 11:16 AM

Feb 2019

Typical trumpers will still be voting to feed the rich even as they are replaced by robotics and AI. That includes office workers.

marble falls

(57,613 posts)

2. Their mea culpa is too late, the cats out of the bag.

Reply to LiberalArkie (Original post)

Sat Feb 16, 2019, 10:59 AM

Feb 2019

dixiegrrrrl

(60,010 posts)

4. Which is what the computer/human GO game challenge shows

Reply to marble falls (Reply #2)

Sun Feb 17, 2019, 09:18 PM

Feb 2019

I watched the documentary, Alpha GO, about the 2017 match, the other night. Excellent film, covers the implications of A1 very well, but is also deeply moving in addressing the human factor.

Anyone who plays GO would find it esp. interesting.

Reply to this discussion