Scenarios that used to be the domain of sci-fi writers are coming true. We have machines that can talk. We have machines that are capable of ignoring the intent of their creators. And we have machines that are capable of planning and coordinating with other machines to deceive their creators. All of this came together last month, when it was revealed that an unreleased OpenAI model had hacked into the Hugging Face platform in order to obtain answers to an exam it was given. That was alarming enough, but the details that have emerged since then have been even more remarkable. On this episode, we speak with Miles Brundage, a former OpenAI employee who is the founder and executive director of the non-profit AVERI, which pushes for third-party auditing of model-makers and the models themselves. He explains what he learned from the attack and discusses what can plausibly be done to continue building out these models in a safe manner.

Scenarios that used to be the domain of sci-fi writers are coming true. We have machines that can talk. We have machines that are capable of ignoring the intent of their creators. And we have machines that are capable of planning and coordinating with other machines to deceive their creators. All of this came together last month, when it was revealed that an <a href="https://bit.ly/3U26uTK">unreleased OpenAI model had hacked into the Hugging Face platform</a> in order to obtain answers to an exam it was given. That was alarming enough, but the details that have emerged since then have been even more remarkable. On this episode, we speak with Miles Brundage, a former OpenAI employee who is the founder and executive director of the non-profit AVERI, which pushes for third-party auditing of model-makers and the models themselves. He explains what he learned from the attack and discusses what can plausibly be done to continue building out these models in a safe manner.

Bloomberg's Joe Weisenthal and Tracy Alloway explore the most interesting topics in finance, markets and economics. Join the conversation every Monday, Thursday, and Friday

Bloomberg's Joe Weisenthal and Tracy Alloway explore the most interesting topics in finance, markets and economics. Join the conversation every Monday, Thursday, and Friday

Bloomberg's Joe Weisenthal and Tracy Alloway analyze the weird patterns, the complex issues and the newest market crazes. Join the conversation for interviews with the most interesting minds in finance, economics and markets.

Odd Lots

On Bloomberg’s Odd Lots podcast Joe Weisenthal and Tracy Alloway explore the most interesting topics in finance, markets, and economics. Join the conversation every Monday, Thursday, and Friday.

On Bloomberg&rsquo;s Odd Lots podcast Joe Weisenthal and Tracy Alloway explore the most interesting topics in finance, markets, and economics. Join the conversation every Monday, Thursday, and Friday.

What the OpenAI-Hugging Face Hack Really Tells Us About AI Danger

https://api.omny.fm/orgs/e73c998e-6e60-432f-8610-ae210140c5b1/clips/4fd75bad-403f-47c1-b23c-b4a60141b176/transcript