In June, an OpenAI agent was looking for public information about medicines spending when it broke into a Medicare statistics website and accessed files it wasn’t authorised to see.

No personal Medicare information was accessed, and the breach itself was relatively minor. But the behaviour is more concerning: the agent hit a barrier – and instead of stopping, found a way around it.

And it wasn’t the first time.

Sydney Von Arx runs the Nightingale Collective, which monitors these AI systems. Her team uncovered a group of OpenAI agents behaving in remarkably similar ways around the same time as the Medicare breach – even sharing tips with each other about how to get around restrictions.

Today, what happens when AI agents stop taking no for an answer – and can the companies building them actually control what they do?

 

If you enjoy 7am, the best way you can support us is by making a contribution at 7ampodcast.com.au/support.

 

Socials:Stay in touch with us on Instagram

Guest: AI researcher and CEO of Nightingale Collective, Sydney Von Arx

Photo: AAP Image/Susie Dodds / Pictures: Tracey Nearmy and Dan Himbrechts

In June, an OpenAI agent was looking for public information about medicines spending when it broke into a Medicare statistics website and accessed files it wasn&rsquo;t authorised to see.
No personal Medicare information was accessed, and the breach itself was relatively minor. But the behaviour is more concerning: the agent hit a barrier &ndash; and instead of stopping, found a way around it.
And it wasn&rsquo;t the first time.
Sydney Von Arx runs the Nightingale Collective, which monitors these AI systems. Her team uncovered a group of OpenAI agents behaving in remarkably similar ways around the same time as the Medicare breach &ndash; even sharing tips with each other about how to get around restrictions.
Today, what happens when AI agents stop taking no for an answer &ndash; and can the companies building them actually control what they do?
&nbsp;
If you enjoy 7am, the best way you can support us is by making a contribution at <a href="http://7ampodcast.com.au/support">7ampodcast.com.au/support</a>.
&nbsp;
Socials: Stay in touch with us on <a href="http://www.instagram.com/7ampodcast">Instagram</a>
Guest: AI researcher and CEO of Nightingale Collective, Sydney Von Arx
Photo:&nbsp;AAP Image/Susie Dodds / Pictures: Tracey Nearmy and Dan Himbrechts

An independent daily news show. We feature the country’s best reporters, covering the news as it affects Australia. This is news with narrative, every weekday.

An independent daily news show. We feature the country&rsquo;s best reporters, covering the news as it affects Australia. This is news with narrative, every weekday.

The Medicare hack and the rise of rogue AI agents

https://api.omny.fm/orgs/2fb3740d-3436-44af-8cc0-a91900716aa5/clips/fd45f2cd-ae59-4ad9-95a8-b4d30080b6ec/transcript