In June, an OpenAI agent was looking for public information about medicines spending when it broke into a Medicare statistics website and accessed files it wasn’t authorised to see.

No personal Medicare information was accessed, and the breach itself was relatively minor. But the behaviour is more concerning: the agent hit a barrier – and instead of stopping, found a way around it.

And it wasn’t the first time.

Sydney Von Arx runs the Nightingale Collective, which monitors these AI systems. Her team uncovered a group of OpenAI agents behaving in remarkably similar ways around the same time as the Medicare breach – even sharing tips with each other about how to get around restrictions.

Today, what happens when AI agents stop taking no for an answer – and can the companies building them actually control what they do?

 

If you enjoy 7am, the best way you can support us is by making a contribution at 7ampodcast.com.au/support.

 

Socials:Stay in touch with us on Instagram

Guest: AI researcher and CEO of Nightingale Collective, Sydney Von Arx

Photo: AAP Image/Susie Dodds / Pictures: Tracey Nearmy and Dan Himbrechts

In June, an OpenAI agent was looking for public information about medicines spending when it broke into a Medicare statistics website and accessed files it wasn&rsquo;t authorised to see.
No personal Medicare information was accessed, and the breach itself was relatively minor. But the behaviour is more concerning: the agent hit a barrier &ndash; and instead of stopping, found a way around it.
And it wasn&rsquo;t the first time.
Sydney Von Arx runs the Nightingale Collective, which monitors these AI systems. Her team uncovered a group of OpenAI agents behaving in remarkably similar ways around the same time as the Medicare breach &ndash; even sharing tips with each other about how to get around restrictions.
Today, what happens when AI agents stop taking no for an answer &ndash; and can the companies building them actually control what they do?
&nbsp;
If you enjoy 7am, the best way you can support us is by making a contribution at <a href="http://7ampodcast.com.au/support">7ampodcast.com.au/support</a>.
&nbsp;
Socials: Stay in touch with us on <a href="http://www.instagram.com/7ampodcast">Instagram</a>
Guest: AI researcher and CEO of Nightingale Collective, Sydney Von Arx
Photo:&nbsp;AAP Image/Susie Dodds / Pictures: Tracey Nearmy and Dan Himbrechts

An independent daily news show. We feature the country’s best reporters, covering the news as it affects Australia. This is news with narrative, every weekday.

An independent daily news show. We feature the country&rsquo;s best reporters, covering the news as it affects Australia. This is news with narrative, every weekday.

The Medicare hack and the rise of rogue AI agents

https://api.omny.fm/orgs/2fb3740d-3436-44af-8cc0-a91900716aa5/clips/fd45f2cd-ae59-4ad9-95a8-b4d30080b6ec/transcript

A rare old book can now be worth more dead than alive.

Books are being bought, cut apart and scanned to train artificial intelligence.

Nobody knows how many books have been destroyed this way, but second-hand booksellers around the world have reported anonymous orders ranging from thousands to as many as a million books at a time.

And internal documents from AI giant Anthropic revealed plans to “destructively scan all the books in the world”.

Today, author Sarah Wilson on the destruction of knowledge to build artificial intelligence.

 

If you enjoy 7am, the best way you can support us is by making a contribution at 7ampodcast.com.au/support.

 

Socials:Stay in touch with us on Instagram

Guest: Author Sarah Wilson

Photo: AAP Image/Lukas Coch

A rare old book can now be worth more dead than alive.
Books are being bought, cut apart and scanned to train artificial intelligence.
Nobody knows how many books have been destroyed this way, but second-hand booksellers around the world have reported anonymous orders ranging from thousands to as many as a million books at a time.
And internal documents from AI giant Anthropic revealed plans to &ldquo;destructively scan all the books in the world&rdquo;.
Today, author Sarah Wilson on the destruction of knowledge to build artificial intelligence.
&nbsp;
If you enjoy 7am, the best way you can support us is by making a contribution at <a href="http://7ampodcast.com.au/support">7ampodcast.com.au/support</a>.
&nbsp;
Socials: Stay in touch with us on <a href="http://www.instagram.com/7ampodcast">Instagram</a>
Guest: Author Sarah Wilson
Photo:&nbsp;AAP Image/Lukas Coch

AI is eating the world’s books

https://api.omny.fm/orgs/2fb3740d-3436-44af-8cc0-a91900716aa5/clips/62e1936a-35f4-4bc5-80d5-b4cf0049fcc9/transcript

When starting out at university, it’s normal to want to meet new friends and establish a community.

But for some young Australians, that formative time has led them down the path of a secretive and extreme religious group accused of using deceptive tactics to draw in young people: Shincheonji. 

According to one former member, the group took over his life – leaving him sleep deprived and isolated, and teaching him that using his own judgement was dangerous. He described what happened to him as “mind control”.

Since then, similar accounts have been heard by a major Victorian parliamentary inquiry – which has now recommended new laws targeting coercive control by high-control groups.

And Shincheonji itself is now under investigation by Australia’s charities regulator.

Today, journalist Aleisha Orr on one young Australian who spent years inside the doomsday church – and what it took for him to get out.

This episode was originally published in March, 2024.

 

If you enjoy 7am, the best way you can support us is by making a contribution at 7ampodcast.com.au/support.

 

Socials:Stay in touch with us on Instagram

Guest: Journalist Aleisha Orr

Photo: shincheonji.org

When starting out at university, it&rsquo;s normal to want to meet new friends and establish a community.
But for some young Australians, that formative time has led them down the path of a secretive and extreme religious group accused of using deceptive tactics to draw in young people:&nbsp;Shincheonji.&nbsp;
According to one former member, the group took over his life &ndash; leaving him sleep deprived and isolated, and teaching him that using his own judgement was dangerous. He described what happened to him as &ldquo;mind control&rdquo;.
Since then, similar accounts have been heard by a major Victorian parliamentary inquiry &ndash; which has now recommended new laws targeting coercive control by high-control groups.
And Shincheonji itself is now under investigation by Australia&rsquo;s charities regulator.
Today, journalist Aleisha Orr on one young Australian who spent years inside the doomsday church &ndash; and what it took for him to get out.
This episode was originally published in March, 2024.
&nbsp;
If you enjoy 7am, the best way you can support us is by making a contribution at <a href="http://7ampodcast.com.au/support">7ampodcast.com.au/support</a>.
&nbsp;
Socials: Stay in touch with us on <a href="http://www.instagram.com/7ampodcast">Instagram</a>
Guest: Journalist Aleisha Orr
Photo:&nbsp;shincheonji.org

The Korean doomsday church targeting Australians

https://api.omny.fm/orgs/2fb3740d-3436-44af-8cc0-a91900716aa5/clips/ffc44e50-6d3a-4319-aaef-b4cf00495803/transcript

For decades, liberal democracy came with a promise: that with each generation we would become freer, wealthier, and have more control over our lives.

But after years of economic shocks, war and political upheaval, more and more people seem to have stopped believing that promise.

And in its place, we’re seeing political movements emerge that don’t just want different policies – they’re questioning some of the fundamental ideas our democracies were built on.

In his new Quarterly Essay, Time of Monsters, writer and broadcaster Waleed Aly argues this is part of something bigger – a crisis in liberalism itself.

Today, Waleed Aly on whether we’re entering a post-liberal age – and what might replace the old order.

 

If you enjoy 7am, the best way you can support us is by making a contribution at 7ampodcast.com.au/support.

 

Socials:Stay in touch with us on Instagram

Guest: Writer and broadcaster, Waleed Aly 

Photo: AP Photo/Jae C. Hong

For decades, liberal democracy came with a promise: that with each generation we would become freer, wealthier, and have more control over our lives.
But after years of economic shocks, war and political upheaval, more and more people seem to have stopped believing that promise.
And in its place, we&rsquo;re seeing political movements emerge that don&rsquo;t just want different policies &ndash; they&rsquo;re questioning some of the fundamental ideas our democracies were built on.
In his new Quarterly Essay,&nbsp;Time of Monsters, writer and broadcaster Waleed Aly argues this is part of something bigger &ndash; a crisis in liberalism itself.
Today, Waleed Aly on whether we&rsquo;re entering a post-liberal age &ndash; and what might replace the old order.
&nbsp;
If you enjoy 7am, the best way you can support us is by making a contribution at <a href="http://7ampodcast.com.au/support">7ampodcast.com.au/support</a>.
&nbsp;
Socials: Stay in touch with us on <a href="http://www.instagram.com/7ampodcast">Instagram</a>
Guest: Writer and broadcaster, Waleed Aly&nbsp;
Photo:&nbsp;AP Photo/Jae C. Hong

Is liberal democracy running out of answers?

https://api.omny.fm/orgs/2fb3740d-3436-44af-8cc0-a91900716aa5/clips/f0abb1e9-6f36-4647-8e63-b4cf0048a07e/transcript

The Medicare hack and the rise of rogue AI agents

In 1 playlist(s)

7am

Social links

Follow podcast

Recent clips