You hear a lot about AI safety, and this idea that sufficiently advanced AI could pose some kind of threat to humans. So people are always talking about and researching "alignment" to ensure that new AI models comport with human needs and values. But what about humans' collective treatment of AI? A small but growing number of researchers talk about AI models potentially being sentient. Perhaps they are "moral patients." Perhaps they feel some kind of equivalent of pleasure and pain -- all of which, if so, raises questions about how we use AI. They argue that one day we'll be talking about AI welfare the way we talk about animal rights, or humane versions of animal husbandry. On this episode we speak with Larissa Schiavo of Eleos AI. Eleos is an an organization that says it's "preparing for AI sentience and welfare." In this conversation we discuss the work being done in the field, why some people think it's an important area for research, whether it's in tension with AI safety, and how our use and development of AI might change in a world where models' welfare were to be seen as an important consideration.

Only Bloomberg.com subscribers can get the Odd Lots newsletter in their inbox — now delivered every weekday — plus unlimited access to the site and app. Subscribe at bloomberg.com/subscriptions/oddlots

You hear a lot about AI safety, and this idea that sufficiently advanced AI could pose some kind of threat to humans. So people are always talking about and researching "alignment" to ensure that new AI models comport with human needs and values. But what about humans' collective treatment of AI? A small but growing number of researchers talk about AI models potentially being sentient. Perhaps they are "moral patients." Perhaps they feel some kind of equivalent of pleasure and pain -- all of which, if so, raises questions about how we use AI. They argue that one day we'll be talking about AI welfare the way we talk about animal rights, or humane versions of animal husbandry. On this episode we speak with Larissa Schiavo of Eleos AI. Eleos is an an organization that says it's "preparing for AI sentience and welfare." In this conversation we discuss the work being done in the field, why some people think it's an important area for research, whether it's in tension with AI safety, and how our use and development of AI might change in a world where models' welfare were to be seen as an important consideration.
Only Bloomberg.com subscribers can get the Odd Lots newsletter in their inbox &mdash; now delivered every weekday &mdash; plus unlimited access to the site and app. Subscribe at <a href="https://www.bloomberg.com/subscriptions/oddlots?in_source=oddlotspodcast" data-destination="https://www.bloomberg.com/subscriptions/oddlots?in_source=oddlotspodcast">bloomberg.com/subscriptions/oddlots</a>

Bloomberg's Joe Weisenthal and Tracy Alloway explore the most interesting topics in finance, markets and economics. Join the conversation every Monday and Thursday.

Bloomberg's Joe Weisenthal and Tracy Alloway explore the most interesting topics in finance, markets and economics. Join the conversation every Monday and Thursday.

Bloomberg's Joe Weisenthal and Tracy Alloway analyze the weird patterns, the complex issues and the newest market crazes. Join the conversation every Tuesday and Thursday for interviews with the most interesting minds in finance, economics and markets.

Odd Lots

On Bloomberg’s Odd Lots podcast Joe Weisenthal and Tracy Alloway explore the most interesting topics in finance, markets, and economics. Join the conversation every Monday and Thursday. 

On Bloomberg’s Odd Lots podcast Joe Weisenthal and Tracy Alloway explore the most interesting topics in finance, markets, and economics. Join the conversation every Monday and Thursday.

The Movement That Wants Us to Care About AI Model Welfare

https://api.omny.fm/orgs/e73c998e-6e60-432f-8610-ae210140c5b1/clips/9ff01ad0-582e-4415-9e8e-b385014eec39/transcript