Clean

Smart Talks with IBM: Responsible AI - Why Businesses Need Reliable AI Governance

Published Dec 10, 2024, 6:08 PM

To deploy responsible AI and build trust with customers, businesses need to prioritize AI governance. In this episode of Smart Talks with IBM, Malcolm Gladwell and Laurie Santos discuss AI accountability with Christina Montgomery, Chief Privacy and Trust Officer at IBM. They chat about AI regulation, what compliance means in the AI age, and why transparent AI governance is good for business.

 

Visit us at: ibm.com/smarttalks

 

Explore watsonx.governance: https://www.ibm.com/products/watsonx-governance

 

This is a paid advertisement from IBM.

 

Welcome to tech Stuff, a production from iHeartRadio. This season on smart Talks with IBM, Malcolm Gladwell and team are diving into the transformative world of artificial intelligence with a fresh perspective on the concept of open What does open really mean in the context of AI. It can mean open source code or open data, but it also encompasses fostering an ecosystem of ideas, ensuring diverse perspectives are heard, and enabling new levels of transparency. Join hosts from your favorite pushkin podcasts as they explore how openness and AI is reshaping industries, driving innovation, and redefining what's possible. You'll hear from industry experts and leaders about the implications and possibilities of open AI, and of course, Malcolm Gladwell will be there to guide you through the season with his unique insights. Look out for new episodes of Smart Talks every other week on the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts, and learn more at IBM dot com slash smart Talks.

Hey Malcolm Glabell, here, I'm back in your feed today because we are re releasing an episode of Smart Talks with IBM on a very timely topic, AI governance and why regulation is critical to building responsible and accountable AI. I hope you enjoy it. Hello, Hello, Welcome to Smart Talks with IBM, a podcast from Pushkin Industries, iHeartRadio and IBM. I'm Malcolm Glabwell. This season, we're continuing our conversation with new creators visionaries who are creatively applying technology in business to drive change, but with a focus on the transformative power of artificial intelligence and what it means to leverage AI as a game changing multiple for your business. Our guest today is Christina Montgomery, IBM's Chief Privacy and Trust Officer. She's also chair of IBM's AI Ethics Board. In addition to overseeing IBM's privacy policy, A core part of Christina's job involves AI governance, making sure the way AI is used complies with the international legal regulations customized for each industry. In today's episode, Christina will explain why businesses need foundational principles when it comes to using technology, why AI regulation should focus on specific use cases over the technology itself, and share a little bit about her landmark congressional testimony. Last May, Christina spoke with doctor Lori Santos, host of the Pushkin podcast The Happiness Lab, a cognitive scientist and psychology professor at Yale University, Laurie is an expert on human happiness and cognition. Okay, let's get to the interview.

So Christina, I'm so excited to talk to you today. So let's start by talking a little bit about your role at IBM. What does a Chief Privacy and Trust Officer actually do.

It's a really dynamic profession and it's not a new profession, but the role has really changed. I mean, my role today is broader than just helping to ensure compliance with data protection laws globally. I'm also responsible for AI governance I co chair or AI Ethics Board here at IBM, and for data clearance in data governance as well for the company. So I have both a compliance aspect to my role, really important on a global basis, but also help the business to competitively differentiate, because really trust is a strategic advantage for IBM and a competitive differentiator as a company that's been responsibly managing the most sensitive data for our clients for more than a century now and helping to usher new technologies into the world with trust and transparency, and so that's also a key aspect of my role.

And so you joined us here on smart Talks back in twenty twenty one and you chatted with us about IBM's approach of building trust and transparency with AI, and that was only two years ago. But it almost feels like an eternity has happened in the field of AI since then, And so I'm curious how much has changed since you were here last time. Were the things you told us before, you know, are they still true? How are things changing?

You're absolutely right, it feels like the world has changed really in the last two years. But the same fundamental principles and the same overall governance applied to IBM's program for data protection and responsible AI that we talked about two years ago, and not much has changed there from our perspective. And the good thing is we've put these practices and this governance approach into place, and we've had an established way of looking at these emerging technologies. As the technology evolves, the tech is more powerful, for sure, foundation models are vastly larger and more capable and are creating in some respects new issues. But that just makes it all the more urgent to do what we've been doing and to put trust and transparency into place across the business to be accountable to those principles.

And so our conversation today is really centered around this need for new AI regulation and part of that regulation involves the mitigation of bias. And this is something I think about a ton as a psychologist, right, you know, I know, like my students and everyone who's interacting with AI is assuming that the kind of knowledge that they're getting from this kind of learning is accurate, right, But of course AI is only as good as the knowledge that's going in. And so talk to me a little bit about like why bias occurs in AI and the level of the problem that we're really dealing with.

Yeah, well, obviously AI is based on data, right, It's trained with data, and that data could be biased in and of itself, and that's where issues could come up. They come up in the data, they could also come up in the output of the models themselves. So it's really important that you build bias consideration and bias testing into your product development cycle. And so what we've been thinking about here at IBM and doing we had some of our research teams delivered some of the very first toolkits to help detect bias years ago now right and deploy them to open source, and we have put into place for our developers here at IBM and Ethics by Design playbook that's sort of a step by step approach which also addresses very fully biased considerations, and we provide not only like here's a point when you should test for it and you consider it in the data, you have to measure it both at the data and the model level or the outcome level, and we provide guidance with respect to what tools can best be used to accomplish that. So it's a really important issue. It's one you can't just talk about. You have to provide essentially the technology and the capabilities and the guidance to enable people to test for it.

Recently, you had this wonderful opportunity to head to Congress to talk about AI, and in your testimony before Congress you mentioned that it's often said that innovation moves too fast for government to keep up. And this is something that I also worry about as a psychologist. Right our policy makers really understanding the issues that they're dealing with, and so I'm curious how you're approaching this challenge of adapting AI policies to keep up with the sort of rapid pace of all the advancements we're seeing in the AI technology itself.

I think it's really critically important that you have foundational principles that applied to not only how you use technology, but whether you're going to use it in the first place and where you're going to use and apply it across your company. And then your program from a governance perspective, has to be agile. It has to be able to address emerging capabilities, new training methods, etc. And part of that involves helping to educate and instill and empower a trustworthy culture at a company so you can spot those issues so you can ask the right questions at the right time if you try. We talked about during the Senate hearing, and IBM's been talking for years about regulating the use, not the technology itself, because if you try to regulate technology, you're very quickly going to find out regulation will absolutely never keep up with that.

And so in your testimony to Congress, you also talked about this idea of a precision regulation approach for AI. Tell me more about this. What is a precision regulation approach, and why could that be so important.

It's funny because I was able to share with Congress our precision regulation point of view in twenty twenty three, but that precision regulation point of view was published by IBM in twenty twenty. So we have not changed our position that you should apply the tightest controls, the strictest regulatory requirements to the technology where the end use and risk of societal harm is the greatest. So that's essentially what it is. There's lots of AI technology that's used today that doesn't touch people, that's very low risk in nature. And even when you think about AI that delivers a movie recommendation versus AI that is used to diagnose cancer, right, there's very different implications associated with those two uses of the technology. And so essentially what precision regulation is is apply different rules to different risks, right, more stringent regulation to the use cases with the greatest risk. And then also we build that out calling for things like transparency. You see it today with content right, misinformation and the like. We believe that consumers should always know when they're interacting with an AI system, So be transparent, don't hyd your AI define the risks. So as a country, we need to have some clear guidance right and globally as well in terms of which uses of AI or higher risk where we'll apply higher and stricter regulation and have sort of a common understanding of what those high risk uses are and then demonstrate the impact in the cases of those higher risk uses. So companies who are using AI in spaces where they can impact people's legal rights, for example, should have to conduct an impact assessment that demonstrates that the technology isn't biased. So we've been pretty clear about apply the most stringent regulation to the highest risk uses of AI.

And so so far we've been talking about your congressional testimony in terms of, you know, the specific content that you talked about, But I'm just curious on a personal level, you know, what was that like right like right now it feels like at a policy level, like there's a kind of fever pitch going on with AI right now. What did that feel like to kind of really have the opportunity to talk to policy makers and sort of influence what they're thinking about AI technologies like in the coming century.

Perhaps I was really an honor to be able to do that and to be one of the first set of invitees to the first hearing, and what I learned from it essentially is, you know, really two things. The first is really the value of authenticity. So both as an individual and as a company, I was able to talk about what I do. You know, I did need a lot of advanced prep, right. I talked about what my job is, what IBM has been putting in place for years now. So this isn't about creating something. This was just about showing up and being authentic. And we were invited for a reason. We were invited because we were one of the earliest companies in the AI technology space. We're the oldest technology company and we are trusted and that's an honor. And then the second thing I came away with was really how important this issue is to society. I don't think I appreciated it as much until following that experience. I had outreached from colleagues I hadn't worked with for years. I had an outreach from family members who heard me on the radio. You know, my mother and my mother in law, and my nieces and nephews and my friends of my kids were all like, oh, I get it. I get what you do. Now, Wow, that's pretty cool, you know So that was really probably the best and most impactful takeaway that I had.

The mass adoption of generative AI, happening at breakneck speed, has spurred societies and governments around the world to get serious about regulating AI. For businesses, compliance is complex enough already, but throw anever involving technology like AI into the mix, and compliance itself becomes an exercise in adaptability. As regulators seek greater accountability in how AI is used, businesses need help creating governance processes comprehensive enough to comply with the law, but agile enough to keep up with the rapid rate of change in AI development. Regulatory scrutiny isn't the only consideration either responsible AI governance. A business's ability to prove its AI models are transparent and explainable is also key to building trust with customers, regardless of industry. In the next part of their conversation, Laurie asked Christina what businesses should consider when approaching AI governance. Let's listen, So.

What's a particular role that businesses are playing in AI governance? Like, why is it so critical for businesses to be part of this.

So I think it's really critically important that businesses understand the impacts that technology can have, both in making them better businesses, but the impacts that those technologies can have on the consumers that they are supporting. You know, businesses need to be deploying AI technology that is in alignment with the goals that they set for it, and that can be trusted. I think for us and for our clients, a lot of this comes back to trust in tech. If you deploy something that doesn't work, that hallucinates, that discriminates, that isn't transparent, where decisions can't be explained, then you are going to very rapidly erode the trust at best right of your clients and at worst for yourself. You're going to create legal and regulatory issues for yourself as well. So trusted technology is really important, and I think there's a lot of pressure on businesses today to move very rapidly and adopt technology. But if you do it without having a program of governance in place, you're really risking eroding that trust.

And so this is really where I think a strong AI governance comes in. You know, talk about from your perspective how this really contributes to me containing the trust that customers and stakeholders have in these technologies.

Yeah. Absolutely. I mean you need to have a governance program because you need to understand that the technology, particularly in the AI space, that you are deploying, is explainable. You need to understand why it's making decisions and recommendations that it's making, and you need to be able to explain that to your consumers. I mean, you can't do that if you don't know where your data is coming from, what data are you using to train those models, if you don't have a program that manages the alignment of your AI models over time to make sure as AI learns and evolves over uses, which is in large part what makes it so beneficial that it stays in alignment with the objectives that you set for the technology over time. So you can't do that without a robust governance process in place. So we work with clients to share our own story here at IBM in terms of how we put that in place also in our consulting practice to help clients work with these new generative capabilities and foundation models and the like in order to put them to work for their business in a way that's going to be impactful to that business, but at the same time be trusted.

So now I wanted to turn a little bit towards Watson x governance, and so IBM recently announced their AI platform, Watson X, which will include a governance component. Could you tell us a little more about watsonx dot governance.

Yeah, I mean before I do that, I'll just back up and talk about the full platform and then lean into Watson X because I think it's important to understand the delivery of a full suite of capabilities to get data, to train models, and then to govern them over their life cycle. All of these things are really important. From the onset you need to make sure that you have. For our watsonex dot AI for example, that's the studio to train new foundation models and generative AI and machine learning capabilities. And we are populating that studio with some IBM trained foundation models which we're curating and tailoring more specifically for enterprises. So that's really important. It comes back to the point I made earlier about business trust and the need to have enterprise ready technologies in the AI space. And then the watsonex dot data is a fit for purpose data store or a data Lake and then watsonex dot gov. So that's a particular component of the platform that my team and the AI Ethics Board has really worked closely with the product team on developing, and we're using it internally here in the Chief Privacy Office as well to help us govern our own uses of AI technology and our compliance program here, and it essentially helps to notify you if a model becomes biased or gets out of alignment as you're using it over time. So companies are going to need these capabilities. I mean they need them today to deliver technologies with trust. They'll need them tomorrow to comply with regulation which is on the horizon.

And I think compliance becomes even more complex when you consider international data protection laws and regulations. Honestly, I don't know how anyone on any company's legal team is keeping up with us these days. But my question for you is really how can businesses develop a strategy to maintain compliance and to deal with it in this ever changing landscape.

It's increasingly more challenging. In fact, I saw statistic just this morning that the regulatory obligations on companies have increased something like seven hundred times in the last twenty years. So it really is a huge focus area for companies. You have to have a process in place in order to do that, and it's not easy, particularly for a company like IBM that it has a presence in over one hundred and seventy countries around the world. There is more than one hundred and fifty comprehensive privacy regulations, there are regulations of non personal data, there are AI regulations emerging, So you really need an operational approach to it in order to stay compliant. But one of the things we do is we set a baseline. And a lot of companies do this as well. So we define a privacy baseline, we define an AI baseline, and we ensure then as a result of that that there are very few deviances because it incorporates in that baseline. So that's one of the ways we do it. Other companies, I think are similarly situated in terms of doing that. But again, it is a real challenge for global companies. It's one of the reasons why we advocate for as much alignment as possible on the international realm as well as nationally here in the US, as much alignment as possible to make compliance easier for easier and not just because companies want an easy way to comply. But the harder it is, the less likely there will be compliance. And it's not the objective of anybody, governments, companies, consumers to have to set legal obligations that companies simply can't meet.

So what advice would you give to other companies who are looking to rethink or strengthen their approach to AI government.

Think you need to start with, as we did, foundational principles, and you need to start making decisions about what technology you're going to deploy and what technology you're not, What are you going to use it for, and what aren't you going to use it for? And then when you do use it, align to those principles. That's really important. Formalize a program, have someone within the organization, whether it's the chief privacy officer, whether it's some other role, chief AI ethics officer, but have an accountable individual and accountable organization. Do a maturity assessment, figure out where you are and where you need to be, and really start, you know, putting it into place today. Don't wait for regulation to apply directly to your business because it'll be too late.

So Smart Talks features new creators these visionaries like yourself who are creatively applying technology in business to drive change. I'm curious if you see yourself as creative.

You know, I definitely do. I mean, you need to be creative when you're working in an industry that evolves so very quickly. So you know, I started with IBM when we were primarily a hardware company, right, and we've changed our business so significantly over the years. And the issues that are raised with respect to each new technology, whether it be cloud, whether it be AI now where we're seeing a ton of issues, or you look at emergent issues in the space of things like neurotechnologies and quantum computers. You have to be strategic and you have to be creative and thinking about how you can adapt agilely quickly a company to an environment that is changing so quickly and.

With this transformation happening at such a rapid pace. Do you think creativity plays a role in how you think about and implement, specifically a trustworthy AI strategy.

Yeah, I absolutely think it does, because again, it comes back to these capabilities, and there are ways, I guess how you define creativity could be different, right, But I'm thinking of creativity in the sense of sort of agility and strategic vision and creative problem solving. I think that's really important in the world that we're in right now, being able to creatively problem solve with new issues that are rising sort of every day.

And so, how do you see the role of chief privacy officer evolving in the future as AI technology continues to advance, Like what stuff should CPOs take to stay ahead of all these changes that are come in their way?

So the role is evolving in most companies, I would say pretty rapidly. Many companies are looking to chief privacy officers who are ready understand the data that's being used in the organization and have programs to ensure compliance with laws that require you to manage that data in accordance with data protection laws and the like. It's a natural place and position for AI responsibility. And so I think what's happening to a lot of chief privacy officers is they're being asked to take on this AI governance responsibility for companies and if not take it on, at least play a very key role working with other parts of the business in AI governance. So that really is changing. And if chief privacy officers are in companies who maybe haven't started thinking about AI yet, they should, so I would encourage them to look at different resources that are available already in AI governance space. For example, the International Association of Privacy Professionals, which is the seventy five thousand member professional body for the profession of chief Privacy Officers, just recently launched an AI Governance Initiative and an AI Governance Certification program. I sit on their advisory board. But that's just emblematic of the fact that the field is changing so rapidly.

And so, you know, speaking of rapid change. When you're back here on smart Talks in twenty twenty one, you said that the future of AI will be more transparent and more trustworthy. You know, what do you see the next five to ten years holding. You know, when you're back on smart Talks in you know, twenty twenty six, you know twenty thirty, You know what are we going to be talking about when it comes to AI technology and governance.

So I try to be an optimist, right And I said that two years ago, and I think we're seeing it now come into fruition, and there will be requirements, whether they're coming from the US, whether they're coming from Europe, whether they're just coming from voluntary adoption by clients of things like the NISS Risk Management Framework, really important voluntary frameworks. You're going to have to adopt transparent and explainable practices in your uses of AI. So I do see that happening. And in the next five to ten years, boy, I think we'll see more research into trust in techniques because we don't really know, for example, how to water mark. We were calling for things like water marking. There'll be more research into how to do that. I think you'll see, you know, regulation that's specifically going to require those types of things. So I think again, I think the regulation is going to drive research. It's going to drive research into these areas that will help ensure that we can deliver new capabilities, generative capabilities and the like with trust and explainability.

Thank you so much, Christina for joining me on smart Talks to talk about AI and governance.

Well, thank you very much for having me.

To unlock the transformative growth possible with artificial intelligence. Businesses need to know what they wish to grow into first. Like Christina said, the best way forward in the AI future is for businesses to figure out their own foundational principles around using the technology, drawing on those principles to apply AI in a way that's ethically consistent with their mission and complies with the legal frameworks built to hold the technology accountable. As AI adoption grows more and more widespread, so too will the expectation from consumers and regulators that businesses use it responsibly. Investing independable AI governance is a way for businesses to lay the foundations for technology that their customers can trust while rising to the challenge of increasing regulatory complexity. Though the emergence of AI does complicate an already tough compliance landscape, businesses now face a creative opportunity to set a precedent for what accountability in AI looks like and rethink what it means to deploy trustworthy artificial intelligence. I'm Malcolm Gladwell. This is a paid advertisement from IBM. Smart Talks with IBM will be taking a short hiatus, but look for new episodes in the coming weeks. Smart Talks with IBM is produced by Matt Ramano, David jaw Nische Venkat and Royston Deserve with Jacob Goldstein. We're edited by Lydia Gene Kott. Our engineer is Jason Gambrel. Theme song by Gramoscope. Special thanks to Carli Migliori, Andy Kelly, Kathy Callahan and the eight Bar and IBM teams, as well as the Pushkin marketing team. Smart Talks with IBM is a production of Pushkin Industries and Ruby Studio at iHeartMedia. To find more Pushkin podcasts, listen on the iHeartRadio app, Apple Podcasts, or wherever you listen to podcasts.

In 1 playlist(s)

  1. TechStuff

    2,447 clip(s)

TechStuff

TechStuff is getting a system update. Everything you love about TechStuff now twice the bandwidth wi 
Social links
Follow podcast
Recent clips
Browse 2,444 clip(s)