Everyone wants an AI-powered economy. But who takes responsibility when the technology gets things wrong, and how do we make sure everyone shares the long-promised productivity gains?

That’s at the heart of this week’s episode of The Business of Tech, recorded as the US absorbs its midterm election results and New Zealand waits for special votes to help determine the next government.

My guest, Victoria University of Wellington AI researcher Dr Andrew Lensen, argues that getting value from AI requires more than buying software, building data centres and telling staff to embrace AI. It needs leadership, accountability and evidence that the investment actually delivers.

For the next government, Lensen’s starting point is to have someone in charge. A senior minister responsible for AI would give the issue political weight. An independent body, the equivalent of the Privacy Commissioner, could help turn broad promises about responsible technology into practical oversight.

Explainability and an appeal process

Lensen sees merit in an AI commissioner, with powers to investigate complaints and scrutinise automated decisions. If a government agency uses AI to make a consequential decision about you, there should be an explanation and a way to challenge it.

But rules are only part of the equation. Leaders also need their people on board.

Selling AI primarily as a vehicle for job cuts, as the coalition Government did earlier this year, risks sabotaging its introduction. The employees who understand an organisation’s processes are often best placed to identify where the technology could help. Give them a reason to fear it, and that knowledge becomes harder to unlock.

“As soon as you say, hey, by the way, we're going to get you to do this, and then we'll fire you. I mean, you're really not going to get much progress being made,” Lensen says.

Then there’s the productivity question. Are organisations measuring improvements, or simply assuming that more AI means better performance?

“Because there's so much where at the moment it feels like it's on vibes.” 

Better metrics on AI's impact

Lensen wants proper comparisons between existing processes and AI-assisted alternatives, with success measures set upfront. Time saved, fewer complaints and better outcomes matter more than enthusiastic anecdotes.

We also tackle the data-centre boom. What should New Zealand expect in return for supplying land, electricity and infrastructure? Could access to computing capacity help local researchers and startups, rather than simply serving offshore demand?

This isn’t a call to stop experimenting. It’s a challenge to get more focused about what success looks like, articulate who benefits and who answers when things go wrong.

Listen to this week’s The Business of Tech in full, streaming on iHeartRadio, Spotify, Apple or wherever you get your podcasts.