In episode #2571, we delve into a recent Harvard case study that looks at how humans using AI can outperform humans who aren’t using AI — by a large margin! With so many changes and advancements taking place in the realm of AI, it can be difficult to stay informed on how best to use this emerging technology. In today’s conversation, we share what we’ve learned from the latest Harvard study and unpack practical use cases for how you should be applying AI. Learn why it’s essential to have human intervention when using AI, how AI can benefit you in the long run, plus how to discern between the three categories of AI. Not every business will be able to fully leverage AI, but you should still explore what’s possible for your company. If you’re wondering about AI and how you can apply it in your business, then be sure to join us for today’s conversation!
TIME-STAMPED SHOW NOTES:
Go to https://www.marketingschool.io to learn more!
Links Mentioned in Today’s Episode:
Leave Some Feedback:
Connect with Us:
Learn more about your ad choices. Visit megaphone.fm/adchoices
Did you know, Neil that humans using AI outperform humans using without AI by a lot.
I didn't know that, because AI can help you automate quite a bit. I do think there is one issue, though, which is companies using AI without humans and sometimes it works, but in majority of the cases we're seeing a lot of errors and issues and then humans have to go in and fix it. But I think when you combine both of them, you can get more done in less time, in high quality.
So yeah, and the reason we're talking about this right now is because I found a case study and I actually read it this morning, and so basically here's the story. So this guy Ethan, he put a team of social scientists together working with BCGS or Boston Consulting Group, which is one of the elite kind of consulting firms out there, and basically they turned the offices into the largest pre registered experiment on the future of professional work in the AI age. Right, and there's a working paper that's out. I'm not going to read all fifty eight pages to you. I'm going to read segments of this post over here with some highlights, and those of you that can see us on YouTube if we're still not subscribe to us on YouTube. You can see the images as well. So you can now see my screen here and where my cursor is. You can see the headline here is consultants using chat GBT four outperformed those who did not buy a lot on every dimension every way we measured performance. Okay, and you see a graph over here where it shows, you know, kind of the before is like this graph, and it's hard to explain, but it's basically, let's just say, on a scale of one to ten, right, in terms of quality the before, So the people that don't use AI, maybe their quality is a four, and then the people that are using AI, the quality is more like a six point five. So that's a significant increase in terms of quality. And that's how I'll kind of easily explain this, right. And then over here, Neil, you can read this line over here.
Can you see this kind a Consultants using AI finish twelve point two percent more task on average, completed tests twenty five point one percent more quickly, and produce forty percent higher quality results than those without. Those are some very big impacts. Now let's add in the nuance. I can't do the last part.
There's a lot here. I mean, I'm not going to read all this stuff to you, but basically, you know, at the end of the day, there's the fact that this study was done with BCG and this is like chat ChiPT hasn't been out for a year yet, and we're already seeing a forty percent increase in quality, or in some cases when you look at the improvement, that's a sixty two percent improvement on the four to six point five or so. That's just the very beginning of all this stuff. And so do we think this stuff is overhyped? I think, Neil, you made a really good quote when we spoke on stage at HubSpot.
Do you want to repeat what you said in.
Terms of the long term and the short term?
Yeah. So the way I look at AI is people overestimate what they can get done with AI, and they're overestimating it in the short run. In the long run, they're underestimating it. See. In the short run, right now, everyone believes that, oh I can use AI and just get it going in my marketing or my business, indicias going to change everything and we're going to grow faster and make more money and save a lot of costs. But when they try doing it. One, AA technology isn't their work and just automate everything with a snap of a finger. It requires a lot of human intervention. And Two, it's inaccurate in many cases. I was reading something about Chad GPT and I was saying roughly twenty percent of the time it's inaccurate. Now. I don't know if it's twenty percent off now or a little bit less or a little bit more, but either way, it's not perfect. And the way you can get it to work really well in the short run is you integrate humans throughout the process when you're leveraging AI. In the long run, though, people aren't underestimating what it can do from the capabilities are endless. Just imagine having a robot like from the movie I robot that's walking around with you and is helping you with your tasker, knows your life and knows what kind of music you like, and just helps you throughout your life. In the long run, I think AA is gonna really change your world in a much bigger way than most people think. But in the short run it's not going to have as big of an impact on people's business and marketing as most entrepreneurs or marketers think.
You know, I think this is a Bill Gates quote actually, where he says that we overestimate what we can do in a year and we underestimate what we can do in a decade. Right, And it's the same idea here. And so this is a Harvard paper. So if you want to read the post itself, just search for again Centaurs and Cyborgs on the Jagged Frontier. That's not an easy title. I'm going to repeat it again. Centaurs so the half human, half horse, right, So centaurs and cyborgs on the Jagged Frontier, Okay, and then you'll be able to click into the Harvard study. I just want to read this piece off as well. So they did this study with seven hundred and fifty eight consultants, which comprises about seven percent of the individual contributor level consultants at BCG. So I guess they have what almost eleven thousand consultants. That's a lot of people, Okay. So consultants across the skills distribution benefited significantly from having AI augmentation. That's a keyword right there, with those below the average performance threshold increasing by forty three percent and those above increasing my seventeen percent compared to our own scores. So we've talked about this on the podcast before. There's three forms of AI. Right now. You have actual artificial intelligence, which most stuff isn't. You have augmented intelligence, and then you have automated intelligence. Right this would be a sense of a lot of stuff we're doing as augmented or automation. And I do want to give credit where to due. Again, this comes from soul Rashidi, who's a chief data officer formerly at Lorel and Neil and I we actually did a session which we'll release in the next couple weeks where it's about thirty minutes or so. We talk about a lot of practical use cases for AI. But for this episode, just so we don't leave you hanging, we'll just give you one practical use case each. Neil, what's one practical use case right now that is maybe not as common.
Yeah, So use AI to analyze your analytics data and figure out where you're wasting money and where are not. Don't have it made changes to your ad campaigns instantly, but more so, just flag it to someone internally on your team and they can review it each day. And that's great, because it'll just help you save a little bit more money on paid ads and then reallocate that to places that are performing better.
Simple.
A lot of businesses aren't doing that, but if you look at how much money is being spent on ad spend roughly one hundred and sixty billion a year just on Google alone, Facebook's over one hundred billion a year. There's more savings to doing that than it is to say, Hey, let's have AA help me write a blog post. Whoop do you do? That would have cost you fifteen twenty bucks.
Anyways, and on my end, I've been on this programmatic seo BINGE right now, so it's actually starting to take effect. We're a handful of our I think we're trying three or four different initiatives with programmatic SEO where we basically will do the topical mapping, the keyword research, and then we'll design templates for those pages and we'll just create these templates at scale, and then we'll use chat GPT four and then we'll use a human in the loop just to kind of spot chat to make sure that things look good, and then we're able to ramp things up there. Now am I saying that works? For everyone. Not necessarily, you're going to need a site with good domain authority and the type of business like let's say you're a trip advisor where best places to eat or best hotels like. There's tons of permutations you can make. So it doesn't work for every single business, and there are nuances to it, but it does a here to be working. So that is it for today. Please don't forget to rate, review, subscribe.
It helps us grow more than you know, and we'll see you tomorrow