The company is overhauling its $200 billion money machine before everyone abandons it for ChatGPT. By Julia Love and Davey Alba
Is this the end of Google Search? The company is overhauling its two hundred billion dollar money machine before everyone abandons it for chat gpt by Julia Love and Davy Alba read aloud by Mark Leidorf. One day in twenty twenty one, Google's web search team presented leadership with what was at the time a novel proposal. Rather than just have the search engine serve up its familiar list of links, have a chat bought, greet visitors at the search results page, and offer to answer questions directly. This wasn't necessarily a shocking idea. Chief Executive Officer Sundr Pichai had been talking for years about redesigning Alphabet, Google's parent company, around artificial intelligence, and the organization ran deep Mind and Google Brain, two of the world's most sophisticated AI labs. Still, the team's management bristled at the proposal. According to a former employee with direct knowledge of those conversastions, Googlers rarely suggested tinkering with the search engine's fundamental design. It was self regulation. People just weren't daring to think the thoughts, the former employee says. The division's leadership worried that its latest AI, though promising wasn't accurate enough, and even if it worked perfectly, answering users questions with AI risked upending Google's core business of mixing so called organic links with a healthy dose of targeted ads. The idea died, at least for the time being. For more than two decades, Google Search has ruled the web. It serves as the primary gateway to the Internet for billions of people. It currently processes almost two hundred thousand queries each second. According to the digital marketing company Semrush Holdings, roughly two thirds of all web traffic referrals come from the search engine. Search is also Google's beating heart, generating more than one hundred and ninety eight billion dollars in revenue in twenty twenty four, almost sixty percent of Alphabet's annual sales. The machine is still humming away, but a chorus of discontent has been building among the web going public in recent years. Users complain that Google results are increasingly larded with advertising and self serving features. Its power over the web also means a substantial portion of the Internet has been designed primarily not for human consumption, but for Google's own web scrapers. Junkie sites with poorly researched listicles or aggregated product reviews, sees prominent space in results, frustrating users and grabbing ad revenue from more useful websites less versed in search engine optimization. Tech critics and lawyers representing the federal government in any trust litigation have been arguing that Google's continued dominance in the face of such shortcomings is proof that the search market is no longer competitive. Then, in twenty twenty two, OpenAI introduced something new. Chat gpt bore a notable resemblance to the twenty twenty one proposal Google had rejected. Like the original version of Google, OpenAI's chatbot provided a simple field for entering text and not much else. The results it spit out didn't display ads above the real answers or offer links to long winded recipe sites where multiple auto playing videos made it hard to concentrate on the steps to make a chickpea salad. And even though its answers weren't always right, the sheer novelty meant users gave open ai a level of grace they might not have extended to the long running leader of the search world. One thing that really stung about chat GPT's rise was that it was built on Google's own inventions. OpenAI's chatbot uses an AI architecture that Google detailed in a now legendary research paper published in twenty seventeen. The breakthrough, a system known as a transformer that helps AI models zero in on the most important pieces of information their analyzed, was free for all to use. That Google's engineering team had woven the technology into search only in the safest of ways showed how much the company struggled to translate its AI breakthroughs into substantial consumer products around the time chat gpt arrived. Pushing through this inertia became the job of Elizabeth Reid, a veteran Googler. Reid joined the search team in twenty twenty one and took over the unit in March twenty twenty four. Since then, she's ushered in some of the biggest changes to Google's core product in years, most notably AI Overviews, which seeds the most prominent space on the search results page to AI generated responses. In March, the company said it will begin experimenting with AI Mode, a dedicated tab on its home page that offers a chat based search experience similar to what it had rejected four years ago. Reid refers to her approach as a constant evolution rather than a complete overhaul. Her team is still struggling to defy the purpose of Google Search in this new era, according to interviews with twenty one current and former search executives and employees, most of whom requested anonymity to avoid straining professional relationships, plus more than two dozen other people in the tech and media industries. In the meantime, multiple independent web publishers say their traffic has been falling. They say aioverviews poses a particular challenge because it presents information directly on Google's own results pages that users previously would have gotten by clicking through to the websites where it originated. In February, the online education company CHEG sued Alphabet, saying the search feature was cribbing Check's own content, posing a dire warning to the company. Google's conduct threatens to leave the public with an increasingly unrecognizable Internet experience in which users never leave Google's walled garden and receive only synthetic, error ridden answers, Check said in its suit. Jose Castaneda, a Google spokesperson responded to the suit by saying the company would defend against these meritless claims. AI's impact on Google itself is just beginning to show. Its search engine is one of the most profitable technologies ever developed, and more than two years after chat GPT's debut, there's little evidence that this is changing, though some analysts anticipate slower search revenue growth in the coming years. The company made more than two hundred billion dollars in gross profit last year. Still, Google is acting with urgency. Shortly after OpenAI released chat GPT, Google reassigned more than one thousand engineers about twenty percent of the search engineering team, to generative AI efforts, albeit with only vague marching orders. According to a former Google employee, in an interview with Bloomberg BusinessWeek, Pitchai, who said that AI is a bigger deal than fire or electricity, says the world is on the verge of a radical transformation in the way it interacts with information. I think we are at one percent of what humanity's information needs are today, he says. It'll be obvious a decade or twenty years from now, and I think we are underestimating how early all of this is and so this is an existential moment for Google. It may also be an existential moment for the web itself. Prior to chat GPT, Google search team was deep into what Arvin Jane, who held the title of Distinguished Engineer at Google until twenty fourteen, called maintenance mode. Thousands of engineers tended to an internal codebase to keep the profits rolling in. It was vast and full of relics from years past, including one hundred thousand lines of code to make a feature that allowed people to vote in the thirteenth season of American Idol. The initial codebase for Uber technologies numbered about ten thousand lines. Search engineers fought over the currency of the realm latency, or how long a web page takes to load. New features risked increasing load times, so Google invented a system that one former manager likened to cap and trade schemes for carbon emissions. To release new projects, teams first had to show they'd reduced latency elsewhere, sending engineers on missions to make unrelated parts of Google Search slightly faster. Other times, they toiled on projects they knew were pointless. In twenty twenty, a former Google manager was charged with helping a team of dozens of engineers who were working on a project to make web search infrastructure more efficient. About six months in, a vice president let slip that he had no intention of releasing the project, but he advised the manager to keep going so the engineers would have something to show their bosses at the end of the year. Not everyone at Google hated such assignments, one former employees, as people sometimes found it relaxing to work on projects for which everyone knew the stakes were low, but the barriers to reducing products hurt morale among engineers and sparked tension between management and rank and filers. In twenty twenty one, Manu Corney, a search engineer who was also Google's resident cartoonist, captured the dynamic by sketching an image of a massive cargo ship with cannons, towers, and cranes grafted on top of an aging hull patched with duct tape, surveying the horizon from the deck. The captain remarks poor execution speed, The rowers need a culture shift. Google did sometimes push the bounds of search, as it did in twenty sixteen with Google Assistant, a feature to field simple voice commands such as checking the weather or finding out who'd won the Warriors game. Many Googlers wanted to push this further, but momentum was tempered by uncertainty about how the product would work with its existing advertising based business model, According to two people familiar with the matter, one of whom framed the debate as an early taste of the angst that generative AI would bring. How the f do we put an ad on it, the former manager says of voice search, That's when the real crisis started. Google's role as a web indexer insulated it from the unreliability of the open Internet. Because it was simply pointing to other sites, its users were less likely to blame it for things they found there. The company was periodically criticized for serving as a distribution system for scams and offensive content, but the reputational risks would clearly increase if Google began providing more information directly. Google has been struggling with the implications of making that shift for more than a decade. In twenty twelve, the company bulked at releasing the Knowledge Graph, a collection of important facts about the world. The database assembled by pulling information from sites Google scraped for search could help the company respond to queries with direct answers and photographs. After months of work, it determined it had reached more than ninety five percent accuracy, to a former employee, but the product provided incorrect information in an internal presentation, and executives refused to give the green light. These hesitations would slow the company's response to generative AI as well. They had the burden of Google speaks the truth, says Jane, the former distinguished engineer. Engineers eventually met Google's bar and the product went ahead that same year. Once the tool was public, the dilemma switched from its accuracy to its impact on the economics of the web. The sites that Google pulled the information from relied on its search engine to send them web traffic and often ad revenue. Later, in internal meetings, Google executives argued the data was fair game because Google credited sources such as Wikipedia in small print beneath its answers. According to one of the former employees, Googlers were well aware of the tension between the preferences of users who liked getting information quickly and the needs of websites that produced them information. I don't know what the right answer is Corney says, I would say that at least as an employee, I felt like the focus on the user was a good enough reason for me to think that Google wasn't trying to do anything nefarious, even though it may put some companies out of business. On the flip side, Google's business model also supported services that were distinctly not useful for users, but were tuned to extract ad revenue, like scammi product affiliate sites and click baity news aggregators. Within the past several years, blog posts began appearing about the declining quality of Google Search. Users started trying to avoid low quality sites with tricks such as appending the term reddit to their queries in the hope of locating threads where the information was coming from real people. It's hard to empirically measure the quality of something as vast and ever changing as Google Search, but academics who've studied the subject say quality has notably declined. I think there really is a feeling of decay that is just widely felt, says Emma Luri, a doctoral candidate at the University of California at Berkeley who's been studying search engines since twenty seventeen. Some Googlers bristled at those complaints. Representatives for Google point to independent assessments determining that its results are higher quality than other search engines. People have high expectations for search and what it does for them, says Pandu Nayak, Google's chief search scientist, and when it delivers on those high expectations, they don't notice it because it's just working the way it should. Even within the company, criticism was mounting that Google was being guided by the wrong incentives. There's natural tension between the search unit, which worked to produce the most useful results to users queries, and the advertising division, which looked to maximize the revenue those queries produced. To keep the priorities of the advertising division from distorting organic search results, those two divisions had traditionally been separated. Some Googlers felt the firewall was weakening as growth leveled off, According to two former employees who'd worked in search. In early twenty nineteen, Google declared a code yellow because it might not meet its goals for search revenue for the quarter. According to documents on earth in the US Department of Justice's twenty twenty three anti trust trial over Google search engine which ultimately resulted in a federal judge's ruling that Google maintained an illegal monopoly in search. The company has said it will appeal. As part of the Code Yellow emergency engineers from Google Search and Chrome browser teams were reassigned to figure out why user queries had slowed. This trend spelled trouble for Google's advertising business because each query represents an opportunity to display a targeted ad, but the actions Google took to address this problem made then Search chief Ben Gomes uncomfortable. I think it is good for us to aspire to query growth and to aspire to more users, but I think we are getting too involved with ads for the go of the product and the company, Gomes wrote in an email made public during the trial. Google called off the Code Yellow seven weeks after it began, with Prabakhar Ragvan, then head of Google's advertising division, praising heroic engineering for helping the company reach its revenue goals despite the slowdown in queries. Shortly thereafter, Gomes shifted into a new role in the educational division, and Ragvan became head of both Search and Ads, further eroding the divide in the eyes of some Googlers. When asked about such concerns, Pitchai says that commercial information is information too, and that advertising can be valuable as long as it's clearly identified. The true north is the users, he says, I think focusing on the users and focusing on quality ends up being the approach by which we will do it all. We'll be right back with is this the end of Google Search? Welcome back to Is this the end of Google Search? The twenty nineteen concerns about query volume would seem quaint compared with the reaction to chat GPT. Reid had joined the search team only nineteen months before and was still learning how it differed from her previous posting at the company's Maps division. It's like you're the next door neighbor who was always in the house, but not after bedtime, Reid says, she pantomimes inspecting the depths of a closet. You still have a lot to learn. Some people who worked at Google when chat GPT arrived describe a panic sweeping through the company, but recalling the moment as she guides a pair of BusinessWeek reporters around the Googleplex in Mountain View, California, while dressed in an outfit based on Google's rainbow palette. Red downplays the idea that the company was shaken by the news. There were plenty of people at Google old enough to remember when Microsoft's two thousand and nine release of the Being search engine was seen as an existential threat. It wasn't business as usual had generally worked, and some weren't inclined to rock the boat. Red, though, was ready to implement real changes. She is very data driven, says Brian mc clendon, who worked with her on Google Maps and is now a senior vice president at Niantic. She would not make a change based on hope, but if she believed she had the data that this other way is better, she'd be a steam roller to get there. Reid has been rising quickly ever since joining Google in two thousand and three, shortly after graduating with a degree in computer science from Dartmouth College, not far from her New Hampshire hometown. She worked in the New York office, where she gained a reputation for being both creative she sewed her own wedding dress and meticulous. She checked her team's code to a level of detail unusual for most managers. In her new role, she's one of the most important people at the company other than Bitchai and Enigmatic founders Larry Page and Sergey Brinn. Earlier in her Google career, Reid had worked on an early version of local Search, a Maps feature that allowed people to limit their search to a geographical area. Brenn, who oversaw the launch, pushed the team to release it even though they hadn't yet completed building the ideal technical infrastructure. This sort of thing would never fly in the search division today. It was also the right call, according to Reid. We learned what people really wanted two months faster, she says. She describes it as a lesson in how you experiment when you're trying to reinvent what's possible. Reid has been attempting to bring that flexibility to her new post. Her team rolled out search labs where enthusiastic users could sign up to try unreleased features, giving the company a way to get user feedback on generative AI experiments before rolling them out to the general public. Read predicts that the traditional Google search bar will become less prominent over time. Voice queries will continue to rise, she says, and Google is planning for expanded use of visual search too. Rajan Patel, a vice president for Search Experience, demonstrated how parents can use Google's visual search tools to help their kids with homework, or to surreptitiously take a photo of a stylish stranger's sneakers in a coffee shop to buy the same pair, something Patel did recently. The search bar isn't going away anytime soon, Reid says, but the company is moving toward a future in which Google is always hovering in the background. The world will just expand, she says. It's as if you can ask Google as easily as you could ask a friend, only the friend is all knowing right. Another step in that direction was Google's recent announcement of AI Mode, which allows users to explore topics in a conversational fashion and ask follow up questions. Robbie Stein, a vice president of product for Google Search, framed the feature as a way for users to explore complex questions that are a poor fit for traditional keyword search. The company's internal testing showed query's doubling in length. It's also a chance for Google to flirt with a new business model. AI Mode will roll out first to users who pay for a subscription to Google's premium AI features a subtle but significant shift for a search engine that has always been free. As AI became more prominent, Google began to lose employees to Open Ai, Anthropic and other startups that were moving faster and building more novel products. But according to several people familiar with the company, morale at the search division has improved as it has begun to feel more dynamic under Reid's leadership. On earnings calls, Pitchye has touted the company's progress in bringing down the costs of delivering AI answers. Brenn has again become a regular presence in Mountain View, and he personally recruited his longtime colleague Nome Shazir, one of Google's most storied engineers, to rejoin the company. Jane says, what I have seen is renewed energy. He says, those early engineers are getting together and now they have a target. There's somebody to catch up with. Red argues that Google is now on track. Things start slowly and then quickly suddenly the combination of the tech and the product and the use and the understanding and the polish and everything comes together and then everyone needs it. She says, on her walk around the Google Plex, it's really exciting to work on search at a time when you think the tech can genuinely change what people can search for. As she exits the Maps campus in the fading afternoon light, red walks a winding path through a grove of redwoods, gingerly stepping aside to accommodate a Googler on a company issued bike. Caterers in neatly pressed uniforms set the stage for an alfresco happy hour. It almost feels like the glory days of the mid twenty tens, when Google was beloved by Internet users and invincible in the market. Google's executives weren't entirely wrong several years ago when they saw risk in building products that might give bad information in Google's own voice. AI Overviews, for instance, has parroted the false claim that Barack Obama is a Muslim, given outdated information about federal student loan policies, and suggested that people eat one rock per day for health reasons. Skepticism about the reliability of AI powered chatbots was already widespread, and Google's willingness to accept such hallucinations could be read as an ominous sign of how much it had lowered its standards to keep pace with other AI companies. To Google, the answers were seen as embarrassing, but not an indication of some fatal weakness in AI. Company representatives also said the examples ricocheting through social media were primarily the result of people bombarding the product with odd queries. Before the advent of generative AI, people did not go to Google Search and say how many rocks should I eat per day? Reid says, they just didn't. She says she doesn't think think Google could have done any better With the release. Google's generative AI products still carry disclaimers that the technology is experimental. Testing tools in public helps them get better. Reid says she's convinced that, as with other changes to search, AI will get people to use Google even more than they did before. Some of the strongest reactions are coming not from users, but from that other core Google constituency and dependent website publishers. Since it became big enough to matter, Google has been in a delicate dance with the people making the sites, videos, and articles that its products helped surface. The company has consistently and accurately described its search as a vital way for websites to attract new users, but it's also steadily been providing more information on the search page itself, obviating the need for users to click through. Supporting publishers has always been incidental to Google's larger aims. According to one former senior executive, give ing traffic to publisher sites is kind of a necessary evil. The main thing they're trying to do is get people to consume Google services, the former executive says, So there's a natural tendency to want to have people stay on Google pages, but it does diminish the sort of deal between the publishers and Google itself. Google contests this characterization, but AI overviews may take it to its logical conclusion. Because Google's AI is trained on the Web, its answers are a kind of remixed version of the Web itself, while also distorting the economy that gave rise to the modern Internet by potentially cutting the sites out of the equation entirely. This is a real problem for publishers such as Emily Henderson, an interior designer who in the early twenty tens built a booming online business by blogging about how to choose just the right size rug for a living room or how far to place the coffee table from the couch. Her posts often landed among the top results on searches about home decoration, drove traffic to her site, which in turn made her subsequent posts more likely to show up high in Google searches. In twenty twenty four, after the introduction of aioverviews, Henderson was dismayed to find Google's AI sharing what appeared to be heard decor guidelines as its own. Her traffic has dipped since May twenty twenty four, when aioverviews was released. Although she's still working to understand what this means for her business, she's concluded she'll have to find another way to attract readers. I loved the Internet how it was, and I'm just a little fearful that we're going to lose people, she says. It's just going to continue to get less human and more generic. Website operators are also encountering new competition from AI generated sites designed to game Google search algorithms. As of March twenty twenty five, the news rating group NewsGuard Technologies identified twelve hundred and fifty four news sites with content written largely or entirely by generate Day AI, up from forty nine sites in May twenty twenty three. Dozens of AI content farms also appear on Google News, where they compete with traditional news outlets for clicks. According to NewsGuard and Google's Advertising business places ads on hundreds of AI generated sites, sharing in the income they generate. In some cases, major brands ads have appeared on spammy AI sites, as when marketing messages from the American Red Cross, Charles Schwab and Google itself showed up on news content farms with names such as What's New to Day and Time News. A Google spokesperson says that AI generated content isn't necessarily against the rules, but that it takes action against low quality sites and those that do violate its policies. What Generative AI did was give people a free and really easy to use tool to automate and scale spam techniques in a really big way, says le Ray, senior vice president for Search Engine Optimization Strategy at the marketing agency AMSIV. At the same time, she says, the standard practices that websites engaged in to make their sites legible to Google and therefore likely to become more visible in search are becoming less effective because of constant changes to search as ranking algorithms. She says the relationship between Google and publishers is as tense as it's been at any point in the past two decades. Reid says that Google cares deeply about publishers and that aioverviews is a jumping off point for users to conduct further research on the open web. Pitchai, for his part, stresses the need to send high quality traffic to websites instead of making users click around on sites that may not be relevant to them. We are in the phase of making sure through this moment that we are improving the product, but in a way that prioritizes sending traffic to the ecosystem, he says, adding that's been the most important goal. In October, Google convened a group of about twenty website creators at its Mountain View headquarters in what it called the Web Creator Conversation Event. The company invited product reviewers, travel bloggers, and entertainment and lifestyle writers and set up a series of meetings with its search engineers. They told us that our content and our websites are exactly the kind of thing that Google wants to reward and that they need to do better, says Gaselle Navarro, the managing editor for Housefresh, a website that specializes in in depth reviews of air purifiers. The engineers asked the creators for tips on how to recognize when content was made by humans rather than generative AI, according to three people who were at the meeting, but Nayak, Google's chief search scientist, also advised publishers to take advantage of AI tools to help them write content, they said. At one point, an attendee pleaded with Google to roll back some of the updates that had made to search, arguing that it must want to remedy the harm it was doing to its partners. But Navarro remembers a Google engineer saying the company couldn't make piecemeal adjustments to core changes to the algorithm. Since then, some attendees have folded and others are struggling to adjust. Google framed it as a broad conversation about the changing nature of search, but the message in the mind of at least some creators was starker. According to Navarro, something they told us in that meeting was to never expect to go back to our old levels of traffic. She says because search has changed.