rajeev lunkad

The Rise of Next-Gen AI Search Engines

Direct Create
6 min readSep 3, 2023


For the better part of three decades, Google has monopolized our gateway to the Internet’s vast expanse of knowledge. Its iconic search box has been the starting point for infinite inquiries, from the mundane to the profound. But in its wake, critics argue, lies a trail of biases, blinkers, and algorithmic manipulations for Google to sever us AD’s and feed on our Keywords.
In our ongoing examination of Traditional KNowladge Sysytem’s, I recently discovered an emerging Next Gen Search option and realized what we have been missing for decades. While the Internet grew and grew, each Google search user worldwide became increasingly locked into Google’s Keyword Kingdom. We want to delve into the much-debated topic of Google Search’s influence over the information we consume and the search results we receive. Many have felt disheartened, suspecting that behind every query lies an auction where the highest bidder takes precedence. Is the information we’ve been consuming truly representative of the web’s vast knowledge, or have we been limited to a version of the Internet that Google deems fit for us?

Search Result from Metaphor

Emerging from the shadows are next-generation search engines fueled by new cutting-edge AI architectures. These platforms, such as Metaphor, promise not just to syndicate the Internet’s knowledge but to make it accessible in a way that feels more intuitive, unbiased, and attuned to human curiosity. Their capabilities extend beyond just keyword matching, offering us a glimpse of what life could be like outside the Google-centric blinkers many have grown accustomed to.

search results from Google for the same search!

As you can see, Google does what Google does — 70% of my results are ads and have little to do with my query. This is how the 7+ billion are made to access information on the Internet. While Google did not create the Internet, it controls the gateway, and it ruined the potential of Knowledge to change lives and transform our minds. Instead, it's given birth to SEO masters and advertising champions who can pay and manipulate the information the world gets to see even when the searcher did not ask for it!

Join us as we navigate this evolving landscape, comparing the tried-and-true Google search methods with the bold innovations brought forth by AI-driven contenders.

Search for Google:

  1. Keyword-based: Google’s primary approach for years was built around users entering keywords to find relevant information.
  2. PageRank: Google’s algorithm ranks web pages based on the number and quality of links to a page.
  3. Ad-driven: A significant portion of Google’s model incorporates ad placements and AdWords, affecting how search results are presented.
  4. Comprehensive Indexing: Google bots crawl billions of web pages to create a vast indexed database from which search results are derived.
  5. Personalization: Google tailors search results based on individual user data, such as search history, location, and browsing habits.

Search for Next Gen Search [ still early days ]:

  1. AI-Driven: Next Gen Search is designed with AI at its core, emphasizing machine learning models over traditional algorithms.
  2. Link Prediction: Instead of simply indexing and ranking pages, Next Gen Search’s model predicts the most likely link that would follow a given text prompt.
  3. Natural Language: Next Gen Search encourages users to pose queries in a more conversational manner, mimicking how links are shared online.
  4. Prompt Structure: Emphasis on the user framing their queries as if they’re introducing a link in an online conversation or forum.
  5. Complex Queries: Next Gen Search is built to handle more intricate, detailed searches beyond mere keyword lookups.

As we stand on the cusp of this transformative era, we’re left pondering-
What does the future hold for search?
Will these new entrants revolutionize the way we interact with the Internet, or will they simply become part of the vast micro-tapestry of platforms coexisting in Google’s colossal shadow?
Prepare for a journey through the realms of search, from the familiar lanes of Google to the uncharted territories of AI-driven discovery.
Will we reclaim knowledge from Internet

It’s clear that Next Gen Search’s approach to search will be quite distinct from traditional AD-focused search engines like Google.

1. AI-First Design: While Google incorporated AI into its search functionalities over time, Next Gen Search is designed from scratch with AI at its core. Next Gen Search’s vision is to achieve results as if a knowledgeable friend spent a week researching for you, but in an instant.

2. Query Complexity: Google prioritizes short keyword-based searches. In contrast, Next Gen Search embraces more complex, multi-sentence queries, aiming to understand and return results for detailed questions.

3. Link Prediction Model: Next Gen Search’s core functionality is link prediction. Given a text prompt, it predicts which link is most likely to follow that prompt. This is a departure from Google’s combination of keyword matching, PageRank, and other algorithms.

4. Prompt Structure: While Google users are trained to type keywords or short phrases, Next Gen Search encourages users to frame their queries as if they’re leading to a link in natural online conversation. For instance, a good prompt might mimic how a user might introduce a link on a forum or in a blog post.

5. Avoidance of Traditional Keyword Searches: Google has trained users to think in terms of keywords. Next Gen Search, however, suggests avoiding traditional keyword searches in favor of more natural, conversation-like prompts.

6. Rephrasing Questions as Answers: Unlike Google, which can handle direct questions, Next Gen Search recommends reframing questions to appear as statements or answers, which better matches its training on how links are typically shared online.

7. Prompt Modifiers: Next Gen Search’s users can specify the nature of the content they’re searching for (e.g., a “funny post” or a “goodreads link”), offering a level of specificity in the search.

8. Attention to Punctuation: Google doesn’t place a strong emphasis on punctuation for standard search queries. Next Gen Search, however, indicates that punctuation (like colons) can significantly affect the quality of search results, as they mimic how links are shared.

9. Evolutionary Vision: Next Gen Search envisions future search systems as extensions of users’ minds, suggesting a direction of interactive, deeply personalized, and contextually rich search experiences.

10. Knowledge-Based: The future of search is going to lay the emphasis back on the information desired from the query of the inquirer. It can upend the entire information architecture of the Internet as we know it and as we use it. Opening up new and vast possibilities.

In the stagnated landscape of internet search, Next Gen Search emerges as a transformative force, redefining how we engage with the vast expanse of online knowledge. Unlike traditional search paradigms that rely heavily on keyword optimization, Next Gen Search champions a more intuitive, conversation-like approach, harnessing the power of AI to predict links from natural human prompts. As users, this calls for a shift in our search behaviour, mirroring how we naturally share and reference content in digital conversations. With its vision of creating search systems that feel like extensions of our minds, Next Gen Search is not just offering a new way to search but is inviting us to experience a future where the boundaries between querying and conversational thought blur. The promise of seamlessly weaving insights from the entirety of human knowledge is both ambitious and exciting.

#BeyondGoogle #AISearchRevolution #UnbiasedWeb #NextGenSearch#InternetDiscovery #MetaphorVsGoogle #SearchEvolution #AIUnleashed#WebRenaissance #BreakingTheBlinkers Direct Create