AI keyword research

searchterms.com is reader-supported. When you buy through links on our site we may earn an affiliate commission, at no extra cost to you. Our rankings are independent. Learn more.

Keyword research has not died in the AI era — it has changed shape. The phrases people use to find answers are getting longer, more conversational, and more often framed as full questions, because the box they type into now talks back. Google reports that the average search in its AI Mode is roughly three times longer than a traditional query, drawn from a sample of searches between May 2025 and April 2026. ChatGPT Search, Perplexity, and Gemini encourage the same behaviour: people describe a situation and ask for a recommendation rather than typing two or three keywords and scanning blue links. This guide is about how to find those queries, and how to turn them into content an answer engine will actually cite.

What actually changed

The old model rewarded the short, high-volume "head term." You found running shoes, sized the demand, and built a page to rank for it. That work still matters, but it is no longer the whole picture. A growing share of valuable queries are specific, intent-rich, and phrased like something you would say out loud. The searcher who once typed running shoes now asks an AI assistant what are the best running shoes for flat feet and knee pain if I run on pavement — and expects a synthesised answer, not a list to sift through.

This is partly the long tail accelerating. The conversational query is a long-tail keyword with the volume knob turned down and the specificity knob turned all the way up. Individually these prompts have tiny or unmeasurable search volume, so traditional volume-first prioritisation under-counts them. But they carry sharp search intent, and AI systems "fan out" — Google's AI Mode internally expands one question into many related sub-queries and assembles an answer from several sources. A page that thoroughly covers a topic can surface for dozens of phrasings it was never explicitly written for, as long as the coverage and clarity are there.

Head term versus conversational prompt

The most useful mental model is to keep both. Map every head term to the cluster of conversational prompts it really represents. Here is the same intent expressed the old way and the new way:

Classic head term Conversational prompt version What the searcher actually wants
email marketing tools which email tool is best for a small Shopify store sending one newsletter a week A shortlist filtered to their stack and volume
keyword research how do I do keyword research for AI search if no one clicks anymore A method, not a definition
standing desk is a standing desk worth it if I already have back pain and work eight hours A judgement call backed by reasoning
protein powder best protein powder for someone who is lactose intolerant and lifts three times a week A recommendation that respects two constraints

Notice that the right-hand column embeds constraints — a platform, a budget, a health condition, a frequency. Those constraints are where the citable content lives. A page that answers "the best email tool" generically will lose to one that explicitly addresses the Shopify-store-sending-weekly case, because the AI can lift a clean, qualified passage straight from it.

Where to find conversational queries

You cannot pull most of these phrasings from a volume tool alone, because many fall below the reporting threshold. You assemble them from several sources, then validate the underlying topics with the tools that do report data.

Question and autocomplete tools

Tools that mine autocomplete and "people also ask" data are the fastest way to harvest real question phrasing at scale. AnswerThePublic visualises the who/what/why/how, prepositions, and comparisons people search around a seed — exactly the raw material for conversational prompts. Our AnswerThePublic review covers what it does well (idea generation) and where it falls short (it won't give you reliable volume). Treat its output as a list of questions to answer, then prioritise with a data tool.

People Also Ask and autocomplete, by hand

Type a seed into Google and read the autocomplete dropdown, then open the "People also ask" box and keep expanding it — each click loads new related questions. Do the same inside ChatGPT or Perplexity: ask your seed question, then watch the follow-up prompts the interface suggests. Google itself reports that follow-up queries in AI Mode rose more than 40% month over month in the U.S. during that same period, so the suggested follow-ups are a live map of where conversations actually go next.

Analysing your own prompts and logs

The richest source is language people already use with you. Mine your site-search logs, the questions in support tickets and sales emails, and — increasingly — the way you and your colleagues phrase questions to AI assistants. If your analytics or search-console data shows longer, sentence-like queries appearing, those are gold: real demand in the new format. Write them down verbatim. The exact wording is the asset.

The data tools this site reviews

Once you have candidate questions, you still need to know which topics carry real demand and how hard they are to compete on. That is the job of a proper research suite. Drop a seed into one and filter the export by question words or by word count to isolate the longer, conversational variants. For depth across billions of terms, the Semrush review walks through the most complete option and its question-filtering workflow. For a lightweight, in-the-SERP approach, the Keywords Everywhere review covers a browser add-on that overlays volume and "people also search for" data on the searches you are already running, which is a quick way to gauge whether a question cluster is worth pursuing. For an overview of how this all fits the wider shift, see our AI search hub.

Mapping queries to content that gets cited

Finding the prompts is half the work. The other half is structuring content so an answer engine can extract and attribute it. Ranking is no longer the only goal; being the source quoted inside the answer is.

  • Cluster, don't scatter. Group twenty related conversational prompts under one thorough page rather than spinning up twenty thin ones. Fan-out rewards depth on a topic, not a separate URL for every phrasing.
  • Answer first, then elaborate. Put a direct, self-contained answer near the top of each section. AI systems lift clean passages; a two-sentence answer that stands on its own is far more extractable than one buried in a wind-up paragraph.
  • Use the question as a heading. Turn the actual conversational prompt into an h2 or h3, then answer it plainly beneath. This mirrors how engines match sub-queries to passages.
  • Name the constraints. If the query specifies "for beginners," "under $50," or "without coding," say those words in the answer. Specificity is what makes a passage quotable for that exact prompt.
  • Back claims with specifics. Numbers, named examples, dates, and genuine first-hand experience give a model reasons to cite you over a vaguer competitor.

For the platform-specific tactics — how to earn placement in Google's summaries — our guide on optimising for Google AI Overviews goes deeper, and the broader discipline is laid out in what generative engine optimization is.

A practical workflow

  1. List head terms the old-fashioned way — the broad topics central to your business.
  2. Explode each into questions using autocomplete, People Also Ask, a question tool, and your own logs. Capture exact phrasing.
  3. Validate the topics in a research tool to confirm real demand and gauge difficulty, filtering for question words and longer phrases.
  4. Cluster the prompts into topic groups, one strong page per group.
  5. Write answer-first, using the real questions as headings and naming every constraint the searcher mentioned.
  6. Watch what gets cited, then feed that back into the next round. The landscape is still moving, so treat your map as a living document.

A fair caveat: measurement here is immature. Conversational queries are hard to volume-check, AI citations are not yet reported in most analytics, and each engine retrieves sources differently. No one can promise a fixed formula for AI keyword research in 2026. But the underlying discipline is durable — understand the real questions, answer them clearly and specifically, and structure the page so a machine can quote you. Do that, and you are optimising for both the ranking that still exists and the answer that increasingly replaces it.