
Before a system can say anything about your company, it has to notice your company was named. Entity recognition does the noticing. It scans text, marks the spans that are names and gives each a type. It’s the first step in turning a sentence into facts. Brand names fail at it more often than marketers expect.
Most systems label every token with a tag. A common format is BIO, also called IOB: B marks the first token of an entity, I marks the tokens inside it, and O marks everything outside.
The hard part is visible in the last three lines. “Google AI Mode” is one product, and a weaker model might tag “Google” as the company and drop the rest. Getting span edges right matters as much as getting the type right.
| Approach | How it finds names | Weak spot |
|---|---|---|
| Rules and gazetteers | Matches lists of known names and patterns | Misses any name not on the list |
| Statistical models | Learns from capitals, word shape and context | Needs labeled data for each domain |
| Transformer models | Reads every word in light of its neighbors | Still unsure about brand-new names |
| Prompted LLMs | Extracts entities from plain instructions | Output can vary between runs |
The field’s best-known benchmark came from the CoNLL-2003 shared task. Sixteen systems tagged four types in English Reuters news and in German text: persons, organizations, locations and miscellaneous names.
Accuracy is reported as F1, the balance of precision (tags that are correct) and recall (entities that were found). At CoNLL-2003, the top system scored 88.76 on English and 72.41 on German.
That 16-point gap between languages still matters for brands selling in many markets. A model that tags your brand reliably in English may miss it in another language.
Today’s open models do better on news-style text. The spaCy English transformer pipeline, en_core_web_trf 3.8, reports an entity F-score of 89.93 across 18 types. Its small CPU model scores about 84. Text from your niche, full of product names, will usually score lower than the benchmark.
Mention tracking runs into the same problem. To count your mentions in AI answers, a tool first has to find your name in each answer. Our guide on tracking brand mentions in ChatGPT walks through that side.
Entity recognition is one task inside natural language processing, and its output feeds the steps after it. A tagged name goes to entity linking, which picks the matching knowledge base entry. The types it uses are described on our named entities page.
In search, recognized entities tell an engine what a query or passage is about. That supports semantic search, where results are matched on meaning. For your own company, the record those names point to is your brand entity.
Ansvisor’s Site Audit scores any public page on 47 weighted AEO and GEO signals, with entity checks among them. Run it on your main product pages in every language you publish. Then look at the answers themselves. Answer Engine Insights reports, market by market, whether each AI platform names your products correctly.
Each prompt you win brings more mentions, more citations and more buyers. Ansvisor keeps finding the next one.
Entity recognition is the task of finding the names in a text and labeling each with a type, such as person, organization, location or product. It’s usually the first step in turning text into structured facts. Search engines, AI assistants and brand trackers all depend on it.
A name that is never tagged as an entity can’t be linked to a knowledge base, counted as a mention or connected to facts. If a model misses your product name or labels it as an ordinary word, everything built on top of that step misses it too.
Most models tag people, organizations, locations and products, and many add events, works, dates, money and percentages. The set depends on the training data. A model trained only on news, for example, may have no product type at all.
On standard news benchmarks, good models score around 0.9 on the F1 measure, which balances precision and recall. Accuracy drops on new domains, rare names and some languages. Brand names that look like ordinary words, or that use lowercase styling, are frequent misses.
Paste a page into an NER tool, such as the spaCy library or Google’s Cloud Natural Language API, and it lists the entities it found with their types. Check that your brand and each product come back complete and correctly typed.
See how AI answers describe your brand, find out why competitors get picked, and close the gaps with AI agents that work alongside your team.
14-day free trial or 50% off your first month with code SAVE50.
Continue exploring key AI visibility concepts.
Measure and improve how often your brand appears in AI-generated answers.
Learn more →Strategies for increasing visibility in answer engines and AI summaries.
Learn more →Optimizing content for AI-powered discovery experiences.
Learn more →Understand how OpenAI retrieves and synthesizes information.
Learn more →AI-generated summaries that appear directly in Google Search.
Learn more →Explore how Perplexity cites and presents sources.
Learn more →References and sources used by AI systems to support answers.
Learn more →Measure the quality and influence of cited sources.
Learn more →How easily AI systems can discover and reuse your content.
Learn more →New terms are added regularly.
Help us improve the page or suggest a new term →
Co-founder at Ansvisor
Cihan Geyik is the co-founder of Ansvisor, an open-source AI Visibility platform for AI Search. With more than 15 years of experience in digital marketing and growth, he writes about AI visibility, AI search, AEO, GEO, citations, and answer engines. He focuses on helping brands understand and improve their presence across ChatGPT, Gemini, Google AI Overviews, Bing AI Mode and other AI answer engines.
Add Ansvisor as a preferred source and Google will show you more of our AI search, AEO and GEO guides.
© 2026 Ansvisor. All rights reserved. Ansvisor is an open-source AI Search Execution Platform for AI Visibility. Ansvisor is a brand owned and operated by Empler AI Inc.
The open-source AI Search Execution Platform. Track how AI answers talk about your brand and act on it.
Open source · MIT license© 2026 Ansvisor, a brand of Empler AI Inc. · 1401 PE Ave. Unit 105, Wilmington, DE 19806, United States
Cookie preferences
We use cookies to keep the site working and, with your OK, to measure traffic and improve our marketing. Read our Cookies & Tracking policy.