Skip to content
HomeBlogHow Oernoe Search builds its index: OernoeBot and ...
Search

How Oernoe Search builds its index: OernoeBot and KnowledgeBot

How OernoeBot crawls and indexes websites, how KnowledgeBot builds knowledge panels from Wikipedia and other sites, and why both can miss pages or make mistakes.

O

Oernoe

Writer

Published November 17, 20264 min read

When you type a query into Oernoe Search, the results do not come from a live tour of the whole internet. They come from the Oernoe index, a database of pages and facts that two automated systems have collected ahead of time. Understanding how those systems work explains why some results appear, why others are missing, and why a knowledge panel can occasionally be wrong.

OernoeBot: the crawler

OernoeBot is Oernoe's web crawler. A crawler is a program that visits websites, reads their pages, and follows links to find more pages. When OernoeBot visits a page, it records what the page contains and adds it to the search database. That stored copy is what Oernoe Search looks through when you run a query.

Crawling takes time, and the web is very large. OernoeBot discovers pages by following links, so a page that few other sites link to may take longer to be found, and some pages are never visited at all. A page can also change after OernoeBot last read it, which means the index can hold an older version for a while.

This is why Oernoe Search does not index every page on the web. When a search returns nothing, it tells you about what is in the index, not about what exists. A page you are looking for may simply not have been crawled yet.

How results are chosen

When you search, Oernoe Search compares your words with the pages in its database and lists the matches. The default order is by relevance, and you can also sort alphabetically. You can narrow results with quotation marks for an exact phrase, or with site: followed by a domain to focus on one website.

A match means the page contains words related to your query. It does not mean the page is accurate, current, or written by an expert. Always open the page and check who published it and when before you rely on it.

KnowledgeBot: the knowledge panels

Some searches show a knowledge panel: a short box that summarizes a person, a company, or another topic. These panels are built by a second system, KnowledgeBot.

KnowledgeBot reads Wikipedia and other websites. When a topic has enough published information about it, KnowledgeBot gathers the key facts and assembles them into a panel that appears alongside the search results. Topics with little information usually do not get a panel, because there is not enough material to summarize.

Why panels can be wrong

A knowledge panel is created automatically, so it depends entirely on its sources. If Wikipedia or another website has an outdated date, a wrong title, or a mistaken claim, the panel can repeat it. Combining several sources can also cause errors that none of them made, such as merging two people with the same name or attaching a fact to the wrong year.

Treat a panel as a helpful starting point. It is good for getting oriented quickly, but for anything that matters, such as a quotation, a date, a figure, or a claim about a real person, open a source and confirm the detail there.

Reporting a problem

If you find a mistake in a knowledge panel or a search result, you can report it. Email support@oernoe.com with the search address, the subject of the panel or the result, the detail that is wrong, and a link to a source that shows the correct information. A clear report with a source is much easier to act on than a general complaint.

If the problem concerns information about you personally, the privacy request guide on www.oernoe.com explains how to ask for a review. If the problem is about copyrighted material, use the copyright page instead.

For website owners

If you run a website and want it to appear in Oernoe Search, the most reliable approach is the same as for any search engine: publish useful pages, link them clearly from your home page, and make sure they load without requiring a sign-in. OernoeBot finds pages by following links, so a well-linked site is easier to crawl.

The short version

OernoeBot collects pages; KnowledgeBot builds summaries from published sources. Both work automatically, both can miss things, and both can be out of date. Use the results and panels to find sources quickly, then read the sources themselves before you decide what is true.

O

Oernoe

Writes for the Oernoe Blog. Questions about this blog post can go to the contact page.

Get in touch

Related Blog Posts

Want to Learn More?

Explore our complete guides and knowledge base for more insights on privacy, technology, and best practices.

Browse Our Guides