# crawler

Published articles for crawler.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## DocSearch migration

DevFeed: [DocSearch migration](<https://devfeed.tech/articles/docsearch-migration-40932.md>)

Original publisher: [Read original article](<https://docusaurus.io/blog/2021/11/21/algolia-docsearch-migration>)

Author: Sébastien Lorber

Published: 2021-11-21T00:00:00Z

Content type: article

Language: en

Sources: [Docusaurus Blog](<https://devfeed.tech/sources/docusaurus-blog.md>)

Topics: [Algolia](<https://devfeed.tech/topics/algolia.md>), [migration](<https://devfeed.tech/topics/migration.md>), [configuration](<https://devfeed.tech/topics/configuration.md>), [Crawler](<https://devfeed.tech/topics/crawler.md>), [account](<https://devfeed.tech/topics/account.md>)

Tags: [account](<https://devfeed.tech/tags/account.md>), [algolia](<https://devfeed.tech/tags/algolia.md>), [configuration](<https://devfeed.tech/tags/configuration.md>), [crawler](<https://devfeed.tech/tags/crawler.md>), [documentation](<https://devfeed.tech/tags/documentation.md>), [github](<https://devfeed.tech/tags/github.md>), [guide](<https://devfeed.tech/tags/guide.md>), [migration](<https://devfeed.tech/tags/migration.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [search](<https://devfeed.tech/tags/search.md>)

### AI overview

DocSearch is migrating to a new system that gives users their own Algolia application and new credentials. Docusaurus site owners must update their configuration by February 1, 2022, after which existing search indexes will become read-only.

### Source excerpt

DocSearch is migrating to a new, more powerful system, which gives users their own Algolia application and new credentials.

## Google's PageRank--Introduction

DevFeed: [Google's PageRank--Introduction](<https://devfeed.tech/articles/google-s-pagerank-introduction-40199.md>)

Original publisher: [Read original article](<https://www.jeremykun.com/2011/06/12/googles-pagerank-introduction/>)

Published: 2011-06-12T21:09:29Z

Content type: tutorial

Language: en

Sources: [Jeremy Kun](<https://devfeed.tech/sources/jeremy-kun.md>)

Topics: [Google](<https://devfeed.tech/topics/google.md>), [Internet](<https://devfeed.tech/topics/internet.md>), [Algorithm](<https://devfeed.tech/topics/algorithm.md>), [Web](<https://devfeed.tech/topics/web.md>)

Tags: [algorithm](<https://devfeed.tech/tags/algorithm.md>), [crawler](<https://devfeed.tech/tags/crawler.md>), [google](<https://devfeed.tech/tags/google.md>), [history](<https://devfeed.tech/tags/history.md>), [indexer](<https://devfeed.tech/tags/indexer.md>), [page-rank](<https://devfeed.tech/tags/page-rank.md>), [query-engine](<https://devfeed.tech/tags/query-engine.md>), [ranking](<https://devfeed.tech/tags/ranking.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [search-engine](<https://devfeed.tech/tags/search-engine.md>), [sorting](<https://devfeed.tech/tags/sorting.md>)

### AI overview

An introduction to Google's PageRank and the broader process search engines use to select and order information. The article describes crawlers, indexers, ranking algorithms, and query engines, and frames ranking in terms of popularity and authority rather than relevance alone.

### Source excerpt

Importance on the Web As a society living in the "Information Age," it comes as no surprise that we are faced with the task of sorting through vast oceans of content. With the admission that most content is actually junk, we must wisely choose the objects of our analysis. The appropriately named site UselessJunk.com certainly doesn't deserve the same attention as the BBC World News page, and yet within the monstrous heart of the internet, it requires the maturity of the human psyche to discriminate their relative worth.