Huawei Mobile Search's AspiegelBot Crawler Found Scraping at High Frequency — Possibly Because Google Services Can't Be Used

Huawei Mobile Search's AspiegelBot crawler was recently found by webmasters scraping site info at high frequency. This AspiegelBot crawler mainly simulates an Android phone to scrape, and its UA identifier doesn't mark which company the crawler belongs to — clearly not wanting to be discovered. Later webmasters dug deeper and found the crawler belongs to AspiegelBot, an Irish subsidiary under Huawei Search; many small sites were directly scraped to a standstill.

Huawei Mobile Search’s AspiegelBot crawler was recently found by webmasters scraping site info at high frequency. This AspiegelBot crawler mainly simulates an Android phone to scrape, and its UA identifier doesn’t mark which company the crawler belongs to — clearly not wanting to be discovered. Later webmasters dug deeper and found the crawler belongs to AspiegelBot, an Irish subsidiary under Huawei Search; many small sites were directly scraped to a standstill.

ASPIEGEL LIMITED

ASPIEGEL LIMITED is a mobile service provider founded in 2015, located in the capital of the Republic of Ireland. By strengthening its business partners and continuously improving the ecosystem, ASPIEGEL is committed to bringing the best digital life experience to every Huawei & Honor device user in all situations across Europe, Canada, Australia, and New Zealand.

This is generally what happens when a new search engine is about to launch: to build its index quickly, the new search engine scrapes internet resources frantically, which shows Huawei’s search engine is about to enter the scene too.

I guess Huawei is building a search engine probably because Google services can’t be used and it must find a replacement, and this AspiegelBot search engine is likely Huawei’s own product as a replacement for Google Search.