Spider Verification

Identify Automated environments/crawlers: verify whether a given IP belongs to a search engine crawler. Currently connected to the 4759 verification Channel.

/api/spider_verification/

Service Description

The spider verification service determines whether an IP comes from a search-engine crawler: submit an IP and the server queries a spider IP database, returning the verdict and the source type. It can support access-log analysis and referrer statistics, or decisions such as only serving indexable content to genuine crawlers.

It is a read-only query API supporting both IPv4 and IPv6. Queries reach an external IP database, so a single call may take a while, which is normal.

This service requires project signature authentication. Results depend on the coverage of the third-party IP database, so treat them as a reference rather than the sole criterion.

4759 Spider IP Verification

4759 spider/crawler IP library Signature Required

Read-only query Endpoint: submit an IP and the server checks whether it originates from a search engine crawler (such as Baidu/Google, etc.).

GET /api/spider_verification/sv4759/verify Total calls: 0

Verify Whether an IP Is a Crawler

Verify whether a given IP is a search engine crawler and return the recognition conclusion and type information.

Required: a valid IPv4 or IPv6 address

  • GET query Endpoint; this Service requires a project signature.
  • Querying the external service may take a while, which is normal; the Endpoint returns data as the Spider verification result (including whether it is a crawler and the source type, subject to the actual response).
XiaoYingAPI · Unified API Aggregation Service