Interface PolitenessPolicy

Politeness policy for a Crawler

Hierarchy

  • PolitenessPolicy

Implemented by

Properties

Methods

Properties

delay: number

Number of milliseconds to wait between requests. Use 0 to avoid waiting.

Methods

  • Returns

    whether target can be crawled

    Parameters

    Returns boolean

Generated using TypeDoc