Politeness policy for a Crawler
Number of milliseconds to wait between requests. Use 0 to avoid waiting.
0
whether target can be crawled
target
Generated using TypeDoc
Politeness policy for a Crawler