| Name | Last modified | Size | Description | |
|---|---|---|---|---|
| Parent Directory | - | |||
| Crawlers.json | 2018-03-06 04:50 | 13K | ||
| Crawlers.txt | 2018-03-06 04:50 | 11K | ||
| Exclusions.json | 2018-03-06 04:50 | 715 | ||
| Exclusions.txt | 2018-03-06 04:50 | 574 | ||
| Headers.json | 2018-03-06 04:50 | 230 | ||
| Headers.txt | 2018-03-06 04:50 | 208 | ||