Seed URLs List
Domain Processor Control
Running
Background Processor:
Active and monitoring for new domains
Check Interval:
30
seconds
Domain Processor: This service automatically
monitors the TempSeedUrl table for new domains. When a new domain
is detected, it validates the website, checks if it's active, uses
the region from TempSeedUrl, analyzes JavaScript usage, and
inserts valid domains into the GenericWebsite table.
Pending domains: 3277
Auto-restart enabled - processor will automatically start when new domains are added.
Pending domains: 3277
Auto-restart enabled - processor will automatically start when new domains are added.
Total Websites
22999
Crawled
567
JS Heavy
12253
Total PDFs
24258968
Generic Website Data
Status:
Region:
Date Range:
| Domain URL | Status | Region | Spider Name | Crawled | Last Crawl Ended | Total PDFs Found | JS Heavy | Actions |
|---|---|---|---|---|---|---|---|---|
|
https://danbury-ct.gov
Query: safety data sheet 04/23/24 filetype:pdf
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://cretecolors.com
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://ezlok.com
Query: safety data sheet 11/10/24 filetype:pdf
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://repligen.com
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://floorfolio.com
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://cse.gob.ni
|
NEW | NI | Not Set | No | Never | 0 | No | |
|
https://stonhard.dk
|
NEW | DK | Not Set | No | Never | 0 | No | |
|
https://easytenders.co.za
|
NEW | ZA | Not Set | No | Never | 0 | No | |
|
https://yuasa.it
|
NEW | IT | Not Set | No | Never | 0 | No | |
|
https://mavcenter.pt
|
NEW | PT | Not Set | No | Never | 0 | No | |
|
https://tecalliance.services
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://lodi-elevage.fr
|
NEW | FR | Not Set | No | Never | 0 | Yes | |
|
https://zucchini.it
|
NEW | IT | Not Set | No | Never | 0 | Yes | |
|
https://hernon.com
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://carbuilders.com.au
|
NEW | AU | Not Set | No | Never | 0 | Yes | |
|
https://rgipt.ac.in
|
NEW | IN | Not Set | No | Never | 0 | Yes | |
|
https://cavasecurity.co.uk
|
NEW | UK | Not Set | No | Never | 0 | No | |
|
https://fcc.report
Query: safety data sheet 06/01/24 filetype:pdf
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://rd2.co.nz
|
NEW | NZ | Not Set | No | Never | 0 | No | |
|
https://ecka.org.au
|
NEW | AU | Not Set | No | Never | 0 | Yes |
Showing 221
to 240
of 22999 websites
Show: