Seed URLs List

Domain Processor Control

Running
Background Processor: Active and monitoring for new domains
Check Interval: 30 seconds
Domain Processor: This service automatically monitors the TempSeedUrl table for new domains. When a new domain is detected, it validates the website, checks if it's active, uses the region from TempSeedUrl, analyzes JavaScript usage, and inserts valid domains into the GenericWebsite table.
Pending domains: 3277
Auto-restart enabled - processor will automatically start when new domains are added.

Total Websites

22999

Crawled

567

JS Heavy

12253

Total PDFs

24258968

Generic Website Data

Domain URL Status Region Spider Name Crawled Last Crawl Ended Total PDFs Found JS Heavy Actions
https://danbury-ct.gov
Query: safety data sheet 04/23/24 filetype:pdf
NEW Global Not Set No Never 0 Yes
https://cretecolors.com
NEW US Not Set No Never 0 Yes
https://ezlok.com
Query: safety data sheet 11/10/24 filetype:pdf
NEW Global Not Set No Never 0 Yes
https://repligen.com
NEW Global Not Set No Never 0 Yes
https://floorfolio.com
NEW Global Not Set No Never 0 No
https://cse.gob.ni
NEW NI Not Set No Never 0 No
https://stonhard.dk
NEW DK Not Set No Never 0 No
https://easytenders.co.za
NEW ZA Not Set No Never 0 No
https://yuasa.it
NEW IT Not Set No Never 0 No
https://mavcenter.pt
NEW PT Not Set No Never 0 No
https://tecalliance.services
NEW Global Not Set No Never 0 No
https://lodi-elevage.fr
NEW FR Not Set No Never 0 Yes
https://zucchini.it
NEW IT Not Set No Never 0 Yes
https://hernon.com
NEW Global Not Set No Never 0 Yes
https://carbuilders.com.au
NEW AU Not Set No Never 0 Yes
https://rgipt.ac.in
NEW IN Not Set No Never 0 Yes
https://cavasecurity.co.uk
NEW UK Not Set No Never 0 No
https://fcc.report
Query: safety data sheet 06/01/24 filetype:pdf
NEW Global Not Set No Never 0 No
https://rd2.co.nz
NEW NZ Not Set No Never 0 No
https://ecka.org.au
NEW AU Not Set No Never 0 Yes
Showing 221 to 240 of 22999 websites
Show: