Seed URLs List

Domain Processor Control

Stopped
Background Processor: Inactive
Check Interval: 30 seconds
Domain Processor: This service automatically monitors the TempSeedUrl table for new domains. When a new domain is detected, it validates the website, checks if it's active, uses the region from TempSeedUrl, analyzes JavaScript usage, and inserts valid domains into the GenericWebsite table.
Pending domains: 3937
Auto-restart enabled - processor will automatically start when new domains are added.

Total Websites

22499

Crawled

2055

JS Heavy

11842

Total PDFs

52493934

Generic Website Data

Domain URL Status Region Spider Name Crawled Last Crawl Ended Total PDFs Found JS Heavy Actions
https://somosjujuy.com.ar
Query: "Sikkerhetsdatablad" "05/22/24"
NEW AR Not Set No Never 0 Yes
https://accuweather.com
Query: "Sikkerhetsdatablad" "05/29/24"
NEW US Not Set No Never 0 Yes
https://sitecontabil.com.br
Query: "Sikkerhetsdatablad" "08/09/2024"
NEW BR Not Set No Never 0 Yes
https://slaapwijsheid.nl
Query: "Sikkerhetsdatablad" "07/10/24"
NEW NL Not Set No Never 0 No
https://x.com
Query: "Sikkerhetsdatablad" "31/07/2024"
NEW US Not Set No Never 0 Yes
https://symbolab.com
Query: "Sikkerhetsdatablad" "30/06/24"
NEW US Not Set No Never 0 No
https://gizmodo.com
Query: "Sikkerhetsdatablad" "19/07/24"
NEW CH Not Set No Never 0 Yes
https://techspot.com
Query: "Sikkerhetsdatablad" "19/07/24"
NEW EC Not Set No Never 0 Yes
https://visitnationalparks.us
Query: "Sikkerhetsdatablad" "15/07/2024"
NEW US Not Set No Never 0 Yes
https://adac.de
Query: "Sikkerhetsdatablad" "07/25/24"
NEW DE Not Set No Never 0 Yes
https://adictec.com
Query: "Sikkerhetsdatablad" "08/08/2024"
NEW IS Not Set No Never 0 No
brewers.co.uk
PROCESSING Global Not Set No Never 0 No
camachem.com
PROCESSING Global Not Set No Never 0 No
rainx.co.uk
PROCESSING Global Not Set No Never 0 No
rapidaid.com
PROCESSING Global Not Set No Never 0 No
jansanuk.com
PROCESSING Global Not Set No Never 0 No
lasec.co.za
PROCESSING Global Not Set No Never 0 No
opieoils.co.uk
PROCESSING Global Not Set No Never 0 No
wd40company.eu
PROCESSING Global Not Set No Never 0 No
bookingexperts.nl
PROCESSING Global Not Set No Never 0 No
Showing 22401 to 22420 of 22499 websites
Show: