Seed URLs List

Domain Processor Control

Running
Background Processor: Active and monitoring for new domains
Check Interval: 30 seconds
Domain Processor: This service automatically monitors the TempSeedUrl table for new domains. When a new domain is detected, it validates the website, checks if it's active, uses the region from TempSeedUrl, analyzes JavaScript usage, and inserts valid domains into the GenericWebsite table.
Pending domains: 3228
Auto-restart enabled - processor will automatically start when new domains are added.

Total Websites

23079

Crawled

637

JS Heavy

12276

Total PDFs

39996724

Generic Website Data

Domain URL Status Region Spider Name Crawled Last Crawl Ended Total PDFs Found JS Heavy Actions
https://sds.sherwin-automotive.com/en/show_localization_products/ES-es
DONE ES generic_api_get Yes
2025-12-11
12:52:44
235
No
https://secretkansascity.com
Query: "Sikkerhetsdatablad" "01/02/2024"
NEW US Not Set No Never 0 Yes
https://allthingskansascity.com
Query: "Sikkerhetsdatablad" "01/02/2024"
NEW US Not Set No Never 0 No
https://elstandard.se
Query: Sikkerhetsdatablad 03/01/24 filetype:pdf
NEW SE Not Set No Never 0 Yes
https://gayot.com
Query: "Sikkerhetsdatablad" "01/02/2024"
NEW US Not Set No Never 0 Yes
https://gotquestions.org
Query: "Sikkerhetsdatablad" "01/02/24"
NEW Global Not Set No Never 0 No
https://programme-tv.net
Query: "Sikkerhetsdatablad" "02/01/2024"
NEW FR Not Set No Never 0 Yes
https://kaeltemittel-direkt.com
Query: Sicherheitsdatenblatt 01/01/2024 filetype:pdf
NEW DE Not Set No Never 0 Yes
https://cemix.at
Query: Sicherheitsdatenblatt 01/01/2024 filetype:pdf
NEW AT Not Set No Never 0 No
https://hdlusa.com
Query: "Sicherheitsdatenblatt" "01/03/2024"
NEW US Not Set No Never 0 Yes
https://mega.de
Query: Sicherheitsdatenblatt 01/01/24 filetype:pdf
NEW DE Not Set No Never 0 Yes
https://lagrandeepicerie.com
Query: "Sicherheitsdatenblatt" "03/01/2024"
NEW FR Not Set No Never 0 Yes
https://epiceriebelgique.com
Query: "Sicherheitsdatenblatt" "03/01/2024"
NEW FR Not Set No Never 0 Yes
https://vipibax.de
Query: Sicherheitsdatenblatt 01/05/2024 filetype:pdf
NEW DE Not Set No Never 0 Yes
https://todayinhistory.com.au
Query: "Sicherheitsdatenblatt" "02/01/24"
NEW AU Not Set No Never 0 Yes
https://haritamap.com
Query: "Sicherheitsdatenblatt" "05/01/24"
NEW TR Not Set No Never 0 Yes
https://bueho.com
Query: Sicherheitsdatenblatt 13/01/24 filetype:pdf
NEW AT Not Set No Never 0 Yes
https://hellweg.at
Query: Sicherheitsdatenblatt 27/01/24 filetype:pdf
NEW AT Not Set No Never 0 Yes
https://cri-genetics.de
Query: Sicherheitsdatenblatt 23/01/24 filetype:pdf
NEW DE Not Set No Never 0 No
http://niedersachsen.de
Query: Sicherheitsdatenblatt 10/01/24 filetype:pdf
NEW DE Not Set No Never 0 Yes
Showing 19041 to 19060 of 23079 websites
Show: