Seed URLs List

Domain Processor Control

Running
Background Processor: Active and monitoring for new domains
Check Interval: 30 seconds
Domain Processor: This service automatically monitors the TempSeedUrl table for new domains. When a new domain is detected, it validates the website, checks if it's active, uses the region from TempSeedUrl, analyzes JavaScript usage, and inserts valid domains into the GenericWebsite table.
Pending domains: 3256
Auto-restart enabled - processor will automatically start when new domains are added.

Total Websites

23025

Crawled

575

JS Heavy

12267

Total PDFs

24817372

Generic Website Data

Domain URL Status Region Spider Name Crawled Last Crawl Ended Total PDFs Found JS Heavy Actions
https://hellmut-ruck.de
NEW DE Not Set No Never 0 Yes
https://flyerdeals.ca
Query: "Sicherheitsdatenblatt" "01/18/24"
NEW CA Not Set No Never 0 No
https://rud-schoettler.de
NEW DE Not Set No Never 0 Yes
https://klarenergy.no
NEW NO Not Set No Never 0 Yes
https://vartools.com
Query: Sicherheitsdatenblatt 25/03/2024 filetype:pdf
NEW FR Not Set No Never 0 Yes
https://uni-stuttgart.de
Query: Sicherheitsdatenblatt 18/02/24 filetype:pdf
NEW DE Not Set No Never 0 Yes
https://truxx.com
Query: "Sicherheitsdatenblatt" "16/01/2024"
NEW US Not Set No Never 0 Yes
https://ihk.de
Query: Sicherheitsdatenblatt 06/03/24 filetype:pdf
NEW DE Not Set No Never 0 Yes
https://sonderpreis-baumarkt.de
NEW DE Not Set No Never 0 Yes
https://blank-gebaeudereinigung.de
Query: Sicherheitsdatenblatt 03/19/24 filetype:pdf
NEW DE Not Set No Never 0 No
https://admonter.com
NEW AT Not Set No Never 0 Yes
https://pohlcon.com
NEW DE Not Set No Never 0 No
https://foxbau.com
NEW Global Not Set No Never 0 Yes
https://bj-agro.de
Query: Sicherheitsdatenblatt 22/03/2024 filetype:pdf
NEW DE Not Set No Never 0 No
https://bloemsealants.de
NEW DE Not Set No Never 0 Yes
https://jonesdayreach.com
Query: Sicherheitsdatenblatt 14/04/24 filetype:pdf
NEW Global Not Set No Never 0 No
https://addinol.kz
NEW KZ Not Set No Never 0 No
https://chromos.eu
Query: Sicherheitsdatenblatt 29/02/24 filetype:pdf
NEW EU Not Set No Never 0 Yes
https://coenen.de
NEW DE Not Set No Never 0 No
https://hartmann.info
NEW Global Not Set No Never 0 No
Showing 20001 to 20020 of 23025 websites
Show: