Seed URLs List

Domain Processor Control

Running
Background Processor: Active and monitoring for new domains
Check Interval: 30 seconds
Domain Processor: This service automatically monitors the TempSeedUrl table for new domains. When a new domain is detected, it validates the website, checks if it's active, uses the region from TempSeedUrl, analyzes JavaScript usage, and inserts valid domains into the GenericWebsite table.
Pending domains: 3266
Auto-restart enabled - processor will automatically start when new domains are added.

Total Websites

23011

Crawled

570

JS Heavy

12259

Total PDFs

24774963

Generic Website Data

Domain URL Status Region Spider Name Crawled Last Crawl Ended Total PDFs Found JS Heavy Actions
https://vogel.de
Query: Sicherheitsdatenblatt 10/12/24 filetype:pdf
NEW DE Not Set No Never 0 Yes
https://greenweedshop.de
NEW DE Not Set No Never 0 Yes
https://easy2clean.at
Query: Sicherheitsdatenblatt 11/23/24 filetype:pdf
NEW AT Not Set No Never 0 No
https://omega-medical.de
Query: Sicherheitsdatenblatt 11/25/24 filetype:pdf
NEW DE Not Set No Never 0 Yes
https://uni-bremen.de
NEW DE Not Set No Never 0 Yes
https://dumanikhabar.in
Query: "Sicherheitsdatenblatt" "02/20/24"
NEW IN Not Set No Never 0 No
https://pubeg.de
Query: Sicherheitsdatenblatt 01/03/2025 filetype:pdf
NEW DE Not Set No Never 0 No
https://auftrag-select.com
Query: Sicherheitsdatenblatt 01/11/2025 filetype:pdf
NEW Global Not Set No Never 0 Yes
https://rubitherm.eu
Query: Sicherheitsdatenblatt 01/13/25 filetype:pdf
NEW EU Not Set No Never 0 Yes
http://jrline.sk
NEW SK Not Set No Never 0 No
https://fishersci.at
NEW AT Not Set No Never 0 Yes
https://uni-duesseldorf.de
NEW DE Not Set No Never 0 No
https://unidomo.de
Query: Sicherheitsdatenblatt 23/10/24 filetype:pdf
NEW DE Not Set No Never 0 Yes
https://busters-accessories.co.uk
NEW UK Not Set No Never 0 No
https://holzschutz-genial.de
Query: Sicherheitsdatenblatt 11/12/24 filetype:pdf
NEW DE Not Set No Never 0 No
https://anit.it
NEW IT Not Set No Never 0 Yes
https://uni-wuppertal.de
Query: Sicherheitsdatenblatt 11/20/24 filetype:pdf
NEW DE Not Set No Never 0 Yes
https://fernco.de
Query: Sicherheitsdatenblatt 12/16/24 filetype:pdf
NEW DE Not Set No Never 0 Yes
https://bl-projektkabel.de
Query: Sicherheitsdatenblatt 12/16/24 filetype:pdf
NEW DE Not Set No Never 0 Yes
https://ebecoheating.dk
NEW DK Not Set No Never 0 No
Showing 21381 to 21400 of 23011 websites
Show: