Seed URLs List

Domain Processor Control

Running
Background Processor: Active and monitoring for new domains
Check Interval: 30 seconds
Domain Processor: This service automatically monitors the TempSeedUrl table for new domains. When a new domain is detected, it validates the website, checks if it's active, uses the region from TempSeedUrl, analyzes JavaScript usage, and inserts valid domains into the GenericWebsite table.
Pending domains: 3243
Auto-restart enabled - processor will automatically start when new domains are added.

Total Websites

23052

Crawled

584

JS Heavy

12270

Total PDFs

26302314

Generic Website Data

Domain URL Status Region Spider Name Crawled Last Crawl Ended Total PDFs Found JS Heavy Actions
https://technoclone.com
NEW AT Not Set No Never 0 Yes
https://zeller-gmelin.co.uk
NEW UK Not Set No Never 0 No
https://lichtner-beton.de
NEW DE Not Set No Never 0 No
https://berndkraft.de
NEW DE Not Set No Never 0 Yes
https://deutschepost.de
NEW DE Not Set No Never 0 Yes
https://netdental.de
Query: Sicherheitsdatenblatt 07/02/2024 filetype:pdf
NEW DE Not Set No Never 0 Yes
https://dt-goldart.com
Query: Sicherheitsdatenblatt 02/08/2024 filetype:pdf
NEW Global Not Set No Never 0 Yes
https://generalmembrane.de
Query: Sicherheitsdatenblatt 08/02/24 filetype:pdf
NEW DE Not Set No Never 0 Yes
https://agrocent.de
Query: Sicherheitsdatenblatt 02/13/24 filetype:pdf
NEW DE Not Set No Never 0 No
https://aral-burger.de
Query: Sicherheitsdatenblatt 13/02/2024 filetype:pdf
NEW DE Not Set No Never 0 Yes
https://waffenreiniger.at
NEW AT Not Set No Never 0 No
https://romimoto-piese.ro
Query: Sicherheitsdatenblatt 30/01/2024 filetype:pdf
NEW RO Not Set No Never 0 No
https://isip.de
NEW DE Not Set No Never 0 Yes
https://boge.com
Query: Sicherheitsdatenblatt 02/14/2024 filetype:pdf
NEW CA Not Set No Never 0 No
https://bigler-lacke.swiss
Query: Sicherheitsdatenblatt 19/02/2024 filetype:pdf
NEW CH Not Set No Never 0 Yes
https://hostdry.com
NEW US Not Set No Never 0 No
https://gutex.de
NEW DE Not Set No Never 0 Yes
https://leipfinger-bader.de
NEW DE Not Set No Never 0 Yes
https://conpart.de
Query: Sicherheitsdatenblatt 25/02/24 filetype:pdf
NEW DE Not Set No Never 0 Yes
https://solardirekt24.de
NEW DE Not Set No Never 0 Yes
Showing 19661 to 19680 of 23052 websites
Show: