Seed URLs List

Domain Processor Control

Running
Background Processor: Active and monitoring for new domains
Check Interval: 30 seconds
Domain Processor: This service automatically monitors the TempSeedUrl table for new domains. When a new domain is detected, it validates the website, checks if it's active, uses the region from TempSeedUrl, analyzes JavaScript usage, and inserts valid domains into the GenericWebsite table.
Pending domains: 3262
Auto-restart enabled - processor will automatically start when new domains are added.

Total Websites

23018

Crawled

573

JS Heavy

12262

Total PDFs

24810923

Generic Website Data

Domain URL Status Region Spider Name Crawled Last Crawl Ended Total PDFs Found JS Heavy Actions
https://melag.com
NEW DE Not Set No Never 0 Yes
https://olwo.ch
Query: Sicherheitsdatenblatt 23/05/24 filetype:pdf
NEW CH Not Set No Never 0 Yes
https://fodig.de
NEW DE Not Set No Never 0 Yes
https://allgreatquotes.com
Query: "Sicherheitsdatenblatt" "29/01/24"
NEW CA Not Set No Never 0 Yes
https://bremer-leguil.de
Query: Sicherheitsdatenblatt 05/22/2024 filetype:pdf
NEW DE Not Set No Never 0 No
https://hranipex.de
NEW DE Not Set No Never 0 Yes
https://praximed.com
NEW DE Not Set No Never 0 Yes
https://stihl.ch
Query: Sicherheitsdatenblatt 06/12/2024 filetype:pdf
NEW CH Not Set No Never 0 Yes
https://hinterseer.com
Query: Sicherheitsdatenblatt 06/18/24 filetype:pdf
NEW DE Not Set No Never 0 Yes
https://direct-onlinehandel.de
Query: "Sicherheitsdatenblatt" "07/02/2024"
NEW DE Not Set No Never 0 Yes
http://marysvillelivestock.com
Query: "Sicherheitsdatenblatt" "07/02/24"
NEW US Not Set No Never 0 Yes
https://glow2b.de
Query: Sicherheitsdatenblatt 19/07/2024 filetype:pdf
NEW DE Not Set No Never 0 No
https://svetkaravanu.cz
NEW CZ Not Set No Never 0 Yes
https://druckweiterverarbeitung.de
NEW DE Not Set No Never 0 Yes
https://horo-hartmetall.de
Query: Sicherheitsdatenblatt 22/09/24 filetype:pdf
NEW DE Not Set No Never 0 No
https://analytichem.de
NEW DE Not Set No Never 0 Yes
https://beck-shop.de
Query: Sicherheitsdatenblatt 10/13/24 filetype:pdf
NEW DE Not Set No Never 0 Yes
https://kontrolldienstkut.ch
Query: Sicherheitsdatenblatt 11/15/24 filetype:pdf
NEW CH Not Set No Never 0 No
https://tfo-bruneck.it
NEW IT Not Set No Never 0 No
https://mundorf.de
NEW DE Not Set No Never 0 Yes
Showing 20461 to 20480 of 23018 websites
Show: