Seed URLs List

Domain Processor Control

Running
Background Processor: Active and monitoring for new domains
Check Interval: 30 seconds
Domain Processor: This service automatically monitors the TempSeedUrl table for new domains. When a new domain is detected, it validates the website, checks if it's active, uses the region from TempSeedUrl, analyzes JavaScript usage, and inserts valid domains into the GenericWebsite table.
Pending domains: 3271
Auto-restart enabled - processor will automatically start when new domains are added.

Total Websites

23006

Crawled

569

JS Heavy

12257

Total PDFs

24629362

Generic Website Data

Domain URL Status Region Spider Name Crawled Last Crawl Ended Total PDFs Found JS Heavy Actions
https://channelnewsasia.com
Query: "Sicherheitsdatenblatt" "18/03/2024"
NEW Global Not Set No Never 0 No
https://digit.in
Query: "Sicherheitsdatenblatt" "29/03/24"
NEW IN Not Set No Never 0 Yes
https://belgiumchocolatiers.com
Query: "Sicherheitsdatenblatt" "11/04/24"
NEW BE Not Set No Never 0 Yes
https://guidgenerator.app
Query: "Sicherheitsdatenblatt" "18/04/24"
NEW Global Not Set No Never 0 Yes
https://jubelio.com
Query: "Sicherheitsdatenblatt" "24/04/2024"
NEW US Not Set No Never 0 Yes
https://iodonna.it
Query: "Sicherheitsdatenblatt" "08/04/24"
NEW IT Not Set No Never 0 Yes
https://memedata.com
Query: "Sicherheitsdatenblatt" "04/12/24"
NEW CN Not Set No Never 0 No
https://rollingstone.com.br
Query: "Sicherheitsdatenblatt" "08/04/24"
NEW BR Not Set No Never 0 No
https://avmindustries.com
NEW Global Not Set No Never 0 Yes
https://casadeourobr.com
Query: "Sicherheitsdatenblatt" "29/02/2024"
NEW US Not Set No Never 0 No
https://bos.de
NEW DE Not Set No Never 0 Yes
https://scentfriends.com
Query: Sicherheitsdatenblatt 05/06/2025 filetype:pdf
NEW DE Not Set No Never 0 Yes
https://online-moebel-kaufen.de
NEW DE Not Set No Never 0 Yes
https://reifen.com
Query: Sicherheitsdatenblatt 08/10/25 filetype:pdf
NEW DE Not Set No Never 0 Yes
https://lu.ch
NEW CH Not Set No Never 0 Yes
https://f3x.de
NEW DE Not Set No Never 0 No
https://swissinno.com
NEW Global Not Set No Never 0 No
https://lebilboquetny.com
Query: "Sicherheitsdatenblatt" "04/03/24"
NEW US Not Set No Never 0 Yes
https://zvshk.de
Query: Sicherheitsdatenblatt 05/12/25 filetype:pdf
NEW DE Not Set No Never 0 Yes
https://hagerwerken.de
Query: Sicherheitsdatenblatt 26/02/25 filetype:pdf
NEW DE Not Set No Never 0 Yes
Showing 21881 to 21900 of 23006 websites
Show: