Seed URLs List
Domain Processor Control
Running
Background Processor:
Active and monitoring for new domains
Check Interval:
30
seconds
Domain Processor: This service automatically
monitors the TempSeedUrl table for new domains. When a new domain
is detected, it validates the website, checks if it's active, uses
the region from TempSeedUrl, analyzes JavaScript usage, and
inserts valid domains into the GenericWebsite table.
Pending domains: 3257
Auto-restart enabled - processor will automatically start when new domains are added.
Pending domains: 3257
Auto-restart enabled - processor will automatically start when new domains are added.
Total Websites
23024
Crawled
575
JS Heavy
12266
Total PDFs
24817372
Generic Website Data
Status:
Region:
Date Range:
| Domain URL | Status | Region | Spider Name | Crawled | Last Crawl Ended | Total PDFs Found | JS Heavy | Actions |
|---|---|---|---|---|---|---|---|---|
|
https://carat-gruppe.de
|
NEW | DE | Not Set | No | Never | 0 | Yes | |
|
https://spguides.com
Query: "Sicherheitsdatenblatt" "20/01/24"
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://ama.at
Query: Sicherheitsdatenblatt 31/03/2024 filetype:pdf
|
NEW | AT | Not Set | No | Never | 0 | No | |
|
https://cemminerals.be
Query: Sicherheitsdatenblatt 09/04/2024 filetype:pdf
|
NEW | BE | Not Set | No | Never | 0 | Yes | |
|
https://augusta-pool.ch
Query: Sicherheitsdatenblatt 29/04/2024 filetype:pdf
|
NEW | CH | Not Set | No | Never | 0 | Yes | |
|
https://soudal.de
|
NEW | DE | Not Set | No | Never | 0 | Yes | |
|
https://vitabad.ch
Query: Sicherheitsdatenblatt 02/28/2024 filetype:pdf
|
NEW | CH | Not Set | No | Never | 0 | Yes | |
|
https://anwander.ch
Query: Sicherheitsdatenblatt 03/05/2024 filetype:pdf
|
NEW | CH | Not Set | No | Never | 0 | No | |
|
https://mea-group.com
|
NEW | DE | Not Set | No | Never | 0 | Yes | |
|
https://ruckgaber.de
Query: Sicherheitsdatenblatt 20/03/2024 filetype:pdf
|
NEW | DE | Not Set | No | Never | 0 | No | |
|
https://aga.de
|
NEW | DE | Not Set | No | Never | 0 | No | |
|
https://nextroom.at
|
NEW | AT | Not Set | No | Never | 0 | Yes | |
|
https://hamburgwasser.de
|
NEW | DE | Not Set | No | Never | 0 | Yes | |
|
https://gemeinde-schluchsee.de
|
NEW | DE | Not Set | No | Never | 0 | Yes | |
|
https://lazyadmin.nl
Query: "Sicherheitsdatenblatt" "20/01/24"
|
NEW | NL | Not Set | No | Never | 0 | No | |
|
https://bfi.tirol
|
NEW | AT | Not Set | No | Never | 0 | No | |
|
https://ghz-cham.de
Query: Sicherheitsdatenblatt 25/03/2024 filetype:pdf
|
NEW | DE | Not Set | No | Never | 0 | Yes | |
|
https://erides.de
|
NEW | DE | Not Set | No | Never | 0 | Yes | |
|
https://tu-dortmund.de
|
NEW | DE | Not Set | No | Never | 0 | Yes | |
|
https://mueller-chemikalien.de
|
NEW | DE | Not Set | No | Never | 0 | No |
Showing 20241
to 20260
of 23024 websites
Show: