Seed URLs List
Domain Processor Control
Running
Background Processor:
Active and monitoring for new domains
Check Interval:
30
seconds
Domain Processor: This service automatically
monitors the TempSeedUrl table for new domains. When a new domain
is detected, it validates the website, checks if it's active, uses
the region from TempSeedUrl, analyzes JavaScript usage, and
inserts valid domains into the GenericWebsite table.
Pending domains: 3228
Auto-restart enabled - processor will automatically start when new domains are added.
Pending domains: 3228
Auto-restart enabled - processor will automatically start when new domains are added.
Total Websites
23077
Crawled
634
JS Heavy
12276
Total PDFs
39995449
Generic Website Data
Status:
Region:
Date Range:
| Domain URL | Status | Region | Spider Name | Crawled | Last Crawl Ended | Total PDFs Found | JS Heavy | Actions |
|---|---|---|---|---|---|---|---|---|
|
https://unilever-sdb.de
|
NEW | DE | Not Set | No | Never | 0 | No | |
|
https://pooltotal.com
|
NEW | DE | Not Set | No | Never | 0 | Yes | |
|
https://beeck.com
|
NEW | DE | Not Set | No | Never | 0 | Yes | |
|
https://qualitrauen.de
|
NEW | DE | Not Set | No | Never | 0 | Yes | |
|
https://brookings.edu
Query: "Sicherheitsdatenblatt" "25/07/2024"
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://liputan6.com
Query: "Sicherheitsdatenblatt" "30/07/2024"
|
NEW | GB | Not Set | No | Never | 0 | Yes | |
|
https://flightera.net
Query: "Sicherheitsdatenblatt" "31/07/24"
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://thewaltdisneycompany.com
Query: "Sicherheitsdatenblatt" "12/08/24"
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://abdichtung-direkt.de
Query: "Sicherheitsdatenblatt" "12/08/2024"
|
NEW | DE | Not Set | No | Never | 0 | Yes | |
|
https://maxit.de
Query: "Sicherheitsdatenblatt" "08/19/2024"
|
NEW | DE | Not Set | No | Never | 0 | Yes | |
|
https://newton.com.tw
Query: "Sicherheitsdatenblatt" "08/22/2024"
|
NEW | TW | Not Set | No | Never | 0 | No | |
|
https://dayspedia.com
Query: "Sicherheitsdatenblatt" "25/07/2024"
|
NEW | PL | Not Set | No | Never | 0 | Yes | |
|
https://ijfans.org
Query: "Sicherheitsdatenblatt" "29/07/24"
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://biographyonline.net
Query: "Sicherheitsdatenblatt" "12/08/24"
|
NEW | GB | Not Set | No | Never | 0 | No | |
|
https://skyscanner.com.br
Query: "Sicherheitsdatenblatt" "15/08/24"
|
NEW | BR | Not Set | No | Never | 0 | No | |
|
https://lyricsmode.com
Query: "Sicherheitsdatenblatt" "08/22/2024"
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://saskatchewan.ca
Query: "Sicherheitsdatenblatt" "08/31/2024"
|
NEW | CA | Not Set | No | Never | 0 | No | |
|
https://gestaogma.com.br
Query: "Sicherheitsdatenblatt" "24/07/24"
|
NEW | BR | Not Set | No | Never | 0 | No | |
|
https://cathaypacific.com
Query: "Sicherheitsdatenblatt" "31/07/24"
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://minecraft.menu
Query: "Sicherheitsdatenblatt" "09/08/2024"
|
NEW | US | Not Set | No | Never | 0 | Yes |
Showing 19361
to 19380
of 23077 websites
Show: