Seed URLs List
Domain Processor Control
Running
Background Processor:
Active and monitoring for new domains
Check Interval:
30
seconds
Domain Processor: This service automatically
monitors the TempSeedUrl table for new domains. When a new domain
is detected, it validates the website, checks if it's active, uses
the region from TempSeedUrl, analyzes JavaScript usage, and
inserts valid domains into the GenericWebsite table.
Pending domains: 3227
Auto-restart enabled - processor will automatically start when new domains are added.
Pending domains: 3227
Auto-restart enabled - processor will automatically start when new domains are added.
Total Websites
23080
Crawled
638
JS Heavy
12277
Total PDFs
40172834
Generic Website Data
Status:
Region:
Date Range:
| Domain URL | Status | Region | Spider Name | Crawled | Last Crawl Ended | Total PDFs Found | JS Heavy | Actions |
|---|---|---|---|---|---|---|---|---|
|
https://wspa.com
Query: "Sikkerhetsdatablad" "01/12/24"
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://thevetdesk.com
Query: "Sikkerhetsdatablad" "20/02/25"
|
NEW | IS | Not Set | No | Never | 0 | Yes | |
|
https://moneydj.com
Query: "Sikkerhetsdatablad" "29/04/24"
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://expedia.co.in
Query: "Sikkerhetsdatablad" "04/24/2025"
|
NEW | IN | Not Set | No | Never | 0 | No | |
|
http://brookslubricantes.com
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://brookslubricantes.com
|
NEW | ES | Not Set | No | Never | 0 | Yes | |
|
https://fnac.com
Query: "Sikkerhetsdatablad" "09/17/2025"
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://expedia.ca
Query: "Sikkerhetsdatablad" "04/24/2025"
|
NEW | CA | Not Set | No | Never | 0 | No | |
|
https://wallethub.com
Query: "Sikkerhetsdatablad" "25/01/25"
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://expedia.de
Query: "Sikkerhetsdatablad" "12/19/2024"
|
NEW | DE | Not Set | No | Never | 0 | No | |
|
https://calgaz.com/cambridge/
|
DONE | US | pdf_list_crawler | Yes |
2025-11-28
10:44:48
|
177
|
No | |
|
https://visiofactory.de
Query: "Sicherheitsdatenblatt" "07/06/24"
|
NEW | DE | Not Set | No | Never | 0 | Yes | |
|
https://serverwatch.com
Query: "Sicherheitsdatenblatt" "06/20/24"
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
http://about.youtube
Query: "Sicherheitsdatenblatt" "06/27/24"
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://healthguide.ng
Query: "Sicherheitsdatenblatt" "07/09/24"
|
NEW | NG | Not Set | No | Never | 0 | No | |
|
https://pixect.com
Query: "Sicherheitsdatenblatt" "06/18/2024"
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://berliner-stellenmarkt.de
Query: "Sicherheitsdatenblatt" "25/06/2024"
|
NEW | DE | Not Set | No | Never | 0 | Yes | |
|
https://boardofwatersupply.com
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://ragnet.co.jp
Query: "Sikkerhetsdatablad" "28/07/25"
|
NEW | JP | Not Set | No | Never | 0 | No | |
|
https://molgroupchemicals.com
|
NEW | HU | Not Set | No | Never | 0 | No |
Showing 18961
to 18980
of 23080 websites
Show: