Seed URLs List
Domain Processor Control
Running
Background Processor:
Active and monitoring for new domains
Check Interval:
30
seconds
Domain Processor: This service automatically
monitors the TempSeedUrl table for new domains. When a new domain
is detected, it validates the website, checks if it's active, uses
the region from TempSeedUrl, analyzes JavaScript usage, and
inserts valid domains into the GenericWebsite table.
Pending domains: 3277
Auto-restart enabled - processor will automatically start when new domains are added.
Pending domains: 3277
Auto-restart enabled - processor will automatically start when new domains are added.
Total Websites
22999
Crawled
567
JS Heavy
12253
Total PDFs
24258968
Generic Website Data
Status:
Region:
Date Range:
| Domain URL | Status | Region | Spider Name | Crawled | Last Crawl Ended | Total PDFs Found | JS Heavy | Actions |
|---|---|---|---|---|---|---|---|---|
|
https://xorgasmo.com
Query: "Sikkerhetsdatablad" "15/04/2024"
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://hentaistube.com
Query: "Sikkerhetsdatablad" "08/09/25"
|
NEW | IS | Not Set | No | Never | 0 | No | |
|
https://qualichem.ca
|
DONE | Global | threaded_playwright_spider | Yes |
2025-12-17
08:28:23
|
185
|
No | |
|
https://orgasmatrix.com
Query: "Sikkerhetsdatablad" "08/16/2025"
|
NEW | ES | Not Set | No | Never | 0 | No | |
|
https://serviporno.com
Query: "Sikkerhetsdatablad" "08/16/2025"
|
NEW | LU | Not Set | No | Never | 0 | Yes | |
|
https://javplease.com
Query: "Sikkerhetsdatablad" "30/09/25"
|
NEW | US | Not Set | No | Never | 0 | No | |
|
https://goodrx.com
Query: "Sikkerhetsdatablad" "16/04/24"
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://gooogle.ca
Query: "Sikkerhetsdatablad" "11/16/2025"
|
NEW | CA | Not Set | No | Never | 0 | No | |
|
https://skyward.com
Query: "Sikkerhetsdatablad" "27/06/2024"
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://camhub.cc
Query: "Sikkerhetsdatablad" "21/01/24"
|
NEW | CC | Not Set | No | Never | 0 | Yes | |
|
https://webshop.struers.com/en/library
Query: safety data sheet pdf
|
DONE | Global | webshop_struers | Yes |
2025-12-17
10:31:28
|
5532
|
No | |
|
https://haymespaint.com.au
|
NEW | AU | Not Set | No | Never | 0 | Yes | |
|
https://next.henkel-adhesives.com/es/en/search.html?filterType=TDS%2FSDS
|
DONE | ES | pagination_product_crawler_v2 | Yes |
2025-12-17
14:54:03
|
4784
|
No | |
|
https://mobile-xvideos.com
Query: "Sikkerhetsdatablad" "03/19/2024"
|
NEW | IS | Not Set | No | Never | 0 | Yes | |
|
https://xvideos.tube
Query: "Sikkerhetsdatablad" "03/19/2024"
|
NEW | IS | Not Set | No | Never | 0 | Yes | |
|
https://xnxx.health
Query: "Sikkerhetsdatablad" "21/03/24"
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://xnxx.com
Query: "Sikkerhetsdatablad" "21/03/24"
|
NEW | CZ | Not Set | No | Never | 0 | No | |
|
https://anysex.com
Query: "Sikkerhetsdatablad" "21/03/24"
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://xnxx.place
Query: "Sikkerhetsdatablad" "21/03/24"
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://porzo.com
Query: "Sikkerhetsdatablad" "15/04/2024"
|
NEW | US | Not Set | No | Never | 0 | Yes |
Showing 22721
to 22740
of 22999 websites
Show: