Seed URLs List
Domain Processor Control
Running
Background Processor:
Active and monitoring for new domains
Check Interval:
30
seconds
Domain Processor: This service automatically
monitors the TempSeedUrl table for new domains. When a new domain
is detected, it validates the website, checks if it's active, uses
the region from TempSeedUrl, analyzes JavaScript usage, and
inserts valid domains into the GenericWebsite table.
Pending domains: 3277
Auto-restart enabled - processor will automatically start when new domains are added.
Pending domains: 3277
Auto-restart enabled - processor will automatically start when new domains are added.
Total Websites
22999
Crawled
562
JS Heavy
12253
Total PDFs
24010331
Generic Website Data
Status:
Region:
Date Range:
| Domain URL | Status | Region | Spider Name | Crawled | Last Crawl Ended | Total PDFs Found | JS Heavy | Actions |
|---|---|---|---|---|---|---|---|---|
|
https://samcleanswater.org
Query: "safety data sheet" "08/11/2025"
|
NEW | US | Not Set | No | Never | 0 | No | |
|
https://theweeklyad.com
Query: "safety data sheet" "08/23/25"
|
NEW | US | Not Set | No | Never | 0 | No | |
|
https://zeolite.com.au
Query: Sikkerhetsdatablad 04/21/2024 filetype:pdf
|
NEW | AU | Not Set | No | Never | 0 | Yes | |
|
https://anskaffelser.no
Query: Sikkerhetsdatablad 22/04/24 filetype:pdf
|
NEW | NO | Not Set | No | Never | 0 | Yes | |
|
https://lefebvre-dalloz.fr
Query: "Sikkerhetsdatablad" "01/20/2024"
|
NEW | FR | Not Set | No | Never | 0 | Yes | |
|
chemblink.com
|
DONE | Global | generic_crawler_one_domain | Yes |
2025-11-11
07:06:53
|
0 | No | |
|
https://saleswl.com
Query: Sikkerhetsdatablad 03/18/2024 filetype:pdf
|
NEW | GB | Not Set | No | Never | 0 | No | |
|
https://tradingfinder.com
Query: "Sikkerhetsdatablad" "23/01/24"
|
NEW | IS | Not Set | No | Never | 0 | Yes | |
|
https://cfindustries.com
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://onlinestreet.de
Query: "Sikkerhetsdatablad" "01/29/2024"
|
NEW | DE | Not Set | No | Never | 0 | Yes | |
|
https://mrsteam.com
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://polaras.dk
|
NEW | DK | Not Set | No | Never | 0 | No | |
|
https://yageogroup.com
Query: Sikkerhetsdatablad 04/04/24 filetype:pdf
|
NEW | TW | Not Set | No | Never | 0 | Yes | |
|
https://hiltra.com
|
NEW | NL | Not Set | No | Never | 0 | No | |
|
https://mohs.gov.sl
|
NEW | SL | Not Set | No | Never | 0 | Yes | |
|
https://gosh.nhs.uk
|
NEW | UK | Not Set | No | Never | 0 | Yes | |
|
https://umea.se
|
NEW | SE | Not Set | No | Never | 0 | No | |
|
https://classicrockhistory.com
Query: "Sikkerhetsdatablad" "02/04/24"
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://sanyodenki.com
|
NEW | JP | Not Set | No | Never | 0 | No | |
|
https://kcfl.co.in
|
NEW | IN | Not Set | No | Never | 0 | No |
Showing 41
to 60
of 22999 websites
Show: