Seed URLs List
Domain Processor Control
Running
Background Processor:
Active and monitoring for new domains
Check Interval:
30
seconds
Domain Processor: This service automatically
monitors the TempSeedUrl table for new domains. When a new domain
is detected, it validates the website, checks if it's active, uses
the region from TempSeedUrl, analyzes JavaScript usage, and
inserts valid domains into the GenericWebsite table.
Pending domains: 3238
Auto-restart enabled - processor will automatically start when new domains are added.
Pending domains: 3238
Auto-restart enabled - processor will automatically start when new domains are added.
Total Websites
23062
Crawled
595
JS Heavy
12273
Total PDFs
26967058
Generic Website Data
Status:
Region:
Date Range:
| Domain URL | Status | Region | Spider Name | Crawled | Last Crawl Ended | Total PDFs Found | JS Heavy | Actions |
|---|---|---|---|---|---|---|---|---|
|
https://substation.com.my
|
NEW | MY | Not Set | No | Never | 0 | No | |
|
https://www.3m.com.pe/3M/es_PE/inicio/mapa-del-sitio/
|
NEW | ES | Not Set | No | Never | 0 | No | |
|
https://www.3m.com.es/3M/es_ES/empresa-es/site-map/
|
DONE | ES | 3m_spider | Yes |
2026-01-07
12:11:15
|
178
|
No | |
|
https://tessasdance.com
Query: "Sikkerhetsdatablad" "02/13/2024"
|
NEW | IS | Not Set | No | Never | 0 | No | |
|
https://crcind.com/crc/CRCdso.csp
|
DONE | FR | crcind | Yes |
2026-01-06
11:30:45
|
1993
|
No | |
|
https://www.3mdeutschland.de/3M/de_DE/unternehmen-de/site-map/
|
DONE | DE | 3m_spider | Yes |
2026-01-06
12:38:54
|
173
|
No | |
|
https://ametek-measurement.com
|
NEW | US | Not Set | No | Never | 0 | No | |
|
https://ametek.com
|
NEW | US | Not Set | No | Never | 0 | No | |
|
https://ameronglobal.com
|
NEW | US | Not Set | No | Never | 0 | No | |
|
https://drexelbrook.com
Query: Sikkerhetsdatablad 09/22/24 filetype:pdf
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://www.3maustria.at/3M/de_AT/unternehmen-alpine/site-map/
|
DONE | DE | 3m_spider | Yes |
2026-01-06
15:41:40
|
161
|
No | |
|
https://eweek.com
Query: "Sicherheitsdatenblatt" "03/05/2024"
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://gluespec.com
|
NEW | US | Not Set | No | Never | 0 | No | |
|
https://thermofisher.com
Query: safety data sheet pdf
|
NEW | NO | Not Set | No | Never | 0 | No | |
|
https://crcind.com/crc/CRCdso.csp
|
DONE | NL | crcind | Yes |
2026-01-07
06:23:40
|
1992
|
No | |
|
https://crcind.com/crc/CRCdso.csp
|
DONE | DA | crcind | Yes |
2026-01-07
08:10:05
|
1530
|
No | |
|
https://www.3mschweiz.ch/3M/de_CH/unternehmen-alpine/site-map/
|
DONE | DE | 3m_spider | Yes |
2026-01-07
08:33:17
|
160
|
No | |
|
https://milesweb.com
Query: "Sicherheitsdatenblatt" "06/20/24"
|
NEW | IN | Not Set | No | Never | 0 | Yes | |
|
https://www.3m.com.mx/3M/es_MX/inicio/mapa-del-sitio/
|
DONE | ES | 3m_spider | Yes |
2026-01-07
14:48:29
|
235
|
No | |
|
https://labbox.eu
|
NEW | EU | Not Set | No | Never | 0 | Yes |
Showing 23041
to 23060
of 23062 websites
Show: