Seed URLs List
Domain Processor Control
Running
Background Processor:
Active and monitoring for new domains
Check Interval:
30
seconds
Domain Processor: This service automatically
monitors the TempSeedUrl table for new domains. When a new domain
is detected, it validates the website, checks if it's active, uses
the region from TempSeedUrl, analyzes JavaScript usage, and
inserts valid domains into the GenericWebsite table.
Pending domains: 3257
Auto-restart enabled - processor will automatically start when new domains are added.
Pending domains: 3257
Auto-restart enabled - processor will automatically start when new domains are added.
Total Websites
23024
Crawled
575
JS Heavy
12266
Total PDFs
24817372
Generic Website Data
Status:
Region:
Date Range:
| Domain URL | Status | Region | Spider Name | Crawled | Last Crawl Ended | Total PDFs Found | JS Heavy | Actions |
|---|---|---|---|---|---|---|---|---|
|
https://www.epc.shell.com/home/HomeSetup?inLang=EN
|
DONE | ES | epc_shell_pure_pw_spider | Yes |
2026-01-02
10:46:31
|
1495
|
No | |
|
https://www.epc.shell.com/home/HomeSetup?inLang=EN
|
DONE | DE | epc_shell_pure_pw_spider | Yes |
2026-01-02
09:10:15
|
4937
|
No | |
|
https://webshop.kyvik.no
|
PROCESSING | Global | Not Set | No | Never | 0 | No | |
|
https://octopart.com
Query: safety data sheet 02/10/24 filetype:pdf
|
NEW | IS | Not Set | No | Never | 0 | Yes |
Showing 23021
to 23024
of 23024 websites
Show: