Seed URLs List
Domain Processor Control
Running
Background Processor:
Active and monitoring for new domains
Check Interval:
30
seconds
Domain Processor: This service automatically
monitors the TempSeedUrl table for new domains. When a new domain
is detected, it validates the website, checks if it's active, uses
the region from TempSeedUrl, analyzes JavaScript usage, and
inserts valid domains into the GenericWebsite table.
Pending domains: 3277
Auto-restart enabled - processor will automatically start when new domains are added.
Pending domains: 3277
Auto-restart enabled - processor will automatically start when new domains are added.
Total Websites
22999
Crawled
567
JS Heavy
12253
Total PDFs
24258968
Generic Website Data
Status:
Region:
Date Range:
| Domain URL | Status | Region | Spider Name | Crawled | Last Crawl Ended | Total PDFs Found | JS Heavy | Actions |
|---|---|---|---|---|---|---|---|---|
|
https://ameropa.ro
Query: safety data sheet 23/04/24 filetype:pdf
|
NEW | RO | Not Set | No | Never | 0 | Yes | |
|
https://bio-zyme.co.nz
|
NEW | NZ | Not Set | No | Never | 0 | No | |
|
https://www.carlroth.com/
Query: safety data sheet pdf
|
PROCESSING | US | Not Set | No | Never | 0 | No | |
|
https://medkart.in
Query: "Sikkerhetsdatablad" "01/27/24"
|
NEW | IN | Not Set | No | Never | 0 | No | |
|
https://probios.com
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://lmsvschools.org
|
NEW | US | Not Set | No | Never | 0 | No | |
|
https://it.rs-online.com/web/
Query: safety data sheet pdf
|
DONE | US | Not Set | Yes |
2025-10-04
20:39:03
|
99770
|
No | |
|
https://sunocolubes.com/
Query: safety data sheet pdf
|
DONE | US | Not Set | Yes |
2025-09-30
15:43:41
|
264
|
No | |
|
https://www.krylon.com/
Query: safety data sheet pdf
|
DONE | US | Not Set | Yes |
2025-09-30
22:30:54
|
3157
|
No | |
|
https://unl.edu
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://www.rustoleum.com/
Query: safety data sheet pdf
|
DONE | US | Not Set | Yes |
2025-09-30
23:58:28
|
9637
|
No | |
|
https://www.paintsupply.com/
Query: safety data sheet pdf
|
DONE | US | Not Set | Yes |
2025-10-03
00:30:15
|
161124
|
No | |
|
https://hascooil.com/
Query: safety data sheet pdf
|
DONE | US | Not Set | Yes |
2025-09-30
21:56:33
|
19429
|
No | |
|
https://avepetroleum.com
Query: safety data sheet pdf
|
DONE | US | generic_crawler_one_domain | Yes |
2025-11-11
11:14:36
|
22485
|
No | |
|
https://powercapacitors.info
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://municodemeetings.com
Query: safety data sheet 19/03/24 filetype:pdf
|
NEW | GB | Not Set | No | Never | 0 | No | |
|
https://northlinkaviation.com
Query: safety data sheet 21/04/24 filetype:pdf
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://hpc-j.co.jp
|
NEW | JP | Not Set | No | Never | 0 | Yes | |
|
https://hekserij.nl
Query: safety data sheet 10/15/2024 filetype:pdf
|
NEW | NL | Not Set | No | Never | 0 | No | |
|
https://solexin.net
Query: safety data sheet 23/04/2024 filetype:pdf
|
NEW | NZ | Not Set | No | Never | 0 | No |
Showing 201
to 220
of 22999 websites
Show: