Seed URLs List
Domain Processor Control
Stopped
Background Processor:
Inactive
Check Interval:
30
seconds
Domain Processor: This service automatically
monitors the TempSeedUrl table for new domains. When a new domain
is detected, it validates the website, checks if it's active, uses
the region from TempSeedUrl, analyzes JavaScript usage, and
inserts valid domains into the GenericWebsite table.
Pending domains: 3937
Auto-restart enabled - processor will automatically start when new domains are added.
Pending domains: 3937
Auto-restart enabled - processor will automatically start when new domains are added.
Total Websites
22499
Crawled
2055
JS Heavy
11842
Total PDFs
52493849
Generic Website Data
Status:
Region:
Date Range:
| Domain URL | Status | Region | Spider Name | Crawled | Last Crawl Ended | Total PDFs Found | JS Heavy | Actions |
|---|---|---|---|---|---|---|---|---|
|
https://buyat.ppg.com/ehsdocumentmanagerpublic/documentSearchInnerFrame.aspx?Language=fi-FI
Query: safety data sheet pdf
|
DONE | FI | buyat_ppg_failed_requests | Yes |
2026-02-19
10:19:35
|
4475
|
No | |
|
https://sydneymarinesupplies.com.au
Query: "safety data sheet" "03/04/2024"
|
PROCESSING | AU | threaded_playwright_spider | Yes |
2026-02-19
08:17:16
|
890
|
Yes | |
|
https://www.sydneypaintwarehouse.com.au/
|
PROCESSING | AU | threaded_playwright_spider | Yes |
2026-02-19
07:11:12
|
16
|
No | |
|
https://federalpremium.com
Query: "safety data sheet" "07/01/2024"
|
DONE | GB | threaded_playwright_spider | Yes |
2026-02-18
18:47:55
|
86
|
No | |
|
https://en-no.ecolab.com/sds-search?countryCode=Mexico
Query: safety data sheet pdf
|
DONE | ES | ecolab | Yes |
2026-02-18
18:12:17
|
366
|
No | |
|
https://netsuite.com
Query: "safety data sheet" "01/05/2024"
|
DONE | US | threaded_playwright_spider | Yes |
2026-02-18
14:19:46
|
0 | Yes | |
|
https://f-ball.com
|
DONE | GB | threaded_playwright_spider | Yes |
2026-02-18
14:18:59
|
1880
|
No | |
|
https://31inc.com
Query: "safety data sheet" "07/01/2024"
|
DONE | Global | threaded_playwright_spider | Yes |
2026-02-18
12:13:20
|
24
|
Yes | |
|
https://perfumersupplyhouse.com
|
DONE | Global | threaded_playwright_spider | Yes |
2026-02-18
09:18:42
|
998
|
Yes | |
|
https://buyat.ppg.com/ehsdocumentmanagerpublic/documentSearchInnerFrame.aspx?Language=nb-NO
Query: safety data sheet pdf
|
DONE | NO | buyat_ppg_failed_requests | Yes |
2026-02-18
09:11:12
|
3180
|
No | |
|
https://meristemag.com
|
DONE | Global | threaded_playwright_spider | Yes |
2026-02-18
07:02:09
|
199
|
No | |
|
https://htspoly.com
|
DONE | US | threaded_playwright_spider | Yes |
2026-02-18
06:26:01
|
135
|
Yes | |
|
https://ussalt.com
|
DONE | US | threaded_playwright_spider | Yes |
2026-02-18
06:06:41
|
42
|
No | |
|
https://www.chempoint.com
|
DONE | Global | threaded_playwright_spider | Yes |
2026-02-16
07:18:57
|
115
|
No | |
|
https://biozym.com
Query: safety data sheet 08/01/24 filetype:pdf
|
DONE | DE | threaded_playwright_spider | Yes |
2026-02-16
05:54:32
|
3046
|
Yes | |
|
https://grainger.com
|
DONE | US | threaded_playwright_spider | Yes |
2026-02-16
04:44:08
|
0 | No | |
|
https://downtownchambersburgpa.com
|
DONE | US | threaded_playwright_spider | Yes |
2026-02-16
04:42:36
|
39
|
Yes | |
|
https://squarespace.com
|
DONE | US | threaded_playwright_spider | Yes |
2026-02-16
02:29:00
|
13
|
Yes | |
|
https://energyoneamerica.com
|
DONE | US | threaded_playwright_spider | Yes |
2026-02-16
01:45:36
|
3
|
No | |
|
https://nipponpaint.com.sg
Query: safety data sheet 06/01/2024 filetype:pdf
|
DONE | SG | threaded_playwright_spider | Yes |
2026-02-16
01:09:47
|
562
|
Yes |
Showing 41
to 60
of 22499 websites
Show: