Seed URLs List

Domain Processor Control

Running
Background Processor: Active and monitoring for new domains
Check Interval: 30 seconds
Domain Processor: This service automatically monitors the TempSeedUrl table for new domains. When a new domain is detected, it validates the website, checks if it's active, uses the region from TempSeedUrl, analyzes JavaScript usage, and inserts valid domains into the GenericWebsite table.
Pending domains: 3277
Auto-restart enabled - processor will automatically start when new domains are added.

Total Websites

22999

Crawled

562

JS Heavy

12253

Total PDFs

24010331

Generic Website Data

Domain URL Status Region Spider Name Crawled Last Crawl Ended Total PDFs Found JS Heavy Actions
https://plantonix.com
Query: "safety data sheet" "04/20/24"
NEW US Not Set No Never 0 Yes
https://chrostiki.com
Query: "safety data sheet" "11/23/24"
NEW Global Not Set No Never 0 Yes
https://stago.com
Query: "safety data sheet" "19/12/2024"
NEW Global Not Set No Never 0 Yes
https://osteoarthritisresearch.com.au
Query: "Sikkerhetsdatablad" "01/24/24"
NEW AU Not Set No Never 0 Yes
https://counteractbalancing.com
NEW Global Not Set No Never 0 No
https://thuneprodukterhelse.no
Query: Sikkerhetsdatablad 11/04/24 filetype:pdf
NEW NO Not Set No Never 0 No
https://verywellhealth.com
Query: "Sikkerhetsdatablad" "01/27/24"
NEW US Not Set No Never 0 Yes
https://colglo.co.uk
NEW UK Not Set No Never 0 Yes
https://dmacc-ia.safecollegessds.com
DONE Global Not Set Yes
2025-09-30
10:56:31
24889
No
https://gssa.org.za
DONE ZA Not Set Yes
2025-09-17
10:28:05
6
Yes
https://worksafe.wa.gov.au
Query: "safety data sheet" "07/22/2025"
NEW Global Not Set No Never 0 No
https://dethlac.co.uk
Query: "safety data sheet" "19/11/2024"
NEW UK Not Set No Never 0 No
plastidip.net.au
DONE AU Not Set Yes
2025-09-30
07:41:57
1191
No
https://battlebornbatteries.com
Query: "safety data sheet" "11/21/24"
NEW US Not Set No Never 0 Yes
https://akemi.de
Query: "safety data sheet" "11/26/2024"
NEW DE Not Set No Never 0 Yes
http://dgr.co.kr
Query: "safety data sheet" "11/30/2024"
NEW KR Not Set No Never 0 Yes
http://ryanfarley.com
Query: "safety data sheet" "11/13/2024"
NEW Global Not Set No Never 0 No
https://kjellmi.no
Query: Sikkerhetsdatablad 14/04/2024 filetype:pdf
NEW NO Not Set No Never 0 Yes
https://qiagen.com
Query: safety data sheet 04/30/2024 filetype:pdf
DONE DE Not Set Yes
2025-10-04
16:17:50
446711
Yes
https://flightpedia.org
Query: "safety data sheet" "16/05/2025"
NEW VN Not Set No Never 0 No
Showing 21 to 40 of 22999 websites
Show: