Seed URLs List
Domain Processor Control
Running
Background Processor:
Active and monitoring for new domains
Check Interval:
30
seconds
Domain Processor: This service automatically
monitors the TempSeedUrl table for new domains. When a new domain
is detected, it validates the website, checks if it's active, uses
the region from TempSeedUrl, analyzes JavaScript usage, and
inserts valid domains into the GenericWebsite table.
Pending domains: 3228
Auto-restart enabled - processor will automatically start when new domains are added.
Pending domains: 3228
Auto-restart enabled - processor will automatically start when new domains are added.
Total Websites
23079
Crawled
637
JS Heavy
12276
Total PDFs
39996724
Generic Website Data
Status:
Region:
Date Range:
| Domain URL | Status | Region | Spider Name | Crawled | Last Crawl Ended | Total PDFs Found | JS Heavy | Actions |
|---|---|---|---|---|---|---|---|---|
|
https://sds.spralac.com/en/show_localization_products/ES-es
|
DONE | ES | generic_api_get | Yes |
2025-12-10
09:45:10
|
58
|
No | |
|
https://renergen.co.za
Query: safety data sheet 15/09/2024 filetype:pdf
|
NEW | ZA | Not Set | No | Never | 0 | No | |
|
http://bolift.no
Query: Sikkerhetsdatablad 23/05/25 filetype:pdf
|
NEW | NO | Not Set | No | Never | 0 | No | |
|
https://my.basf.com/en-US/product-documents
|
DONE | ES | generic_api_get | Yes |
2025-12-10
12:23:10
|
22099
|
No | |
|
https://courthousenews.com
Query: "Sikkerhetsdatablad" "10/30/25"
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://computercity.com
Query: "Sikkerhetsdatablad" "02/26/2024"
|
NEW | US | Not Set | No | Never | 0 | No | |
|
https://sdsviewer.fmc.com
Query: safety data sheet pdf
|
DONE | Global | generic_api_post | Yes |
2025-12-10
11:56:34
|
5957
|
No | |
|
https://www.msd.com/research/safety-data-sheets/
|
DONE | Global | pdf_list_crawler | Yes |
2025-12-10
13:28:19
|
14526
|
No | |
|
https://en-no.ecolab.com/sds-search
Query: safety data sheet pdf
|
DONE | NO | ecolab | Yes |
2025-12-10
07:23:19
|
2950
|
No | |
|
https://www.chiron.no/en/documentation/msds/
|
DONE | DE | generic_api_get | Yes |
2025-12-11
06:54:15
|
10
|
No | |
|
https://godaddy.com
Query: "Sikkerhetsdatablad" "21/07/2025"
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://zh.ch
|
NEW | CH | Not Set | No | Never | 0 | Yes | |
|
https://kaeltemittel-direkt.ch
Query: "Sicherheitsdatenblatt" "01/01/2024"
|
NEW | CH | Not Set | No | Never | 0 | Yes | |
|
https://endeksa.com
Query: "Sicherheitsdatenblatt" "05/01/24"
|
NEW | US | Not Set | No | Never | 0 | No | |
|
https://sds.valsparindustrialmix.com/en/show_localization_products/DE-de
|
DONE | DE | valsparindustrialmix | Yes |
2025-12-11
11:34:59
|
1179
|
No | |
|
https://vonguttenberg.de
|
NEW | DE | Not Set | No | Never | 0 | Yes | |
|
https://sds.valsparindustrialmix.com/en/show_localization_products/ES-es
|
DONE | ES | valsparindustrialmix | Yes |
2025-12-11
11:49:38
|
1179
|
No | |
|
https://nilfiskfood.com
Query: Sicherheitsdatenblatt 01/09/2024 filetype:pdf
|
NEW | DK | Not Set | No | Never | 0 | Yes | |
|
https://sds.sherwin-automotive.com/en/show_localization_products/DE-de
|
DONE | DE | generic_api_get | Yes |
2025-12-11
12:45:01
|
235
|
No | |
|
https://innotec.at
Query: Sicherheitsdatenblatt 01/12/2024 filetype:pdf
|
NEW | AT | Not Set | No | Never | 0 | Yes |
Showing 19021
to 19040
of 23079 websites
Show: