Seed URLs List
Domain Processor Control
Running
Background Processor:
Active and monitoring for new domains
Check Interval:
30
seconds
Domain Processor: This service automatically
monitors the TempSeedUrl table for new domains. When a new domain
is detected, it validates the website, checks if it's active, uses
the region from TempSeedUrl, analyzes JavaScript usage, and
inserts valid domains into the GenericWebsite table.
Pending domains: 3277
Auto-restart enabled - processor will automatically start when new domains are added.
Pending domains: 3277
Auto-restart enabled - processor will automatically start when new domains are added.
Total Websites
22999
Crawled
563
JS Heavy
12253
Total PDFs
24175048
Generic Website Data
Status:
Region:
Date Range:
| Domain URL | Status | Region | Spider Name | Crawled | Last Crawl Ended | Total PDFs Found | JS Heavy | Actions |
|---|---|---|---|---|---|---|---|---|
|
https://sdstotalms.total.com
|
DONE | Global | generic_crawler_one_domain | Yes |
2025-12-17
21:10:29
|
0 | No | |
|
https://globalmediajournal.com
Query: "Sicherheitsdatenblatt" "29/07/24"
|
NEW | US | Not Set | No | Never | 0 | No | |
|
https://www.chemical-concepts.com
|
DONE | Global | generic_crawler_one_domain | Yes |
2025-12-18
00:47:00
|
0 | No | |
|
https://pornhub.com
Query: "Sikkerhetsdatablad" "13/03/24"
|
NEW | LU | Not Set | No | Never | 0 | No | |
|
https://mirusbio.com
Query: Sicherheitsdatenblatt 02/05/24 filetype:pdf
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://questar-ny.safeschoolssds.com
|
DONE | Global | generic_crawler_one_domain | Yes |
2025-12-18
09:06:14
|
6905
|
No | |
|
https://cattco.gov
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://expedia.ie
Query: "Sikkerhetsdatablad" "08/22/2024"
|
NEW | IE | Not Set | No | Never | 0 | No | |
|
https://magazineluiza.com.br
Query: "Sikkerhetsdatablad" "10/20/2024"
|
NEW | BR | Not Set | No | Never | 0 | Yes | |
|
https://eurotrol.it
|
NEW | IT | Not Set | No | Never | 0 | Yes | |
|
https://concertarchives.org
Query: "Sikkerhetsdatablad" "01/27/25"
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://www.productionsupplystore.com
|
DONE | Global | generic_crawler_one_domain | Yes |
2025-12-18
23:16:40
|
157923
|
No | |
|
https://tudosobrecidades.com
Query: "Sicherheitsdatenblatt" "23/03/25"
|
NEW | BR | Not Set | No | Never | 0 | No | |
|
https://vicash.com.au
|
DONE | Global | generic_crawler_one_domain | Yes |
2025-12-18
23:41:15
|
1685
|
No | |
|
https://study.com
Query: "Sikkerhetsdatablad" "30/03/2024"
|
NEW | US | Not Set | No | Never | 0 | No | |
|
https://msds.deco.akzonobel.com/
|
DONE | DE | akzonobel_spider | Yes |
2025-12-19
14:52:03
|
21419
|
No | |
|
https://webemu.top
Query: "Sikkerhetsdatablad" "12/08/2024"
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://flightsfrom.com
Query: "Sikkerhetsdatablad" "04/16/24"
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://msds.deco.akzonobel.com/
|
DONE | ES | akzonobel_spider | Yes |
2025-12-19
14:02:43
|
12283
|
No | |
|
https://instron.com
Query: "safety data sheet" "03/12/2025"
|
NEW | US | Not Set | No | Never | 0 | No |
Showing 22921
to 22940
of 22999 websites
Show: