Seed URLs List
Domain Processor Control
Running
Background Processor:
Active and monitoring for new domains
Check Interval:
30
seconds
Domain Processor: This service automatically
monitors the TempSeedUrl table for new domains. When a new domain
is detected, it validates the website, checks if it's active, uses
the region from TempSeedUrl, analyzes JavaScript usage, and
inserts valid domains into the GenericWebsite table.
Pending domains: 3227
Auto-restart enabled - processor will automatically start when new domains are added.
Pending domains: 3227
Auto-restart enabled - processor will automatically start when new domains are added.
Total Websites
23080
Crawled
638
JS Heavy
12277
Total PDFs
40172834
Generic Website Data
Status:
Region:
Date Range:
| Domain URL | Status | Region | Spider Name | Crawled | Last Crawl Ended | Total PDFs Found | JS Heavy | Actions |
|---|---|---|---|---|---|---|---|---|
|
https://rjbatt.com.au
Query: safety data sheet 30/05/2024 filetype:pdf
|
NEW | AU | Not Set | No | Never | 0 | No | |
|
https://themost10.com
Query: "Sikkerhetsdatablad" "01/27/2024"
|
NEW | US | Not Set | No | Never | 0 | No | |
|
https://www.sysmex.no/services/document-centre/safety-data-sheets/
|
DONE | NO | pdf_list_crawler | Yes |
2025-12-02
10:46:01
|
170
|
No | |
|
http://hilton.com
Query: "Sikkerhetsdatablad" "01/01/2024"
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://hilton.com
Query: "Sikkerhetsdatablad" "01/01/2024"
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://www.abcam.com/en-us/products
|
DONE | UK | abcam_crawler_v2 | Yes |
2025-12-01
13:24:43
|
0 | No | |
|
https://calgaz.com/stoke/
|
DONE | US | pdf_list_crawler | Yes |
2025-11-28
10:20:50
|
642
|
No | |
|
https://www.greencastonline.com/labels/labelsearch.aspx
|
DONE | US | greencastonline_spider | Yes |
2025-11-27
11:35:34
|
0 | No | |
|
https://bus-tabi.net
Query: "Sicherheitsdatenblatt" "29/05/24"
|
NEW | JP | Not Set | No | Never | 0 | No | |
|
https://homes.com
Query: "Sikkerhetsdatablad" "11/11/2025"
|
NEW | US | Not Set | No | Never | 0 | No | |
|
https://fashioneyewear.com
Query: "Sicherheitsdatenblatt" "07/06/24"
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://gradesaver.com
Query: "Sicherheitsdatenblatt" "06/10/24"
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://www.gov.cn
Query: "Sikkerhetsdatablad" "20/08/2025"
|
NEW | CN | Not Set | No | Never | 0 | Yes | |
|
https://oracle.com
Query: "Sikkerhetsdatablad" "11/10/2024"
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://ray-ban.com
Query: "Sikkerhetsdatablad" "29/04/2025"
|
NEW | IT | Not Set | No | Never | 0 | Yes | |
|
https://mister-auto.pt
Query: "safety data sheet" "28/09/24"
|
NEW | PT | Not Set | No | Never | 0 | No | |
|
https://jamaicaobserver.com
Query: "Sikkerhetsdatablad" "08/25/25"
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://esports.gg
Query: "Sikkerhetsdatablad" "09/07/24"
|
NEW | GG | Not Set | No | Never | 0 | Yes | |
|
https://chemvulcindustrialaustralia.com.au
|
NEW | AU | Not Set | No | Never | 0 | Yes | |
|
https://wayfair.com
Query: "Sikkerhetsdatablad" "23/09/2024"
|
NEW | US | Not Set | No | Never | 0 | No |
Showing 18941
to 18960
of 23080 websites
Show: