Seed URLs List
Domain Processor Control
Running
Background Processor:
Active and monitoring for new domains
Check Interval:
30
seconds
Domain Processor: This service automatically
monitors the TempSeedUrl table for new domains. When a new domain
is detected, it validates the website, checks if it's active, uses
the region from TempSeedUrl, analyzes JavaScript usage, and
inserts valid domains into the GenericWebsite table.
Pending domains: 3277
Auto-restart enabled - processor will automatically start when new domains are added.
Pending domains: 3277
Auto-restart enabled - processor will automatically start when new domains are added.
Total Websites
22999
Crawled
567
JS Heavy
12253
Total PDFs
24258968
Generic Website Data
Status:
Region:
Date Range:
| Domain URL | Status | Region | Spider Name | Crawled | Last Crawl Ended | Total PDFs Found | JS Heavy | Actions |
|---|---|---|---|---|---|---|---|---|
|
https://betaboard.com.au
Query: "safety data sheet" "11/26/24"
|
NEW | AU | Not Set | No | Never | 0 | No | |
|
https://betterhealth.vic.gov.au
Query: "safety data sheet" "11/26/24"
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://nysolarmap.com
Query: "safety data sheet" "03/20/2024"
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://scanox.no/datablader/
Query: safety data sheet pdf
|
DONE | US | Not Set | Yes |
2025-09-30
12:06:55
|
22
|
No | |
|
https://technologyreview.com
Query: "safety data sheet" "08/10/2024"
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://mvlwb.ca
|
NEW | CA | Not Set | No | Never | 0 | No | |
|
https://freshskin.co.uk
|
NEW | UK | Not Set | No | Never | 0 | Yes | |
|
https://kansai.co.jp
|
NEW | JP | Not Set | No | Never | 0 | No | |
|
https://marylandzoo.org
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://cbp.gov
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://meridianzero.co.uk
|
NEW | UK | Not Set | No | Never | 0 | Yes | |
|
https://indigrow.com
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://proquipnz.co.nz
|
NEW | NZ | Not Set | No | Never | 0 | No | |
|
https://myprotein.com
Query: "safety data sheet" "19/01/2024"
|
NEW | GB | Not Set | No | Never | 0 | Yes | |
|
https://theloadstar.com
Query: "safety data sheet" "09/10/2024"
|
NEW | US | Not Set | No | Never | 0 | No | |
|
https://rottentomatoes.com
Query: "safety data sheet" "13/10/24"
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://lyricstraining.com
Query: "safety data sheet" "10/16/2024"
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://boschrexroth.com
Query: "safety data sheet" "10/22/24"
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://coventry.gov.uk
Query: safety data sheet 01/06/24 filetype:pdf
|
NEW | UK | Not Set | No | Never | 0 | No | |
|
https://imper.it
Query: safety data sheet 01/07/2024 filetype:pdf
|
NEW | IT | Not Set | No | Never | 0 | Yes |
Showing 321
to 340
of 22999 websites
Show: