Seed URLs List
Domain Processor Control
Running
Background Processor:
Active and monitoring for new domains
Check Interval:
30
seconds
Domain Processor: This service automatically
monitors the TempSeedUrl table for new domains. When a new domain
is detected, it validates the website, checks if it's active, uses
the region from TempSeedUrl, analyzes JavaScript usage, and
inserts valid domains into the GenericWebsite table.
Pending domains: 3277
Auto-restart enabled - processor will automatically start when new domains are added.
Pending domains: 3277
Auto-restart enabled - processor will automatically start when new domains are added.
Total Websites
22999
Crawled
567
JS Heavy
12253
Total PDFs
24258968
Generic Website Data
Status:
Region:
Date Range:
| Domain URL | Status | Region | Spider Name | Crawled | Last Crawl Ended | Total PDFs Found | JS Heavy | Actions |
|---|---|---|---|---|---|---|---|---|
|
https://microlifefertilizer.com
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://thueringen.de
|
NEW | DE | Not Set | No | Never | 0 | No | |
|
https://pa.gov
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://true-fresh.com
|
NEW | US | Not Set | No | Never | 0 | No | |
|
https://flintstones.com.au
Query: safety data sheet 01/07/24 filetype:pdf
|
NEW | AU | Not Set | No | Never | 0 | Yes | |
|
https://qprusa.com
Query: safety data sheet 01/09/24 filetype:pdf
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://vanderbiltworldwide.com
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://sakarya.edu.tr
|
NEW | TR | Not Set | No | Never | 0 | Yes | |
|
https://houlihansaddlery.com
Query: "safety data sheet" "08/01/2024"
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://draco.com
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://tifco.com
|
NEW | PA | Not Set | No | Never | 0 | No | |
|
https://syngeneintl.com
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://artemisbiosolutions.com
|
NEW | US | Not Set | No | Never | 0 | No | |
|
https://columbus.co.za
Query: safety data sheet 15/04/2024 filetype:pdf
|
NEW | ZA | Not Set | No | Never | 0 | No | |
|
https://bfgsupply.com
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://davids-bio.com
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://portsanluis.com
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://ego.de
Query: safety data sheet 04/09/24 filetype:pdf
|
NEW | DE | Not Set | No | Never | 0 | No | |
|
https://stonhard.ie
|
NEW | IE | Not Set | No | Never | 0 | No | |
|
https://boronmolecular.com
|
NEW | AU | Not Set | No | Never | 0 | Yes |
Showing 341
to 360
of 22999 websites
Show: