Seed URLs List
Domain Processor Control
Running
Background Processor:
Active and monitoring for new domains
Check Interval:
30
seconds
Domain Processor: This service automatically
monitors the TempSeedUrl table for new domains. When a new domain
is detected, it validates the website, checks if it's active, uses
the region from TempSeedUrl, analyzes JavaScript usage, and
inserts valid domains into the GenericWebsite table.
Pending domains: 3277
Auto-restart enabled - processor will automatically start when new domains are added.
Pending domains: 3277
Auto-restart enabled - processor will automatically start when new domains are added.
Total Websites
22999
Crawled
567
JS Heavy
12253
Total PDFs
24258968
Generic Website Data
Status:
Region:
Date Range:
| Domain URL | Status | Region | Spider Name | Crawled | Last Crawl Ended | Total PDFs Found | JS Heavy | Actions |
|---|---|---|---|---|---|---|---|---|
|
https://ojrsa.org
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://mdgreenview.ab.ca
|
NEW | CA | Not Set | No | Never | 0 | Yes | |
|
https://digikey.com
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://deyathassou.gr
|
NEW | GR | Not Set | No | Never | 0 | Yes | |
|
https://zamzam.edu.af
|
NEW | AF | Not Set | No | Never | 0 | No | |
|
https://columbuslibrary.org
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://hallmanlindsay.com
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://netflix.com
Query: "safety data sheet" "13/10/24"
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://europomice.it
Query: "safety data sheet" "18/10/2024"
|
NEW | IT | Not Set | No | Never | 0 | Yes | |
|
https://rapidaid.com
Query: safety data sheet 04/23/24 filetype:pdf
|
NEW | US | Not Set | No | Never | 0 | No | |
|
https://idealfuel.eu
|
NEW | EU | Not Set | No | Never | 0 | No | |
|
https://cityofunion.com
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://sancora.com
|
NEW | MY | Not Set | No | Never | 0 | No | |
|
https://absoluteconcreteproducts.com
|
NEW | US | Not Set | No | Never | 0 | No | |
|
https://iwmfhk.com
|
NEW | HK | Not Set | No | Never | 0 | No | |
|
https://cslbehring.com
Query: safety data sheet 23/04/2024 filetype:pdf
|
NEW | US | Not Set | No | Never | 0 | No | |
|
https://aclu-il.org
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://solara.co.in
|
NEW | IN | Not Set | No | Never | 0 | Yes | |
|
https://messefrankfurt.com
|
NEW | DE | Not Set | No | Never | 0 | Yes | |
|
https://glassonfertilisers.co.uk
Query: "safety data sheet" "02/06/24"
|
NEW | UK | Not Set | No | Never | 0 | No |
Showing 261
to 280
of 22999 websites
Show: