Seed URLs List
Domain Processor Control
Running
Background Processor:
Active and monitoring for new domains
Check Interval:
30
seconds
Domain Processor: This service automatically
monitors the TempSeedUrl table for new domains. When a new domain
is detected, it validates the website, checks if it's active, uses
the region from TempSeedUrl, analyzes JavaScript usage, and
inserts valid domains into the GenericWebsite table.
Pending domains: 3224
Auto-restart enabled - processor will automatically start when new domains are added.
Pending domains: 3224
Auto-restart enabled - processor will automatically start when new domains are added.
Total Websites
23088
Crawled
643
JS Heavy
12279
Total PDFs
49044913
Generic Website Data
Status:
Region:
Date Range:
| Domain URL | Status | Region | Spider Name | Crawled | Last Crawl Ended | Total PDFs Found | JS Heavy | Actions |
|---|---|---|---|---|---|---|---|---|
|
https://swiftsalary.com
Query: "Sikkerhetsdatablad" "18/04/2024"
|
NEW | CA | Not Set | No | Never | 0 | No | |
|
https://polimetro.com
Query: "Sikkerhetsdatablad" "08/08/2024"
|
NEW | US | Not Set | No | Never | 0 | No | |
|
https://aso2osb.org.tr
|
NEW | TR | Not Set | No | Never | 0 | No | |
|
https://planetcalc.com
Query: "Sicherheitsdatenblatt" "31/05/2024"
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://boombapnation.com
Query: "Sicherheitsdatenblatt" "05/29/2024"
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://meetb.de
Query: "Sicherheitsdatenblatt" "06/06/24"
|
NEW | DE | Not Set | No | Never | 0 | Yes | |
|
https://supersummary.com
Query: "Sicherheitsdatenblatt" "06/10/24"
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://calculadoraonline.com.br
Query: "Sicherheitsdatenblatt" "06/19/24"
|
NEW | BR | Not Set | No | Never | 0 | No | |
|
https://oddsshark.com
Query: "Sicherheitsdatenblatt" "06/28/2024"
|
NEW | GB | Not Set | No | Never | 0 | No | |
|
https://playncs.com
Query: "Sicherheitsdatenblatt" "06/08/2024"
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://jpmorgan.com
Query: "Sicherheitsdatenblatt" "23/06/24"
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://familyweal.com
Query: "Sicherheitsdatenblatt" "10/07/2024"
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://supplements.best
Query: "Sicherheitsdatenblatt" "07/07/24"
|
NEW | US | Not Set | No | Never | 0 | No | |
|
https://gameslearningsociety.org
Query: "Sicherheitsdatenblatt" "14/06/24"
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://google.com.gt
Query: "Sicherheitsdatenblatt" "07/08/24"
|
NEW | GT | Not Set | No | Never | 0 | Yes | |
|
https://biopharminternational.com
Query: "Sicherheitsdatenblatt" "07/18/2024"
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://oneroof.co.nz
Query: "Sicherheitsdatenblatt" "06/14/24"
|
NEW | NZ | Not Set | No | Never | 0 | Yes | |
|
https://arbeitsagentur.de
Query: "Sicherheitsdatenblatt" "25/06/2024"
|
NEW | DE | Not Set | No | Never | 0 | Yes | |
|
https://uptodate.com
Query: "Sicherheitsdatenblatt" "26/06/24"
|
NEW | US | Not Set | No | Never | 0 | No | |
|
https://en-en-pawbiotix.us
Query: "Sicherheitsdatenblatt" "07/07/24"
|
NEW | US | Not Set | No | Never | 0 | No |
Showing 18801
to 18820
of 23088 websites
Show: