Seed URLs List
Domain Processor Control
Running
Background Processor:
Active and monitoring for new domains
Check Interval:
30
seconds
Domain Processor: This service automatically
monitors the TempSeedUrl table for new domains. When a new domain
is detected, it validates the website, checks if it's active, uses
the region from TempSeedUrl, analyzes JavaScript usage, and
inserts valid domains into the GenericWebsite table.
Pending domains: 3277
Auto-restart enabled - processor will automatically start when new domains are added.
Pending domains: 3277
Auto-restart enabled - processor will automatically start when new domains are added.
Total Websites
22999
Crawled
563
JS Heavy
12253
Total PDFs
24175048
Generic Website Data
Status:
Region:
Date Range:
| Domain URL | Status | Region | Spider Name | Crawled | Last Crawl Ended | Total PDFs Found | JS Heavy | Actions |
|---|---|---|---|---|---|---|---|---|
|
https://maritim.as
|
NEW | AS | Not Set | No | Never | 0 | Yes | |
|
https://finance.gov.mv
|
NEW | MV | Not Set | No | Never | 0 | No | |
|
https://nwcollege.edu
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://paramountsafety.co.nz
Query: safety data sheet 16/10/24 filetype:pdf
|
NEW | NZ | Not Set | No | Never | 0 | Yes | |
|
https://mksmarmara.com
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://wellington-north.com
Query: safety data sheet 23/04/24 filetype:pdf
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://mbctimberframe.co.uk
|
NEW | UK | Not Set | No | Never | 0 | Yes | |
|
https://coatary.com
Query: safety data sheet 09/28/2024 filetype:pdf
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://ura.gov.sg
|
NEW | SG | Not Set | No | Never | 0 | Yes | |
|
https://schrader-pacific.fr
|
NEW | FR | Not Set | No | Never | 0 | Yes | |
|
https://amindustries.com
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://motortrend.com
Query: "Sikkerhetsdatablad" "02/12/24"
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://sigmacoatings.dk
Query: Sikkerhetsdatablad 27/06/24 filetype:pdf
|
NEW | DK | Not Set | No | Never | 0 | No | |
|
https://arbeidstilsynet.no
|
NEW | NO | Not Set | No | Never | 0 | Yes | |
|
https://safenor.no
|
NEW | NO | Not Set | No | Never | 0 | No | |
|
https://byggros.com
|
NEW | DK | Not Set | No | Never | 0 | Yes | |
|
https://singersroom.com
Query: "Sikkerhetsdatablad" "02/04/24"
|
NEW | Global | Not Set | No | Never | 0 | No | |
|
https://garasjetid.no
Query: Sikkerhetsdatablad 21/05/2024 filetype:pdf
|
NEW | NO | Not Set | No | Never | 0 | Yes | |
|
https://strides.com
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://uin-suska.ac.id
|
NEW | ID | Not Set | No | Never | 0 | Yes |
Showing 161
to 180
of 22999 websites
Show: