Seed URLs List
Domain Processor Control
Running
Background Processor:
Active and monitoring for new domains
Check Interval:
30
seconds
Domain Processor: This service automatically
monitors the TempSeedUrl table for new domains. When a new domain
is detected, it validates the website, checks if it's active, uses
the region from TempSeedUrl, analyzes JavaScript usage, and
inserts valid domains into the GenericWebsite table.
Pending domains: 3277
Auto-restart enabled - processor will automatically start when new domains are added.
Pending domains: 3277
Auto-restart enabled - processor will automatically start when new domains are added.
Total Websites
22999
Crawled
563
JS Heavy
12253
Total PDFs
24175048
Generic Website Data
Status:
Region:
Date Range:
| Domain URL | Status | Region | Spider Name | Crawled | Last Crawl Ended | Total PDFs Found | JS Heavy | Actions |
|---|---|---|---|---|---|---|---|---|
|
https://theconversation.com
Query: "Sikkerhetsdatablad" "02/13/2024"
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://yara.se
Query: Sikkerhetsdatablad 04/05/24 filetype:pdf
|
NEW | SE | Not Set | No | Never | 0 | Yes | |
|
https://fireballnorge.no
Query: Sikkerhetsdatablad 04/11/2024 filetype:pdf
|
NEW | NO | Not Set | No | Never | 0 | No | |
|
https://nlg.nhs.uk
|
NEW | UK | Not Set | No | Never | 0 | No | |
|
https://photonis.com
Query: "safety data sheet" "11/20/2024"
|
NEW | FR | Not Set | No | Never | 0 | No | |
|
https://aemnunavut.ca
Query: "safety data sheet" "12/13/24"
|
NEW | CA | Not Set | No | Never | 0 | Yes | |
|
https://beifangalloy.com
Query: "safety data sheet" "23/12/2024"
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://talasey.co.uk
Query: "safety data sheet" "24/01/2025"
|
NEW | UK | Not Set | No | Never | 0 | Yes | |
|
https://iaac-aeic.gc.ca
|
NEW | CA | Not Set | No | Never | 0 | No | |
|
https://msds.fmpco.com
|
DONE | Global | Not Set | Yes |
2025-09-29
14:05:59
|
3353
|
No | |
|
https://turbobuildinggroup.com.au/building-supplies/
|
NEW | AU | Not Set | No | Never | 0 | No | |
|
https://yxhult.se
|
NEW | SE | Not Set | No | Never | 0 | Yes | |
|
https://enerflux.es
Query: "safety data sheet" "09/07/2024"
|
NEW | ES | Not Set | No | Never | 0 | No | |
|
https://hardwaremise.com.my
|
NEW | MY | Not Set | No | Never | 0 | No | |
|
https://farrwestcity.net
|
NEW | US | Not Set | No | Never | 0 | No | |
|
https://estc.co.za
Query: "safety data sheet" "15/01/2024"
|
NEW | ZA | Not Set | No | Never | 0 | No | |
|
https://alfakimya.com
|
NEW | Global | Not Set | No | Never | 0 | Yes | |
|
https://wildwoodtreesltd.co.uk
Query: "safety data sheet" "03/05/24"
|
NEW | UK | Not Set | No | Never | 0 | No | |
|
https://thirumalaichemicals.com
|
NEW | US | Not Set | No | Never | 0 | Yes | |
|
https://irpa2018europe.com
|
NEW | NL | Not Set | No | Never | 0 | No |
Showing 121
to 140
of 22999 websites
Show: