Seed URLs List

Domain Processor Control

Running
Background Processor: Active and monitoring for new domains
Check Interval: 30 seconds
Domain Processor: This service automatically monitors the TempSeedUrl table for new domains. When a new domain is detected, it validates the website, checks if it's active, uses the region from TempSeedUrl, analyzes JavaScript usage, and inserts valid domains into the GenericWebsite table.
Pending domains: 3221
Auto-restart enabled - processor will automatically start when new domains are added.

Total Websites

23095

Crawled

651

JS Heavy

12281

Total PDFs

49717329

Generic Website Data

Domain URL Status Region Spider Name Crawled Last Crawl Ended Total PDFs Found JS Heavy Actions
https://cotswoldpetroleum.co.uk
Query: Sikkerhetsdatablad 06/10/25 filetype:pdf
NEW UK Not Set No Never 0 No
https://tjocr.com
Query: Sikkerhetsdatablad 09/14/2025 filetype:pdf
NEW TR Not Set No Never 0 No
https://aspose.ai
Query: "Sicherheitsdatenblatt" "05/27/2024"
NEW AI Not Set No Never 0 Yes
https://cloudcapsule.io
Query: "Sicherheitsdatenblatt" "02/22/2025"
NEW IO Not Set No Never 0 No
https://csimarket.com
Query: "Sicherheitsdatenblatt" "03/08/25"
NEW Global Not Set No Never 0 No
https://wusf.org
Query: "Sicherheitsdatenblatt" "03/16/25"
NEW Global Not Set No Never 0 Yes
https://grunge.com
Query: "Sicherheitsdatenblatt" "10/04/25"
NEW US Not Set No Never 0 No
https://cosuno.com
Query: "Sicherheitsdatenblatt" "03/12/2025"
NEW DE Not Set No Never 0 No
https://sebrae.com.br
Query: "Sicherheitsdatenblatt" "11/03/2025"
NEW BR Not Set No Never 0 No
https://meteocity.com
Query: "Sicherheitsdatenblatt" "18/04/2025"
NEW FR Not Set No Never 0 Yes
https://icliniq.com
Query: "Sicherheitsdatenblatt" "04/28/2025"
NEW US Not Set No Never 0 Yes
http://cidadesdegoias.com.br
Query: "Sicherheitsdatenblatt" "23/03/25"
NEW BR Not Set No Never 0 Yes
https://gctoiture.fr
Query: "Sicherheitsdatenblatt" "04/17/2025"
NEW FR Not Set No Never 0 Yes
https://sonora.id
Query: "Sicherheitsdatenblatt" "07/05/2025"
NEW ID Not Set No Never 0 Yes
https://cash.app
Query: "Sicherheitsdatenblatt" "23/03/25"
NEW Global Not Set No Never 0 Yes
http://niigata-airport.gr.jp
Query: "Sicherheitsdatenblatt" "24/03/25"
NEW JP Not Set No Never 0 No
https://grow-zen.de
Query: "Sicherheitsdatenblatt" "06/04/2025"
NEW DE Not Set No Never 0 Yes
https://grizzlyreports.com
Query: "Sicherheitsdatenblatt" "04/15/2025"
NEW US Not Set No Never 0 Yes
https://journalofsustainability.net
Query: "Sicherheitsdatenblatt" "04/12/2025"
NEW DE Not Set No Never 0 Yes
https://nct-polska.pl
Query: "Sicherheitsdatenblatt" "17/04/2025"
NEW PL Not Set No Never 0 No
Showing 18561 to 18580 of 23095 websites
Show: