Seed URLs List

Domain Processor Control

Running
Background Processor: Active and monitoring for new domains
Check Interval: 30 seconds
Domain Processor: This service automatically monitors the TempSeedUrl table for new domains. When a new domain is detected, it validates the website, checks if it's active, uses the region from TempSeedUrl, analyzes JavaScript usage, and inserts valid domains into the GenericWebsite table.
Pending domains: 3277
Auto-restart enabled - processor will automatically start when new domains are added.

Total Websites

22999

Crawled

563

JS Heavy

12253

Total PDFs

24175048

Generic Website Data

Domain URL Status Region Spider Name Crawled Last Crawl Ended Total PDFs Found JS Heavy Actions
http://hnhylb.com
NEW CN Not Set No Never 0 No
https://stihlusa.com
Query: safety data sheet 07/17/2025 filetype:pdf
NEW Global Not Set No Never 0 Yes
https://ultratex.au
Query: safety data sheet 13/01/25 filetype:pdf
NEW AU Not Set No Never 0 Yes
https://sci-hub.box
Query: safety data sheet 12/01/25 filetype:pdf
NEW US Not Set No Never 0 No
https://ursa.rs
NEW RS Not Set No Never 0 Yes
https://truestrikenails.com.au
NEW AU Not Set No Never 0 No
https://tempestnails.com.au
NEW AU Not Set No Never 0 No
https://vinylscout.de
Query: "Sikkerhetsdatablad" "28/06/25"
NEW DE Not Set No Never 0 Yes
https://porn300.com
Query: "Sikkerhetsdatablad" "08/16/2025"
NEW LU Not Set No Never 0 No
https://tubesafari.com
Query: "Sikkerhetsdatablad" "12/03/24"
NEW SC Not Set No Never 0 No
https://clips4sale.com
Query: "Sikkerhetsdatablad" "12/03/24"
NEW LU Not Set No Never 0 Yes
https://rexxx.com
Query: "Sikkerhetsdatablad" "12/03/24"
NEW Global Not Set No Never 0 Yes
https://pornkai.com
Query: "Sikkerhetsdatablad" "12/03/24"
NEW GB Not Set No Never 0 No
https://forumporn.org
Query: "Sikkerhetsdatablad" "12/03/24"
NEW IS Not Set No Never 0 No
https://playvids.com
Query: "Sikkerhetsdatablad" "12/03/24"
NEW US Not Set No Never 0 No
https://pornav.net
Query: "Sikkerhetsdatablad" "12/03/24"
NEW IS Not Set No Never 0 Yes
https://mp3-teca.com
Query: "Sikkerhetsdatablad" "07/31/2025"
NEW IS Not Set No Never 0 No
https://oilcare.vn
Query: "safety data sheet" "12/09/2024"
NEW VN Not Set No Never 0 No
https://chegg.com
Query: "Sikkerhetsdatablad" "19/06/24"
NEW US Not Set No Never 0 No
https://www.evolubesupply.com
DONE Global generic_crawler_one_domain Yes
2025-12-17
21:10:11
91511
No
Showing 22901 to 22920 of 22999 websites
Show: