Seed URLs List

Domain Processor Control

Running
Background Processor: Active and monitoring for new domains
Check Interval: 30 seconds
Domain Processor: This service automatically monitors the TempSeedUrl table for new domains. When a new domain is detected, it validates the website, checks if it's active, uses the region from TempSeedUrl, analyzes JavaScript usage, and inserts valid domains into the GenericWebsite table.
Pending domains: 3277
Auto-restart enabled - processor will automatically start when new domains are added.

Total Websites

22999

Crawled

567

JS Heavy

12253

Total PDFs

24258968

Generic Website Data

Domain URL Status Region Spider Name Crawled Last Crawl Ended Total PDFs Found JS Heavy Actions
https://ndmarketingdigital.com
Query: "Sikkerhetsdatablad" "21/01/25"
NEW IS Not Set No Never 0 Yes
https://celine-perrin.fr
Query: "Sikkerhetsdatablad" "06/12/25"
NEW FR Not Set No Never 0 Yes
https://money-converter.org
Query: "Sikkerhetsdatablad" "01/19/2025"
NEW Global Not Set No Never 0 No
https://gemini.com
Query: "Sikkerhetsdatablad" "10/02/25"
NEW FR Not Set No Never 0 Yes
https://ilovepdfapp.com
Query: "Sikkerhetsdatablad" "30/05/2025"
NEW IS Not Set No Never 0 Yes
https://lovepdf.org
Query: "Sikkerhetsdatablad" "30/05/2025"
NEW Global Not Set No Never 0 No
https://mangadex.org
Query: "Sikkerhetsdatablad" "29/02/2024"
NEW Global Not Set No Never 0 No
https://bitrue.com
Query: "Sikkerhetsdatablad" "21/04/2024"
NEW US Not Set No Never 0 Yes
https://boredflix.rest
Query: "Sikkerhetsdatablad" "03/30/24"
NEW Global Not Set No Never 0 No
https://characterai.help
Query: "Sikkerhetsdatablad" "21/04/2024"
NEW IS Not Set No Never 0 No
https://boredflix.lat
Query: "Sikkerhetsdatablad" "03/30/24"
NEW Global Not Set No Never 0 No
https://new-york-tourist-information.com
Query: "Sikkerhetsdatablad" "01/26/24"
NEW Global Not Set No Never 0 Yes
https://emojis.directory
Query: "Sicherheitsdatenblatt" "03/03/2025"
NEW Global Not Set No Never 0 No
https://next.henkel-adhesives.com/de/en/search.html?filterType=TDS%2FSDS
DONE DE pagination_product_crawler_v2 Yes
2025-12-17
17:23:00
8753
No
http://ddo.jp
Query: "Sicherheitsdatenblatt" "01/08/2024"
NEW JP Not Set No Never 0 No
https://ijels.com
Query: "Sicherheitsdatenblatt" "17/01/2024"
NEW IN Not Set No Never 0 No
https://milfmoms.tv
Query: "Sicherheitsdatenblatt" "01/30/24"
NEW TV Not Set No Never 0 Yes
https://milfporn.tv
Query: "Sicherheitsdatenblatt" "01/30/24"
NEW TV Not Set No Never 0 No
https://porn18videos.com
Query: "Sicherheitsdatenblatt" "02/27/24"
NEW US Not Set No Never 0 No
https://dewaproducts.com
Query: Sicherheitsdatenblatt 11/28/24 filetype:pdf
NEW DE Not Set No Never 0 Yes
Showing 22821 to 22840 of 22999 websites
Show: