Seed URLs List

Domain Processor Control

Running
Background Processor: Active and monitoring for new domains
Check Interval: 30 seconds
Domain Processor: This service automatically monitors the TempSeedUrl table for new domains. When a new domain is detected, it validates the website, checks if it's active, uses the region from TempSeedUrl, analyzes JavaScript usage, and inserts valid domains into the GenericWebsite table.
Pending domains: 3227
Auto-restart enabled - processor will automatically start when new domains are added.

Total Websites

23080

Crawled

638

JS Heavy

12277

Total PDFs

40172834

Generic Website Data

Domain URL Status Region Spider Name Crawled Last Crawl Ended Total PDFs Found JS Heavy Actions
https://trumpsproducts.com.au
NEW AU Not Set No Never 0 Yes
https://businesslend.com
Query: "Sikkerhetsdatablad" "13/06/25"
NEW Global Not Set No Never 0 Yes
https://americantimewatch.com
Query: "Sikkerhetsdatablad" "13/11/24"
NEW IS Not Set No Never 0 Yes
https://cityoflonetree.com
Query: safety data sheet 02/20/24 filetype:pdf
NEW US Not Set No Never 0 Yes
https://join-myquiz.com
Query: "Sikkerhetsdatablad" "07/06/25"
NEW IS Not Set No Never 0 No
https://hotels.com
Query: "Sikkerhetsdatablad" "01/13/2024"
NEW Global Not Set No Never 0 No
https://emojiportal.com
Query: "Sikkerhetsdatablad" "05/27/2025"
NEW Global Not Set No Never 0 Yes
https://projectbeacontx.org
Query: "Sikkerhetsdatablad" "10/05/2024"
NEW Global Not Set No Never 0 No
https://aimailhub.com
Query: "Sikkerhetsdatablad" "21/01/25"
NEW US Not Set No Never 0 Yes
https://wordsmyth.net
Query: "Sikkerhetsdatablad" "13/07/25"
NEW US Not Set No Never 0 No
https://www.exxonmobil.com/nb-no/sds
Query: safety data sheet pdf
DONE US exxonmobil Yes
2025-12-08
18:04:34
51180
No
https://indoramaventures.com
NEW Global Not Set No Never 0 No
https://sds.spralac.com/en/show_localization_products/DE-de
DONE DE generic_api_get Yes
2025-12-10
09:13:54
58
No
https://www.beckmancoulter.com/en/support/safety-data-sheets
DONE US beckmancoulter_new_v2 Yes
2025-11-06
12:50:52
714
No
https://www.safetyemporium.com/safety-data-sheets-sds/
DONE US pdf_list_crawler Yes
2025-11-14
11:44:36
75
No
https://winchester.com/Support/Partners/Safety-Data-Sheets
DONE US pdf_list_crawler Yes
2025-11-12
11:07:49
41
No
https://www.hillyard.com/Chemicals-%26-Dispensing/c/1e6b706e-1f91-4f4b-ada1-6758d67217ca?q=%3Arelevance
DONE US pagination_product_crawler_v2 Yes
2025-11-12
19:05:09
6411
No
https://rocketreach.co
Query: "Sikkerhetsdatablad" "09/01/25"
NEW CO Not Set No Never 0 No
https://3iatlas.com
Query: "Sikkerhetsdatablad" "02/12/2025"
NEW IS Not Set No Never 0 No
https://whatsapp.com
Query: "Sikkerhetsdatablad" "26/02/24"
NEW US Not Set No Never 0 Yes
Showing 18981 to 19000 of 23080 websites
Show: