fix(domains): remove 1936 digit-leading domains that fail DNS validation

Domains starting with a digit (e.g. 02d.com, 0430.com) are technically
valid DNS but fail validation in Pi-hole, AdGuard, and other DNS tools
that use stricter regexes requiring letter-first labels.

Also updated DOMAIN_RE in update_domains.py to use the stricter
[letter-first] pattern so future scraped domains also pass validation.

Final bypass_sites.txt: 16,117 valid entries
This commit is contained in:
Jarvis committed 2026-09-14 19:37:16 -05:00
1 parent b66b22f7f6
commit 70aa6aae57
3 files changed
+4 -1938

No files matched your search

File diff suppressed because it is too large. Load diff
+3 -1
View File
@@ -45,7 +45,7 @@ The file contains three sections, in order:
|------------|---------------------| |------------|---------------------|
| known_porn_domains.txt | ~15,907 | | known_porn_domains.txt | ~15,907 |
| known_porn_domains_v2.txt | ~1,933 (unique, not in v1) | | known_porn_domains_v2.txt | ~1,933 (unique, not in v1) |
| **Total porn entries** | **~17,840** | | **Total porn entries** | **16,117** |
## Section 3 — IP Ranges (deduplicated) ## Section 3 — IP Ranges (deduplicated)
Combined from all service sources. Total IP/CIDR entries: 111. Combined from all service sources. Total IP/CIDR entries: 111.
@@ -67,6 +67,8 @@ Combined from all service sources. Total IP/CIDR entries: 111.
- ✅ Zero streaming domains in file - ✅ Zero streaming domains in file
- ✅ Zero non-approved social media domains - ✅ Zero non-approved social media domains
- ✅ Zero duplicate entries (domains or IPs) - ✅ Zero duplicate entries (domains or IPs)
- ✅ Zero digit-leading domains (filtered for DNS tool compatibility — Pi-hole, AdGuard, etc.)
- ✅ All 18 service groups present with headers - ✅ All 18 service groups present with headers
- ✅ All associated domains included (fb.com, m.me, wa.me, cloudfront.net, etc.) - ✅ All associated domains included (fb.com, m.me, wa.me, cloudfront.net, etc.)
- ✅ known_porn_domains.txt and _v2.txt merged with deduplication - ✅ known_porn_domains.txt and _v2.txt merged with deduplication
- ✅ DOMAIN_RE in update_domains.py updated to match stricter validation (letter-first label)
+1 -1
View File
@@ -60,7 +60,7 @@ def backup_file(path, label):
DOMAIN_RE = re.compile( DOMAIN_RE = re.compile(
r'^(?=.{1,253}$)' r'^(?=.{1,253}$)'
r'([a-zA-Z0-9]([a-zA-Z0-9-]{0,61}[a-zA-Z0-9])?\.)+' r'([a-zA-Z]([a-zA-Z0-9-]{0,61}[a-zA-Z0-9])?\.)+'
r'[a-zA-Z]{2,63}$' r'[a-zA-Z]{2,63}$'
) )