mirror of
https://github.com/wickedyoda/public-setupfiles.git
synced 2026-11-16 13:31:56 -06:00
fix(domains): remove 1936 digit-leading domains that fail DNS validation
Domains starting with a digit (e.g. 02d.com, 0430.com) are technically valid DNS but fail validation in Pi-hole, AdGuard, and other DNS tools that use stricter regexes requiring letter-first labels. Also updated DOMAIN_RE in update_domains.py to use the stricter [letter-first] pattern so future scraped domains also pass validation. Final bypass_sites.txt: 16,117 valid entries
This commit is contained in:
1 parent
b66b22f7f6
commit
70aa6aae57
3 files changed
+4
-1938
No files matched your search
File diff suppressed because it is too large.
Load diff
@@ -45,7 +45,7 @@ The file contains three sections, in order:
|
|||||||
|------------|---------------------|
|
|------------|---------------------|
|
||||||
| known_porn_domains.txt | ~15,907 |
|
| known_porn_domains.txt | ~15,907 |
|
||||||
| known_porn_domains_v2.txt | ~1,933 (unique, not in v1) |
|
| known_porn_domains_v2.txt | ~1,933 (unique, not in v1) |
|
||||||
| **Total porn entries** | **~17,840** |
|
| **Total porn entries** | **16,117** |
|
||||||
|
|
||||||
## Section 3 — IP Ranges (deduplicated)
|
## Section 3 — IP Ranges (deduplicated)
|
||||||
Combined from all service sources. Total IP/CIDR entries: 111.
|
Combined from all service sources. Total IP/CIDR entries: 111.
|
||||||
@@ -67,6 +67,8 @@ Combined from all service sources. Total IP/CIDR entries: 111.
|
|||||||
- ✅ Zero streaming domains in file
|
- ✅ Zero streaming domains in file
|
||||||
- ✅ Zero non-approved social media domains
|
- ✅ Zero non-approved social media domains
|
||||||
- ✅ Zero duplicate entries (domains or IPs)
|
- ✅ Zero duplicate entries (domains or IPs)
|
||||||
|
- ✅ Zero digit-leading domains (filtered for DNS tool compatibility — Pi-hole, AdGuard, etc.)
|
||||||
- ✅ All 18 service groups present with headers
|
- ✅ All 18 service groups present with headers
|
||||||
- ✅ All associated domains included (fb.com, m.me, wa.me, cloudfront.net, etc.)
|
- ✅ All associated domains included (fb.com, m.me, wa.me, cloudfront.net, etc.)
|
||||||
- ✅ known_porn_domains.txt and _v2.txt merged with deduplication
|
- ✅ known_porn_domains.txt and _v2.txt merged with deduplication
|
||||||
|
- ✅ DOMAIN_RE in update_domains.py updated to match stricter validation (letter-first label)
|
||||||
@@ -60,7 +60,7 @@ def backup_file(path, label):
|
|||||||
|
|
||||||
DOMAIN_RE = re.compile(
|
DOMAIN_RE = re.compile(
|
||||||
r'^(?=.{1,253}$)'
|
r'^(?=.{1,253}$)'
|
||||||
r'([a-zA-Z0-9]([a-zA-Z0-9-]{0,61}[a-zA-Z0-9])?\.)+'
|
r'([a-zA-Z]([a-zA-Z0-9-]{0,61}[a-zA-Z0-9])?\.)+'
|
||||||
r'[a-zA-Z]{2,63}$'
|
r'[a-zA-Z]{2,63}$'
|
||||||
)
|
)
|
||||||
|
|
||||||
|
|||||||
Reference in new issue
Block a user