feat(domains): merge known_porn_domains.txt and v2 into bypass_sites.txt

feat(domains): merge known_porn_domains.txt and v2 into bypass_sites.txt
This commit is contained in:
WickedYoda authored and GitHub committed 2026-09-14 19:27:27 -05:00
commit 18b3f584ca
2 files changed
+17892 -23

No files matched your search

File diff suppressed because it is too large. Load diff
+46 -23
View File
@@ -4,28 +4,51 @@
> This file is regenerated by `update_domains.py --bypass` (combines
> social+porn, no streaming services).
## Services Included
## Structure
| # | Service Group | Domains | IP Ranges | Notes |
|---|--------------|---------|-----------|-------|
| 1 | Facebook / Meta | 35 | 33 | facebook.com, instagram.com, meta.com, oculus.com, messenger.com |
| 2 | Amazon | 7 | 0 | amazon.com, amazonaws.com, s3.amazonaws.com, cloudfront.net |
| 3 | Apple | 8 | 3 | apple.com, apple-dns.net, mzstatic.com, icoud.com |
| 4 | TikTok / Bytedance | 13 | 15 | tiktok.com, bytedance.com, musical.ly |
| 5 | Duck.com (DuckDuckGo) | 3 | 0 | duck.com, duckduckgo.com, ddg.gg |
| 6 | ESPN | 3 | 0 | espn.com, espn.net, espncdn.com |
| 7 | Flickr | 2 | 0 | flickr.com, staticflickr.com |
| 8 | Meetup | 2 | 0 | meetup.com, meetupstatic.com |
| 9 | Zoom | 4 | 0 | zoom.com, zoom.us, zoomgov.com |
| 10 | Discord | 7 | 0 | discord.com, discordapp.com, discord.media |
| 11 | Pinterest | 3 | 0 | pinterest.com, pinimg.com, pinterestcdn.com |
| 12 | Quora | 2 | 0 | quora.com, quoracdn.net |
| 13 | Snapchat | 6 | 64 | snapchat.com, snap.com, snapkit.com |
| 14 | OnlyFans | 5 | 3 | onlyfans.com (Cloudflare) |
| 15 | Fansly | 7 | 3 | fansly.com (Cloudflare) |
| 16 | WhatsApp | 6 | 8 | whatsapp.com (Meta) |
The file contains three sections, in order:
**Totals:** 124 domains + 111 IP/CIDR blocks = 235 entries
1. **Bypass Sites (18 services)** — Manually curated list with structured headers for:
- Facebook/Meta, Amazon, Apple, TikTok/Bytedance, Instagram, Duck.com, ESPN,
Flickr, Meetup, Zoom, Discord, Pinterest, Quora, Snapchat, OnlyFans, Fansly,
WhatsApp — and their known IP ranges.
2. **Porn Sites** — Bulk-merged from `known_porn_domains.txt` and
`known_porn_domains_v2.txt` with all duplicates removed against Section 1.
## Section 1 — Bypass Services
| # | Service Group | Example Domains | IP Ranges |
|---|--------------|-----------------|-----------|
| 1 | Facebook / Meta | facebook.com, fb.com, instagram.com, meta.com | 33 |
| 2 | Amazon | amazon.com, amazonaws.com, s3.amazonaws.com | 0 |
| 3 | Apple | apple.com, apple-dns.net, mzstatic.com, icloud.com | 3 |
| 4 | TikTok / Bytedance | tiktok.com, bytedance.com, musical.ly | 15 |
| 5 | Instagram | instagram.com, api.instagram.com, cdninstagram.com | 0 |
| 6 | Duck.com | duck.com, duckduckgo.com, ddg.gg | 0 |
| 7 | ESPN | espn.com, espn.net, espncdn.com | 0 |
| 8 | Flickr | flickr.com, staticflickr.com | 0 |
| 9 | Meetup | meetup.com, meetupstatic.com | 0 |
| 10 | Zoom | zoom.us, zoom.com, zoomgov.com | 0 |
| 11 | Discord | discord.com, discordapp.com, discord.media | 0 |
| 12 | Messenger | messenger.com | 0 |
| 13 | Pinterest | pinterest.com, pinimg.com, pinterestcdn.com | 0 |
| 14 | Quora | quora.com, quoracdn.net | 0 |
| 15 | Snapchat | snapchat.com, snap.com, snapkit.com | 64 |
| 16 | OnlyFans | onlyfans.com, cdn3.onlyfans.com, api.onlyfans.com | 3 |
| 17 | Fansly | fansly.com, cdn3.fansly.com, apiv3.fansly.com | 3 |
| 18 | WhatsApp | whatsapp.com, whatsapp.net, wa.me | 8 |
## Section 2 — Porn Sites (merged)
| Source File | Unique Domains Added |
|------------|---------------------|
| known_porn_domains.txt | ~15,907 |
| known_porn_domains_v2.txt | ~1,933 (unique, not in v1) |
| **Total porn entries** | **~17,840** |
## Section 3 — IP Ranges (deduplicated)
Combined from all service sources. Total IP/CIDR entries: 111.
## Services NOT Included (by design)
- Netflix, Hulu, Disney+, Amazon Prime Video — streaming services
@@ -38,12 +61,12 @@
## IP Range Notes
- Meta/Facebook: AS32934, AS2603, AS131772 (224.0.0.0/4 excluded — multicast)
- OnlyFans/Fansly: Cloudflare AS13335 (shared ranges deduplicated)
- Twitch: AS14061 (excluded — Twitch not in approved list)
- WhatsApp: Meta AS32934
## Validation
- ✅ Zero streaming domains in file
- ✅ Zero non-approved social media domains
- ✅ Zero duplicate IP ranges
- ✅ All 18 service groups present
- ✅ Zero duplicate entries (domains or IPs)
- ✅ All 18 service groups present with headers
- ✅ All associated domains included (fb.com, m.me, wa.me, cloudfront.net, etc.)
- ✅ known_porn_domains.txt and _v2.txt merged with deduplication