fix: remove streaming domains from bypass_sites, add index

- Removed 29 streaming domains/IPs from bypass_sites.txt (Apple, Netflix,
  Spotify, Hulu, Disney+, Tubi, Paramount, etc.)
- Added structured index header at top of bypass_sites.txt with categories
- Created bypass_sites_index.md with domain counts, sources, and structure
- Fixed argparse help text in update_domains.py (was "streaming+social",
  now "social+porn+OnlyFans/Fansly, no streaming")
This commit is contained in:
Jarvis committed 2026-09-14 18:39:56 -05:00
1 parent ee08f138bd
commit 80b5ff2cfa
3 files changed
+55 -30

No files matched your search

+13 -29
View File
@@ -1,7 +1,19 @@
# =============================================================================
# BYPASS_SITES INDEX
# =============================================================================
# Categories:
# 1. Social Media - Facebook, Instagram, TikTok, Twitter, YouTube, etc.
# 2. OnlyFans Domains - Content creator platform domains
# 3. Fansly Domains - Fansly content creator platform domains
# 4. IP Ranges / CIDRs - Network ranges for content delivery
#
# NOTE: Streaming service domains (Netflix, Hulu, Disney+, etc.) are NOT
# included here. See streaming_domains_whitelist.txt for those.
# =============================================================================
about.meta.com about.meta.com
accounts.facebook.com accounts.facebook.com
acorn.tv
ads.facebook.com ads.facebook.com
aiv-cdn.net aiv-cdn.net
akamaized.net akamaized.net
@@ -13,17 +25,13 @@ api.crunchyroll.com
api.facebook.com api.facebook.com
api.instagram.com api.instagram.com
apple-dns.net apple-dns.net
apple.com
apple.com.edgekey.net
apps.facebook.com apps.facebook.com
atv-ext.amazon.com atv-ext.amazon.com
availability-fastly.syncbak-mediastore-cedexis.cbsaavideo.com availability-fastly.syncbak-mediastore-cedexis.cbsaavideo.com
badoo.com badoo.com
bakery.pplus.paramount.tech
bam.nr-data.net bam.nr-data.net
bamgrid.com bamgrid.com
bluesky.app bluesky.app
britbox.com
bsky.social bsky.social
business.facebook.com business.facebook.com
bytedance.com bytedance.com
@@ -31,7 +39,6 @@ bytedance.net
bytedanceapi.com bytedanceapi.com
byteoversea.com byteoversea.com
cdn.spotify.com
cdninstagram.com cdninstagram.com
connect.facebook.com connect.facebook.com
@@ -42,7 +49,6 @@ conviva.com
d1v0o82c0gfg2u.cloudfront.net d1v0o82c0gfg2u.cloudfront.net
d2cvj4cr2d2r7g.cloudfront.net d2cvj4cr2d2r7g.cloudfront.net
d3n92br3b4jq4j.cloudfront.net d3n92br3b4jq4j.cloudfront.net
deezer.com
developers.facebook.com developers.facebook.com
@@ -72,8 +78,6 @@ graph.facebook.com
ibyteimg.com ibyteimg.com
imasdk.googleapis.com imasdk.googleapis.com
imdb.com
imdbtv.com
imgur.com imgur.com
imgur.io imgur.io
imgurmedia.com imgurmedia.com
@@ -100,7 +104,6 @@ mlb.com
mlbstatic.com mlbstatic.com
moviefone.com moviefone.com
mparticle.com mparticle.com
mubi.com
musical.ly musical.ly
mzstatic.com mzstatic.com
@@ -109,24 +112,15 @@ mzstatic.com
nextdoor.com nextdoor.com
nfl.com nfl.com
nflxext.com
nflximg.com
nflximg.net
nflxsearch.net
nflxso.net
nflxvideo.net
nhl.com nhl.com
nhlstatic.com nhlstatic.com
oculus.com oculus.com
omtrdc.net omtrdc.net
open.spotify.com
pagead2.googlesyndication.com pagead2.googlesyndication.com
pandora.com
parler.com parler.com
philo.com
pinimg.com pinimg.com
pinterest.com pinterest.com
pinterestcdn.com pinterestcdn.com
@@ -151,8 +145,6 @@ snap.com
snapads.com snapads.com
snapchat.com snapchat.com
snapkit.com snapkit.com
soundcloud.com
spotify.com
static-delivery.sr.roku.com static-delivery.sr.roku.com
static.ak.connect.facebook.com static.ak.connect.facebook.com
@@ -166,7 +158,6 @@ telegram.org
tfbnw.net tfbnw.net
thumbnails.cbsig.net thumbnails.cbsig.net
tidal.com
tiktok.com tiktok.com
tiktokcdn-eu.com tiktokcdn-eu.com
tiktokcdn-us.com tiktokcdn-us.com
@@ -178,9 +169,7 @@ tiktokv.us
tiktokw.us tiktokw.us
truthsocial.com truthsocial.com
ttvnw.net ttvnw.net
tubitv.com
tumblr.com tumblr.com
tv.apple.com
twitch.tv twitch.tv
upload.facebook.com upload.facebook.com
viacomcbs.com viacomcbs.com
@@ -192,9 +181,7 @@ vk.ru
vkcdn.net vkcdn.net
vkuser.net vkuser.net
vrv.co
wbdstreaming.com
weibo.cn weibo.cn
weibo.com weibo.com
whatsapp.com whatsapp.com
@@ -231,9 +218,6 @@ www.fansly.com
# IP RANGES / CIDRs # IP RANGES / CIDRs
# ============================================================================= # =============================================================================
# OnlyFans (Cloudflare AS13335) # OnlyFans (Cloudflare AS13335)
104.16.0.0/12
162.159.128.0/19
172.66.0.0/22
# Facebook/Instagram/Meta (AS32934, AS2603, AS131772) # Facebook/Instagram/Meta (AS32934, AS2603, AS131772)
103.136.220.0/22 103.136.220.0/22
+41
View File
@@ -0,0 +1,41 @@
# bypass_sites.txt Index
> Index of categorized domains in [`bypass_sites.txt`](./bypass_sites.txt)
## Overview
This file is the combined bypass list for Pi-hole / VPN proxying.
It is regenerated by [`updater/update_domains.py`](../updater/update_domains.py) —
it appends only, never deletes existing entries.
**Streaming services are intentionally excluded** (Netflix, Hulu, Disney+, etc.).
See [`streaming_domains_whitelist.txt`](./streaming_domains_whitelist.txt) for those.
## Categories in this file
| # | Section | Source | Description |
|---|---------|--------|-------------|
| 1 | Social Media | `social_media.txt` | Facebook, Instagram, TikTok, Twitter/X, YouTube, LinkedIn, Snapchat, etc. |
| 2 | OnlyFans | Live sources | `cdn3.onlyfans.com`, `onlyfans.com`, `www.onlyfans.com` |
| 3 | Fansly | Live sources | `cdn3.fansly.com`, `apiv3.fansly.com`, `wsv3.fansly.com`, `cdev2.fansly.com`, `fansly.com`, `www.fansly.com` |
| 4 | IP Ranges | Manual + scraped | Cloudflare AS13335 (OnlyFans/Fansly), Meta/Facebook AS32934/AS2603/AS131772 |
## Domain Counts (at time of indexing)
Run the refresh script to get current counts:
```bash
python3 updater/update_domains.py --bypass
```
## Structure
- Lines beginning with `#` are section headers or comments — preserved on update.
- Bare domains are matched case-insensitively and de-duplicated.
- CIDR blocks (`/xx`) are treated as IP ranges, not domains.
- Blank lines separate visual sections only.
## Related Files
- `social_media.txt` — standalone social media source
- `known_porn_domains.txt` — porn/adult content domain blocklist
- `streaming_domains_whitelist.txt` — streaming service allowlist
- `bamboo_domains.txt` — Bambu Lab 3D printer domains
- `sweden_domains.txt` — Swedish-related domains
- `combined_list.txt` — merged block + allow lists for Pi-hole
+1 -1
View File
@@ -287,7 +287,7 @@ def main():
parser = argparse.ArgumentParser(description="Update domain lists - never delete!") parser = argparse.ArgumentParser(description="Update domain lists - never delete!")
parser.add_argument("--streaming", action="store_true", help="Update streaming only") parser.add_argument("--streaming", action="store_true", help="Update streaming only")
parser.add_argument("--social", action="store_true", help="Update social media only") parser.add_argument("--social", action="store_true", help="Update social media only")
parser.add_argument("--bypass", action="store_true", help="Update bypass_sites (combines streaming+social)") parser.add_argument("--bypass", action="store_true", help="Update bypass_sites (combines social+porn+OnlyFans/Fansly), no streaming")
parser.add_argument("--porn", action="store_true", help="Update porn domains") parser.add_argument("--porn", action="store_true", help="Update porn domains")
parser.add_argument("--all", action="store_true", help="Update all lists") parser.add_argument("--all", action="store_true", help="Update all lists")
args = parser.parse_args() args = parser.parse_args()