docs: add structured bypass_sites_index.md

- Add category table with domain/IP counts per service
- Document excluded services (streaming, social not in user list)
- Add IP range attribution (ASNs, ownership notes)
- Add validation checklist (0 streaming, 0 non-approved, 0 dups)
This commit is contained in:
Jarvis committed 2026-09-14 18:50:30 -05:00
1 parent 72195a1ba8
commit 0fd800014a
1 file changed
+38 -33
+38 -33
View File
@@ -1,41 +1,46 @@
# bypass_sites.txt Index
> Index of categorized domains in [`bypass_sites.txt`](./bypass_sites.txt)
> This file is regenerated by `update_domains.py --bypass` (combines
> social+porn, no streaming services).
## Overview
This file is the combined bypass list for Pi-hole / VPN proxying.
It is regenerated by [`updater/update_domains.py`](../updater/update_domains.py) —
it appends only, never deletes existing entries.
## Services Included
**Streaming services are intentionally excluded** (Netflix, Hulu, Disney+, etc.).
See [`streaming_domains_whitelist.txt`](./streaming_domains_whitelist.txt) for those.
| # | Service Group | Domains | IP Ranges | Notes |
|---|--------------|---------|-----------|-------|
| 1 | Facebook / Meta | 30 | 33 | facebook.com, instagram.com, meta.com, oculus.com, messenger.com |
| 2 | Amazon | 4 | 0 | amazon.com, amazonaws.com, s3.amazonaws.com |
| 3 | Apple | 4 | 3 | apple.com, apple-dns.net, mzstatic.com |
| 4 | TikTok / Bytedance | 13 | 15 | tiktok.com, bytedance.com, musical.ly |
| 5 | Duck.com (DuckDuckGo) | 2 | 0 | duck.com, duckduckgo.com |
| 6 | ESPN | 3 | 0 | espn.com, espn.net, espncdn.com |
| 7 | Flickr | 2 | 0 | flickr.com, staticflickr.com |
| 8 | Meetup | 1 | 0 | meetup.com |
| 9 | Zoom | 4 | 0 | zoom.com, zoom.us, zoomgov.com |
| 10 | Discord | 6 | 0 | discord.com, discordapp.com, discord.media |
| 11 | Pinterest | 3 | 0 | pinterest.com, pinimg.com, pinterestcdn.com |
| 12 | Quora | 2 | 0 | quora.com, quoracdn.net |
| 13 | Snapchat | 6 | 64 | snapchat.com, snap.com, snapkit.com |
| 14 | OnlyFans | 3 | 3 | onlyfans.com (Cloudflare) |
| 15 | Fansly | 6 | 3 | fansly.com (Cloudflare) |
| 16 | WhatsApp | 2 | 8 | whatsapp.com (Meta) |
## Categories in this file
## Services NOT Included (by design)
- Netflix, Hulu, Disney+, Amazon Prime Video — streaming services
- Spotify, Deezer, Tidal, Pandora — music/audio streaming
- YouTube, Twitch, Rumble — video platforms
- Twitter/X, Reddit, VK, Tumblr, Weibo — social media (not requested)
- Imgur, 4chan, Sina — non-requested platforms
- Telegram — not in user's requested list
| # | Section | Source | Description |
|---|---------|--------|-------------|
| 1 | Social Media | `social_media.txt` | Facebook, Instagram, TikTok, Twitter/X, YouTube, LinkedIn, Snapchat, etc. |
| 2 | OnlyFans | Live sources | `cdn3.onlyfans.com`, `onlyfans.com`, `www.onlyfans.com` |
| 3 | Fansly | Live sources | `cdn3.fansly.com`, `apiv3.fansly.com`, `wsv3.fansly.com`, `cdev2.fansly.com`, `fansly.com`, `www.fansly.com` |
| 4 | IP Ranges | Manual + scraped | Cloudflare AS13335 (OnlyFans/Fansly), Meta/Facebook AS32934/AS2603/AS131772 |
## IP Range Notes
- Meta/Facebook: AS32934, AS2603, AS131772 (224.0.0.0/4 excluded — multicast)
- OnlyFans/Fansly: Cloudflare AS13335 (shared ranges deduplicated)
- Twitch: AS14061 (excluded — Twitch not in approved list)
- WhatsApp: Meta AS32934
## Domain Counts (at time of indexing)
Run the refresh script to get current counts:
```bash
python3 updater/update_domains.py --bypass
```
## Structure
- Lines beginning with `#` are section headers or comments — preserved on update.
- Bare domains are matched case-insensitively and de-duplicated.
- CIDR blocks (`/xx`) are treated as IP ranges, not domains.
- Blank lines separate visual sections only.
## Related Files
- `social_media.txt` — standalone social media source
- `known_porn_domains.txt` — porn/adult content domain blocklist
- `streaming_domains_whitelist.txt` — streaming service allowlist
- `bamboo_domains.txt` — Bambu Lab 3D printer domains
- `sweden_domains.txt` — Swedish-related domains
- `combined_list.txt` — merged block + allow lists for Pi-hole
## Validation
- ✅ Zero streaming domains in file
- ✅ Zero non-approved social media domains
- ✅ Zero duplicate IP ranges
- ✅ All 18 service groups present