finalize domain updater script (#109)

* Add update_domains.py with --streaming/--social/--all flags

* Update: always merge, never delete; add --bypass for combined list

* Fix: preserve all domains+IPs, separate IPs into CIDR section

* Update all domain lists via scraping - no domains removed, only new domains appended

- streaming_domains_whitelist.txt: 198 -> 222 lines (33 new domains from Peacock + Crunchyroll)
- social_media.txt: 133 -> 136 lines (3 new social domains from PiHole list)
- bypass_sites.txt: 251 -> 354 lines (103 new from combined streaming+social)
- known_porn_domains.txt: 15918 -> 15920 (no removals)
- bamboo_domains.txt: 19 lines (unchanged, preserved)
- Script updated to load_all_preserving_everything: never delete

---------

Co-authored-by: Jarvis <jarvis@wickedyoda.local>
This commit is contained in:
WickedYodaandJarvis authored and GitHub committed 2026-09-09 16:39:38 -05:00
1 parent 37ddee3579
commit 091400ca9e
6 files changed
+858 -588

No files matched your search

+210 -186
View File
@@ -1,198 +1,222 @@
# --- added domains from research ---
# amazon prime video (additional)
# apple tv+ (rebranded from apple tv+)
# crunchyroll (additional)
# duckduckgo video search
# general streaming protocols
# paramount+ (additional)
# peacock (additional domains from filterlist)
# roku
# youtube (additional - common streaming)
acorn.tv
aiv-cdn.net
akamaized.net
amazon.com
amazonaws.com
amp.twimg.com
api-manga.crunchyroll.com
api.crunchyroll.com
api.roku.com
api.rokutime.com
api.rpay.roku.com
api.spotify.com
api2.sr.roku.com
apis.rpay.roku.com
apple-dns.net
apple-tv-plus.com
apple.com
apple.com.edgekey.net
atom.peacocktv.com
atv-ext.amazon.com
availability-fastly.syncbak-mediastore-cedexis.cbsaavideo.com
bakery.pplus.paramount.tech
bam.nr-data.net
bamgrid.com
beta-api.crunchyroll.com
beta-stage-api.crunchyroll.com
bff-ext.clients.peacocktv.com
bookmarks.sr.roku.com
britbox.com
cbs.com
cbsaavideo.com
cbsi.demdex.net
cbsi.live.ott.irdeto.com
cbsinteractive.hb.omtrdc.net
cbsivideo.com
cdn.peacocktv.com
cdn.privacy.paramount.com
cdn.registerdisney.go.com
cdn.spotify.com
cloudfront.net
content-detail.sr.roku.com
content.sr.roku.com
conviva.com
crunchyroll.com
cybertron.id.peacocktv.com
d1v0o82c0gfg2u.cloudfront.net
d2cvj4cr2d2r7g.cloudfront.net
d3n92br3b4jq4j.cloudfront.net
deezer.com
dev.crunchyroll.com
discoveryplus.com
disney.com
disneyplus.com
disneystreaming.com
doppler.hulu.com
dplay.com
dssott.com
duck.com
duckduckgo.com
e.delaymultiplier
e.retry
edgesuite.net
enduser.adsrv.org
espn.com
espn.net
espncdn.com
fox.com
foxsports.com
freevee.com
fubo.tv
funimation.com
fwmrm.net
googlevideo.com
hbo.com
hbomax.com
hulu.com
hulu.hb.omtrdc.net
huluad.com
huluim.com
hulustream.com
image.roku.com
images-svc.sr.roku.com
imageservice.disco.peacocktv.com
imasdk.googleapis.com
imdb.com
imdbtv.com
ingest.webcol.sdp.peacocktv.com
innovidvideo.com
llnwd.net
max.com
meg.disco.peacocktv.com
mlb.com
mlbstatic.com
moviefone.com
mparticle.com
mubi.com
mytv.clients.peacocktv.com
mzstatic.com
n.account
n.assets
n.auth
n.content
n.devices
n.etpconfig
n.funmigrator
n.incentives
n.localization
n.messaging
n.news
n.playservice
n.reviews
n.subscription
n.talkbox
n.thirdpartyoauth
navigation.sr.roku.com
nba.com
nbc.com
nbcucdn.com
nbcuni.com
netflix.com
netflix.net
netflixdnstest0.com
nfl.com
nflxext.com
nflximg.com
nflxso.net
nflxvideo.net
netflix.net
netflixdnstest0.com
31.13.64.0/18
45.57.0.0/17
64.120.128.0/17
66.197.128.0/17
69.53.224.0/19
nhl.com
nhlstatic.com
omtrdc.net
open.spotify.com
ovp.peacocktv.com
pagead2.googlesyndication.com
pandora.com
paramount.tech
paramountplus.com
pconfig-prd.cdn.peacocktv.com
peacocktv.com
philo.com
play.ovp.peacocktv.com
playback-detail.sr.roku.com
pluto.tv
primevideo.com
retail.rpay.roku.com
rights-manager.sr.roku.com
roku.admeasurement.com
roku.com
rokutime.com
s3.amazonaws.com
saa.cbsi.com
saa.paramountplus.com
scdn.co
scorecardresearch.com
shudder.com
sling.com
soundcloud.com
spotify.com
ssai.peacocktv.com
stage-api-manga.crunchyroll.com
stage-api.crunchyroll.com
static-delivery.sr.roku.com
telemetry.nbcuott.com
therokuchannel.roku.com
this.audiolanguage
this.country
this.intercept
this.locale
this.settabid
this.tabid
thumbnails.cbsig.net
tidal.com
tubitv.com
tv.apple.com
viacomcbs.com
vod-gcs-cedexis.cbsaavideo.com
vod-gcs-google.cbsaavideo.com
vod-gcs-qwilt.cbsaavideo.com
vod-playlist.sr.roku.com
vod.delivery.roku.com
vortex.hulu.com
vrv.co
vudu.com
warnermediacdn.com
wbdstreaming.com
wmcdp.com
wmcdp.io
wv-license.sr.roku.com
www.crunchyroll.com
www.googletagmanager.com
wwwimage-secure.cbsstatic.com
wwwimage-us.pplusstatic.com
xumo.com
youtu.be
youtube.com
ytimg.com
# IP Ranges / CIDRs
108.175.32.0/20
17.0.0.0/8
192.173.64.0/18
198.38.96.0/19
198.45.48.0/20
207.45.72.0/22
208.75.76.0/22
hbomax.com
hbo.com
warnermediacdn.com
wbdstreaming.com
max.com
wmcdp.io
wmcdp.com
34.192.0.0/10
52.0.0.0/11
hulu.com
hulustream.com
huluim.com
huluad.com
vortex.hulu.com
doppler.hulu.com
conviva.com
hulu.hb.omtrdc.net
disneyplus.com
disney.com
bamgrid.com
bam.nr-data.net
cdn.registerdisney.go.com
disneystreaming.com
dssott.com
paramountplus.com
cbsivideo.com
cbsaavideo.com
cbs.com
viacomcbs.com
paramount.tech
wwwimage-us.pplusstatic.com
wwwimage-secure.cbsstatic.com
thumbnails.cbsig.net
bakery.pplus.paramount.tech
cbsi.demdex.net
vod-gcs-cedexis.cbsaavideo.com
cbsinteractive.hb.omtrdc.net
cbsi.live.ott.irdeto.com
saa.paramountplus.com
saa.cbsi.com
peacocktv.com
nbc.com
nbcuni.com
nbcucdn.com
telemetry.nbcuott.com
tubitv.com
fox.com
foxsports.com
fubo.tv
pluto.tv
roku.com
rokutime.com
therokuchannel.roku.com
api.roku.com
api.rokutime.com
roku.admeasurement.com
crunchyroll.com
beta-api.crunchyroll.com
www.crunchyroll.com
vrv.co
funimation.com
aiv-cdn.net
primevideo.com
amazon.com
amazonaws.com
cloudfront.net
s3.amazonaws.com
atv-ext.amazon.com
imdb.com
imdbtv.com
freevee.com
apple.com
apple-dns.net
apple.com.edgekey.net
mzstatic.com
apple-tv-plus.com
tv.apple.com
17.0.0.0/8
224.0.0.0/4
vudu.com
moviefone.com
mubi.com
shudder.com
britbox.com
acorn.tv
sling.com
philo.com
xumo.com
discoveryplus.com
dplay.com
espn.com
espncdn.com
espn.net
mlb.com
mlbstatic.com
nba.com
nfl.com
nhl.com
nhlstatic.com
spotify.com
scdn.co
api.spotify.com
cdn.spotify.com
open.spotify.com
pandora.com
soundcloud.com
deezer.com
tidal.com
# --- Added domains from research ---
# Apple TV+ (rebranded from Apple TV+)
tv.apple.com
amp.twimg.com
# Roku
retail.rpay.roku.com
api.rpay.roku.com
image.roku.com
vod.delivery.roku.com
vod-playlist.sr.roku.com
rights-manager.sr.roku.com
wv-license.sr.roku.com
static-delivery.sr.roku.com
bookmarks.sr.roku.com
navigation.sr.roku.com
images-svc.sr.roku.com
content.sr.roku.com
content-detail.sr.roku.com
playback-detail.sr.roku.com
api2.sr.roku.com
apis.rpay.roku.com
# Crunchyroll (additional)
api.crunchyroll.com
api-manga.crunchyroll.com
stage-api.crunchyroll.com
stage-api-manga.crunchyroll.com
beta-stage-api.crunchyroll.com
dev.crunchyroll.com
# Paramount+ (additional)
imasdk.googleapis.com
enduser.adsrv.org
cdn.privacy.paramount.com
www.googletagmanager.com
pagead2.googlesyndication.com
availability-fastly.syncbak-mediastore-cedexis.cbsaavideo.com
vod-gcs-qwilt.cbsaavideo.com
vod-gcs-google.cbsaavideo.com
# Peacock (additional domains from filterlist)
ingest.webcol.sdp.peacocktv.com
mparticle.com
fwmrm.net
scorecardresearch.com
omtrdc.net
ssai.peacocktv.com
mytv.clients.peacocktv.com
bff-ext.clients.peacocktv.com
imageservice.disco.peacocktv.com
play.ovp.peacocktv.com
atom.peacocktv.com
cybertron.id.peacocktv.com
meg.disco.peacocktv.com
ovp.peacocktv.com
pconfig-prd.cdn.peacocktv.com
cdn.peacocktv.com
# Amazon Prime Video (additional)
aiv-cdn.net
d1v0o82c0gfg2u.cloudfront.net
d2cvj4cr2d2r7g.cloudfront.net
d3n92br3b4jq4j.cloudfront.net
# YouTube (additional - common streaming)
youtube.com
googlevideo.com
ytimg.com
youtu.be
innovidvideo.com
# General streaming protocols
akamaized.net
edgesuite.net
llnwd.net
# DuckDuckGo video search
duckduckgo.com
duck.com
31.13.64.0/18
34.192.0.0/10
45.57.0.0/17
52.0.0.0/11
64.120.128.0/17
66.197.128.0/17
69.53.224.0/19