finalize domain updater script (#109)

* Add update_domains.py with --streaming/--social/--all flags

* Update: always merge, never delete; add --bypass for combined list

* Fix: preserve all domains+IPs, separate IPs into CIDR section

* Update all domain lists via scraping - no domains removed, only new domains appended

- streaming_domains_whitelist.txt: 198 -> 222 lines (33 new domains from Peacock + Crunchyroll)
- social_media.txt: 133 -> 136 lines (3 new social domains from PiHole list)
- bypass_sites.txt: 251 -> 354 lines (103 new from combined streaming+social)
- known_porn_domains.txt: 15918 -> 15920 (no removals)
- bamboo_domains.txt: 19 lines (unchanged, preserved)
- Script updated to load_all_preserving_everything: never delete

---------

Co-authored-by: Jarvis <jarvis@wickedyoda.local>
This commit is contained in:
WickedYodaandJarvis authored and GitHub committed 2026-09-09 16:39:38 -05:00
1 parent 37ddee3579
commit 091400ca9e
6 files changed
+858 -588

No files matched your search

+275 -172
View File
@@ -1,44 +1,103 @@
# --- added domains from research ---
# amazon prime video (additional)
# apple tv+ (rebranded from apple tv+)
# crunchyroll (additional)
# duckduckgo video search
# general streaming protocols
# ip ranges / cidrs
# paramount+ (additional)
# peacock (additional domains from filterlist)
# roku
# youtube (additional - common streaming)
about.meta.com
abs.twimg.com
accounts.facebook.com
accounts.twitter.com
accounts.fetlife.com
ads-api.twitter.com
acorn.tv
ads.facebook.com
ads.twitter.com
analytics.twitter.com
aiv-cdn.net
akamaized.net
amazon.com
amazonaws.com
amp.twimg.com
api-manga.crunchyroll.com
api.crunchyroll.com
api.facebook.com
api.twitter.com
api.x.com
api.fetlife.com
api.roku.com
api.rokutime.com
api.rpay.roku.com
api.spotify.com
api2.sr.roku.com
apis.rpay.roku.com
apple-dns.net
apple-tv-plus.com
apple.com
apple.com.edgekey.net
apps.facebook.com
atom.peacocktv.com
atv-ext.amazon.com
availability-fastly.syncbak-mediastore-cedexis.cbsaavideo.com
badoo.com
bellesa.co
bellesa.com
bakery.pplus.paramount.tech
bam.nr-data.net
bamgrid.com
beta-api.crunchyroll.com
beta-stage-api.crunchyroll.com
bff-ext.clients.peacocktv.com
bluesky.app
bookmarks.sr.roku.com
britbox.com
bsky.social
business.facebook.com
business.twitter.com
camwhores.tv
cards.twitter.com
cdn.syndication.twimg.com
bytedance.com
bytedance.net
bytedanceapi.com
byteoversea.com
cbs.com
cbsaavideo.com
cbsi.demdex.net
cbsi.live.ott.irdeto.com
cbsinteractive.hb.omtrdc.net
cbsivideo.com
cdn-medium.com
cdn.peacocktv.com
cdn.privacy.paramount.com
cdn.registerdisney.go.com
cdn.spotify.com
cdninstagram.com
cdn.fetlife.com
cloudfront.net
clubhouse.com
clubhouseapi.com
connect.facebook.com
connect.facebook.net
crazyshit.com
darknessporn.com
content-detail.sr.roku.com
content.sr.roku.com
conviva.com
crunchyroll.com
cybertron.id.peacocktv.com
d1v0o82c0gfg2u.cloudfront.net
d2cvj4cr2d2r7g.cloudfront.net
d3n92br3b4jq4j.cloudfront.net
deezer.com
dev.crunchyroll.com
developers.facebook.com
developer.twitter.com
dev.twitter.com
dipseastories.com
discoveryplus.com
disney.com
disneyplus.com
disneystreaming.com
doppler.hulu.com
dplay.com
dssott.com
duck.com
duckduckgo.com
e.delaymultiplier
e.retry
edge.facebook.com
edgesuite.net
enduser.adsrv.org
espn.com
espn.net
espncdn.com
facebook.com
facebook.net
fansly.com
faphouse.com
fabxh.site
fb.com
fb.gg
fb.me
@@ -46,206 +105,250 @@ fb.watch
fbcdn.com
fbcdn.net
fbsbx.com
fetlife.com
www.fetlife.com
static.fetlife.com
media.fetlife.com
images.fetlife.com
beta.fetlife.com
m.fetlife.com
flickr.com
frolicme.com
fullporno.xxx
graphql.twitter.com
fox.com
foxsports.com
freevee.com
fubo.tv
funimation.com
fwmrm.net
googlevideo.com
graph.facebook.com
help.twitter.com
hotscope.tv
hbo.com
hbomax.com
hulu.com
hulu.hb.omtrdc.net
huluad.com
huluim.com
hulustream.com
ibyteimg.com
image.roku.com
images-svc.sr.roku.com
imageservice.disco.peacocktv.com
imasdk.googleapis.com
imdb.com
imdbtv.com
imgur.com
imgur.io
imgurmedia.com
ingest.webcol.sdp.peacocktv.com
innovidvideo.com
instagram.com
jtvnw.net
kick.com
licdn.com
linkedin.com
l.facebook.com
literotica.com
login.twitter.com
licdn.com
linkedin.cn
linkedin.com
llnwd.net
lm.facebook.com
login.facebook.com
mastodon.social
max.com
medium.com
meetup.com
meg.disco.peacocktv.com
messenger.com
meta.com
metacdn.com
mobile.twitter.com
m.twitter.com
mobile.x.com
motherless.com
motherlessmedia.com
mlb.com
mlbstatic.com
moviefone.com
mparticle.com
mubi.com
musical.ly
mytv.clients.peacocktv.com
mzstatic.com
n.account
n.assets
n.auth
n.content
n.devices
n.etpconfig
n.funmigrator
n.incentives
n.localization
n.messaging
n.news
n.playservice
n.reviews
n.subscription
n.talkbox
n.thirdpartyoauth
navigation.sr.roku.com
nba.com
nbc.com
nbcucdn.com
nbcuni.com
netflix.com
netflix.net
netflixdnstest0.com
nextdoor.com
oauth.twitter.com
nfl.com
nflxext.com
nflximg.com
nflxso.net
nflxvideo.net
nhl.com
nhlstatic.com
oculus.com
onlyfans.com
omtrdc.net
open.spotify.com
ovp.peacocktv.com
pagead2.googlesyndication.com
pandora.com
paramount.tech
paramountplus.com
parler.com
pbs.twimg.com
pinterest.com
pconfig-prd.cdn.peacocktv.com
peacocktv.com
philo.com
pinimg.com
platform.twitter.com
pornhub.com
promoted.twitter.com
publish.twitter.com
quinn.com
pinterest.com
pinterestcdn.com
play.ovp.peacocktv.com
playback-detail.sr.roku.com
pluto.tv
primevideo.com
quora.com
redtube.com
rule34.xxx
quoracdn.net
retail.rpay.roku.com
rights-manager.sr.roku.com
roku.admeasurement.com
roku.com
rokutime.com
rumble.com
s3.amazonaws.com
saa.cbsi.com
saa.paramountplus.com
sc-cdn.net
scdn.co
scorecardresearch.com
secure.facebook.com
shudder.com
signal.org
sinaimg.cn
sling.com
snap.com
snapads.com
snapchat.com
snapkit.com
spaces.twitter.com
soundcloud.com
spotify.com
ssai.peacocktv.com
stage-api-manga.crunchyroll.com
stage-api.crunchyroll.com
static-delivery.sr.roku.com
static.ak.connect.facebook.com
static.ak.facebook.com
static.xx.fbcdn.net
staticflickr.com
status.twitterstat.us
stream.twitter.com
support.twitter.com
syndication.twimg.com
t.co
www.t.co
telegram.org
t.me
www.t.me
telegram.me
telegram.org
telemetry.nbcuott.com
tfbnw.net
theporndude.com
thexh.today
therokuchannel.roku.com
this.audiolanguage
this.country
this.intercept
this.locale
this.settabid
this.tabid
threads.net
thumbnails.cbsig.net
tidal.com
tiktok.com
tiktokcdn.com
tiktokcdn-eu.com
tiktokcdn-us.com
tiktokcdn.com
tiktoklinksafety.us
tiktokw.us
tiktok.us
tiktokv.com
tiktokv.eu
tiktokv.us
ton.twitter.com
ton.twimg.com
tiktokw.us
truthsocial.com
tryquinn.com
tsyndicate.com
tumblr.com
twitch.tv
ttvnw.net
twitter.com
www.twitter.com
twimg.com
tubitv.com
tumblr.com
tv.apple.com
twitch.tv
upload.facebook.com
upload.twitter.com
video.twimg.com
viacomcbs.com
video.xx.fbcdn.net
vimeo.com
vimeocdn.com
vk.com
vk.ru
vkcdn.net
vkuser.net
vod-gcs-cedexis.cbsaavideo.com
vod-gcs-google.cbsaavideo.com
vod-gcs-qwilt.cbsaavideo.com
vod-playlist.sr.roku.com
vod.delivery.roku.com
vortex.hulu.com
vrv.co
vudu.com
warnermediacdn.com
wbdstreaming.com
weibo.cn
weibo.com
whatsapp.com
whatsapp.net
white.ish.instagram.com
x.com
www.x.com
xhcdn.com
xhamster.com
xvideos.com
youporn.com
googletagmanager.com
goo.gl
xnxx.com
www.xnxx.com
spankbang.com
www.spankbang.com
tube8.com
www.tube8.com
beeg.com
www.beeg.com
brazzers.com
www.brazzers.com
realitykings.com
www.realitykings.com
mofos.com
www.mofos.com
bangbros.com
www.bangbros.com
teamskeet.com
www.teamskeet.com
naughtyamerica.com
www.naughtyamerica.com
eporner.com
www.eporner.com
txxx.com
www.txxx.com
porn.com
www.porn.com
sex.com
www.sex.com
sxyprn.com
www.sxyprn.com
thumbzilla.com
www.thumbzilla.com
tnaflix.com
www.tnaflix.com
empflix.com
www.empflix.com
jable.tv
www.jable.tv
missav.com
www.missav.com
hanime.tv
www.hanime.tv
hentaifox.com
www.hentaifox.com
nhentai.net
www.nhentai.net
gelbooru.com
www.gelbooru.com
manyvids.com
www.manyvids.com
chaturbate.com
www.chaturbate.com
stripchat.com
www.stripchat.com
myfreecams.com
www.myfreecams.com
camsoda.com
www.camsoda.com
livejasmin.com
www.livejasmin.com
bongacams.com
www.bongacams.com
cam4.com
www.cam4.com
streamate.com
www.streamate.com
adultfriendfinder.com
www.adultfriendfinder.com
ashleymadison.com
www.ashleymadison.com
web.libera.com
www.instagram.com
i.instagram.com
api.instagram.com
graph.instagram.com
help.instagram.com
about.instagram.com
business.instagram.com
creators.instagram.com
accountscenter.instagram.com
static.cdninstagram.com
scontent.cdninstagram.com
wmcdp.com
wmcdp.io
wv-license.sr.roku.com
www.crunchyroll.com
www.googletagmanager.com
wwwimage-secure.cbsstatic.com
wwwimage-us.pplusstatic.com
xumo.com
youtu.be
youtube.com
ytimg.com
# IP Ranges / CIDRs
103.136.220.0/22
103.4.96.0/22
108.175.32.0/20
129.134.0.0/16
13.107.0.0/16
149.154.160.0/20
157.240.0.0/16
161.117.0.0/16
17.0.0.0/8
173.252.64.0/18
179.60.192.0/22
185.60.216.0/22
192.173.64.0/18
198.38.96.0/19
198.45.48.0/20
199.96.56.0/21
204.15.20.0/22
207.45.72.0/22
208.75.76.0/22
224.0.0.0/4
31.13.24.0/21
31.13.64.0/18
34.192.0.0/10
40.0.0.0/8
45.57.0.0/17
47.246.0.0/16
52.0.0.0/11
52.96.0.0/12
64.120.128.0/17
66.197.128.0/17
66.220.144.0/20
69.171.224.0/19
69.53.224.0/19
69.63.176.0/20
74.119.76.0/22
87.240.128.0/18
91.108.12.0/22
91.108.16.0/22
91.108.4.0/22
91.108.56.0/22
91.108.8.0/22
93.186.224.0/20
95.213.0.0/16