13 Commits
Author SHA1 Message Date
Jarvis 1e6b35f078 fix: make updates.sh path-independent and fix InfluxData keyring usage
- updates.sh: use BASH_SOURCE to find script dir, so fix_apt_influx.sh
  can be called from anywhere (was failing with 'command not found' when
  run from outside the updates_scripts directory)
- fix_apt_influx.sh: if key download fails but keyring already exists on
  disk, reuse it with [signed-by=] instead of falling back to
  [trusted=yes] which disables signature verification entirely
- Fixes: Missing key AC10D7449F343ADCEFDDC2B6DA61C26A0585BD3B error
  on Trixie when running updates.sh
2026-09-19 16:48:13 -05:00
Jarvis 86838efc64 docs: fix README clone instructions for existing directories 2026-09-19 16:22:14 -05:00
Jarvis 70aa6aae57 fix(domains): remove 1936 digit-leading domains that fail DNS validation
Domains starting with a digit (e.g. 02d.com, 0430.com) are technically
valid DNS but fail validation in Pi-hole, AdGuard, and other DNS tools
that use stricter regexes requiring letter-first labels.

Also updated DOMAIN_RE in update_domains.py to use the stricter
[letter-first] pattern so future scraped domains also pass validation.

Final bypass_sites.txt: 16,117 valid entries
2026-09-14 19:37:16 -05:00
Jarvis 8519674ee6 fix(domains): remove 22 exact streaming service domains leaked from porn lists
Filtered out exact streaming service domains (youtube.com, spotify.com,
twitch.tv, hulu.com, netflix.com, disneyplus.com, primevideo.com,
deezer.com, tidal.com, soundcloud.com, etc.) that were present in
known_porn_domains.txt and known_porn_domains_v2.txt.

Porn domains containing streaming service substrings (e.g. 18huluwa.com,
app.netflixmi.com) are retained as they are not the actual services.
2026-09-14 19:31:26 -05:00
Jarvis 9b1a63fdee feat(domains): merge known_porn_domains.txt and v2 into bypass_sites.txt
Merged known_porn_domains.txt (15,907 domains) and
known_porn_domains_v2.txt (1,933 unique additional domains)
into bypass_sites.txt under a dedicated PORN SITES section.
All entries deduplicated against the 18-service bypass list (235 entries).

Total bypass_sites.txt: 18,075 entries (124 social + 111 IP + 17,840 porn)
Updated bypass_sites_index.md with new structure documentation.
2026-09-14 19:27:01 -05:00
Jarvis 296caa4ba2 docs: update bypass_sites_index.md with final domain counts (235 entries) 2026-09-14 19:24:08 -05:00
Jarvis 303f2180e0 feat(domains): add associated domains for all 18 services
Added secondary/associated domains for each service:
- Facebook/Meta: edge-mqtt.facebook.com, fna.fbcdn.net, m.me, web.facebook.com, xrcdn.com
- Amazon: amazon-adsystem.com, a9.com, cloudfront.net
- Apple: appstore.com, aaplimg.com, icloud.com, me.com
- Discord: discord.new
- Duck.com: ddg.gg
- Meetup: meetupstatic.com
- OnlyFans: api.onlyfans.com, m.onlyfans.com
- Fansly: m.fansly.com
- WhatsApp: graph.whatsapp.com, m.whatsapp.com, wa.me, web.whatsapp.com

Total domains: 235 (up from 210)
2026-09-14 19:21:32 -05:00
Jarvis 0fd800014a docs: add structured bypass_sites_index.md
- Add category table with domain/IP counts per service
- Document excluded services (streaming, social not in user list)
- Add IP range attribution (ASNs, ownership notes)
- Add validation checklist (0 streaming, 0 non-approved, 0 dups)
2026-09-14 18:50:30 -05:00
Jarvis 72195a1ba8 fix: rewrite bypass_sites.txt with user-specified services only
Rewrote bypass_sites.txt to include ONLY domains for:
- Facebook/Meta, Amazon, Apple, TikTok/Bytedance, Instagram
- DuckDuckGo, ESPN, Flickr, Meetup, Zoom, Discord
- Messenger, Pinterest, Quora, Snapchat, OnlyFans, Fansly, WhatsApp

Changes:
- Removed all streaming domains (Netflix, Hulu, Disney+, Spotify, etc.)
- Removed social media not in user's list (Twitter/X, Twitch, Reddit, VK, etc.)
- Removed non-allowed domains (Imgur, 4chan, Sina, etc.)
- Added Zoom + Discord domains (were missing)
- Added structured category headers with service attribution
- Deduplicated IP ranges
- Added WhatsApp IP ranges
- Removed 224.0.0.0/4 (multicast, was erroneously listed)

Domains total: 102
IP/CIDR blocks: 110 (deduplicated)
2026-09-14 18:48:19 -05:00
Jarvis 80b5ff2cfa fix: remove streaming domains from bypass_sites, add index
- Removed 29 streaming domains/IPs from bypass_sites.txt (Apple, Netflix,
  Spotify, Hulu, Disney+, Tubi, Paramount, etc.)
- Added structured index header at top of bypass_sites.txt with categories
- Created bypass_sites_index.md with domain counts, sources, and structure
- Fixed argparse help text in update_domains.py (was "streaming+social",
  now "social+porn+OnlyFans/Fansly, no streaming")
2026-09-14 18:39:56 -05:00
Jarvis 7003082f21 chore: expand streaming_domains_whitelist.txt — 223 → 337 entries with comprehensive IPs and domains
- Added 32 IP ranges/CIDRs (Netflix AS2906, Hulu AS23286, Apple)
- Added 235 domains covering Netflix, Amazon Prime Video, Disney+,
  HBO Max, Hulu, Paramount+, Peacock, Apple TV+, Roku, YouTube,
  Spotify, Crunchyroll, and other streaming services
- Cleaned up 155 junk/invalid entries (truncated Roku subdomains,
  invalid entries like e.retry, e.delaymultiplier)
- Structured into service-organized sections with headers
- Updated update_domains.py Peacock filterlist source
2026-09-10 13:33:13 -05:00
Jarvis fe110c10a1 feat: disable Copilot auto code review on PRs
Add .copilot.yml with code_review.auto_enable=false to prevent
Copilot from being automatically requested as a reviewer on
pull requests.
2026-09-04 14:15:44 -05:00
Jarvis 1f2c919f56 fix: complete shellcheck fixes
- Fix CRLF line endings (SC1017) in 10 shell scripts
- Add shebangs (SC2148) to 5 scripts missing them
- Fix unquoted variables (SC2086) in kali-updates.sh
- Add shellcheck disable directive for intentional eval usage
- Fix missing space after ! in observium/custom_install.sh
- Add security scan reports to .gitignore-safe location
2026-09-04 13:48:56 -05:00