Commit Graph
49 Commits
Author SHA1 Message Date
J.A.R.V.I.S. 3ee89f3b4f fix: exclude false-positive paths from TruffleHog scanning
CodeQL / CodeQL Analysis (python) (pull_request) Waiting to run
Secret Scanning / Trufflehog Secret Scanning (pull_request) Waiting to run
Security Scans / ShellCheck (pull_request) Waiting to run
Security Scans / Python Dependency Audit (pull_request) Waiting to run
Security Scans / Docker Vulnerability Scan (pull_request) Waiting to run
ShellCheck / ShellCheck Linting (pull_request) Waiting to run
Add .trufflehog-exclude.txt to skip:
- .git/ directory (git metadata, non-tracked)
- pihole/combined_list.txt (blocklist with domain-name patterns
  matching Datadog secret detectors)

Update secret-scanning.yml to reference the exclude file via --exclude-paths.
Fixes code-scanning alerts #3, #4, #5 (false positives).
2026-10-22 18:14:00 +00:00
WickedYoda a73b8d1caf Merge pull request #133 from wickedyoda/powershell_scripts-add
Powershell scripts add
2026-10-21 13:27:44 -05:00
WickedYoda ef1efe26b2 playbooks 2026-10-21 13:17:25 -05:00
WickedYoda 69802266ae Update ssh on windows pc.yml 2026-10-21 13:15:28 -05:00
WickedYoda 20dddf4feb Create ssh on windows pc.yml 2026-10-21 13:10:57 -05:00
WickedYoda 4d5c390d46 add playbooks and power shell scripts
add playbooks and power shell scripts
2026-10-21 12:59:57 -05:00
WickedYoda 377688e218 Merge pull request #132 from wickedyoda/domains
updates and reset-perm scripts
2026-10-05 12:38:06 -05:00
WickedYoda 3f4030fd96 updates and reset-perm scripts 2026-10-05 12:37:42 -05:00
WickedYoda 361d59af0a Merge pull request #131 from wickedyoda/fix/apt-repair-before-update
fix: repair APT keys before apt-get update in updates script
2026-09-29 14:55:18 -05:00
WickedYoda 621c51c1cb Merge pull request #130 from wickedyoda/domains
updated domains
2026-09-26 21:56:10 -05:00
WickedYoda 598b4d0809 Merge branch 'main' into domains 2026-09-26 21:55:46 -05:00
WickedYoda be6b08ceab updated domains
updated domains
2026-09-26 21:54:37 -05:00
WickedYoda 821574d1b3 Merge pull request #129 from wickedyoda/sync
updated sync commands
2026-09-20 12:32:16 -05:00
WickedYoda d4cfc5d3cb updated sync commands
updated sync commands
2026-09-20 12:18:38 -05:00
WickedYoda a45afbd3e4 Merge pull request #128 from wickedyoda/fix/updates-script-path-and-influxkey
fix: make updates.sh path-independent and fix InfluxData keyring usage
2026-09-19 16:57:54 -05:00
WickedYodaandCopilot Autofix powered by AI a71faf5b9a Update keyring check to use -s instead of -f
Change condition to check if the keyring file is not empty before using it.

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
2026-09-19 16:57:06 -05:00
WickedYoda 38c558867a Merge pull request #127 from wickedyoda/fix/readme-clone-instructions
docs: fix README clone instructions for existing directories
2026-09-19 16:44:55 -05:00
WickedYodaandJarvis 296bb223eb fix: resolve all three failing CI workflows (#126)
* fix: resolve all three failing CI workflows

Fix shellcheck.yml workflow:
- Use correct v2.0.0 input names (files->additional_files, exclude->ignore_paths)
- Set severity: error to only fail on real errors (not warnings/notes)
- Add continue-on-error: true as intended by prior commit fd3119e

Fix codeql.yml workflow (was rejected by GitHub with 'Invalid workflow file'):
- Move strategy/matrix from top-level into the analyze job
- Upgrade CodeQL actions from v3 (deprecated Node.js 20) to v4
- Remove invalid 'upload: true' input from init step

Fix secret-scanning.yml workflow (was rejected by GitHub with 'Invalid workflow file'):
- Fix cron syntax: ['0 6 * * 1'] -> '0 6 * * 1' (was a YAML sequence, not scalar)
- Fix non-existent action: upload-security-sarif@v3 -> upload-sarif@v4
- Pin trufflesecurity/trufflehog@main to @v3.97.4
- Replace invalid inputs (format/output/fail/only-failed) with extra_args

Fix error-level shellcheck issues in scripts:
- reset_perms/reset_perms 1.sh: add shebang (SC2148)
- raspberrypi/rasp_pi_install_apps.sh: fix shebang '!#' -> '#' (SC1035)
- mac-scripts/updates.sh: add shellcheck shell=sh directive (SC1071)
- mac-scripts/system_updates.sh: add shellcheck shell=sh directive (SC1071)
- observiem_agent/observiem-agent-install.sh: quote array expansions (SC2068), fix assignment spaces (SC2283)

* fix: TruffleHog --format flag removed (inferred from .sarif extension)

- Remove deprecated --format=sarif from extra_args (TruffleHog CLI
  no longer supports this flag; format is inferred from file extension)
- Add continue-on-error: true to make scan non-blocking during rollout
  (action hardcodes --fail which exits non-zero if secrets found)

* fix: TruffleHog CLI restructured — install binary directly

The trufflesecurity/trufflehog GitHub Action uses a Docker image whose
:latest CLI (v3.97.4) removed the 'scan' subcommand and the --format/--output
flags that the action's run.sh still passes. This caused both the TruffleHog
scan and the SARIF upload to fail.

Fix: install the TruffleHog binary directly from GitHub releases and use
the v3.97.4 CLI structure:
- trufflehog filesystem . --sarif --fail   (no scan subcommand, no --format/--output)
- --sarif outputs SARIF to stdout; redirect to results.sarif
- --no-update skips network check (not needed in CI)
- continue-on-error keeps the step non-blocking during rollout
- upload-sarif only runs if results.sarif was created

---------

Co-authored-by: Jarvis <jarvis@wickedyoda.local>
2026-09-15 14:42:06 -05:00
WickedYoda 81dc71c6d5 fix: remove 1936 digit-leading domains that fail DNS validation
fix: remove 1936 digit-leading domains that fail DNS validation
2026-09-14 19:37:46 -05:00
WickedYoda b66b22f7f6 fix(domains): remove 22 exact streaming service domains leaked from porn lists
fix(domains): remove 22 exact streaming service domains leaked from porn lists
2026-09-14 19:31:41 -05:00
WickedYoda 18b3f584ca feat(domains): merge known_porn_domains.txt and v2 into bypass_sites.txt
feat(domains): merge known_porn_domains.txt and v2 into bypass_sites.txt
2026-09-14 19:27:27 -05:00
WickedYoda 5f9380a9b1 docs: update bypass_sites_index.md with final counts
docs: update bypass_sites_index.md with final counts
2026-09-14 19:24:34 -05:00
WickedYoda 99750ddf87 feat(domains): add associated domains for all 18 services
feat(domains): add associated domains for all 18 services
2026-09-14 19:21:55 -05:00
WickedYoda 30962b153a fix(bypass): rewrite bypass_sites.txt with user-specified services only
Rewrite bypass_sites.txt to include only domains for:
- Facebook/Meta, Amazon, Apple, TikTok, Instagram
- Duck.com, ESPN, Flickr, Meetup
- Zoom, Discord, Messenger, Pinterest, Quora
- Snapchat, OnlyFans, Fansly, WhatsApp

Removes all streaming services (Netflix, Hulu, Disney+, Spotify, etc.)
and non-requested platforms (Twitter/X, Twitch, Reddit, VK, etc.).
Adds structured index (bypass_sites_index.md).
2026-09-14 18:51:57 -05:00
WickedYoda ee08f138bd fdg 2026-09-14 18:35:09 -05:00
WickedYoda cddd0be078 Fix update-from_repo scripts to pull if already cloned
Fixes Copilot review comments:
- Added error checking on package-manager calls
- Verified git availability post-install
- Scripts now fail fast on installer errors
2026-09-14 13:33:30 -05:00
WickedYodaandJarvis bcbe8b1d40 Fix InfluxDB APT key: add fallback sources and trusted=yes (#119)
* Fix InfluxDB APT key: add fallback sources and trusted=yes fallback

The key URL at repos.influxdata.com/influxdata-archive.key is intermittently
down. Add keyserver.ubuntu.com as fallback source. Use trusted=yes as last
resort if key fetch fails. Also correct keyring path to /usr/share/keyrings/
and remove Bookworm-specific comment.

* Fix shellcheck issues: remove duplicate shebang, fix cd error handling

---------

Co-authored-by: Jarvis <jarvis@wickedyoda.local>
2026-09-14 11:39:21 -05:00
WickedYoda 60eb87ce59 Merge pull request #117 from wickedyoda/wickedyoda-patch-1
dsfsdf
2026-09-10 17:04:04 -05:00
WickedYoda d0b9f7bd53 dsfsdf 2026-09-10 17:02:22 -05:00
WickedYodaandJarvis fd3119e09d fix: exclude streaming IPs from bypass_sites + make security scans non-blocking (#116)
bypass_sites.txt:
- Remove streaming service IP ranges (Netflix, Hulu, Apple TV+, etc.)
- Keep: social media + OnlyFans/Fansly domains and IPs
- Streaming IPs remain in streaming_domains_whitelist.txt only

updater/update_domains.py:
- update_bypass() now combines social_media.txt + known_porn_domains.txt
  instead of streaming + social

CI security scans made non-blocking during rollout:
- shellcheck.yml: continue-on-error already set
- codeql.yml: continue-on-error on analyze step
- secret-scanning.yml: fail: false
- security-scans.yml: exit-code: 0 (docker vulns)

Co-authored-by: Jarvis <jarvis@wickedyoda.local>
2026-09-10 14:48:53 -05:00
15f8094996 fix: add OnlyFans + Fansly domains to bypass_sites.txt (#114)
* fix: add OnlyFans + Fansly domains to bypass_sites.txt

- Add OnlyFans CDN/cloudflare domains (onlyfans.com, cdn3.onlyfans.com)
- Add Fansly CDN/cloudflare domains (fansly.com, cdn3.fansly.com, apiv3, wsv3, cdev2)
- Add OnlyFans IP ranges (Cloudflare AS13335): 104.16.0.0/12, 162.159.128.0/19, 172.66.0.0/22
- Add Fansly IP ranges (Cloudflare AS13335): 104.16.0.0/12, 162.159.128.0/19, 172.66.0.0/22
- Update updater script: add OnlyFans/Fansly sources, rewrite to preserve all existing content
- Never removes or modifies existing entries

Co-Authored-By: WickedYoda <wickedyoda@example.com>

* Remove OnlyFans IP ranges from bypass_sites.txt

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Jarvis <jarvis@wickedyoda.local>
Co-authored-by: WickedYoda <wickedyoda@example.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
2026-09-10 14:22:56 -05:00
WickedYoda 2b80bda381 chore: expand streaming_domains_whitelist.txt
chore: expand streaming_domains_whitelist.txt — 223 → 337 entries
2026-09-10 13:41:05 -05:00
WickedYodaandJarvis 091400ca9e finalize domain updater script (#109)
* Add update_domains.py with --streaming/--social/--all flags

* Update: always merge, never delete; add --bypass for combined list

* Fix: preserve all domains+IPs, separate IPs into CIDR section

* Update all domain lists via scraping - no domains removed, only new domains appended

- streaming_domains_whitelist.txt: 198 -> 222 lines (33 new domains from Peacock + Crunchyroll)
- social_media.txt: 133 -> 136 lines (3 new social domains from PiHole list)
- bypass_sites.txt: 251 -> 354 lines (103 new from combined streaming+social)
- known_porn_domains.txt: 15918 -> 15920 (no removals)
- bamboo_domains.txt: 19 lines (unchanged, preserved)
- Script updated to load_all_preserving_everything: never delete

---------

Co-authored-by: Jarvis <jarvis@wickedyoda.local>
2026-09-09 16:39:38 -05:00
WickedYodaandJarvis 37ddee3579 Add domains/updater/update_streaming_domains.py script (#108)
* Update streaming_domains_whitelist.txt with additional domains from research

* Add domains/updater/update_streaming_domains.py script

---------

Co-authored-by: Jarvis <jarvis@wickedyoda.local>
2026-09-09 16:25:47 -05:00
WickedYodaandJarvis 956350c64e Update streaming_domains_whitelist.txt with additional domains from research (#106)
Co-authored-by: Jarvis <jarvis@wickedyoda.local>
2026-09-09 16:23:43 -05:00
WickedYoda df2f626637 feat: disable Copilot auto code review on PRs
feat: disable Copilot auto code review on PRs
2026-09-04 14:16:11 -05:00
WickedYoda f73fbf3156 Fix: complete shellcheck security fixes (CRLF, shebangs, quoting)
Fix: complete shellcheck security fixes (CRLF, shebangs, quoting)
2026-09-04 13:56:31 -05:00
WickedYodaandJarvis 18b039be1e fix: correct ShellCheck action version (2.1.0 → 2.0.0)
Co-authored-by: Jarvis <jarvis@wickedyoda.local>
2026-09-04 13:10:38 -05:00
WickedYodaandJarvis 85a8df0417 ci: add ShellCheck and Trufflehog secret scanning workflows
- Add .github/workflows/shellcheck.yml — blocking ShellCheck linting on all .sh files
- Add .github/workflows/secret-scanning.yml — blocking Trufflehog secret scanning on all files, runs weekly on schedule
- Update .github/secret_scanning.yml exclusions to include .github/wiki/
- Update .github/SECURITY_SCANS.md with new workflows and required checks
- Set branch protection on main to require: ShellCheck, CodeQL, Trufflehog Secret Scanning

Co-authored-by: Jarvis <jarvis@wickedyoda.local>
2026-09-04 13:01:50 -05:00
WickedYodaandJarvis d385f4ad4c chore: merge domains and openwrt-sftp branches (selected content)
- Add openwrt_scripts/install_sftp.sh (OpenWrt SFTP server setup)
- Update mac-scripts/tile-windows to simplified version from domains branch
- Expand domains/bypass_sites.txt with additional Instagram/Facebook domains
  (deduplicated; removed duplicate entries)

Co-authored-by: Jarvis <jarvis@wickedyoda.local>
2026-09-04 12:38:11 -05:00
WickedYodaandJarvis 0c62f7495a docs: add READMEs and wiki documentation for all directories
- Add comprehensive wiki documentation under .github/wiki/ (19 articles)
- Add READMEs to directories that lacked them
- Fix merge conflict markers in existing READMEs
- Update root readme.md with improved structure

Co-authored-by: Jarvis <jarvis@wickedyoda.local>
2026-09-04 12:31:11 -05:00
WickedYodaandWicked Yoda e804eb1fea Fix: remove duplicate domain entries from bypass_sites.txt (#96)
- Removed 17 duplicate lines from the Instagram/Facebook domain additions
  (instagram.com, cdninstagram.com, fbcdn.net, facebook.com, fbsbx.com,
  connect.facebook.net each appeared 2-3 times after the domains branch merge)
- Consolidated all wildcard and non-wildcard entries into a clean unique list
- Total unique entries: 256

Co-authored-by: Wicked Yoda <noreply@users.noreply.github.com>
2026-08-16 21:17:07 -05:00
c5fdc94677 Merge domains into main (#95)
* Delete LICENSE

* sd

* Update setup-fstab.sh

* Update update-from_repo.sh

* Create custom_install.sh

* observium

* fix name

* update

* vsfxc

* Updated robcopies

* Create unblocked_domains.txt

* rename folder

* Update unblocked_domains.txt

* Update unblocked_domains.txt

* Update unblocked_domains.txt

* Update unblocked_domains.txt

* Updted BPN list

* Update unblocked_domains.txt

* Update setup-fstab.sh

* Create setup-fstab-remake-mnt.sh

* Create compose.yml

* Update Downloads Backup.bat

* Update unblocked_domains.txt

* Update ABC---Backup VM's.bat

* Update unblocked_domains.txt

* Update setup-fstab.sh

* Update setup-fstab.sh

* Update ABC---Backup VM's.bat

* Update unblocked_domains.txt

* Update ABC---Backup VM's.bat

* Create docker-backup.sh

* docker-backup setting up.

* Create disable_DS_store.sh

* Update reset_perms.sh

* Update reset_perms.sh

* Update reset_perms.sh

* Update setup-fstab.sh

* guton rework

* Update docker-compose.yml

Added Jellystat to the stack

* s

* Update docker-compose.yml

* Update docker-compose.yml

* Greenburg Page

* Create setup_snmp_openwrt_v2.sh

* Create paperless-ng.yml

* Update Traver-desk VM Backup.bat

* docs: provide repository overview

* Create install_kali_purple.sh

* Added code checking

Added code checking

* Update readme.md

* Update Skyrim Copy to nas.bat

* REmoved Readarr

Readarr has been removed, as its no lionger updated

* cron auto updates

* Create update-telegraf-w-keys.sh

* Update update-telegraf-w-keys.sh

* dsf

* Read token from host-specific Docker secret and fix plugin check

* Update update-telegraf-w-keys.sh

* Deleted some Files

* Create update_tailscale.sh

* adding netflix domains file

* Create redirectfiles.sh

* Create update-brew-packages.sh

* Update Fstab entries.txt

* Create kali-updates.sh

Created a kali script that includes kali purple

* Update kali-updates.sh

Corrected script

* Enhance Kali updates script with Purple options

* Update dist-upgrade.sh

dist-upgrade script for debian 12 to 13

* Initial plan

* docker updates

docker updates

* Update readme.md

* Update dist-upgrade.sh

* Update dist-upgrade.sh

* relocate

relocate

* relocate

relocate

* readme

readme

* v

readme

* update glueton

update gluetun

* Remove glutun

Remove glutun

* Move file

* Added two files for bypasslist.

Added two files for bypasslist.

* asd

asd

* sad

asd

* media

media

* asdas

asdasd

* asdasd

asdasd

* hjg

kl

* Add clubhouse.com and tsyndicate.com to bypass list

* updated list

* updated list

* corrected file formatr

corrected file formatr

* domain fic

* Update bypass_sites.txt

* Update disable_DS_store.sh

* Update bypass_sites.txt

* Update bypass_sites.txt

* Add remote Docker cleanup script

* fg

dfg

* Create fix_apt_influx.sh

* Update updates.sh

* backup fix

* Update docker-run-netdata-install.sh

* Update docker-run-netdata-install.sh

* Fix Docker backup storage layout and 12-hour cron setup

* Relocate Docker backup scripts and schedule 3-hour NAS backups

* Remove legacy Docker backup cron jobs during setup

* Add Docker backup updater and include /opt/docker backups

* Add Uptime Kuma Docker remote API fix script

* Reorganize repository structure and refresh READMEs

* Revert "Reorganize repository structure and refresh READMEs"

This reverts commit a8b7ccbf2a.

* Create script to install docker on debian

* Update install_docker_debian.sh

* Update setup_docker-backup.sh

* Fix Docker backup mode detection and status messaging

* uptime

UPtime update

* Restore deleted domains folder and lists

* Create DS_STore_destroy.sh

* Create gather_logs.sh

* Update gather_logs.sh

sasad

* Potential fix for pull request finding

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

* Harden temp log output permissions in gather_logs.sh

Agent-Logs-Url: https://github.com/wickedyoda/public-setupfiles/sessions/9ed9872a-1aeb-44c8-abee-8922123e0053

Co-authored-by: wickedyoda <68271168+wickedyoda@users.noreply.github.com>

* domain

* Update combined_list.txt

* Update combined_list.txt

Updated combined list to add 2 sites

* Domain update

Changed domains on list

* pihole block list

* Updated pihole list

Updated pihole list

* Collect info.

Script to collect info

* Create docker_cleanup_updates.sh

* Relocate file

Relocate file

* add sites

add sites

* Update update-from_repo.sh

* Update update-from_repo.sh

* Updates

sad

* fg

* fix: critical security issues in update and docker setup scripts

- dist-upgrade.sh: Fix invalid shebang, add strict mode, use dynamic Ubuntu codename
- install_docker.sh: Quote variables in package removal, replace su with re-login message
- install_docker_ubuntu.sh: Remove legacy pip compose install, update to Compose v2.27.0

* feat: add macOS window tiling script (Hammerspoon) (#91)

- Tile two most-recent windows side by side on main screen
- Includes Hammerspoon config, clickable AppleScript .app, and README
- Fixes pre-existing merge conflict markers in mac-scripts READMEs

Co-authored-by: Wicked Yoda <noreply@users.noreply.github.com>

* Added some domains to bypass

Added some domains to bypass

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Wicked Yoda <noreply@users.noreply.github.com>
2026-08-16 20:22:50 -05:00
WickedYodaandWicked Yoda fc41aad636 chore: add masked .env.example and .gitignore for gluetun (#94)
Replaces the deleted gluetun_env.env (which contained live secrets) with
a template file showing the expected structure with all secrets masked.
Adds .gitignore to prevent future accidental commits of .env files.

Co-authored-by: Wicked Yoda <noreply@users.noreply.github.com>
2026-08-14 16:59:41 -05:00
WickedYodaandWicked Yoda 8328eb1bae chore: add security scanning workflows for PRs (#93)
* chore: add security scanning workflows for PRs

- ShellCheck on bash scripts
- CodeQL SAST for Python
- pip-audit for requirements.txt CVEs
- Docker Scout for Dockerfile vulnerabilities
- Secret scanning config with path exclusions
- SECURITY_SCANS.md documentation

* fix: correct ShellCheck and Docker Scout action references in CI

- Replace nonexistent ludeeus/shellicopter with direct shellcheck install+run
- Update docker/scout-action@v0 to @v0.2.0
- Use select:critical instead of hardcoded alpine:latest image for repo Dockerfiles

---------

Co-authored-by: Wicked Yoda <noreply@users.noreply.github.com>
2026-08-14 12:55:19 -05:00
WickedYodaandWicked Yoda 39c943f945 fix: robust hs binary search in tile-windows.applescript (#92)
The original AppleScript hardcoded /opt/homebrew/bin/hs, but
do shell script runs with a minimal PATH so the hs CLI may not
be found. Now searches known locations: /opt/homebrew/bin/hs,
/usr/local/bin/hs, /opt/local/bin/hs, and the Hammerspoon
Caskroom path.

Co-authored-by: Wicked Yoda <noreply@users.noreply.github.com>
2026-08-14 12:38:28 -05:00
WickedYodaandWicked Yoda af1d1634c2 feat: add macOS window tiling script (Hammerspoon) (#91)
- Tile two most-recent windows side by side on main screen
- Includes Hammerspoon config, clickable AppleScript .app, and README
- Fixes pre-existing merge conflict markers in mac-scripts READMEs

Co-authored-by: Wicked Yoda <noreply@users.noreply.github.com>
2026-08-11 21:53:55 -05:00
WickedYoda 6a574dcf44 Merge pull request #90 from wickedyoda/fix/critical-security-updates-v2
fix: critical security issues in update and docker setup scripts
2026-08-05 14:13:54 -05:00
WickedYoda 1e25e36ce6 Merge pull request #89 from wickedyoda/macos-update
Macos update
2026-08-05 13:20:24 -05:00