๐Ÿ“ฆ The Offline Arsenal: Local AI, Console Emulators, OSINT & Serverless Transfer

:package: A curated repo dump: local AI, PS5/PS3 emulators, OSINT lab & serverless file transfer โ€” all free & offline.



Everything below runs on hardware you already own โ€” no datacenter, no console disc, no cloud bill.
Repos and tools only, grouped by what they unlock. Plain-English first line, real tools under it.
Open a section โ–ผ

โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”

๐Ÿฆ 744B AI model on a 25GB laptop โ€” Colibrรฌ + disk-streaming MoE engines (no GPU)

Plain: a model that normally needs a server farm runs on a normal PC by keeping most of itself on your SSD and pulling in only the ~11GB it needs per word.

Colibrรฌ โ€” 744B GLM-5.2, ~25GB RAM, one 2,400-line C file, no GPU/Python โ€” https://github.com/JustVugg/colibri

Same โ€œdonโ€™t load what you donโ€™t useโ€ trick, more engines:
โ€ข KTransformers โ€” full 671B DeepSeek on one GPU โ€” https://github.com/kvcache-ai/ktransformers
โ€ข PowerInfer โ€” hot neurons on GPU, cold on CPU โ€” https://github.com/SJTU-IPADS/PowerInfer
โ€ข AirLLM โ€” 70B on a 4GB card, one layer at a time โ€” https://github.com/lyogavin/airllm
โ€ข prima.cpp โ€” split a model across your phones + laptops โ€” https://github.com/OpenCPIL/prima.cpp
โ€ข exo โ€” home AI cluster from everyday devices โ€” https://github.com/exo-explore/exo
โ€ข llamafile โ€” whole model as one file that runs anywhere โ€” https://github.com/mozilla-ai/llamafile

First run does a one-time weight conversion and thrashes the disk โ€” normal, not a bug.

๐ŸŒฑ 27B multimodal model on a phone โ€” Bonsai 27B + 1-bit/ternary quantization stack

Plain: store each weight as just -1/0/+1 instead of a 16-bit number โ†’ file shrinks ~10ร— and the math gets cheap โ†’ a 27B model fits on a handset.

Bonsai 27B (Qwen 3.6) โ€” 1-bit 3.9GB @ ~11 tok/s on iPhone 17 Pro, or ternary 5.9GB @ ~95% quality, full multimodal โ€” https://huggingface.co/collections/prism-ml/bonsai-27b

โ€ข BitNet โ€” 100B at reading speed on one CPU (reference impl) โ€” https://github.com/microsoft/BitNet
โ€ข T-MAC โ€” the low-bit lookup-table kernels underneath โ€” https://github.com/microsoft/T-MAC
โ€ข iFairy โ€” the weird edge: weights as complex {ยฑ1,ยฑi} โ€” https://arxiv.org/abs/2508.05571
โ€ข Jan โ€” offline ChatGPT app โ€” https://github.com/janhq/jan
โ€ข LocalAI โ€” drop-in OpenAI API on your own box โ€” https://github.com/mudler/LocalAI
โ€ข MLX โ€” Apple-Silicon native, unified memory = no VRAM wall โ€” https://github.com/ml-explore/mlx

๐ŸŽฎ PS5 booting on PC โ€” SharpEmu status + working emulators + static recompilation

Plain: run console games on a PC. Emulators fake the hardware; recompilers translate the game into native code that just runs.

SharpEmu โ€” new PS5 emu (C#); boots real games to a video loop, runs small 2D titles. Boots โ‰  plays โ€” years from GTA6, but itโ€™s the foundation โ€” https://github.com/sharpemu/sharpemu

Working today:
โ€ข shadPS4 โ€” PS4 โ€” https://github.com/shadps4-emu/shadPS4
โ€ข RPCS3 โ€” PS3 โ€” https://github.com/RPCS3/rpcs3
โ€ข xemu โ€” original Xbox โ€” https://github.com/xemu-project/xemu
โ€ข Vita3K โ€” PS Vita โ€” https://github.com/Vita3K/Vita3K

Static recompilation (game โ†’ native C, full speed, no interpreter):
โ€ข N64Recomp โ€” N64 ROM โ†’ PC port โ€” https://github.com/N64Recomp/N64Recomp
โ€ข XenonRecomp โ€” Xbox 360 โ†’ C++ โ€” https://github.com/hedge-dev/XenonRecomp
โ€ข xboxrecomp โ€” original Xbox x86 โ†’ C โ€” https://github.com/sp00nznet/xboxrecomp
โ€ข MiSTer FPGA โ€” preservation in hardware, not software โ€” https://github.com/MiSTer-devel/Main_MiSTer

๐Ÿ•ต๏ธ One-download OSINT lab โ€” Trace Labs VM + username/email/phone recon tools

Plain: a ready Linux VM with every open-source-intelligence tool preloaded (built for legal missing-persons work); wipes its own data on exit.

Trace Labs OSINT VM โ€” Sherlock, PhoneInfoga, SpiderFoot, sn0int, theHarvester, h8mail, Sublist3r, ExifTool, Steghide, Shodan CLI + Obsidian vault โ€” https://github.com/tracelabs/tlosint-vm

Add the modern hunters:
โ€ข Maigret โ€” one username across 3,100+ sites โ€” https://github.com/soxoj/maigret
โ€ข Blackbird โ€” username + email, fast โ€” https://github.com/p1ngul1n0/blackbird
โ€ข Osmedeus โ€” turn recon into a repeatable workflow โ€” https://github.com/j3ssie/osmedeus
โ€ข WhatsMyName โ€” the dataset every namechecker runs on โ€” https://github.com/WebBreacher/WhatsMyName

Public info, legal use โ€” thatโ€™s what the kit is for.

๐Ÿ“ค No-server direct file transfer + P2P dial-by-key โ€” PairDrop, iroh, Trystero, LocalSend

Plain: send files straight between two devices with nothing in the middle โ€” no upload, no cloud, no size cap.

PairDrop โ€” browser AirDrop for any OS; same Wi-Fi auto-connects, else a 6-digit code; self-hostable โ€” https://github.com/schlagmichdoch/PairDrop

โ€ข LocalSend โ€” native-app cousin of PairDrop โ€” https://github.com/localsend/localsend
โ€ข iroh โ€” dial any device by its public key over the open internet โ€” https://github.com/n0-computer/iroh
โ€ข Trystero โ€” serverless browser multiplayer over BitTorrent/Nostr/MQTT โ€” https://github.com/dmotz/trystero

๐Ÿงญ Rest of the local-first stack โ€” mesh VPN, offline Wikipedia, local speech/image AI, PDFโ†’text, LLM compression, one-file DBs, anonymous storage

Own your network (self-hosted mesh VPN):
โ€ข Nebula โ€” https://github.com/slackhq/nebula
โ€ข NetBird โ€” https://github.com/netbirdio/netbird
โ€ข Headscale โ€” https://github.com/juanfont/headscale
โ€ข AmneziaVPN โ€” looks like HTTPS, beats blocks โ€” https://github.com/amnezia-vpn/amnezia-client

Keep knowledge offline:
โ€ข Kiwix โ€” all of Wikipedia in one file โ€” https://github.com/kiwix/kiwix-tools
โ€ข ArchiveBox โ€” freeze any site โ€” https://github.com/ArchiveBox/ArchiveBox
โ€ข monolith โ€” page โ†’ single HTML โ€” https://github.com/Y2Z/monolith
โ€ข yt-dlp โ€” pull media from 1000+ sites โ€” https://github.com/yt-dlp/yt-dlp

Run the rest of AI locally:
โ€ข whisper.cpp โ€” speech-to-text on a CPU โ€” https://github.com/ggml-org/whisper.cpp
โ€ข stable-diffusion.cpp โ€” image gen, no Python โ€” https://github.com/leejet/stable-diffusion.cpp
โ€ข Kokoro โ€” 82M text-to-speech โ€” https://github.com/hexgrad/kokoro
โ€ข Marker โ€” any PDF โ†’ clean Markdown โ€” https://github.com/datalab-to/marker

LLM-as-compressor (beats zip):
โ€ข ts_zip / NNCP (Bellard) โ€” https://bellard.org/ts_zip/
โ€ข cmix โ€” ratio king โ€” https://github.com/byronknoll/cmix

Servers-optional apps + one-file databases:
โ€ข cr-sqlite โ€” SQLite that syncs peer-to-peer โ€” https://github.com/vlcn-io/cr-sqlite
โ€ข Automerge โ€” merge edits with no server โ€” https://github.com/automerge/automerge
โ€ข DuckDB โ€” SQLite for analytics โ€” https://github.com/duckdb/duckdb
โ€ข CozoDB โ€” graph+vector+Datalog in one file โ€” https://github.com/cozodb/cozo

Anonymous / content-addressed storage:
โ€ข Veilid โ€” Cult of the Dead Cow, Tor-like P2P โ€” https://veilid.com
โ€ข iroh-blobs โ€” verified blobs over QUIC โ€” https://github.com/n0-computer/iroh-blobs
โ€ข Perkeep โ€” content-addressed personal store โ€” https://github.com/perkeep/perkeep

๐Ÿ’ก Where this actually pays off โ€” offline, blocked, delisted, air-gapped (5 real situations)

โ€ข :airplane: No internet, still need AI โ€” on a plane or dead zone, Colibrรฌ/Bonsai answer from your SSD, not a server.
โ€ข :prohibited: API blocked or too pricey โ€” run a 27B model straight off your phone, no account, no bill.
โ€ข :video_game: Game delisted or console died โ€” an emulator/recomp keeps the library you paid for alive on PC.
โ€ข :magnifying_glass_tilted_left: Vetting a stranger from just a handle โ€” one VM runs the whole recon kit, then wipes itself on close.
โ€ข :electric_plug: Client site, USB locked, no shared drive โ€” two browser tabs send a 4GB file directly, nothing uploaded.

โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”

Every tool above is open-source, runs locally, and works offline. No accounts, no bills, no middleman.

Every subscription is a lock. Every repo above is a key.

:up_arrow: The Core-Community team has AI-upgraded the topic above.

1 Like