Skip to content
View sirfyyn's full-sized avatar

Block or report sirfyyn

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
sirfyyn/README.md

Hi, I'm Max 👋

IT administrator by day (document management and digitalisation in public administration), AI builder by night. Trained as an IT systems specialist, studied IT security, taught myself the rest. I run my own AI stack at home in Balingen, Germany — one workstation, a small k3s cluster and a lot of nights — and I publish what I find along the way.

No datacenter. No enterprise budget. Just consumer and workstation hardware and a stubborn refusal to accept "unsupported" as the end of the story.

Released

FLE — Fast Local Experts · v1.1.0 · MIT A llama.cpp fork for running large Mixture-of-Experts models on one 32 GB GPU with the routed experts in host RAM: a GPU expert cache with a byte budget and warm start, cache hits on the GPU overlapped with misses on the CPU, MTP speculative decoding with the model's own head, and a leaner prefill. On Qwen3.8-Flash-Next (89 GB) it decodes at roughly 90 tok/s in my own paired measurements (RTX PRO 4500 32 GB + Ryzen 9950X3D). Technical report · Zenodo · GGUF models · REAP448 · “Making Rhea fast” films

FLE Studio · v0.3.0 · MIT A local chat and lab for llama.cpp and the FLE engine: GGUF model loader, live inference data, launch profiles. No account, no telemetry, macOS, Linux and Windows. Website

FYOS — For Your Own Sake · v0.1.1 · Apache-2.0 A personal operating system in the browser that runs entirely on your side: a desktop shell with windows and apps, an MCP hub that bundles tools and interfaces from plugins, an installer for Docker Compose or Kubernetes, and an agent that works with those tools and asks before heavy steps. fyos-os (shell, hub, installer) · fyos-agent (the agent, an OpenClaw mod) · fyos-plugin-vorlage (template for your own plugin)

Contexierge · Claude Code plugin · MIT Claude keeps its own session notebook, injected verbatim after every compaction, so what matters survives long sessions instead of depending on the automatic summary.

Earlier

Project What it is
consumer-llm-patches 11 patches from fine-tuning Gemma4 26B on a single RTX 4090, with an honest per-patch validation status
three-level-ai-development A method for building with AI: human vision, persistent architect, execution AI
snowmelting-method Companion method to the above

How I work

  • Every claim gets a measurement, and I retract when new evidence says otherwise.
  • I build with several AI coding agents in parallel; the decisions stay with me.
  • I build for myself first. Sensible issues, PRs and hints are welcome; there is no support promise.

🌐 sirfyyn.de · 🤗 huggingface.co/sirfyyn · ▶️ YouTube @sirfyyn

Pinned Loading

  1. FastLocalExperts FastLocalExperts Public

    FLE – Fast Local Experts: a llama.cpp fork for large Mixture-of-Experts models. Qwen3.8-Flash-Next (89 GB) at ~90 tokens/s on one 32 GB GPU with an expert cache and MTP speculative decoding. MIT.

    C++ 2

  2. fle-studio fle-studio Public

    A local LLM chat and lab for llama.cpp and the FLE engine: GGUF model loader, live inference data, launch profiles, MCP tools. No account, no telemetry. macOS, Linux and Windows.

    Python 2

  3. fyos-os fyos-os Public

    FYOS (For Your Own Sake): a personal operating system in the browser - desktop shell, MCP hub and installer. Runs entirely on your side.

    Python 1

  4. claude-contexierge claude-contexierge Public

    Contexierge (context + concierge): Claude Code plugin — Claude keeps its own session notebook, injected verbatim after every compaction

    Python 1

  5. fyos-agent fyos-agent Public

    FYOS agent foundation: an OpenClaw mod (image, version-bound patches, behaviour plugins, workspace templates) for FYOS - For Your Own Sake.

    JavaScript 1

  6. fyos-plugin-vorlage fyos-plugin-vorlage Public

    Template plugin for FYOS (For Your Own Sake): a runnable sample with tools, a hub app, an installer catalog entry and a skill.

    Python 1