Same model.
Less waiting.
CUDA attention optimizations for Qwen3.8-27B Unsloth Q6 on the RTX 5090. Faster decode, with the same weights and context settings.
Explore the kernelsmeasured decode throughput
Big models. Your hardware.
I push local AI further with faster kernels,
better tools, and a lot of curiosity.
Interactive artwork.
Not live GPU telemetry.
SELECTED PUBLIC WORK
Practical experiments turned into tools you can inspect, reproduce, and build on.
CUDA attention optimizations for Qwen3.8-27B Unsloth Q6 on the RTX 5090. Faster decode, with the same weights and context settings.
Explore the kernelsmeasured decode throughput
THE RECEIPTS
A fast screenshot is easy. A reproducible comparison is the part I care about.
Text-only profile. This measures decode, not total request latency. The initial 190K prompt still took about 148 seconds to process.
The workload is a long-prefix synthetic test, not a completed coding benchmark. Six paired response streams and five deterministic attention outputs matched exactly on the recorded tests. That is not a universal guarantee of unchanged quality. Peak VRAM and initial prompt processing did not improve. Vision-loaded timing uses text input; image support was verified separately.
Inspect the raw evidence ↗THE HUMAN BEHIND THE MACHINE
Independent.
Curious by default.
That question is usually where my projects start.
I’m an independent developer exploring what consumer hardware can do with better software. I work across local inference, GPU optimization, and agent tooling — testing ideas, breaking things in controlled experiments, and documenting what actually holds up.
Not every experiment wins. The useful ones become public code, measured results, and instructions someone else can follow. The goal is simple: more capable tools, with more control in the hands of the person using them.
INDEPENDENT WORK NEEDS INDEPENDENT SUPPORT
Every coffee goes toward more experiments, more testing, and more things worth sharing.