Neuro-Genesis Engine
Self-Modifying Mixture-of-Experts300-step self-expanding MoE · 4 → 11 experts · ROCm 7.2
Built a self-modifying Mixture-of-Experts system that detects training plateaus, asks a local Gemma model to generate new PyTorch expert modules, and hot-swaps validated code into the live network. An AST screen, sandboxed execution, smoke tests, and automatic rollback protect the training run while the model expands from four to eleven experts on AMD ROCm hardware.
- Detected loss plateaus and expanded from 4 to 11 experts
- Generated new PyTorch modules with local Gemma-2-2b-it
- Validated code through AST screening, sandboxing, and rollback



