H3-metal: Native MiniMax-H3 Inference Engine for Apple Silicon

Original: H3-metal – Native MiniMax-H3 inference for Apple Silicon

Why This Matters

Native Apple Silicon inference engines lower hardware barriers for running large multimodal models locally without cloud dependency.

Developer antirez has released h3.c, an open-source native inference engine for MiniMax-H3 models targeting Apple Silicon Macs, using Metal GPU acceleration. The project is structured as incremental working vertical slices, starting with deterministic host/model metadata.

antirez has published h3.c on GitHub, a native C-based inference engine designed to run MiniMax-H3 multimodal models directly on Apple Silicon hardware. The project leverages Apple's Metal GPU framework for accelerated computation, with dedicated shader files (h3_shaders.metal) and GPU abstraction layers.

The codebase supports text, vision, audio, and video modalities, as evidenced by separate modules for vision encoding, audio VAE, video VAE, and video encoding. It also includes safetensors weight loading, a tokenizer, a CLI interface, and FFmpeg integration for media handling.

The repository description states the project is being built as 'a sequence of working vertical slices: deterministic host/model metadata first, then portable Meta...' — indicating an iterative, bottom-up development approach. The project has already accumulated 570 stars and 27 forks on GitHub, suggesting significant community interest. It is released under the MIT license.

Source

github.com — Read original →