1bit.MONSTERDocs GitHub โ†—

๐Ÿ“œ Historical reference โ€” This document references the closed-source FastFlowLM runtime which has since been fully reverse-engineered and replaced. See The story for the current state.

Lemonade Compatibility

Status: Active ยท targeting Lemonade v10.9.0+

1bit.MONSTER NPU and GPU engines are compatible with Lemonade via the OpenAI-compatible /v1/chat/completions endpoint.

How it works

1bit-halo-server (port :8180 โ€” NPU engine) and the ZINC GPU engine both expose the standard OpenAI chat completions API. Lemonade can route omni-modal requests to either backend as a sub-process or remote server.

# lemonade config.yaml
models:
  - name: qwen3-npu
    server:
      url: http://127.0.0.1:9090  # FLM proxy or 1bit-halo-server
      type: openai

Quick start

# 1. Start the 1bit NPU daemon
./npu_engine_all model.q4nx 16

# 2. Lemond auto-discovers or point manually
lemond launch --model qwen3-npu

v10.9.0+ integration

Version compatibility table

1bit.MONSTER Lemonade Status
v2026.07+ v10.9.0 โœ… Verified (Jul 2026)
v2026.04+ v10.3 โœ… Compatible (API stable)
v2026.04+ v10.0+ โœ… Basic chat

Updating

When a new Lemonade release ships:

  1. Check the Lemonade releases for breaking API changes
  2. Smoke-test with 1bit-halo-server on port :9090
  3. Update this doc and the site wiki

MCP support

Both projects expose MCP servers. See: