Text Generation
GGUF
English
causal-lm
mixture-of-experts
recurrent
custom-architecture
preview
conversational
Instructions to use Local-Axiom-AI/Sabaki-Preview with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Local-Axiom-AI/Sabaki-Preview with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Local-Axiom-AI/Sabaki-Preview:F16 # Run inference directly in the terminal: llama cli -hf Local-Axiom-AI/Sabaki-Preview:F16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Local-Axiom-AI/Sabaki-Preview:F16 # Run inference directly in the terminal: llama cli -hf Local-Axiom-AI/Sabaki-Preview:F16
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Local-Axiom-AI/Sabaki-Preview:F16 # Run inference directly in the terminal: ./llama-cli -hf Local-Axiom-AI/Sabaki-Preview:F16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Local-Axiom-AI/Sabaki-Preview:F16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf Local-Axiom-AI/Sabaki-Preview:F16
Use Docker
docker model run hf.co/Local-Axiom-AI/Sabaki-Preview:F16
- LM Studio
- Jan
- vLLM
How to use Local-Axiom-AI/Sabaki-Preview with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Local-Axiom-AI/Sabaki-Preview" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Local-Axiom-AI/Sabaki-Preview", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Local-Axiom-AI/Sabaki-Preview:F16
- Ollama
How to use Local-Axiom-AI/Sabaki-Preview with Ollama:
ollama run hf.co/Local-Axiom-AI/Sabaki-Preview:F16
- Unsloth Desktop
- Pi
How to use Local-Axiom-AI/Sabaki-Preview with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Local-Axiom-AI/Sabaki-Preview:F16
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Local-Axiom-AI/Sabaki-Preview:F16" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use Local-Axiom-AI/Sabaki-Preview with Docker Model Runner:
docker model run hf.co/Local-Axiom-AI/Sabaki-Preview:F16
- Lemonade
How to use Local-Axiom-AI/Sabaki-Preview with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Local-Axiom-AI/Sabaki-Preview:F16
Run and chat with the model
lemonade run user.Sabaki-Preview-F16
List all available models
lemonade list
- Hermes Agent
How to use Local-Axiom-AI/Sabaki-Preview with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Local-Axiom-AI/Sabaki-Preview:F16
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default Local-Axiom-AI/Sabaki-Preview:F16
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Local-Axiom-AI/Sabaki-Preview with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Local-Axiom-AI/Sabaki-Preview:F16
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "Local-Axiom-AI/Sabaki-Preview:F16" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Update README.md
Browse files
README.md
CHANGED
|
@@ -14,7 +14,7 @@ tags:
|
|
| 14 |
|
| 15 |
# Sabaki Preview
|
| 16 |
|
| 17 |
-
Sabaki
|
| 18 |
|
| 19 |
This upload is a research preview, not a polished assistant. It is here for people who want to inspect the design, run local experiments, or continue post-training. Expect rough edges, including uneven instruction following, repetition, factual mistakes, and sensitivity to prompts.
|
| 20 |
|
|
@@ -50,8 +50,6 @@ Most layers use Kimi Delta Attention (KDA), which carries a fixed-size recurrent
|
|
| 50 |
|
| 51 |
The feed-forward side is sparse in all but the first block. For each token, the router selects two of eight routed experts and combines them with two shared experts. Persistent routing biases help keep expert use balanced without adding a separate balancing loss.
|
| 52 |
|
| 53 |
-

|
| 54 |
-
|
| 55 |
The complete layer schedule is:
|
| 56 |
|
| 57 |
| Blocks | Sequence mixer | Feed-forward path |
|
|
|
|
| 14 |
|
| 15 |
# Sabaki Preview
|
| 16 |
|
| 17 |
+
Sabaki our first attempt at a small, experimental language model. It was trained from scratch with a custom architecture.
|
| 18 |
|
| 19 |
This upload is a research preview, not a polished assistant. It is here for people who want to inspect the design, run local experiments, or continue post-training. Expect rough edges, including uneven instruction following, repetition, factual mistakes, and sensitivity to prompts.
|
| 20 |
|
|
|
|
| 50 |
|
| 51 |
The feed-forward side is sparse in all but the first block. For each token, the router selects two of eight routed experts and combines them with two shared experts. Persistent routing biases help keep expert use balanced without adding a separate balancing loss.
|
| 52 |
|
|
|
|
|
|
|
| 53 |
The complete layer schedule is:
|
| 54 |
|
| 55 |
| Blocks | Sequence mixer | Feed-forward path |
|