CryptoGemma-4B-v1

The first open-source crypto-specialized LLM. Fine-tuned from Google's Gemma 4 E4B on 56,000+ crypto-specific examples.

What is CryptoGemma?

CryptoGemma is a 4B parameter language model specialized for cryptocurrency and blockchain analysis. Built by SkillForge, it understands:

  • Token analysis โ€” fundamental and on-chain metrics
  • Scam detection โ€” smart contract risk assessment
  • Portfolio advice โ€” allocation and rebalancing strategies
  • Technical analysis โ€” chart patterns, indicators, market structure
  • DeFi protocols โ€” liquidity, yield farming, lending
  • Blockchain security โ€” audit patterns, vulnerability detection
  • Market sentiment โ€” social signals, fear & greed analysis

Training Details

Parameter Value
Base model google/gemma-4-E4B-it (4B params)
Dataset size 56,612 examples
Method LoRA (8 layers)
Iterations 500
Learning rate 1e-5
Train loss 0.120
Validation loss 0.153
Training time ~1.5 hours on Mac Studio M2 Ultra
Framework mlx-lm

Dataset Composition

Source Examples
Cogneo Crypto Sentiment 43,027
Forta Malicious Contracts 12,000
HuggingFace open datasets (Bitcoin, smart contracts, blockchain) 3,267
ChainGPT-generated Q&A (16 categories) ~300
Total (after dedup) 56,612

Usage

With Ollama

# Download and run
ollama run cryptogemma

# Example
>>> Analyze Bitcoin's current market structure and key support levels

With Transformers

from transformers import AutoTokenizer, AutoModelForCausalLM

model = AutoModelForCausalLM.from_pretrained("SkillForge/CryptoGemma-4B-v1")
tokenizer = AutoTokenizer.from_pretrained("SkillForge/CryptoGemma-4B-v1")

prompt = "Analyze the risk factors of this DeFi protocol..."
inputs = tokenizer(prompt, return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=512)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

With MLX (Apple Silicon)

from mlx_lm import load, generate

model, tokenizer = load("SkillForge/CryptoGemma-4B-v1")
response = generate(model, tokenizer, prompt="What are the key metrics for evaluating a DeFi token?", max_tokens=512)

Skills

CryptoGemma powers 4 ready-to-use skills:

  1. Token Analyzer โ€” ticker to full breakdown
  2. Scam Detector โ€” contract address to risk score
  3. Portfolio Advisor โ€” positions to recommendations
  4. TA Generator โ€” trading pair to technical analysis

Links

License

Apache 2.0 (same as base Gemma model)

Citation

@misc{cryptogemma2026,
  title={CryptoGemma-4B-v1: Open-Source Crypto-Specialized LLM},
  author={SkillForge Team},
  year={2026},
  url={https://huggingface.co/SkillForge/CryptoGemma-4B-v1}
}
Downloads last month
236
Safetensors
Model size
8B params
Tensor type
BF16
ยท
MLX
Hardware compatibility
Log In to add your hardware

Quantized

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for midnigter/CryptoGemma-4B-v1

Finetuned
(496)
this model