lol thanks man
Hoglet (Ash) PRO
Hoglet-33
AI & ML interests
Open source AI, datasets, non-attention based models, parameter efficiency, SLMs, AI for the betterment of humanity. Contact at ash@basicallyai.co
Recent Activity
new activity about 14 hours ago
AxiomicLabs/Open_SLM_Leaderboard:Code & Agentic Benchmarks new activity 7 days ago
Banaxi-Tech/HuggingPolls:Revamp liked a Space 7 days ago
Banaxi-Tech/HuggingPollsOrganizations
replied to their post 7 days ago
reacted to Banaxi-Tech's post with ๐ 12 days ago
reacted to DedeProGames's post with ๐๐ฅ 19 days ago
Post
8,924
๐ Introducing Kiyo-230M-Instruct โ my compact English & Portuguese chat model!
Built on Kiyo-230M-Preview, a base model I pretrained from scratch, Kiyo now has an instruction-tuned release for everyday conversations, rewriting, and lightweight assistant experiments.
๐ง 229.7M parameters
๐ English + Portuguese
๐ฌ Native chat template for multi-turn conversations
๐ 2,048-token context window
๐ฆ 459 MB of BF16 safetensors weights
๐ Apache-2.0 license
For instruction tuning, I used 165,735 conversations from SmolTalk2, smol-smoltalk, UltraChat, and Dolci-Instruct-SFT. Training ran for two complete epochs with assistant-only loss, using a roughly 70% English / 30% Portuguese token mix.
The updated model card includes benchmarks against SmolLM2-135M-Instruct, BananaMind, and Supra2, plus example conversations, CPU measurements, training details, and a Transformers quickstart.
The results are mixed: Kiyo is competitive with these small models across the reported evaluations, while SmolLM2 and BananaMind score higher on the instruction-following benchmarks. Portuguese was a highlight in the small conversational sanity test.
This is an experimental 230M model, with plenty of room to improve reasoning, factual accuracy, and strict instruction following. Iโm excited to share it with people exploring how much we can get from small, accessible models!
๐ค Model & full README:
DedeProGames/Kiyo-230M-Instruct
๐ฌ Try the chat demo:
DedeProGames/kiyo-230m-chat
Try it in English or Portuguese โ Iโd love to see your examples, feedback, and experiments!
Built on Kiyo-230M-Preview, a base model I pretrained from scratch, Kiyo now has an instruction-tuned release for everyday conversations, rewriting, and lightweight assistant experiments.
๐ง 229.7M parameters
๐ English + Portuguese
๐ฌ Native chat template for multi-turn conversations
๐ 2,048-token context window
๐ฆ 459 MB of BF16 safetensors weights
๐ Apache-2.0 license
For instruction tuning, I used 165,735 conversations from SmolTalk2, smol-smoltalk, UltraChat, and Dolci-Instruct-SFT. Training ran for two complete epochs with assistant-only loss, using a roughly 70% English / 30% Portuguese token mix.
The updated model card includes benchmarks against SmolLM2-135M-Instruct, BananaMind, and Supra2, plus example conversations, CPU measurements, training details, and a Transformers quickstart.
The results are mixed: Kiyo is competitive with these small models across the reported evaluations, while SmolLM2 and BananaMind score higher on the instruction-following benchmarks. Portuguese was a highlight in the small conversational sanity test.
This is an experimental 230M model, with plenty of room to improve reasoning, factual accuracy, and strict instruction following. Iโm excited to share it with people exploring how much we can get from small, accessible models!
๐ค Model & full README:
DedeProGames/Kiyo-230M-Instruct
๐ฌ Try the chat demo:
DedeProGames/kiyo-230m-chat
Try it in English or Portuguese โ Iโd love to see your examples, feedback, and experiments!
replied to DedeProGames's post 19 days ago
@DedeProGames Why those languages?
reacted to wayneworkman2012's post with ๐โ๐ 22 days ago
replied to Banaxi-Tech's post 22 days ago
@Banaxi-Tech YES! you should. You are the one that inspired me to start making SLMs in the first place. Just because of some controversy doesn't mean you should stop.
reacted to Banaxi-Tech's post with ๐โค๏ธ 22 days ago
replied to their post 23 days ago
yeah def, it might be easier to do one launch for these though... depends i guess.
replied to their post 23 days ago
@Datdanboi25 just wondering why you would prefer the models to be launched when ready instead of in one big launch?
replied to Banaxi-Tech's post 24 days ago
yeah i know, i have my priorities elsewhere
replied to Banaxi-Tech's post 24 days ago
YAY!
also dang it, i was gonna do that lol. How do you build all of these so quickly?