Soup CLI
Soup CLI is an open-source toolkit for local LLM post-training that streams decoder layers into GPU memory to reduce peak VRAM usage.
Open productWhat it does
About Soup CLI
Soup CLI is an open-source toolkit for LLM post-training on local hardware, developed and maintained by MePlay, Inc. To lower hardware requirements, it retains the base model in system RAM or NVMe and streams decoder layers into the GPU one at a time during fine-tuning. Soup CLI provides tools to convert configurations from existing training frameworks, rank post-training strategies, run chat-template checks, and expose workflows to AI coding assistants.
- Availability:
- launched
- Access:
- free
- Format:
- software
- Platform:
- cli
Pricing at launch: Soup CLI is free software released under the Apache-2.0 license with no paid tier.
Core capabilities
Decoder Layer Streaming
Keeps the base model in system RAM or NVMe and streams decoder layers sequentially into GPU memory to minimize peak VRAM consumption during training.
One-Command Config Migration
Converts existing training setup configurations from tools like LLaMA-Factory, Axolotl, and Unsloth using a single command.
Keep discovering
Related debuts
Continue with products that solve a similar problem or serve the same kind of maker.
