github.devotd.
NewLLM infrastructure

modelscope/ms-swift v4.6.0 — LLM and multimodal training framework

The ModelScope community project ms-swift has published release v4.6.0, covering training, evaluation, quantization and deployment of 600+ LLMs and 300+ multimodal models through a single CLI.

Repositorymodelscope/ms-swift ↗

The ModelScope community project ms-swift has published release v4.6.0, covering training, evaluation, quantization and deployment of 600+ LLMs and 300+ multimodal models through a single CLI.

GitHub description: Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).

stars
★ 15.9K
Forks
1.8K
Language
Python
License
Apache-2.0
Latest release
v4.6.0
Read original source ↗View on GitHub ↗

The latest release of modelscope/ms-swift is v4.6.0. It is a training and deployment framework for large language models (LLMs) and multimodal models provided by the ModelScope community, written in Python and released under the Apache-2.0 license. However, the individual changes in v4.6.0 are not broken down in this record.

Its broad coverage stands out first. Continued pre-training (CPT), supervised fine-tuning (SFT), alignment training (DPO), GRPO-family reinforcement learning algorithms, inference, evaluation, quantization and deployment are all handled by a single CLI. The README states support for more than 600 LLMs and more than 300 multimodal models, and cites language models such as Qwen3.8, DeepSeek-V4 and GLM-5.1 alongside multimodal models such as Qwen3-VL and InternVL3.5. It offers both full-parameter training and lightweight fine-tuning such as PEFT and LoRA, and a web user interface can run training, inference, evaluation and quantization. The repository description lists AAAI 2025.

However, the evaluation records contain no performance or quality scores, only a momentum metric of 4.4 (out of 10). No own benchmarks showing training speed or stability are presented either, so judging by the numbers how well it works is premature. It is worth a first look for those bundling several models into a single CLI pipeline; for now, the only certain thing is the feature scope stated in the README.