dsh-model-arena
Manifest validNo project description is available for this repository yet.
dsh-model-arena
Run the same prompt through every model you have, and see the difference without squinting.
Install
dsh plugin --profile web add dsh-model-arena
What it does
- Run a prompt through N models. Same prompt, identical parameters, outputs collected side by side.
- Compare. Line-level diff between any two model outputs.
- Score. Auto-scorer (length, latency, reference match) + manual user ratings (1-5).
- Benchmark suites. Save a named set of prompts + models, re-run after changes, get a regression report.
- Panel. Settings page listing recent runs with drill-down to comparison view.
CLI
dsh-model-arena list # list recent runs
dsh-model-arena compare <run> <modelA> <modelB> # diff two models in a run
dsh-model-arena rate <run> --model M --rating 4 # rate a model output
License
MIT
Comments
Loading…
From the same category
by awesome-dsh-plugin
A curated list of plugins for DeepSeek Harness (dsh) · DeepSeek Harness 插件精选列表
★ 17.8k
CC0-1.0
Python
Oct 5, 2026
by 0xsline
DeepSeek Harness (DSH) ecosystem: curated plugins, tools, and infrastructure from dsh-external/hub and the public dsh-plugin topic.
★ 1.1k
CC0-1.0
Python
Sep 30, 2026
by pax-beehive
Open-source CLI, schemas, resolver, and DSH agent tools for DSH Plugin Hub
★ 458
MIT
TypeScript
Sep 22, 2026
by yjh051108
推荐组件（非必须）：DeepSeek Harness 运行时注入器；已随 dsh-routing-suite 单仓库化保留，本仓库继续维护/发布。
★ 166
TypeScript
Sep 18, 2026
dsh plugin --profile web add @dsh-external/dsh-super-injectorby xiajiajun516
DeepSeek Harness (DSH) backup & restore plugin — export, import, migrate and sync your complete DSH configuration, plugins, MCP servers, skills and workspace. One-click migration to another machine.
★ 155
MIT
TypeScript
Oct 5, 2026
dsh plugin --profile web add dsh-config-managerby jigjoy-ai
A CLI that turns a goal into a pull request - and a sandbox for testing concurrent AI coding agents on the Mozaik runtime.
★ 124
MIT
TypeScript
Oct 2, 2026