dsh-model-arena
Manifest validNo project description is available for this repository yet.
dsh-model-arena
Run the same prompt through every model you have, and see the difference without squinting.
Install
dsh plugin --profile web add dsh-model-arena
What it does
- Run a prompt through N models. Same prompt, identical parameters, outputs collected side by side.
- Compare. Line-level diff between any two model outputs.
- Score. Auto-scorer (length, latency, reference match) + manual user ratings (1-5).
- Benchmark suites. Save a named set of prompts + models, re-run after changes, get a regression report.
- Panel. Settings page listing recent runs with drill-down to comparison view.
CLI
dsh-model-arena list # list recent runs
dsh-model-arena compare <run> <modelA> <modelB> # diff two models in a run
dsh-model-arena rate <run> --model M --rating 4 # rate a model output
License
MIT
Comments
Loading…
From the same category
by awesome-dsh-plugin
A curated list of plugins for DeepSeek Harness (dsh) · DeepSeek Harness 插件精选列表
★ 25.3k
CC0-1.0
Python
Nov 19, 2026
by woniuniuniu
DeepSeek Harness 自媒体工作台插件:一句话记灵感,一键生成脚本、封面、配图和分镜
★ 1.6k
↓ 6.9k/wk
MIT
JavaScript
Nov 18, 2026
dsh plugin --profile web add dsh-media-deskby 0xsline
DeepSeek Harness (DSH) ecosystem: curated plugins, tools, and infrastructure from dsh-external/hub and the public dsh-plugin topic.
★ 1.4k
CC0-1.0
Python
Nov 6, 2026
by keli-wen
Hire Google's Antigravity CLI (agy) as a fast Gemini staffer for Claude Code, OpenAI Codex, and DeepSeek Harness.
★ 902
MIT
JavaScript
Nov 19, 2026
dsh plugin --profile agent add agy-staffby Roland0511
MarkText (muya) WYSIWYG Markdown editor for the DeepSeek Harness right sidebar
★ 874
↓ 598/wk
MIT
JavaScript
Nov 7, 2026
dsh plugin --profile web add dsh-marktextby SAOS-3624
Scene-aware storyboard for DeepSeek Harness: 9-16 numbered cells with timestamps + transcript + an audio envelope, packed into ONE image (384 tokens). Two tools: video_storyboard and video_zoom.
★ 580
↓ 17k/wk
MIT
JavaScript
Nov 16, 2026
dsh plugin --profile web add dsh-video-storyboard