DSH Plugins Marketplace

DSH Plugins

Plugins

/

Awesome-Gaussian-Skills

j

Awesome-Gaussian-Skills

Manifest valid★ 161

图形学与3DGS、空间智能持续更新论文;AI Agent Skills for 3D Gaussian Splatting, NeRF & Computer Graphics Research. 800+ methods, 25categories, 12skills. OpenClaw / Claude Code compatible.

hasBundlePatchMachine translated
3D Gaussian Splatting Methods Overview

Awesome Gaussian Skills

The Most Comprehensive 3D Gaussian Splatting Catalog — 900 methods, 23 Categories, Interactive Explorer

You shouldn't search 20 repos for 3DGS papers. This is the only one you need.

Stars Live Demo Methods Skills Bug Patterns License PRs Welcome

English | 中文

Why This Repo?

Other awesome lists give you paper titles. We give you paper titles + an AI toolkit that makes you faster.

What You NeedOther ListsThis Repo
Browse papersStatic markdown tableInteractive explorer: search, filter, sort
Compare methodsOpen 2 papers side by side10+ dimension auto-comparison
Avoid code bugsDiscover after submission104 known bug pattern detection
Design experimentsGuess baselines & ablationsVenue-tailored experiment plan
NeRF → 3DGSTrial-and-error portingStep-by-step migration guide
CAD → 3DGSNo coverage40+ method conversion pipeline
Patent filingManual from scratchAuto-generated claims & specs

Live Demo

Try the Interactive Method Explorer →

Search 900 Methods instantly, filter by category, sort by citations, click any method card for details.

Integrations

This repo ships as both AI agent skills and an MCP server, so it works across agent runtimes and MCP clients:

ClientHow to use
DSH (DeepSeek Harness)dsh plugin --profile web add jaccen/Awesome-Gaussian-Skills — the 15 skills + MCP renderer auto-mount via cordis.patch.yml
Claude Code / OpenClawskills load directly from skills/ (see CLAUDE.md); MCP server via the config below
Claude Desktop / Cursor / Clinecopy the MCP stdio config from .marketplace/mcp-servers/client-configs.md
Any MCP clientcommand: node, args: [/path/to/mcp-server/dist/index.js], transport: stdio (21 core tools)

The MCP server exposes 21 tools (import_scene, set_camera, modify_gaussians, render_frame, sculpt_pipeline, SLAT latent editing, …) — see mcp-server/README.md and .marketplace/mcp-servers/mcp-metadata.json.

📖 Online Book: Spatial & Embodied Intelligence (New!)

** NEW (Jul 2026)** —A full open-source technical book, built around 3D Gaussian Splatting as the spine and weaving together spatial intelligence and embodied intelligence into one closed loop: representation → perception → planning → action.

📖 Read the Book →

Spatial & Embodied Intelligence Book —Cover & Chapter Overview

Core formula (echoing Agent = LLM + Context + Tools):

Embodied Agent = Spatial Representation × Perception × Planning × Action

What's inside — 13 chapters + hands-on prelude & capture SOP, every method name anchored to this repo's real data (900 Methods, 23 categories, 15 skills), zero fabrication:

#ChapterFocus
引言Why this bookWhy 3DGS is the key puzzle piece of Physical AI
前Landing prelude: should you, can youTech-selection matrix, eight cases where you should NOT use 3DGS, three reading paths
CH 01NeRF → 3DGS: A paradigm leapExplicit vs implicit, the three innovations, the alpha-compositing formula
CH 02The math & engineering coreAnisotropic Gaussians, differentiable rasterization, adaptive density control, CUDA
操Data-capture SOPDevice selection, trajectory design, seven exposure hard rules, scale calibration —the first step that decides your quality ceiling
CH 03From scene to worldLarge-scale, dynamic/4D, GS-SLAM, compression & deployment
CH 04Semantic GaussiansCLIP/DINO feature distillation, open-vocabulary 3D segmentation
CH 05Editing · Generation · Asset-izationFeed-forward reconstruction, SDS generation, animatable assets, PBR relighting
CH 06Embodied intelligence basicsVLA lineage (RT/π0/GR00T/ReconVLA), simulation, Sim2Real
CH 073DGS as robot spatial memoryGS-SLAM, map-as-renderer, three tiers of spatial memory
CH 08Object-level & articulated understandingPart-level Gaussians, URDF bridging, the CAD·Mesh·3DGS triangle
CH 09Agent-driven digital twinsMCP rendering pipeline, gesture interaction, the perception-action loop
CH 10World models & the futureSix schools of world models, 3DGS×World Model, spatial foundation models, Physical AI
CH 11Security, provenance & copyright3DGS watermarking, GaussTrace forensics, adversarial attacks, IP management
CH 12Capture-to-delivery: the end-to-end pipelineTen-stage tool selection & pitfalls, formats & coordinate systems, cost/duration estimates, project failure modes
CH 13Industry playbooks: six verticalsMuseums & tourism, e-commerce, industrial inspection, AD simulation, embodied robots, surveying & mapping
附AppendixDatasets, evaluation metrics, delivery-metric conversion & acceptance-report templates
实Practice index: from book to engineering15 engineering skills · 34 MCP tools · 900+ method explorer, chapter-to-runnable-resource mapping
后记Will 3DGS be eaten?Why explicit representations will be compressed, not consumed

Each chapter ends with hands-on exercises and links back to the repo's method tables, references/, and skills —so reading the book and doing the engineering are one seamless flow.

Highlights you won't find in a paper list:

  • The six schools of world models (2026 taxonomy) and where 3DGS sits as the only representation that is simultaneously renderable, differentiable, and editable.
  • How GS-World, ManiGaussian, and OrbiSim turn 3DGS into a differentiable simulation engine.
  • A three-tier model of robot spatial memory (geometric → appearance → semantic) and where current GS-SLAM actually stands.
Why we wrote it (and how it relates to this repo)

This book is the narrative layer over the repo's data layer. The repo gives you 900 method names, abstracts, and 15 engineering skills —but not the through-line that connects them. The book supplies that through-line: it argues why 3DGS became the bridge between spatial intelligence and embodied intelligence, and walks every chapter back to concrete methods and skills you can use today. Read the book to understand the map; use the repo to ship the territory.

What's New (Oct 2026)

Latest Update (Oct 20, 2026): v0.9.8 — World Models Category Reinforcement (896 → 900) ⭐

Targeted reinforcement of the thinnest category. 4 new arXiv-verified 3DGS-based World Model / Spatial Intelligence methods admitted, taking the library from 896 to 900. The World Models & Spatial Intelligence category grew from 8 → 12 methods: HY-World 2.0, F3DGS (federated multi-agent world modeling), 4DGS-WAM (object-centric world action model), Cloth-Splatting (3DGS cloth state estimation). Two missing arXiv IDs backfilled (Holi-Spatial → 2603.07660, Spatial-TTT → 2603.12255); two entries flagged unverified pending source check (APEIRIA, S²AM3D). GSMem found already in library under Embodied AI & Robotics — not duplicated. See changelog.

Previous Update (Oct 12, 2026): v0.9.7 — Manual Admission: 15 New Methods (881 → 896) ⭐

Manual admission of 15 new arXiv-verified 3DGS methods, taking the library from 881 to 896 (+15, +1.7%). Admissions span 9 categories: Acceleration (H2-Ray, TileSkipper, SplatQ), Feed-Forward (CompactSplat, DeltaSplat, DensiTok), Embodied AI & Robotics (Splat2Act, 2DGS-Planner, NovaSplat), plus OuroWorld (Dynamic & 4D), PAM-ToD (HDR & Relighting), FlyMark (Security), GSCV (Compression & Streaming), OpenSplatGraph (Language & Semantic), PCAsplat (Surface & Rendering). Every admitted method name is self-stated in its own paper's title/abstract (R9 protocol) and arXiv-verified. 12 candidate papers were rejected for lacking a self-stated method name, being benchmark-only, NeRF (not 3DGS), or using 3DGS merely as a tool. All data carriers (methods.json / CSV / methods.html / abstracts.js / reference doc) re-verified at 896, name sets compared entry by entry. No method name was fabricated.

See changelog/2026-10-12.md for the full admission list.

Update (Oct 7, 2026): v0.9.6 — Manual Admission: 9 New Methods (872 → 881) ⭐

Manual admission of 9 new arXiv-verified 3DGS methods, taking the library from 872 to 881 (+9, +1.0%). Admission includes Speedy-Splat (CVPR 2025, precise tile intersection + efficient Hessian-based pruning, 6.71× render speedup) and 8 recent September 2026 papers: AESplat (pose-free feed-forward), AGILE-GS (anchor-guided NBV), OC-GS (irregular turntable), ClearGS (handheld video), ChronoFuseGS (multi-temporal fusion, PG 2026), TangoGS (cross-scale compact), RRTO-CF3DGS (COLMAP-free), Observation-Gram (SH compression). All data carriers (methods.json / CSV / methods.html / abstracts.js / reference doc) re-verified at 881, name sets compared entry by entry. No method name was fabricated.

See changelog/2026-10-07.md for the full admission list.

Update (Sep 21, 2026): v0.9.5 — Daily arXiv Scan: 13 New Methods (859 → 872) ⭐

Routine daily arXiv scan admitted 13 new arXiv-verified 3DGS methods, taking the library from 859 to 872 (+13, +1.5%). Admissions span Surface & Rendering, Feed-Forward, Large-Scale, Compression, Sparse-View, Cross-Domain, Embodied AI & Robotics, Dynamic, and Language & Semantic categories (incl. LiteTex-GS, GrapeSplat, VDGS, CRP-GS, NormLift). 7 candidate papers were rejected for failing the verification protocol — benchmarks without a self-stated method name, descriptive-only paper titles, or 3DGS used merely as a tool. All data carriers (methods.json / CSV / methods.html / abstracts.js / reference doc) re-verified at 872, name sets compared entry by entry. No method name was fabricated; the library's "every entry arXiv-verifiable" guarantee holds.

See changelog/2026-09-21-v3.md for the full admission list.

Earlier updates (v0.9.4 and before)

Latest Update (Sep 21, 2026): v0.9.4 — Multi-Channel Harvest: 700 → 859 Methods + Accuracy Overhaul ⭐

Knowledge base expanded from 700 to 859 verified methods (+159, +22.7%) through a multi-channel arXiv harvest over the last 150 days. Six query families (cs.CV / cs.GR / cs.RO / full-corpus / abs:"3D Gaussian Splatting" / ti:"Gaussian Splatting") returned 395 candidates; after verification 162 were admitted. Also in this release:

  • Verification protocol (R1–R6): every admission requires the paper's self-stated method name, reproduced in its own abstract; multi-word names must contain a proper-noun token — this alone rejected 67 descriptions masquerading as method names (Capacity-Controlled, Scene-Level). 114 borderline candidates were read individually; 25 adjudicated in, the rest dropped.
  • Accuracy repairs: 57 reference links had a displayed arXiv ID differing from the hyperlinked one (all had the correct ID displayed, wrong link). 13 mis-attributed entries deleted — e.g. Dynamic 3D Gaussians pointed at 2309.13114, which is actually a magnetic spin-glass physics paper, and GS-LRM-v2 pointed at DOF-GS. All now verified against the arXiv API.
  • AIGC traces removed from 29 text files; 21 historically corrupted JPEGs restored and re-stripped safely.
  • README_CN.md recovered from double-encoding corruption that had mangled every Chinese string.
  • Full carrier sync — methods.json / CSV / methods.html / abstracts.js / reference doc all verified at 881, name sets compared entry by entry rather than by count alone.

Adjudication wave (same day). A second pass resolved every name carrying a derived suffix or colliding with another entry: Scaffold-GS+ and GaussianSplatting-SLAM-v2 deleted (no such paper exists), Luminance-GS++ renamed to its self-declared base name, and Spark 2.0's description corrected — it is World Labs' open-source WebGL2 splat renderer, not an NVIDIA robotics simulator. Two independent papers both self-name GeoGS-SLAM (2607.07452 and 2607.11184, disjoint author lists); they are two methods, not a sequel, and are now disambiguated. 862 → 859.

See changelog/2026-09-21.md and changelog/2026-09-21-v2.md for the full audit trail.

Latest update (Sep 20): v0.9.2 —Scene Agent + Mapmost Engineering Wave: 5 New Methods + 6 Skill Enhancements. Knowledge base expanded from 692→ 97 methods. Added 5 scene-generation Agent papers: SceneSmith (ICML 2026 Spotlight, MIT CSAIL —hierarchical designer-critic-orchestrator VLM agents for simulation-ready indoor scenes), Scenethesis (ICLR 2026, NVIDIA —training-free LLM+vision agentic framework), SceneGenAgent (ACL 2025 —LLM coding agent for industrial scenes), SceneConductor (arXiv —multi-agent orchestration from single image), SceneAssistant (arXiv —visual-feedback agent for open-vocabulary scene generation). Injected Mapmost production engineering knowledge into 4 skill files: 3DGS individualization (单体化) in best-practices.md, LOD streaming + seam-fix + adaptive partition training in best-practices.md, 3DGS+3DTiles multi-source fusion in gis-toolchain.md, LUT color grading in tech-stack.md, Mapmost as Digital Twin player with 100km² benchmark in industry-landscape.md. Categories updated: Generation +4, Embodied AI & Robotics +1.

Previous (Sep 20): v0.9.1 —ECCV 2026 Wave: 14 New Methods. Knowledge base expanded from 678→ 92 methods. All 14 new entries arXiv-verified or ECCV-official: Wat3R (underwater 3D geometry without annotations), GeoNVS (geometry-grounded video diffusion with GS-Adapter), Edit3r (instant 3D editing from unposed images), SA-ResGS (first residual learning for 3DGS in next-best-view selection), GaussianLens (on-demand localized high-res reconstruction), Deformable Triangle Splatting (non-convex primitive with per-edge control points), Neural Harmonic Textures (per-primitive harmonic feature decoding), CubicSplat (error-bounded differentiable vector graphics), TetraSDF (analytic isosurface extraction), Heat Kernel Textures (ECCV 2026 Best Paper —geodesic Gaussians), GRF-Recon (long-sequence feed-forward with global ray-field), PriSplat (distractor-free 3DGS via multi-view propagation), Per-View Distractor Filtering (training-free feed-forward artifact removal), GS-Underwater (controlled cross-regime underwater benchmark study). Categories updated: Surface & Rendering +5, Feed-Forward +4, Cross-Domain +2, Robustness +2, Editing +1, Embodied AI & Robotics +1. All data carriers in sync.

Previous (Sep 16): v0.9.0 —Data Accuracy Release. Full-library audit of every entry against the arXiv API: each arXiv ID re-verified reachable and matched to its paper (method name must appear in the title/abstract). 181 entries failed verification and were removed, 56 wrong-ID entries re-linked to their real papers, 5 renamed to the papers' self-declared method names, plus 1 duplicate removed. The count is now honest instead of inflated: 678 methods, 23 categories, 568 arXiv-verified (83%), 130 code links (19%). Per-entry audit evidence: docs/data-accuracy-audit-2026-09-16.md. See changelog/2026-09-16-v5.md.

Previous (Sep 4): v0.8.3 —Dynamic Scene Survey Integration: 23 New Methods. Knowledge base expanded from 801→ 19 verified methods. Added 23 arXiv-verified dynamic scene reconstruction methods from survey paper (连振晗 et al., J CAD & CG, Jan 2026), spanning 3 categories: deformation field (LoopGaussian, CoGS, CD-GS, PGED, GPS-Gaussian, MoDGS, MoDec-GS, SpectroMotion, BARD-GS, GauFRE, ReconDreamer++), sparse-control deformation (SP-GS, Video-3DGS, SplineGS), 4D Gaussian primitive (Real-time 4DGS, PVG, 4D-rotor GS), and per-frame inter-frame transfer (3DGStream, Dual-GS, STC-GS, IGS, GFlow, DynOMo). Dynamic & 4D category: 75→ 7. New references/dynamic-datasets.md (11 datasets) and expanded benchmark-data.md (MS-SSIM/VMAF/FID metrics + 4 performance comparison tables). Experiment planner skill updated with dynamic scene design guide. See changelog/2026-09-04.md.

Previous (Sep 2): v0.8.2 —Daily Update: 11 New Methods. Knowledge base expanded from 790→ 01 verified methods. New additions span 7 categories: BRF-GS (hyperspectral BRDF modeling with 3DGS), SMG (ECCV 2026, semantic motion graph for dynamic GS), VCAR (ACM MM 2026, training-free 3DGS segmentation), RealCAD (real-world image to CAD reconstruction), ObjectSplat (object-level mesh splatting), CapFrame (ECCV 2026, text-instructed viewpoint localization), Amortized Anchor Refinement (continuous-time 4D reconstruction), ATGS (SIGGRAPH 2026, anchored temporal GS for long volumetric video), CausalSplat (hierarchical causal reasoning in 3DGS), VoroTracing (623 FPS differentiable ray tracing), Lucida (Real-to-Sim composable scene modeling). All arXiv IDs verified, data CI passed. See changelog/2026-09-02.md.

Previous (Aug 23): v0.8.1 —Daily Update: 7 New Methods. Knowledge base expanded from 783→ 90 verified methods. New additions span 6 categories: LEGO (ECCV 2026, hierarchical language GS with LLM spatial reasoning), OutLangSplat (UAV outdoor open-vocabulary 3D language GS), ESVR (IEEE VIS 2026, 3D ellipsoid sparse volume rendering with 4 orders of magnitude compression), TRACE-GS (sparse-view 3DGS via privileged geometric conditioning), RORA (single-video-to-articulated-object pipeline with Unreal Engine deployment), OVOW (ECCV 2026, monocular video to instance-level 4D mesh for physics simulation), Super-Gaussian (interactive 3DGS scene editing with VR NLI visualization). All arXiv IDs verified, data CI passed. See changelog/2026-08-23.md.

Previous (Aug 7): v0.8.0 —Platform Upgrade (P0+P1+P2). Knowledge layer: single source of truth (data/methods.json, 783 methods, 23 categories) with data CI; 5 fabricated entries purged; 14 arXiv-verified frontier methods added. Capability layer: true-3DGS render loop (gsplat via HTTP-served PLY), server-authoritative scene persistence, real PLY/SPLAT export, 5 distinct prune strategies, grid-accelerated ray query, runtime arg validation, WS origin allowlist, 21 unit tests. Platform layer: Benchmark arena (bench/), skill orchestration contracts (skills/_contracts/), Router manifest loader (scripts/router_load.py). 13 core MCP tools (all real) + 13 experimental (gated by INCLUDE_EXPERIMENTAL=1). See changelog/2026-08-07.md.

Previous (Jul 26): v0.5.1 —Full Method Audit & 14 New Methods. Now 789+ Methods (775 verified unique baseline + 14 new). Full re-audit across 11 source files; all method counts unified to 789+. New additions: GrainGS (dynamic, 36.98 dB / 435.6 FPS / 4.67 MB), GLAM-SLAM (IROS 2026, outdoor decoupled SLAM), SubSplat (subpixel feed-forward), ATSplat (adaptive 3D tokens, 1136 FPS), 3D-GIMP (3DGS inpainting), LB-Edit (7× lower editing latency), FlexiAvatar (ECCV 2026, visible-body-only optimization), ZeroSplat (ECCV 2026, training-free segmentation), CaT-GS (CVPR 2026, 10× faster rendering), FF-ProCams (projector-camera inverse rendering), i3dgs (SIGGRAPH 2026, large-scale unordered), VIGS-SLAM (ECCV 2026, iPhone real-time), ECoNGS (IEEE VIS 2026, volume visualization), AniGS (scene-level animation via diffusion prior). +MoDE/MoE-GS code link. Previous (Jul 24): v0.5.0 MCP Protocol Implementation. Previous (Jul 23): v0.4.3 ICML 2026 & Material/Provenance Wave —GaussTrace (ICML 2026), GADA (ICML 2026), InvSplat, MGM, DualPhys-GS, StereoGS. v0.4.4 added 3dgs-training-debugger skill (60+ runtime patterns).

MethodVenueCategoryOne-Line Innovation
Proxy-GSCVPR 2026 OralAccelerationLightweight proxy model for 2.5x speedup with no accuracy loss
Z-Order GSCVPR 2026 OralFeed-ForwardZ-order Morton curve + sparse attention O(N²)→ O(N log N)
3DReflecNetCVPR 2026 Best Paper CandidateCross-Domain120K+ objects, 48 material combos, 3 failure modes
Flux-GSECCV 2026AccelerationFlux-based Gaussian splatting for real-time rendering
AnchorSplatECCV 2026OptimizationAnchor-driven splatting with efficient density control
ASSEMCADECCV 2026CADAssembly-aware CAD reconstruction from 3DGS
WildSplatECCV 2026RobustnessIn-the-wild scene reconstruction with transient object removal
NoDrift3RECCV 2026SLAMDrift-free dense 3D reconstruction via point map regression
Axis-Shared Rasterization AcceleratorISCA 2026AccelerationHardware accelerator with axis-shared tiled rasterization
Prune Wisely—Optimization90% Gaussian pruning via DoG importance criterion
Provable Pruning via Coresets—OptimizationCoreset-based provable Gaussian pruning with bounded error
StreamLoD-GS—StreamingLoD-based progressive streaming with view-dependent quality
CADDreamerCVPR 2025 HighlightCADText/sketch → CAD B-rep generation
GaussTraceICML 2026Security3DGS provenance analysis via LLM reasoning for IP forensics
GADAICML 2026Feed-ForwardGeometry-aware deformable aggregation, 2.13× faster FPS
InvSplatarXiv 2026Feed-ForwardInverse feed-forward splatting with intrinsic PBR materials
MGMarXiv 2026RelightingLarge material Gaussian model for relightable 3D generation
DualPhys-GSarXiv 2026RobustnessDual physics-guided 3DGS for underwater reconstruction
StereoGS2026AccelerationEnergy-efficient hardware stereoscopic GS rendering processor

Full changelog: changelog/

Quick Start

Each skill is a standalone SKILL.md file —copy it to your Agent's skills directory.

3 commands to your first AI-powered 3DGS workflow:

git clone https://github.com/jaccen/Awesome-Gaussian-Skills.git

# Option 1: Claude Code
cp -r Awesome-Gaussian-Skills/skills/* .claude/

# Option 2: Cursor
cp -r Awesome-Gaussian-Skills/skills/* .cursor/rules/

# Option 3: One-Click Install
curl -sSL https://raw.githubusercontent.com/jaccen/Awesome-Gaussian-Skills/main/scripts/setup.sh | bash

Then ask your Agent: "Compare 3DGS and 2DGS rendering formulations"

Knowledge Base (900 Methods, 23 Categories)

GroupCategoriesKey Topics
Core RepresentationsFoundation, Antialiasing, Optimization, Surface/Rendering, Image Rep.3DGS, 2DGS, Scaffold-GS, Mip-Splatting, GaussianImage
Efficiency & ScaleCompression, Acceleration, Large-Scale, Feed-ForwardCompact-3DGS, BlitzGS, HiGS, VEDAL, VG²GT
Understanding & SemanticsLanguage/Semantic, Generation, Autonomous DrivingLangSplat, DreamGaussian, StreetNVS
Dynamic & SpatialDynamic, HDR, SLAM, Sparse-View, Spatial IntelligenceDSD-GS, WebSpline, GGD-SLAM, Holi-Spatial, Spatial-TTT
ApplicationsHuman/Avatar, Editing, Relighting, CAD, Cross-Domain, Simulation, Robotics, +14 moreAlbedoEdit, KDH-CAD, LEGS, TIDES, 3DEditSafe

Download full database: CSV | Full analysis: references/3dgs-methods-overview.md

Full Category Table (23 categories)

Core Representations

CategoryDescriptionMethods
Foundation (40)Core 3DGS representations and basic variants3D Representation Survey, 3DGEER, 3DSGS
Optimization (76)Training objectives, density control, convergenceAdaGScale, AdpSplit, ArtifactWorld
Surface & Rendering (50)Surface extraction and rendering-formulation innovation2D-SuGaR, 3DSS, AmbiSuR

Efficiency & Scale

CategoryDescriptionMethods
Compression & Streaming (43)Lightweight, mobile, and progressive streamingCAGS, Clustered Codebook VQ, CodecSplat
Acceleration (10)Training and inference speedup3DGS\u00B3, Axis-Shared Rasterization Accelerator, DDF-GS
Large-Scale (20)City-scale and distributed scene managementBlitzGS, CaT-GS, City-Level 3D Surface
Feed-Forward (67)Generalizable single-pass reconstruction (incl. foundation models)AdaptSplat, AnchorSplat, AnyCity

Understanding & Semantics

CategoryDescriptionMethods
Language & Semantic (37)Open-vocabulary 3D understanding and language fields3D-GIMP, Consistent Scene Understanding in 3DGS, DGSG-Mind
Generation (27)Text/condition-driven 3D/4D generationAniGen, AnySurf, AssetGen
Autonomous Driving (33)Driving scene reconstruction and simulation3DGS Safety Evaluation for AD, Asset Harvester, CGGS

Dynamic & Spatial

CategoryDescriptionMethods
Dynamic & 4D (97)4D Gaussians, temporal deformation, physics-integrated dynamics3DGS³, AniGS, ClipGStream
HDR & Relighting (27)HDR capture, relightable and material-aware GaussiansAlbedoEdit, Ambient-Robust IR, DiffAdapt4DSI
SLAM (40)Simultaneous localization and mapping2DGS-SLAM, Anchor3R, Anythingreality
Sparse-View (21)Few-shot and sparse-view reconstructionDropAnSH-GS, FrameTwin, GeoQuery
World Models & Spatial Intelligence (8)3D spatial reasoning, world modelingABot-3DWorld 0, APEIRIA, FlashWorld

Applications & Cross-Domain

CategoryDescriptionMethods
Human & Avatar (43)Animatable human and avatar reconstructionArtMesh, CapTalk, COSY
Editing (47)Interactive and text-guided scene editingBEA-GS, Capacity-Controlled Stylization, DeSplat
CAD & Reverse Engineering (20)CAD fitting, B-rep reconstruction, reverse engineering3DCodeBench, ASSEMCAD, BRepCLIP
Cross-Domain (47)Medical, underwater, remote sensing and other domains3DTV, Aes3D, AsyncEvGS
Simulation (11)Physics simulation and surrogate models3DThinkVLA, AGILE, ArtiTwinSplat
Embodied AI & Robotics (30)Grasping, manipulation, navigation, digital twins3DGS Demo Synthesis (IL), ArtGS, Forecast-GS
Robustness (11)In-the-wild and degradation-robust reconstruction3DReflecNet, DelowlightSplat, DualPhys-GS
Security (13)Watermarking, copyright, forgery detection3DEditSafe, 4D-GSW, BitC-3DGS

15 AI-Powered Skills

#SkillWhat It DoesExample
13dgs-paper-readerRead any 3DGS paper, extract structured insights"帮我读一篇 2401.01345 的论文"
23dgs-method-compareCompare variants across 10+ dimensions"对比 3DGS 和 2DGS 的渲染公式差异"
33dgs-code-reviewerCatch 104 known 3DGS implementation bugs"审查我的 CUDA 渲染 kernel"
43dgs-experiment-plannerDesign experiments for CVPR/SIGGRAPH/TVCG"帮我设计消融实验"
5nerf-to-3dgs-migratorMigrate NeRF methods to 3DGS step-by-step"hash encoding 怎么迁移到 3DGS?"
6cad-mesh-3dgsBridge CAD/Mesh/3DGS — 40+ conversion methods"3DGS 模型怎么提取高质量 mesh?"
7cg-paper-writingWrite papers for CVPR/SIGGRAPH/TVCG with adversarial review"帮我写论文引言"
83dgs-visualizerPublication-quality radar charts, timelines, heatmaps"画一张 3DGS 方法对比雷达图"
93dgs-engineering-guideDeploy 3DGS from research to production (10 industry tracks)"怎么部署 3DGS 做自动驾驶仿真?"
10patent-software-ipGenerate patent applications & software copyrights"生成专利申请文件"
113dgs-spatial-agentAgent-driven 3D scene reasoning, CAD extraction, editing"从 3DGS 中提取物体的 CAD 模型"
123dgs-mcp-rendererMCP-controlled Three.js/3DGS rendering bridge"从上方查看这个场景"
133dgs-articulated-reasonerArticulated object reasoning and digital twin"打开抽屉"
143dgs-compression-deployCompress & deploy 3DGS (quantize, prune, VQ, stream, Web/Mobile)"3DGS 模型怎么压缩到 10MB?"
153dgs-training-debuggerDiagnose training failures: OOM, NaN, divergence, artifacts (60+ runtime patterns)"训练 OOM 了怎么办?"

Works with Claude Code, Cursor, Windsurf, and other AI Agent frameworks.

Visualization Samples

Generated by 3dgs-visualizer —see Test/ for full-resolution files.

Radar ChartMetrics Bar Chart
Quality vs SpeedMetrics Heatmap

Research Innovation Highlights

Derived from systematic gap analysis across 900 Methods. Target venues: TVCG / CGF / CAD / T-RO / IJCV / ACM TOG.

I-01. Part-Aware Alpha-Compositing for Articulated Objects

Problem: Standard alpha-compositing causes color bleeding at part boundaries of articulated objects. ULF-Loc (CVPR 2026) exposed this feature bias, but no rendering-formulation-level fix exists.

Approach: Extend alpha-compositing with part-aware opacity modulation: C(θ) = Σ Tᵢ · αᵢ · ω_{p(i)}(θ) · cᵢ(θ), where ω penalizes penetration and joint violations, making inter-part penetration regions automatically transparent.

Path: 1) Build on gsplat rasterizer. 2) Add FK layer for articulated objects (URDF). 3) Compute penetration/joint violation via SDF. 4) Train on Articulate-100.

Target: SIGGRAPH / ACM TOG / TVCG

I-02. Geometry-Consistent Flow World Model for Manipulation

Problem: Flow-based world models (RoboFlow4D) predict dense 3D flows but lack geometric consistency —predicted flows can violate object rigidity and physical constraints.

Approach: Couple 3D flow prediction with scene graph constraints: rigidity loss for static objects, articulation loss for joints, support-relation constraints for stacking.

Path: 1) Extend RoboFlow4D. 2) Scene graph parser via OpenMask3D. 3) Geometric regularizer. 4) Train on LIBERO + RoboCasa.

Target: IJCV / T-RO / RSS

I-03. Multi-Scale Occupancy-Gaussian Bidirectional Bridge for Driving

Problem: Occupancy (SparseWorld, DOV) is the driving world model standard; 3DGS provides superior rendering. No differentiable bridge exists between them.

Approach: Bidirectional conversion: Occ→ DGS (learned position+scale predictor from occupancy+semantics) and 3DGS→ Occ (differentiable sparse convolution pooling). Joint backbone for unified prediction+rendering.

Path: 1) Backbone: SparseWorld-TC. 2) Occ→ DGS module. 3) 3DGS→ Occ module. 4) Training: nuScenes, Waymo.

Target: TVCG / T-ITS / CVPR

6 more innovation highlights (I-04 to I-10)
  • I-04. Solid Geometry Neural-Symbolic Reasoning: VLM + Z3/SMT formal verifier in iterative refinement loop. Target: Pattern Recognition / AAAI.
  • I-05. Embodied Spatial Memory: Hippocampus-inspired 3DGS scene graph + Perceiver compressor + importance-weighted forgetting. Target: T-RO / IJCV.
  • I-06. Differentiable Physics Engine: SDF-based contact + differentiable KKT contact solver + Coulomb friction for manipulation. Target: ACM TOG / SIGGRAPH.
  • I-06. Tactile-Visual Spatial Fusion: GelSight → contact geometry maps → 3D scene projection → cross-attention fusion. Target: T-RO / ICRA.
  • I-08. Panoramic Spatial World Model: Spherical visual panorama + BEV semantic + affordance + spatial relation graph for "imagine then navigate". Target: ECCV / CVPR.
  • I-09. Code-as-Spatial-Vocabulary: VLM generates Three.js code → render → extract spatial annotations → fine-tune VLM. Target: CVPR / NeurIPS.
  • I-10. Hyperbolic Cross-Modal Distillation: Poincare ball distillation for image→ point-cloud hierarchical feature transfer. Target: T-MM / T-IP.

Roadmap

  • v0.1 —Initial release with 6 core skills (Apr 2026)
  • v0.2 —3dgs-visualizer + Text2Word demo (May 2026)
  • v0.3 —Knowledge base 665->789+ Methods, 25 Categories, 101+ bug patterns, 12 skills (Jun 2026)
  • v0.3.6 —Spatial intelligence wave: 680->639+ methods, +10 new methods (FastGS, Holi-Spatial, Spatial-TTT, etc.), Dimension 11, Anthropic standard alignment (Jun 25, 2026)
  • v0.3.6 —CVPR 2026 representative papers: 690->639+ methods, +23 verified new methods, all 13 skills updated (Jun 28, 2026)
  • v0.4.0 —Router Architecture Expansion: cg-paper-writing + 3dgs-engineering-guide → Router + manifest.yaml + static/; 3dgs-code-reviewer Self-Check Loop; cg-paper-writing Stage Gates; 3 Router skills total (Jul 2, 2026)
  • v0.4.1 —ECCV & ISCA 2026 Wave: +Flux-GS, AnchorSplat, ASSEMCAD, WildSplat, NoDrift3R (ECCV 2026), Axis-Shared Rasterization Accelerator (ISCA 2026), Provable Pruning via Coresets; 639+ methods (Jul 9, 2026)
  • v0.4.2 —SIGGRAPH & MICCAI 2026 Wave: +DP-Splat, MoE-GS/MoDE (TPAMI 2026), HyperGS, MAC-Splat (ECCV 2026), Track2Map (MICCAI 2026), PEAR (SIGGRAPH 2026), CoSAG, HoloTetSphere (ECCV 2026), SalientGS; 639→ 89+ Methods, +3dgs-compression-deploy skill, 14 skills total (Jul 14, 2026)
  • v0.4.3 —ICML 2026 & Material/Provenance Wave: +GaussTrace (ICML 2026), GADA (ICML 2026), InvSplat, MGM, DualPhys-GS, StereoGS; 660→ 89+ Methods, +3 bug patterns (108+ total), MCP roadmap v0.2.3 (Jul 23, 2026)
  • v0.4.4 —Training Debugger Skill: +1 skill (3dgs-training-debugger, 60+ runtime patterns, VRAM management, convergence analysis), 14→ 5 skills total (Jul 23, 2026)
  • v0.4 —3dgs-spatial-agent enhancements (knowledge-constrained CAD, DDF-GS ray query)
  • v0.5.0 —MCP Protocol Implementation: 24-tool MCP server (mcp-server/), Three.js WebSocket renderer, 24-pattern voice intent mapper, headless mode, voice demo (Jul 24, 2026)
  • v0.5.1 —Full Method Audit & 14 New Methods: 775 verified unique baseline + 14 new = 789+ methods; all method counts unified across 11 source files; +GrainGS, GLAM-SLAM, SubSplat, ATSplat, 3D-GIMP, LB-Edit, FlexiAvatar, ZeroSplat, CaT-GS, FF-ProCams, i3dgs, VIGS-SLAM, ECoNGS, AniGS (Jul 26, 2026)
  • v0.8.0 —Platform Upgrade (P0+P1+P2): single source of truth (data/methods.json, 783 methods, 23 categories, data CI); 5 fabricated entries purged + 14 arXiv-verified frontier methods; true-3DGS render loop (gsplat via HTTP-served PLY); server-authoritative scene persistence; real PLY/SPLAT export; 5 prune strategies; grid-accelerated ray query; runtime arg validation; WS origin allowlist; 21 unit tests + 2 CI workflows; Benchmark arena (bench/); skill orchestration contracts (skills/_contracts/); Router manifest loader (scripts/router_load.py); 13 core MCP tools + 13 experimental (Aug 7, 2026)
  • v0.8.1 —Daily Update: 7 new arXiv-verified methods (LEGO, OutLangSplat, ESVR, TRACE-GS, RORA, OVOW, Super-Gaussian); 783→ 90 methods; 6 categories updated; all data carriers in sync (Aug 23, 2026)
  • v0.8.2 —Daily Update: 11 new arXiv-verified methods (BRF-GS, SMG, VCAR, RealCAD, ObjectSplat, CapFrame, Amortized Anchor Refinement, ATGS, CausalSplat, VoroTracing, Lucida); 790→ 01 methods; 7 categories updated; all data carriers in sync (Sep 2, 2026)
  • v0.8.3 —Dynamic Scene Survey Integration: 23 new arXiv-verified methods from 连振晗 et al. survey (J CAD & CG, Jan 2026); 801→ 19 methods; Dynamic & 4D 75→ 7; +dynamic-datasets.md (11 datasets); +benchmark-data.md metrics (MS-SSIM/VMAF/FID) and 4 performance tables; experiment-planner skill updated (Sep 4, 2026)
  • v0.9.0 —Data Accuracy Release: full-library name↔ paper verification against arXiv API; 181 unverifiable entries removed, 56 wrong IDs fixed, 5 renames, 1 dedup; count corrected to 678 (Sep 16, 2026)
  • v0.8.4 —Daily Update: 39 new arXiv-verified methods (arXiv window 2026-09-02 ~ 09-16); 819→ 78 methods; 15 categories updated (Compression & Streaming +4, Large-Scale +4, Optimization +4, Robustness +4, Cross-Domain +3, Dynamic & 4D +3, Generation +3, SLAM +3, Acceleration +2, Embodied AI & Robotics +2, Feed-Forward +2, Sparse-View +2, HDR & Relighting +1, Human & Avatar +1, Surface & Rendering +1); pure benchmarks/surveys excluded; validate_knowledge_base.py SyntaxWarning fixed; all data carriers in sync (Sep 16, 2026)
  • v0.9.1 —ECCV 2026 Wave: 14 new arXiv-verified methods (Wat3R, GeoNVS, Edit3r, SA-ResGS, GaussianLens, Deformable Triangle Splatting, Neural Harmonic Textures, CubicSplat, TetraSDF, Heat Kernel Textures, GRF-Recon, PriSplat, Per-View Distractor Filtering, GS-Underwater); 678→ 92 methods; 6 categories updated (Surface & Rendering +5, Feed-Forward +4, Cross-Domain +2, Robustness +2, Editing +1, Embodied AI & Robotics +1); all data carriers in sync (Sep 20, 2026)
  • v0.9.2 —Scene Agent + Mapmost Engineering Wave: 5 new scene-generation Agent methods (SceneSmith ICML 2026, Scenethesis ICLR 2026, SceneGenAgent ACL 2025, SceneConductor, SceneAssistant); 692→ 97 methods; Generation +4, Embodied AI & Robotics +1; 6 skill file enhancements: 3DGS individualization, LOD streaming + seam-fix, adaptive partition training, 3DGS+3DTiles fusion, LUT color grading, Mapmost 100km² benchmark (Sep 20, 2026)
  • v1.0 —CI/CD integration + multi-framework official listings
  • v2.0 —Agent-to-Agent collaboration (multi-agent paper discussion)

Full version history: changelog/

Architecture

Awesome-Gaussian-Skills/
├── data/                      # Single source of truth (methods.json, categories.json)
├── skills/                    # 15 AI Agent skills (SKILL.md format)
│   ├── _contracts/            # Inter-skill I/O schemas (paper-insight, comparison-report, experiment-plan)
│   ├── 3dgs-paper-reader/     # Paper reading & summarization
│   ├── 3dgs-method-compare/   # Method comparison engine (Router)
│   ├── 3dgs-code-reviewer/    # Code review (104 bug patterns)
│   ├── 3dgs-experiment-planner/ # Experiment design
│   ├── nerf-to-3dgs-migrator/ # NeRF→3DGS migration
│   ├── cad-mesh-3dgs/         # CAD/Mesh/3DGS bridge
│   ├── cg-paper-writing/      # CG paper writing assistant (Router)
│   ├── 3dgs-visualizer/       # Research visualization
│   ├── 3dgs-engineering-guide/ # Engineering deployment (Router)
│   ├── patent-software-ip/    # Patent & copyright generation
│   ├── 3dgs-spatial-agent/    # Spatial intelligence agent
│   ├── 3dgs-mcp-renderer/     # MCP rendering bridge
│   ├── 3dgs-articulated-reasoner/ # Articulated reasoning & digital twin
│   ├── 3dgs-compression-deploy/  # Compression & deployment
│   └── 3dgs-training-debugger/  # Training failure diagnosis
├── mcp-server/                # MCP server v0.8.0 (13 core + 13 experimental tools, gsplat render loop, HTTP+WS :9842)
├── bench/                     # Benchmark arena (metrics.py, run_eval.py, leaderboard.json)
├── scripts/                   # build_knowledge_base.py, validate_knowledge_base.py, router_load.py, validate_skill_contract.py
├── studio/                    # SplatVerse Studio (bridge + web)
├── docs/                      # GitHub Pages interactive explorer
├── references/                # Knowledge base (900 Methods, 23 Categories)
├── Test/                      # Visualization samples
├── changelog/                 # Version history
└── assets/                    # Project images

Each skill follows the SKILL.md standard, compatible with Claude Code (.claude/), Cursor (.cursor/rules/), Windsurf, and other AI Agent frameworks.

SplatVerse Studio: Short Video Creation

SplatVerse Studio integrates 3D Gaussian Splatting with a short-drama pipeline powered by the Toonflow engine, letting you go from text scripts to 3DGS-rendered video scenes.

Architecture

Toonflow Engine (:10588)                    SplatVerse Studio
+------------------------------+            +------------------------------------------+
| Script -> Assets ->           |   REST     | Bridge (:10590)                           |
| Storyboard -> Video           |<--------->| Project Browser                            |
| Vendor: 3dgs-renderer         |            | Render Studio                              |
|                               |            | MCP Tools (25 tools)                       |
|                               |            | MCP Renderer (:9842)                       |
|                               |            | Pipeline (7 steps)                         |
|                               |            |   |-- Script Adaptation                     |
| MoneyPrinterTurbo (:8081)     |   REST     |   |-- Storyboard                            |
| Online material ->            |<--------->|   |-- Toonflow Sync                         |
| TTS -> FFmpeg -> Video        |            |   |-- TTS Dubbing                           |
| Cross-platform post           |            |   |-- Video Gen                             |
|                               |            |   |-- FFmpeg Compose                        |
| Studio Web (:5173)            |            |   +-- Publish (MPT)                         |
+------------------------------+            +------------------------------------------+

Quick Start

Prerequisites: Node.js ≥18 (Toonflow and MoneyPrinterTurbo are optional).

The one-click launcher starts everything automatically on first run: checks Node.js, creates .env from .env.example if missing, runs npm install if dependencies are missing, builds the MCP Server / Bridge binaries if needed, then starts Toonflow Studio (:10588) (if found), MCP 3D Renderer (:9842), Bridge Server (:10590) and Studio Web (:5173), health-checks every service, and opens your browser.

Option A —Windows (double-click)

Download the project, then double-click start-all.bat in the project root. That's it —all services start automatically and a browser opens at http://localhost:5173.

Option B —npm (any OS)

npm run start:all

Option C —PowerShell (Windows)

powershell -NoProfile -ExecutionPolicy Bypass -File scripts/start-all.ps1

One-time manual step only needed for video generation: set LLM_API_KEY in the generated .env (used for script/storyboard generation).

Toonflow (optional, for the full video pipeline) is auto-detected from ../AI应用/Toonflow-app, ../Toonflow-app, ./Toonflow-app, or TOONFLOW_APP_DIR. MoneyPrinterTurbo (optional, needs Docker) is started only when MPT_ENABLED=true in .env.

Useful flags: -NoToonflow skip Toonflow, -NoMpt skip MPT, -NoBrowser skip auto-opening the browser, -SkipInstall skip npm install.

Minimal (no Toonflow)

If you only need the 3DGS rendering tools without Toonflow:

npm run dev    # MCP + Bridge + Web, no Toonflow

Creating a Short Video: Step by Step

Step 1 —Write a Script in Toonflow

Open the Toonflow web app (typically at http://localhost:10588). Create a project, write a script, and generate storyboards. Each storyboard is a scene with:

  • Prompt —text description for image/video generation
  • Duration —scene length in seconds
  • Track —scene grouping label

Toonflow's pipeline: Text → Script → Assets (roles, scenes, props) → Storyboards → Video

Step 2 —Browse Projects in Studio Web

Open http://localhost:5173 and navigate to Projects. You'll see all Toonflow projects. Click a project to view its storyboards.

Example: Creating a test project via API
# Login to Toonflow
TOKEN=$(curl -s http://localhost:10588/api/login/login \
  -H "Content-Type: application/json" \
  -d '{"username":"admin","password":"admin123"}' | jq -r '.data.token')

# Create a script
curl -s http://localhost:10588/api/script/addScript \
  -H "Authorization: $TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"name":"Forest Adventure","content":"# Forest Adventure\n## Scene 1...","projectId":1}'

# Add storyboards
curl -s http://localhost:10588/api/production/storyboard/batchAddStoryboardInfo \
  -H "Authorization: $TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
    "scriptId": 1,
    "projectId": 1,
    "data": [
      {
        "prompt": "A misty forest at dawn, sunlight through trees",
        "videoDesc": "Dawn mist over ancient forest",
        "duration": 5,
        "track": "Scene 1",
        "state": "pending",
        "src": "",
        "shouldGenerateImage": 1,
        "associateAssetsIds": []
      }
    ]
  }'

Step 3 —Render Storyboards as 3DGS Scenes

Two rendering modes in Render Studio (/render):

ModeWhat it doesWhen to use
Direct 3DGS RenderRender a single scene from a text description or .ply fileQuick preview without Toonflow
Batch Render from ToonflowRender multiple Toonflow storyboards as 3DGS scenesFull short-video production

For batch rendering, enter the Toonflow Project ID and Storyboard IDs (comma-separated), then click Render Batch. The Bridge fetches storyboards from Toonflow, builds 3DGS scenes via MCP Server, and renders each storyboard frame.

Step 4 —Monitor Render Progress

Render progress streams via SSE (Server-Sent Events). You'll see toast notifications in the top-right corner as each storyboard renders. The Dashboard shows recent render tasks with progress bars.

Step 5 — 3DGS as a Toonflow Vendor (Optional)

To use 3DGS rendering directly inside Toonflow's image/video generation:

# Copy the vendor adapter to Toonflow
cp studio/bridge/vendor/3dgs-renderer.ts ../AI应用/Toonflow-app/data/vendor/

This registers 3DGS as both an image model (single-frame render) and video model (multi-frame animation) in Toonflow's vendor system.

Port Reference

ServicePortDescription
Toonflow Engine10588Short-drama creation (external app)
MCP Renderer9842WebSocket 3DGS renderer
Bridge Server10590REST API + SSE, Toonflow proxy
Studio Web5173Vue 3 SPA frontend
MPT API (Sidecar)8081MoneyPrinterTurbo FastAPI (optional; 8081 used when host 8080 is taken)
MPT Web UI8501MoneyPrinterTurbo Streamlit UI (optional)

Troubleshooting

  • "Toonflow engine not running" —Start Toonflow: npm run start:all or manually node data/serve/app.js in the Toonflow directory
  • Projects page shows no storyboards —Create a script first in Toonflow; storyboards belong to scripts
  • 3DGS vendor not available in Toonflow —Copy studio/bridge/vendor/3dgs-renderer.ts to Toonflow's data/vendor/ directory

MoneyPrinterTurbo (MPT) Integration

MoneyPrinterTurbo is integrated as an optional HTTP API sidecar, extending SplatVerse Studio with online material video generation, additional TTS voices, and cross-platform publishing. Zero intrusion —when MPT_ENABLED=false or MPT_API_URL is unset, the pipeline behaves exactly as before.

What MPT Adds

CapabilityPipeline StepRole
Extended TTSStep 4 (TTS)Fallback when CosyVoice2 → Edge → SAPI all fail; adds Azure / SiliconFlow / ElevenLabs / Gemini voices
Full Video GenerationStep 6 (Compose)Final fallback when 3DGS / Toonflow / video gen all produce no clips —uses Pexels / Pixabay / Coverr online materials
Cross-Platform PublishStep 7 (Publish, new)One-click publish to TikTok / Instagram / YouTube Shorts

Frontend Entry

The Studio Web "Script → Video" page (/pipeline) ships a built-in MPT entry:

  • Config panel: a "📖 MoneyPrinterTurbo Integration" group at the bottom of the model config section —enable toggle, service URL, material source, default voice, plus a live connection status (Connected / Not connected). Saving writes the settings into .env.
  • Per-task options: a "📖 MoneyPrinterTurbo Fallback" block at the bottom of the input section —check "Video fallback" and "TTS fallback" to automatically degrade to MPT when any main-pipeline step (3DGS / Toonflow / TTS) fails; when MPT is enabled you can also pick an MPT voice and publish platforms (TikTok / YouTube / Instagram).

Note: the bridge auto-loads the project-root .env at startup (dependency-free implementation, see studio/bridge/src/load-env.ts), so config saved from the UI takes effect after the bridge restarts. Launch the bridge from the project root (npm run dev:bridge or scripts/start-dev.ps1) to ensure the root .env is picked up.

Setup

# 1. Configure MPT (fill in at least one material API key)
cp mpt-config.example.toml mpt-config.toml
#    Edit mpt-config.toml —required: pexels.api_key or pixabay.api_key (both free)

# 2. Start MPT container
docker compose -f docker-compose.mpt.yml up -d

# 3. Verify MPT is running
curl http://localhost:8081/api/v1/tasks?page=1&page_size=1

# 4. Enable MPT in Studio .env
#    MPT_ENABLED=true
#    MPT_API_URL=http://localhost:8081

Configuration Reference

Env VariableDefaultDescription
MPT_ENABLEDfalseEnable/disable MPT integration
MPT_API_URL(empty)MPT FastAPI service URL
MPT_MATERIAL_SOURCEpexelsMaterial source: pexels / pixabay / coverr / local
MPT_DEFAULT_VOICEzh-CN-XiaoxiaoNeuralDefault TTS voice name

MPT-side settings (API keys for Pexels/Pixabay, TTS providers, LLM) go in mpt-config.toml, not .env. See mpt-config.example.toml for the full template.

API Endpoints

EndpointMethodDescription
/api/pipeline/mpt/healthGETCheck MPT service availability
/api/pipeline/mpt/bgmGETList MPT BGM library
/api/pipeline/tasks/:id/publishPOSTPublish video to platforms ({ platforms: [{ name, title, tags }] })

Creating a Task with MPT Fallback

curl -s http://localhost:10590/api/pipeline/tasks \
  -H "Content-Type: application/json" \
  -d '{
    "text": "In a quiet town, a kitten named HuaHua chats with a butterfly...",
    "title": "HuaHua Adventure",
    "style": "水彩",
    "videoRatio": "16:9",
    "enableTTS": true,
    "enableVideoGen": false,
    "enableMptFallback": true,
    "enableMptTTS": true,
    "mptVoiceName": "zh-CN-XiaoxiaoNeural",
    "publishPlatforms": [
      { "name": "tiktok", "title": "HuaHua Adventure", "tags": ["animation", "cat"] }
    ]
  }'

The 7-step pipeline: Script Adaptation → Storyboard → Toonflow Sync → TTS (MPT fallback) → Video Gen → FFmpeg Compose (MPT fallback) → Publish (MPT)

Contributing

Contributions welcome! See Contributing Guide.

Contributors

Citation

@misc{awesome-gaussian-skills,
  author = {jaccen},
  title = {Awesome Gaussian Skills: 3D Spatial Intelligence Open-Source Toolbox for 3D Gaussian Splatting Research},
  year = {2026},
  url = {https://github.com/jaccen/Awesome-Gaussian-Skills}
}

Acknowledgments

License

Apache-2.0. See LICENSE for details.

Sponsor & Community

If this project helps your research or work, consider supporting us!


Sponsor / 打赏
Buy us a coffee

Join Group / 加入社群
3DGS research discussion

Star History

Star History Chart

If this project saves you time, please give it a star!

Comments

Loading…