Jian AI Lab · 中文EN

NINE FIELDS · 06

Video, Image & Audio

Compare editing, subtitles, voice, avatars, image generation, and video models with their actual compute costs.

How to use this pageStart with the job you need to finish. Open a research file, then check capability, requirements, license, and actual cost.

CURATED FOR THIS FIELD

51 GitHub projects worth investigating

All projects →

Each project is classified by the value it adds, its research status, requirements, and real operating costs.

Cut costsNew discovery

immich-app/immich

Immich

IN ONE SENTENCE

See what Immich can add to a real workflow before you install it.

Immich is catalogued as open-source video tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source video tool
Requirements
iOS、Android、Browser; 需server、硬盘和持续备份
Real cost
Actual cost still needs verification.
Cut costsNew discovery

iv-org/invidious

Invidious

IN ONE SENTENCE

See what Invidious can add to a real workflow before you install it.

Invidious is catalogued as open-source video tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source video tool
Requirements
Browser; self-hosted需 Docker or Linux server
Real cost
Actual cost still needs verification.
Add capabilityNew discovery

3b1b/manim

ManimGL

IN ONE SENTENCE

See what ManimGL can add to a real workflow before you install it.

ManimGL is catalogued as open-source project. Read the research file and current GitHub README before using it in production.

Project type
Open-source project
Requirements
macOS or Linux; Python、FFmpeg、OpenGL,部分场景需 LaTeX
Real cost
Actual cost still needs verification.
Automate workNew discovery

averygan/reclip

Reclip

IN ONE SENTENCE

See what Reclip can add to a real workflow before you install it.

Reclip is catalogued as open-source video tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source video tool
Requirements
yt-dlp、FFmpeg、Python or Docker
Real cost
Actual cost still needs verification.
Cut costsNew discovery

codeforreal1/compressO

CompressO

IN ONE SENTENCE

See what CompressO can add to a real workflow before you install it.

CompressO is catalogued as open-source tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source tool
Requirements
Windows、macOS、Linux; 依赖本机算力与 FFmpeg
Real cost
Actual cost still needs verification.
Cut costsNew discovery

mifi/lossless-cut

LosslessCut

IN ONE SENTENCE

See what LosslessCut can add to a real workflow before you install it.

LosslessCut is catalogued as open-source video tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source video tool
Requirements
Windows、macOS、Linux; 兼容性取决于 FFmpeg 和源文件
Real cost
Actual cost still needs verification.
Cut costsNew discovery

jub0t/Concat

Concat

IN ONE SENTENCE

See what Concat can add to a real workflow before you install it.

Concat is catalogued as open-source video tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source video tool
Requirements
Windows、macOS、Linux; 目前仍为 Beta
Real cost
Actual cost still needs verification.
Cut costsNew discovery

realskyrin/capcap

CapCap

IN ONE SENTENCE

See what CapCap can add to a real workflow before you install it.

CapCap is catalogued as open-source tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source tool
Requirements
macOS 14+
Real cost
Actual cost still needs verification.
Automate workNew discovery

ArcReel/ArcReel

ArcReel

IN ONE SENTENCE

See what ArcReel can add to a real workflow before you install it.

ArcReel is catalogued as open-source video tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source video tool
Requirements
Docker; 图像、视频和配音服务另配
Real cost
Actual cost still needs verification.
Cut costsResearch queue

OpenCut-app/OpenCut

OpenCut

IN ONE SENTENCE

Keep everyday timeline editing, media organization, and export inside an open-source video workspace.

OpenCut is catalogued as open-source project. Read the research file and current GitHub README before using it in production.

Project type
Open-source project
Requirements
Web / 桌面路线
Real cost
MIT; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Add capabilityResearch queue

meituan-longcat/LongCat-Video

LongCat-Video

IN ONE SENTENCE

Make a person, animated character, or animal speak naturally from one image and an audio track.

LongCat-Video is catalogued as open-source video tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source video tool
Requirements
Python / CUDA GPU / Docker
Real cost
MIT; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Cut costsTesting

lipku/LiveTalking

LiveTalking

IN ONE SENTENCE

Drive a real-time talking avatar from text or audio and stream it to the web, live video, or a virtual camera.

LiveTalking is catalogued as open-source project. Read the research file and current GitHub README before using it in production.

Project type
Open-source project
Requirements
云 GPU candidate
Real cost
Open-source; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Add capabilityVerified

KlingAIResearch/LivePortrait

LivePortrait

IN ONE SENTENCE

Animate a portrait from one image and a driving video with efficient motion and expression control.

LivePortrait is catalogued as open-source model. Read the research file and current GitHub README before using it in production.

Project type
Open-source model
Requirements
Windows / Linux / Apple Silicon Mac
Real cost
Open-source; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Add capabilityNew discovery

debpalash/VoiceStudio

VoiceStudio

IN ONE SENTENCE

Clone voices, dub video, transcribe speech, and build audiobooks locally without a required subscription.

VoiceStudio is catalogued as open-source speech tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source speech tool
Requirements
macOS Apple Silicon / Windows / Linux / Docker
Real cost
AGPL-3.0; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Cut costsNew discovery

QuentinFuxa/WhisperLiveKit

WhisperLiveKit

IN ONE SENTENCE

Convert live speech into low-latency captions with speaker separation, translation, and an API.

WhisperLiveKit is catalogued as open-source tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source tool
Requirements
Requirements to be verified
Real cost
Actual cost still needs verification.
Add capabilityNew discovery

ATH-MaaS/Pixelle-Video

Pixelle-Video

IN ONE SENTENCE

Turn a topic into an automated pipeline for script, visuals, voice, music, and final video assembly.

Pixelle-Video is catalogued as open-source model. Read the research file and current GitHub README before using it in production.

Project type
Open-source model
Requirements
Requirements to be verified
Real cost
Actual cost still needs verification.
Cut costsResearch queue

Comfy-Org/ComfyUI

ComfyUI

IN ONE SENTENCE

Build generation workflows like blocks, save them once, and reuse them for images, video, audio, and 3D.

ComfyUI is catalogued as workflow automation platform. Read the research file and current GitHub README before using it in production.

Project type
Workflow automation platform
Requirements
Windows / macOS / Linux / Localorcloud
Real cost
GPL-3.0; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Cut costsResearch queue

Wan-Video/Wan2.1

Wan2.1

IN ONE SENTENCE

Use one open model family for text-to-video, image-to-video, frame control, editing, and audio tasks.

Wan2.1 is catalogued as open-source video tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source video tool
Requirements
Python / NVIDIA GPU; 部分模型可用消费级显卡
Real cost
Apache-2.0; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Cut costsResearch queue

Tencent-Hunyuan/HunyuanVideo-1.5

HunyuanVideo 1.5

IN ONE SENTENCE

Run Tencent's open video-generation models through local GPU, Diffusers, or ComfyUI workflows.

HunyuanVideo 1.5 is catalogued as open-source video tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source video tool
Requirements
Linux / Python 3.10+ / NVIDIA GPU; 模型卸载时官方minimum约 14GB VRAM
Real cost
Open-source; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Cut costsResearch queue

Lightricks/LTX-Video

LTX-Video

IN ONE SENTENCE

Control video development with keyframes, extend clips forward or backward, and generate picture with sound.

LTX-Video is catalogued as open-source video tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source video tool
Requirements
Python / NVIDIA GPU / ComfyUI / online demo
Real cost
Apache-2.0; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Add capabilityNew discovery

MartinDelophy/ai-video-editor

Timeline Studio

IN ONE SENTENCE

Edit multitrack video, subtitles, dubbing, AI enhancement, and offline exports directly in the browser.

Timeline Studio is catalogued as open-source video tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source video tool
Requirements
桌面Browser / PWA / WebGPU
Real cost
MIT; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Add capabilityResearch queue

invoke-ai/InvokeAI

InvokeAI

IN ONE SENTENCE

Combine generation, inpainting, a creative canvas, asset management, and node workflows locally.

InvokeAI is catalogued as open-source image tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source image tool
Requirements
Local Web UI / GPU
Real cost
Apache-2.0; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Cut costsResearch queue

mcmonkeyprojects/SwarmUI

SwarmUI

IN ONE SENTENCE

Use a simple generation screen and advanced Comfy workflows from the same local image interface.

SwarmUI is catalogued as open-source image tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source image tool
Requirements
Windows / macOS / Linux; Localor云 GPU
Real cost
MIT; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Cut costsResearch queue

ByteDance-Seed/BAGEL

BAGEL

IN ONE SENTENCE

Understand, generate, and edit images with one open multimodal model from ByteDance Seed.

BAGEL is catalogued as open-source model. Read the research file and current GitHub README before using it in production.

Project type
Open-source model
Requirements
Python / Gradio / CUDA GPU
Real cost
Apache-2.0; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Cut costsResearch queue

lllyasviel/Fooocus

Fooocus

IN ONE SENTENCE

Focus on prompts instead of parameters with a streamlined local image-generation experience.

Fooocus is catalogued as open-source image tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source image tool
Requirements
Windows / Linux / Colab; NVIDIA GPU preferred
Real cost
GPL-3.0; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Add capabilityResearch queue

Acly/krita-ai-diffusion

Krita AI Diffusion

IN ONE SENTENCE

Generate, inpaint, upscale, and use references without leaving Krita's real editing workflow.

Krita AI Diffusion is catalogued as open-source project. Read the research file and current GitHub README before using it in production.

Project type
Open-source project
Requirements
Krita 5.2+; Windows / macOS / Linux
Real cost
GPL-3.0; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Cut costsResearch queue

lllyasviel/stable-diffusion-webui-forge

Stable Diffusion WebUI Forge

IN ONE SENTENCE

Manage models, LoRAs, and ControlNet with more efficient local Stable Diffusion inference.

Stable Diffusion WebUI Forge is catalogued as open-source image tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source image tool
Requirements
Windows 一键包 / Python self-hosted
Real cost
AGPL-3.0; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Cut costsResearch queue

Kwai-Kolors/Kolors

Kolors

IN ONE SENTENCE

Generate images with stronger Chinese and English text rendering for posters and visual content.

Kolors is catalogued as open-source image tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source image tool
Requirements
Python / Gradio / ComfyUI / NVIDIA CUDA
Real cost
Apache-2.0; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Add capabilityResearch queue

Stability-AI/generative-models

Stability Generative Models

IN ONE SENTENCE

Start from Stability AI's official code, inference examples, and model-license boundaries.

Stability Generative Models is catalogued as open-source model. Read the research file and current GitHub README before using it in production.

Project type
Open-source model
Requirements
Python 3.10 / CUDA / Streamlit
Real cost
MIT; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Cut costsResearch queue

KDE/kdenlive

Kdenlive

IN ONE SENTENCE

Keep professional multitrack editing, transitions, and audio work inside a mature open-source editor.

Kdenlive is catalogued as open-source video tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source video tool
Requirements
Windows / macOS / Linux
Real cost
GPL-3.0; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Cut costsResearch queue

lllyasviel/FramePack

FramePack

IN ONE SENTENCE

Generate longer image-to-video sequences in segments on comparatively modest local GPU hardware.

FramePack is catalogued as open-source video tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source video tool
Requirements
Windows / Linux / NVIDIA RTX 30、40、50 系; minimum 6GB VRAM
Real cost
Apache-2.0; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Cut costsResearch queue

zai-org/CogVideo

CogVideo / CogVideoX

IN ONE SENTENCE

Bring text, reference images, and existing clips into an open, self-deployable video-generation workflow.

CogVideo / CogVideoX is catalogued as open-source video tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source video tool
Requirements
Python / NVIDIA GPU / Colab
Real cost
Open-source; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Cut costsResearch queue

ace-step/ACE-Step-1.5

ACE-Step 1.5

IN ONE SENTENCE

Generate complete songs, covers, edits, and separated stems from a description or reference audio.

ACE-Step 1.5 is catalogued as open-source model. Read the research file and current GitHub README before using it in production.

Project type
Open-source model
Requirements
Windows / macOS / Linux; CUDA、Apple Silicon、ROCm、Intel XPU or CPU
Real cost
MIT; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Cut costsResearch queue

QwenAudio/CosyVoice

CosyVoice

IN ONE SENTENCE

Build multilingual, Chinese-dialect, cross-lingual cloning, and streaming speech services from one model family.

CosyVoice is catalogued as open-source speech tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source speech tool
Requirements
Python / Linux / Docker / NVIDIA GPU
Real cost
Apache-2.0; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Cut costsResearch queue

hexgrad/kokoro

Kokoro

IN ONE SENTENCE

Create lightweight multilingual text-to-speech that is fast enough to integrate into real content workflows.

Kokoro is catalogued as open-source speech tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source speech tool
Requirements
Python 3.10–3.13 / Localor Colab
Real cost
Apache-2.0; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Cut costsResearch queue

modelscope/ClearerVoice-Studio

ClearerVoice-Studio

IN ONE SENTENCE

Repair noisy, reverberant, or unclear recordings with enhancement, separation, and target-speaker extraction.

ClearerVoice-Studio is catalogued as open-source speech tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source speech tool
Requirements
Python / Linux preferred / Localor GPU
Real cost
Apache-2.0; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Cut costsNew discovery

CapSoftware/Cap

Cap

IN ONE SENTENCE

See what Cap can add to a real workflow before you install it.

Cap is catalogued as open-source video tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source video tool
Requirements
macOS / Windows; 可选 Docker self-hosted
Real cost
Actual cost still needs verification.
Cut costsNew discovery

remsky/Kokoro-FastAPI

Kokoro-FastAPI

IN ONE SENTENCE

See what Kokoro-FastAPI can add to a real workflow before you install it.

Kokoro-FastAPI is catalogued as open-source speech tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source speech tool
Requirements
Docker; CPU、NVIDIA/AMD GPU or Apple Silicon 原生运行
Real cost
Actual cost still needs verification.
Cut costsNew discovery

KartikLabhshetwar/better-shot

BetterShot

IN ONE SENTENCE

Capture, record, caption, zoom, and trim a Mac tutorial or product demo inside one native app.

BetterShot is catalogued as open-source video tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source video tool
Requirements
macOS; Homebrew or DMG 安装; 需屏幕录制与辅助功能权限
Real cost
Actual cost still needs verification.
Cut costsNew discovery

Anil-matcha/Open-Generative-AI

Open Generative AI

IN ONE SENTENCE

Bring hundreds of image, video, lip-sync, and creative models into one self-hosted studio.

Open Generative AI is catalogued as open-source video tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source video tool
Requirements
JavaScript / Browser / self-hostedserver; 需接入相应模型服务
Real cost
MIT; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Cut costsNew discovery

Moh4696/freecut

Freecut

IN ONE SENTENCE

Let Codex or Claude Code grade footage, trim clips, add captions, transitions, and animated overlays.

Freecut is catalogued as open-source video tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source video tool
Requirements
Python / Local电脑 / FFmpeg / Codex or Claude Code
Real cost
MIT; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Add capability

freestylefly/awesome-gpt-image-2

Awesome GPT Image 2

IN ONE SENTENCE

Reuse patterns distilled from hundreds of GPT-Image-2 examples, templates, and style skills.

Awesome GPT Image 2 is catalogued as agent skill. Read the research file and current GitHub README before using it in production.

Project type
Agent skill
Requirements
Browser / agents with Skills support / GPT-Image-2 or兼容图像服务
Real cost
MIT; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Add capabilityNew discovery

music-assistant/server

Music Assistant

IN ONE SENTENCE

Unify music services, local libraries, and connected speakers, then automate playback with Home Assistant.

Music Assistant is catalogued as open-source project. Read the research file and current GitHub README before using it in production.

Project type
Open-source project
Requirements
Home Assistant 插件or Docker; 需常开 Raspberry Pi、NAS、NUC 等设备
Real cost
Actual cost still needs verification.
Automate workNew discovery

browser-use/video-use

video-use

IN ONE SENTENCE

See what video-use can add to a real workflow before you install it.

video-use is catalogued as open-source video tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source video tool
Requirements
Python / ffmpeg / yt-dlp; 需要模型与视频处理依赖
Real cost
MIT; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Cut costsNew discovery

oboroge0/hayamimi

早耳 hayamimi

IN ONE SENTENCE

See what 早耳 hayamimi can add to a real workflow before you install it.

早耳 hayamimi is catalogued as open-source speech tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source speech tool
Requirements
Python / CPU / 约 2GB RAM; Browser面板
Real cost
MIT; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.
Add capabilityNew discovery

Anil-matcha/Open-AI-UGC

Open AI UGC

IN ONE SENTENCE

See what Open AI UGC can add to a real workflow before you install it.

Open AI UGC is catalogued as open-source project. Read the research file and current GitHub README before using it in production.

Project type
Open-source project
Requirements
Next.js self-hosted; 需 MUAPI 等生成服务、模型额度和部署环境; 带 Stripe 的 SaaS 模板路线
Real cost
Actual cost still needs verification.
Automate workNew discovery

datascale-ai/opentalking

OpenTalking

IN ONE SENTENCE

See what OpenTalking can add to a real workflow before you install it.

OpenTalking is catalogued as open-source platform. Read the research file and current GitHub README before using it in production.

Project type
Open-source platform
Requirements
Mock 模式可用 CPU 试流程; 真实口型与实时渲染通常需 Python、Node.js、FFmpeg、模型和 8GB+ VRAM GPU
Real cost
Actual cost still needs verification.
Add capabilityNew discovery

motiful/product-shots

Product Shots

IN ONE SENTENCE

See what Product Shots can add to a real workflow before you install it.

Product Shots is catalogued as agent skill. Read the research file and current GitHub README before using it in production.

Project type
Agent skill
Requirements
Claude Code、Codex、Cursor、Windsurf 等agents with Skills support; 需兼容图像生成接口并人工检查商品一致性
Real cost
Actual cost still needs verification.
Automate workNew discovery

pexoai/pexo-skills

Pexo Skills

IN ONE SENTENCE

See what Pexo Skills can add to a real workflow before you install it.

Pexo Skills is catalogued as agent skill. Read the research file and current GitHub README before using it in production.

Project type
Agent skill
Requirements
支持 Agent Skills 的客户端; 安装需 Node.js/npx,实际生成需 Pexo API Key
Real cost
Actual cost still needs verification.
Add capabilityNew discovery

AtlasCloudAI/atlas-marketing-studio

Atlas Marketing Studio

IN ONE SENTENCE

See what Atlas Marketing Studio can add to a real workflow before you install it.

Atlas Marketing Studio is catalogued as open-source video tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source video tool
Requirements
Node.js / Next.js; self-hosted需 Atlas Cloud API、数据库、对象存储和 OAuth,支付模块可选
Real cost
Actual cost still needs verification.
Automate workNew discovery

danielgatis/rembg

rembg

IN ONE SENTENCE

See what rembg can add to a real workflow before you install it.

rembg is catalogued as open-source image tool. Read the research file and current GitHub README before using it in production.

Project type
Open-source image tool
Requirements
Python 3.11–3.13; CLI、Python 库、HTTP 服务or Docker; 支持 CPU 与 GPU
Real cost
MIT; models, APIs, compute, storage, hosting, and maintenance may add real costs. Verify the repository license and current service terms.