Writing & Content video-editingffmpegspeech-transcriptionsubtitle-burningcolor-gradingtimeline-analysisanimation-overlays

Video Use

Turn raw footage into a graded, subtitled, quality-checked edit through a coding agent.

FollowAgents review · FARS-2.1
Not recommended
54/ 100 5-point scale 2.7 / 5
1 2 3 4 5 6
1Trust13 / 29 · 2.2/5

The README discloses one ElevenLabs Scribe call per source, the API-key requirement, output under the source directory's edit/ folder, and a propose-confirm-execute workflow, providing meaningful data-flow, external-effect, and confirmation evidence. Originals appear not to be overwritten, but no formal backup, undo, or recovery mechanism is documented. The agent is expected to have shell access, inspect media directories, and install dependencies without demonstrated permission minimization or isolation. The key is stored in .env, but file permissions, redaction, retention, and incident handling are not addressed. Dependencies are unpinned and there is no evidence of vulnerability scanning, integrity verification, or supply-chain controls. MIT attribution is clear, while maintainer identity and responsibility paths are thin; the unverified publisher is treated as unknown without an identity-based penalty.

2Reliability6 / 14 · 2.1/5

The README, project metadata, and dependency declaration are broadly consistent about the purpose and basic setup, and identify Python packages, ffmpeg, optional yt-dlp, ElevenLabs, and the Python requirement. Deductions reflect absent availability checks or fallback behavior for external services, system binaries, and animation tools, plus a multi-agent compatibility claim broader than the Claude Code-oriented package description. No evidence shows actionable failure messages, fault classification, retry guidance, or troubleshooting examples; the claimed three-attempt self-evaluation loop is also unsupported by supplied code or tests.

3Adaptability14 / 18 · 3.9/5

The material names interviews, tutorials, travel, talking-head, and montage scenarios and supports customizable subtitles, grading chains, and animation tools, thoroughly describing audiences and scenarios. It establishes basic boundaries and triggering through transcript-first inspection, on-demand visual composites, and strategy approval before editing. Deductions apply because claims such as working for any content and making zero assumptions are overly broad, with no limits for formats, duration, languages, or complex editing tasks. Environment guidance favors macOS Homebrew and lacks Windows/Linux instructions, resource requirements, and a compatibility matrix.

4Convention10 / 18 · 2.8/5

The README has a useful progression through features, setup, usage, architecture, pipeline, and principles; naming and conventions such as final.mp4 and edit/ are mostly stable, with manual-install and session examples. The complete MIT text agrees with pyproject metadata, justifying full license credit. Deductions reflect the absence of an FAQ, troubleshooting section, and comprehensive known limitations; version 0.1.0 is present but no changelog, release policy, or compatibility promise is supplied. A copyright holder is named, but maintainers, support and security-reporting routes, and update responsibility are unclear. Important details are deferred to SKILL.md and install.md, which are not in the supplied evidence.

5Effectiveness7 / 13 · 2.7/5

The intended artifact, location, editing features, and workflow are concrete, and transcript plus on-demand visual inspection offers plausible marginal value over frame-by-frame input. Deductions reflect the lack of sample outputs, quality benchmarks, or static test evidence supporting editing, self-evaluation, and automatic repair claims; the 45M-token versus 12KB comparison is an uncorroborated example. Cost-benefit coverage is thin because it mentions one transcription call and reduced visual input but provides no API pricing, processing time, compute, storage, or rerun-cost analysis.

6Verifiability4 / 8 · 2.5/5

Repository metadata directly supports the name, version, Python requirement, dependency list, and MIT license, while the README distinctly explains the transcript layer, visual layer, and intended pipeline. Most central claims—including filler removal, cut-boundary self-evaluation, parallel animation generation, and up to three repair attempts—cannot be traced to supplied implementation, tests, examples, or logs and lack cross-source corroboration. Architecture and promotional language are reasonably distinguishable, but several performance and universality statements are presented as facts without labels identifying them as estimates, goals, or inferences.

Evidence confidence: Low Reviewed Aug 23, 2026 Reviewed revision 92c2b34e44c2
The upstream repository has new commits since this review. The score still applies to the reviewed revision shown and may not cover the latest changes.
Safety controls not found in source: dependency security
Before you use it
  • Source audio is sent to ElevenLabs. Before processing confidential, copyrighted, or personal-data-bearing footage, verify authorization, service terms, retention, and data-residency requirements.
  • The agent requires shell access and is instructed to clone code, install dependencies, and register a skill. Review commands in an isolated environment and restrict access to the intended media directory.
  • requests, librosa, matplotlib, pillow, numpy, and setuptools are not version-pinned. Establish a lockfile, integrity checks, and vulnerability scanning before deployment.
  • Do not assume the README's automatic quality checks or three-attempt repair loop are reliable; no implementation, tests, or sample artifacts were supplied for verification.
  • No formal undo, backup, or failure-recovery procedure is documented. Preserve read-only originals and work on copies when first using it with important footage.
Review evidence [1][2][3]
See the full review method →

What does this agent do, and when should you use it?

Video Use is an open-source video-editing workflow operated through coding agents for footage such as talking heads, tutorials, interviews, travel videos, and montages. It uses ElevenLabs Scribe to obtain word-level timestamps, speaker diarization, and audio events, then condenses multiple takes into a text-first working document named takes_packed.md. At ambiguous pauses, retake comparisons, and other decision points, timeline_view generates a PNG combining filmstrip frames, a waveform, word labels, and silence-gap candidates. Once the user approves a strategy, the workflow creates an EDL, renders through ffmpeg, and evaluates every cut in the rendered result, with up to three fix-and-rerender attempts. The finished file is written to edit/final.mp4 beside the source footage, while project.md preserves session context for later work; it runs inside a coding-agent environment with shell and filesystem access.

The workflow inventories source media and makes one ElevenLabs Scribe transcription call per source to collect word-level timing, speaker labels, and events such as laughter, applause, and sighs. It packs the takes into takes_packed.md, which the agent reads to identify filler words, false starts, alternate takes, and silence gaps; timeline_view is invoked when a decision requires visual evidence. After strategy approval, it produces an EDL and renders with ffmpeg, applying per-segment color treatment, 30ms audio fades at cuts, and burned-in subtitles whose default format is two-word uppercase chunks. Animation overlays can be produced with HyperFrames, Remotion, Manim, or PIL, with separate animations assigned to parallel sub-agents. The rendered output is inspected with timeline_view at every cut boundary for visual jumps, audio pops, and hidden subtitles; a passing result becomes edit/final.mp4, and session memory is stored in project.md.

  1. A presenter with several raw talking-head takes who wants filler words, false starts, and dead space removed before publishing a launch video.
  2. A video editor who wants to specify pacing, color treatment, subtitle styling, or a custom ffmpeg chain conversationally instead of working through presets and menus.
  3. A content team cutting an interview or tutorial that needs speech-boundary precision plus speaker and audio-event context.
  4. A producer adding generated overlays from Remotion, Manim, HyperFrames, or PIL to a product demo, montage, or educational video.
  5. A self-hosting user who wants editing to run from a local machine, VPS, or Telegram-connected agent while keeping outputs beside the original footage.

What are this agent's strengths and limitations?

Pros
  • Its text-first representation uses a roughly 12KB takes_packed.md plus a small number of on-demand PNGs instead of placing every video frame in the agent context.
  • Transcription includes word-level timestamps, speaker diarization, and audio events, enabling cuts based on speech boundaries rather than fixed time intervals alone.
  • The rendered video is checked at every cut for visual jumps, audio pops, and hidden subtitles, with up to three fix-and-rerender cycles.
  • The workflow includes 30ms cut fades, subtitle burning, per-segment color grading, and several documented animation-overlay generators.
  • It requires strategy approval before executing an edit and records project context in project.md for later sessions.
Limitations
  • The documented transcription layer depends on ElevenLabs Scribe, an ELEVENLABS_API_KEY, and network access.
  • Adoption requires a shell-capable coding agent, local filesystem access, and ffmpeg; this is not presented as a standalone in-browser editor.
  • The agent does not watch the complete video directly and instead relies on transcripts and requested timeline_view images; performance on silent or primarily visual footage is not documented.
  • The supplied ffmpeg and yt-dlp installation commands are Homebrew-specific, with no equivalent setup documented for other operating systems.
  • Automated correction stops after at most three rerenders, and no recovery behavior is described for an output that still fails evaluation.

How do you install or deploy this agent?

For agent-led setup, use Claude Code, Codex, Hermes, Openclaw, or another shell-capable agent and instruct it to read the repository's install.md, clone https://github.com/browser-use/video-use, install the dependencies and ffmpeg, register the repository in the current agent's skills directory, and request the ELEVENLABS_API_KEY when needed.

Manual installation:

  1. git clone https://github.com/browser-use/video-use ~/Developer/video-use
  2. For Claude Code: ln -sfn ~/Developer/video-use ~/.claude/skills/video-use
  3. For Codex: ln -sfn ~/Developer/video-use ~/.codex/skills/video-use
  4. cd ~/Developer/video-use
  5. Run uv sync, or use pip install -e .
  6. Run brew install ffmpeg.
  7. Optionally run brew install yt-dlp for downloading online sources.
  8. Run cp .env.example .env.
  9. Edit .env and set ELEVENLABS_API_KEY=....

The documented package commands use Homebrew; equivalent ffmpeg and optional yt-dlp installation steps for other operating systems are not supplied.

How do you use this agent?

Put the raw footage in a directory, then run:

cd /path/to/your/videos
claude

For Codex, replace the second command with codex. In the session, make a concrete request such as edit these into a launch video. The agent inventories the sources, proposes an editing strategy, and waits for approval before cutting, rendering, and evaluating the result. The final video is saved as <videos_dir>/edit/final.mp4, with all other outputs under <videos_dir>/edit/. Before routine work, the agent should read SKILL.md and the editing scripts under helpers/.

FAQ

Is ElevenLabs required?
The documented transcription layer uses ElevenLabs Scribe and requires ELEVENLABS_API_KEY. No alternative transcription provider is described.
Will it alter the edit before I approve the plan?
The stated workflow inventories the footage and proposes a strategy first, then waits for approval before producing the EDL and rendering.
Where are the finished video and intermediate files stored?
All outputs go under <videos_dir>/edit/, with the finished video at edit/final.mp4; the skill directory remains clean.
What happens when the rendered edit has a problem?
The workflow runs timeline_view at every rendered cut boundary to look for visual jumps, audio pops, and hidden subtitles. It can fix and rerender detected issues up to three times.
Does it work with Codex?
Yes. The repository documents a ~/.codex/skills/video-use symlink and explicitly includes Codex among the shell-capable agents that can perform setup and use the workflow.

Compare agents like this one

The same FARS review applied across the shortlist this agent qualifies for.

Related agents