AutoClip - AI Video Clipping & Highlight Tool
AI-powered video clipping and highlight generation with automatic download from YouTube and Bilibili.
Evidence: API keys are stored via environment variables, no hardcoded credentials found; user must manually configure API keys, but no explicit user confirmation mechanism (e.g., second confirmation for dangerous operations) found; data flow is described in README architecture diagram, but detailed data flow and storage locations are not specified; sensitive data handling (e.g., Bilibili cookies) is mentioned but encryption measures are not detailed; dependency list includes known packages, but no vulnerability scan results provided; external effects include video download and upload to Bilibili (in development), but permission controls are not described; no rollback mechanism provided; source attribution: MIT license and copyright notice exist, but publisher is unverified. Deductions: lack of user confirmation, insufficient data flow transparency, missing sensitive data handling details, unverified dependency security, unclear permission controls for external effects, no rollback mechanism.
Evidence: README, SECURITY.md, CI config, and test files are largely consistent in feature descriptions, but some inconsistencies exist (e.g., version support in SECURITY.md vs README); dependency list is explicit, but no version pinning or integrity checks provided; error handling system has detailed tests, but no actual runtime verification. Deductions: dependency availability unverified, failure messages based only on code review, not actual execution.
Evidence: README clearly identifies target users (video creators, content teams) and use cases (YouTube/Bilibili video clipping); capability boundaries are described in feature list and in-development features; trigger precision: user triggers via UI, but trigger conditions are not detailed; environment fit: Docker and local deployment provided, supports macOS/Linux/Windows, but not all platforms are fully tested. Deductions: trigger precision description insufficient, environment fit not fully verified.
Evidence: README is well-structured with project structure, API docs, quick start; install notes are detailed including Docker and local deployment; naming stability: API endpoint naming is consistent, but version numbers are not explicit; examples and FAQ are rich; known limitations: in-development features are marked, but not all limitations are listed; license: MIT license file present; versioning changelog: no CHANGELOG provided; maintenance responsibility: SECURITY.md provides security contact email, but publisher is unverified. Deductions: naming stability not fully explicit, versioning changelog missing, maintenance responsibility not fully clear.
Evidence: Output usability: generated clips and collections are downloadable, but no actual output examples provided; marginal value: AI auto-clipping and smart collections are differentiating features, but no comparison with other tools; cost-benefit: requires API keys and compute resources, but no performance benchmarks provided. Deductions: output examples missing, cost-benefit not quantified.
Evidence: Feature claims in README have some code support (e.g., pipeline steps), but implementation details are not provided; cross-source verification: relies solely on single repository, no external validation; fact-inference separation: in-development features are clearly marked, but some claims (e.g., AI analysis capability) lack evidence. Deductions: claim traceability insufficient, cross-source corroboration missing, fact-inference separation not fully adequate.
- Publisher identity is unverified; treat security claims with caution.
- Dependencies are not version-pinned, posing supply chain risks.
- Sensitive data handling (e.g., Bilibili cookies) lacks encryption details.
- No rollback mechanism; mistakes may be irreversible.
- AI features rely on external APIs; consider data privacy and costs.
What does this agent do, and when should you use it?
AutoClip is an open-source intelligent video clipping system that downloads videos from platforms like YouTube and Bilibili, analyzes content using the Qwen large language model, automatically identifies highlight segments, and generates compilations. The system uses a modern front-end/back-end separation architecture, with FastAPI and Celery for backend processing and React/TypeScript for the frontend, providing real-time progress updates and comprehensive project management. Deployment is straightforward with Docker one-click scripts and local startup scripts, offering flexibility for different production environments. Advanced features such as Bilibili upload and subtitle editing are currently under development.
AutoClip ingests video files or platform links, downloads YouTube videos via yt-dlp, downloads Bilibili videos through custom APIs, and supports uploading local files. The video is submitted to an AI analysis engine (based on Qwen) that extracts an outline, identifies topic timelines, scores segments for highlight-worthiness, and generates titles. Users can create projects in the React frontend, monitor processing progress (via WebSocket), manage generated clips and compilations, and export or download results. The backend utilizes Celery for asynchronous tasks, Redis as the message broker, SQLite for data storage, and exposes a REST API via FastAPI.
- Content creators who need to quickly extract highlights from long videos for social media.
- Video editors looking to automate batch processing to reduce manual clipping time.
- Bilibili uploaders wanting to upload sliced videos, though the upload feature is not yet available.
- Educational institutions needing to extract key segments from lecture recordings.
- Entertainment enthusiasts wanting to auto-generate highlight compilations from movies or shows.
- Business teams extracting decision points from meeting recordings for review.
What are this agent's strengths and limitations?
- Modern tech stack (FastAPI, React, TypeScript) with a clean separation of concerns, making it easy to extend.
- Supports multi-platform video download (YouTube, Bilibili) and local upload, with integrated AI analysis for high automation.
- Offers Docker one-click deployment and detailed local deployment docs for various environments.
- Asynchronous task queue with real-time progress updates improves user experience.
- AI analysis depends on Alibaba Cloud's Qwen API, creating vendor lock-in and requiring a paid API key.
- Bilibili upload, subtitle editing, and multi-language support are not yet implemented, missing some advanced features.
- Backend storage relies on SQLite and Redis, which may need migration to PostgreSQL for large-scale deployments.
- Mobile support is under development; the current interface is desktop-focused.
How do you install or deploy this agent?
Requirements: Python 3.8+, Node.js 16+, Redis 6.0+, FFmpeg, Docker (optional). Recommended: clone the repository and run ./docker-start.sh for Docker deployment. For local setup, create a virtual environment, install dependencies, configure a .env file with Qwen API key, and then start Redis, backend, and frontend. See the 'Quick Start' section in the README for exact commands.
How do you use this agent?
After starting the services, access the frontend at http://localhost:3000. Click 'New Project', select a video source (YouTube link, Bilibili link, or local file), paste the link or upload the file (optionally with subtitles), and start the download. The system automatically performs AI analysis, clip generation, and compilation. In the project detail page, you can review clips, edit titles and descriptions, create/edit compilations, and download outputs. API documentation is available at http://localhost:8000/docs.
FAQ
Does AutoClip require a paid API key?
API_DASHSCOPE_API_KEY in the .env file. Without it, video downloading and basic processing still work, but AI highlight extraction will not function.What should I do if YouTube download fails?
pip install --upgrade yt-dlp. If the problem persists, try using browser cookies when creating the project.Does Bilibili download require login?
Can I deploy this system in production?
Can AutoClip work with other AI models?
API_MODEL_NAME). However, the project structure includes an LLM manager (llm_manager.py), so it might be extensible, but documentation does not provide guidance for adding other models.