video-clipping

byAhmad Yani

# PROMPT MASTER — BANGUN APLIKASI AI VIDEO CLIPPING MIRIP OPUS CLIP (FUNCTIONAL 99%) ## 0. PERAN Bertindaklah sebagai: - Senior Full-Stack Engineer - AI/ML Engineer - UI/UX Designer - DevOps Engineer - Product Manager Tugas Anda: membangun aplikasi web SaaS end-to-end bernama **ClipForge AI** yang secara fungsional mirip 99% dengan Opus Clip. Fokus pada feature parity, UX, dan pipeline AI. Jangan menyalin merek, logo, aset, copywriting, atau desain persis dari Opus Clip. Gunakan branding, ikon, warna, dan kode orisinal. ## 1. TUJUAN PRODUK ClipForge AI adalah platform AI untuk: - Mengubah video panjang menjadi banyak klip pendek viral. - Otomatis memilih momen terbaik. - Auto reframe ke 9:16, 1:1, 16:9. - Menambahkan caption, emoji, B-roll, musik, sound effect, hook, title, CTA. - Memberi virality score. - Export dan publish ke TikTok, Reels, Shorts, LinkedIn, X. - Kolaborasi tim, approval, analytics, billing. ## 2. TARGET PENGGUNA - Content creator - Podcaster - Agency - Social media manager - Coach/educator - Tim marketing - Editor video ## 3. FITUR UTAMA (WAJIB SEMUA) ### 3.1 Autentikasi & Workspace - Sign up/login: email, Google, magic link. - Workspace multi-tenant. - Role: Owner, Admin, Editor, Viewer. - Undang anggota via email. - Manajemen profil dan preferensi. ### 3.2 Import Video - Upload file: MP4, MOV, MKV, WebM, MP3, WAV. - Import dari URL YouTube, Vimeo, Zoom, Google Drive, Dropbox. - Maksimal durasi awal: 3 jam. - Progress upload, resume, validasi format. - Antrian processing. ### 3.3 Pipeline AI Otomatis Saat video diupload, jalankan pipeline: 1. Transcode ke format standar dengan FFmpeg. 2. Ekstrak audio. 3. Transkripsi dengan WhisperX/Whisper large-v3. 4. Diarisasi speaker. 5. Deteksi scene dan silence. 6. Analisis transcript dengan LLM untuk mencari: - Hook kuat - Emosi tinggi - Kontroversi - Insight berharga - Cerita menarik - Punchline - Kutipan viral 7. Hitung virality score 0–100. 8. Tentukan boundary klip optimal. 9. Generate 5–30 klip per video. 10. Auto reframe 9:16 dengan face tracking. 11. Generate caption animasi. 12. Tambahkan emoji, B-roll, SFX, musik. 13. Generate judul, deskripsi, hashtag, thumbnail. 14. Simpan semua versi ke storage. ### 3.4 Clip Library - Grid/list klip. - Filter: skor, durasi, topik, status, tanggal. - Sorting: virality, terbaru, terpopuler. - Preview hover. - Bulk action: export, delete, schedule, pindah folder. - Search transkrip. ### 3.5 Editor Klip - Timeline multi-track. - Trim, split, delete, duplicate, reorder. - Crop & reframe manual/otomatis. - Caption editor: font, warna, posisi, animasi, karaoke style. - Emoji otomatis/manual. - Sticker, shape, progress bar. - B-roll dari library atau AI generate. - Musik & SFX library. - Voice enhancement, noise removal. - Text-to-speech. - AI assistant: “Buat hook lebih viral”, “Pendekkan jadi 30 detik”, “Tambah caption”. - Preview real-time. - Version history. ### 3.6 Brand Kit - Logo, warna, font, intro, outro. - Template caption. - Template hook. - Watermark. - Default aspect ratio. - Simpan sebagai preset. ### 3.7 Export & Publish - Export MP4, MOV, GIF, SRT, VTT, ASS. - Resolusi 720p, 1080p, 4K. - Aspect ratio: 9:16, 1:1, 16:9, 4:5. - Schedule ke TikTok, Instagram Reels, YouTube Shorts, LinkedIn, X. - Integrasi OAuth sosial media. - Caption otomatis saat publish. - Bulk export. - Download ZIP. ### 3.8 Kolaborasi - Komentar timestamp. - Mention anggota. - Approval workflow. - Activity log. - Shared folder. - Permission per project. ### 3.9 Analytics - Views, watch time, engagement, CTR. - Per platform. - Virality score vs performa nyata. - Top klip. - Export CSV. ### 3.10 Billing & Subscription - Free trial. - Plan: Free, Pro, Team, Enterprise. - Limit berdasarkan menit video/bulan. - Stripe integration. - Usage meter. - Invoice. - Upgrade/downgrade. - Cancel. ### 3.11 Admin Panel - Manajemen user, workspace, subscription. - Monitoring queue. - Log error. - Feature flag. - Statistik penggunaan. - Moderasi konten. ## 4. ALUR PENGGUNA UTAMA 1. User daftar/login. 2. Buat workspace. 3. Upload/import video. 4. Pilih preset: Podcast, Webinar, Vlog, Gaming, Edukasi. 5. AI processing. 6. Lihat daftar klip + virality score. 7. Pilih klip, edit di editor. 8. Tambah caption, B-roll, brand kit. 9. Preview. 10. Export atau schedule. 11. Lihat analytics. 12. Kelola tim dan billing. ## 5. ARSITEKTUR SISTEM Gunakan arsitektur modular: - Frontend: Next.js 14 App Router, TypeScript, Tailwind CSS, shadcn/ui, Zustand, React Query, Remotion untuk preview video, WaveSurfer untuk audio. - Backend: NestJS atau FastAPI, REST + GraphQL opsional, WebSocket untuk progress. - Database: PostgreSQL + Prisma. - Cache & Queue: Redis + BullMQ/Celery. - Storage: AWS S3 / Cloudflare R2. - Video Processing: FFmpeg, MediaPipe, YOLO, Rembg. - AI: OpenAI GPT-4o, Whisper, Claude, Gemini, Replicate, HuggingFace. - Infra: Docker, Kubernetes, AWS/GCP, CloudFront, GitHub Actions. - Monitoring: Sentry, PostHog, Grafana. ## 6. SKEMA DATABASE (MINIMAL) Tabel: - users - workspaces - workspace_members - projects - videos - transcripts - transcript_segments - clips - clip_versions - clip_assets - templates - brand_kits - social_accounts - schedules - subscriptions - usage_records - comments - activities - analytics_events - notifications - api_keys - feature_flags Sertakan relasi, index, foreign key, enum status, dan migration. ## 7. API ENDPOINTS (MINIMAL) Auth: - POST /auth/register - POST /auth/login - POST /auth/logout - GET /auth/me Workspace: - GET/POST /workspaces - GET/PATCH/DELETE /workspaces/:id - POST /workspaces/:id/invite Video: - POST /videos/upload - POST /videos/import-url - GET /videos - GET /videos/:id - DELETE /videos/:id - GET /videos/:id/status Clip: - GET /clips - GET /clips/:id - PATCH /clips/:id - POST /clips/:id/export - POST /clips/:id/schedule - DELETE /clips/:id AI: - POST /ai/analyze - POST /ai/reframe - POST /ai/caption - POST /ai/broll - POST /ai/hook Billing: - POST /billing/checkout - POST /billing/webhook - GET /billing/usage Admin: - GET /admin/users - GET /admin/workspaces - GET /admin/queues - GET /admin/logs ## 8. UI/UX Buat halaman: - Landing page - Pricing - Login/Register - Dashboard - Upload/Import - Processing status - Clip library - Editor - Brand kit - Schedule - Analytics - Team - Billing - Settings - Admin Gaya: - Modern, clean, gelap/terang. - Responsif. - Aksesibel WCAG AA. - Loading skeleton. - Toast notification. - Empty state. - Error state. - Keyboard shortcut. - Drag and drop. ## 9. NON-FUNCTIONAL - Scalable horizontal. - Video processing async. - Retry otomatis. - Rate limiting. - Enkripsi data. - GDPR & privasi. - Backup harian. - Audit log. - SSO untuk Enterprise. - API publik. - Webhook. - Multi-bahasa: Indonesia, Inggris, dll. ## 10. OUTPUT YANG HARUS DIHASILKAN Hasilkan: 1. Struktur folder monorepo. 2. Kode frontend lengkap. 3. Kode backend lengkap. 4. Skema database + migration + seed. 5. Dockerfile & docker-compose. 6. File .env.example. 7. Integrasi AI pipeline. 8. Integrasi Stripe. 9. Integrasi sosial media. 10. Unit test, integration test, e2e test. 11. Dokumentasi API. 12. README setup lokal & deploy. 13. CI/CD GitHub Actions. 14. Mock data dan placeholder jika API key belum ada. 15. Komentar kode jelas. ## 11. ROADMAP Fase 1 MVP: - Auth, upload, transkripsi, clip generation, editor dasar, export. Fase 2: - Auto reframe, caption animasi, brand kit, schedule. Fase 3: - B-roll AI, analytics, kolaborasi, billing. Fase 4: - API publik, SSO, enterprise, mobile app. ## 12. ACCEPTANCE CRITERIA - Video 1 jam diproses < 15 menit. - Akurasi transkripsi > 90%. - Virality score berkorelasi dengan engagement. - Export 1080p berhasil. - UI responsif. - Tidak ada error kritis. - Billing berjalan. - Multi-tenant aman. ## 13. LARANGAN - Jangan gunakan nama, logo, atau aset Opus Clip. - Jangan copy kode berlisensi proprietary. - Jangan hardcode API key. - Jangan buat fitur ilegal. - Jangan abaikan keamanan. ## 14. INSTRUKSI AKHIR Mulai dengan: 1. Rencana arsitektur. 2. Struktur folder. 3. Skema database. 4. Kode backend. 5. Kode frontend. 6. Pipeline AI. 7. Testing. 8. Deployment. Jika ada bagian yang ambigu, buat asumsi terbaik dan tulis di dokumentasi. Bangun semaksimal mungkin hingga aplikasi bisa dijalankan secara lokal dengan `docker-compose up`.