AI Video Player

#Overview

AI Video Player is a full-featured desktop app for local libraries and YouTube/remote URLs. It layers AI on top of classic playback — auto subtitles in 100+ languages, semantic transcript search, summaries & chapters, a streaming tutor, translation, emotion analysis, quizzes, and FFmpeg-powered clip tools.

#Core Playback

• 📚 Video library — folder scan, thumbnails, search & sort
• 🔗 URL playback — YouTube embed + direct media URLs via yt-dlp
• ⏩ Player controls — A/B loop, 0.25×–4× speed, PiP, fullscreen
• 📋 Playlist queue — auto-advance with rebindable hotkeys
• 💾 Watch history — resume playback with HTTP range streaming

#AI Features

• 🗣️ AI subtitles — AssemblyAI / Gladia / Whisper / Gemini routing with speaker diarization
• ⏱️ Auto-sync — align cues to speech onset via FFmpeg
• 🔍 Semantic search — FAISS + sentence-transformers, seek-on-click results
• 📝 Summary & chapters — Gemini or local Ollama, pointwise or paragraph
• 🎓 AI tutor — streaming Q&A about video content (SSE)
• 🌐 Translation — MyMemory → Gemini/Ollama fallback
• ✨ Smart highlights — key moments spaced across the timeline
• 😊 Emotion / sentiment — per-segment tone analysis
• ❓ Quiz generation — comprehension Q&A from the transcript

#Clips & Processing

• ✂️ Clip creator, screenshots, named bookmarks
• 🎞️ GIF creator (two-pass palettegen)
• 🔗 Clip merger, speed remapping, frame extraction
• 🎯 Subtitle auto-sync for exported media

#Tech Stack

#Architecture

ai-video-player/
├── electron/       # Main process + IPC + service launcher
├── frontend/web/   # React + Vite player UI
├── backend/        # Express API (transcribe, tutor, clips…)
└── ai-service/     # FastAPI + FAISS + Whisper/Gemini