Timothy Pomeroy 401551d3a0 Add watcher health monitoring and auto-recovery system 3 weeks ago
..
DEVELOPMENT_NOTES.md b0d470b2e8 Add comprehensive Mermaid.js diagrams to all documentation files 1 month ago
DUPLICATE_DETECTION_IMPLEMENTATION.md d3d59b06e1 feat: optimize duplicate detection with database-indexed hashing 4 weeks ago
DUPLICATE_DETECTION_OPTIMIZATION.md d3d59b06e1 feat: optimize duplicate detection with database-indexed hashing 4 weeks ago
DUPLICATE_DETECTION_QUICKREF.md d3d59b06e1 feat: optimize duplicate detection with database-indexed hashing 4 weeks ago
MIGRATION_API_PROXY.md 92b3619b88 docs: update migration guide formatting 1 month ago
QUICK_REFERENCE_CARD.md d3d59b06e1 feat: optimize duplicate detection with database-indexed hashing 4 weeks ago
README.md 7b7c4f0ac9 Initial commit 1 month ago
UI_AND_CLI_INTERFACES.md d3d59b06e1 feat: optimize duplicate detection with database-indexed hashing 4 weeks ago
UI_CLI_SUMMARY.md d3d59b06e1 feat: optimize duplicate detection with database-indexed hashing 4 weeks ago
WATCHER_HEALTH_MONITORING.md 401551d3a0 Add watcher health monitoring and auto-recovery system 3 weeks ago
architecture.md ccf61d1a99 docs: update documentation with recent improvements and fixes 1 month ago
cli.md ca27d758e6 fix: correct queue processing logic for batchSize and concurrency 1 month ago

README.md

Documentation

This directory contains comprehensive documentation for the Watch Finished Turbo project.

Files

  • architecture.md - Complete system architecture documentation with Mermaid.js diagrams
    • System overview and components
    • Data flows and event architecture
    • Service interactions and API endpoints
    • Database schema and deployment architecture
    • Error handling and performance considerations
  • cli.md - Command-line interface documentation
    • Complete CLI command reference
    • Task management commands
    • Queue configuration and monitoring
    • Configuration management
    • Examples and usage patterns

System Overview

Watch Finished Turbo is a video processing system that:

  1. Automatically detects new video files in configured directories using file system watching
  2. Creates processing tasks immediately when video files are detected
  3. Processes videos automatically using HandBrake with configurable presets via a background task queue
  4. Provides manual control through a web interface for requeuing failed tasks or changing priorities
  5. Tracks progress and status in real-time via WebSocket events
  6. Stores all data in a local SQLite database

Key Features

  • Automatic File Detection: File system monitoring with Chokidar detects new video files instantly
  • Task-Based Processing: Background task queue processes files automatically with priority handling
  • Advanced Queue Management: Configurable batch processing, concurrency limits, and automatic retry logic
  • Real-time Progress Tracking: Live updates during video encoding via WebSocket
  • Manual Override Control: Web interface allows manual requeuing and priority management
  • Dataset Management: Configurable processing presets per directory
  • Modern Web UI: React/Next.js interface with real-time updates and dark mode support
  • Event-Driven Architecture: WebSocket-based real-time communication
  • Comprehensive CLI: Full command-line interface for all system operations

Quick Start

  1. Configure your dataset directories and HandBrake presets
  2. Start the file watcher to begin automatic monitoring
  3. Video files added to watched directories are automatically detected and queued for processing
  4. The system processes files in the background using the task queue
  5. Monitor progress in real-time through the web UI
  6. Use manual requeue for failed tasks or to change processing priorities
  7. Access processed files once encoding is complete

Implementation Status

Automatic Processing: File detection triggers immediate task creation and background processing ✅ Task Queue System: Priority-based queue with concurrent processing limits ✅ Advanced Queue Settings: Configurable batch size, concurrency, retry logic, and processing intervals ✅ Real-time Monitoring: WebSocket events for live progress updates ✅ Manual Override: Web interface allows requeuing failed tasks with custom priorities ✅ Enhanced Task Model: Tasks contain all necessary processing metadata with retry tracking ✅ Comprehensive CLI: Full command-line interface for task management and queue configuration ✅ Deployment: Docker Compose for containerized deployment