📚 Table of Contents¶
This comprehensive table of contents lists all sections and subsections of the Continuum MAAAS documentation, following the site's navigation structure.
🎯 Overview¶
- Continuum Marketing Agency As A Service
- 📋 Context Level Documentation - This is the root context level of the Continuum system documentation following...
📦 Containers¶
🎯 Overview¶
- Containers Documentation
- 📦 Container Structure - Each container represents a major functional area of the system:
- 📋 Container Documentation Format - Each container directory contains:
- 🔗 Inter-Container Communication - All containers communicate through:
🎥 Production & Distribution¶
🎯 Overview¶
- Production & Distribution
- 🎯 Overview - The Production & Distribution container manages the creative production...
- 📋 Responsibilities - - Creative Production: Content creation tools and marketplaces
- 🔧 Key Components - - Template Marketplace
- 🏗️ Architecture Patterns - - Producer-Consumer: Render queue and worker pattern
⚙️ Components¶
🎯 Overview¶
- Components Documentation
- Component Categories - #
- Component Documentation Format - Each component directory contains:
🎞️ Montagist¶
🎯 Overview¶
- Montagist
- 🎯 Overview - The Montagist is an intelligent video assembly system designed to create...
- 🏗️ System Architecture - Based on the detailed Montagist documentation, the system follows a hybrid...
- 🔧 Core Components - #
- 🔄 Data Flow Architecture - mermaid
- 📋 Internal Timeline Format - JSON Timeline Structure:
- ☁️ AWS Scalability Architecture - #
- 🎯 Development Principles - #
- 🗺️ Implementation Roadmap - #
- 📊 Development Status - According to the Creative Production documentation:
- 📚 Documentation Status - The following sections require additional information and are marked for future...
📥 Asset Ingest System¶
- Asset Ingest System
- Overview - The Asset Ingest System is responsible for receiving and cataloging all...
- Responsibilities - Based on the Montagist documentation:
- Input Types - #
- Output Structure - #
- Processing Flow - mermaid
- Asset Processing Pipeline - #
- Integration Points - #
- Error Handling - #
- Performance Considerations - #
- Development Status - Status: TODO - Implementation details not yet documented
- Documentation Status - The following sections require additional information and are marked for future...
🔍 Content Analysis Engine¶
- Content Analysis Engine
- 🎯 Overview - The Content Analysis Engine is responsible for extracting semantic and...
- 🎯 Responsibilities - Based on the Montagist documentation:
- 🔍 Analysis Modules - #
- 🏗️ Analysis Architecture - mermaid
- 🔄 Processing Pipeline - #
- 🤖 AI/ML Components - #
- 🔗 Integration Points - #
- ⚡ Performance Optimization - #
- ✅ Quality Assurance - #
- 🚧 Development Status - Status: TODO - Implementation details not yet documented
- 📚 Documentation Status - The following sections require additional information and are marked for future...
⏰ Timeline Generation Engine¶
- Timeline Generation Engine
- Overview - The Timeline Generation Engine is responsible for creating the base editing...
- Responsibilities - Based on the Montagist documentation:
- Processing Workflow - The Timeline Generation Engine follows a structured process:
- Editing Rules - #
- Timeline Structure - #
- Rule Engine Architecture - #
- Optimization Algorithms - #
- Integration Points - #
- Performance Considerations - #
- Quality Assurance - #
- Development Status - Status: TODO - Implementation details not yet documented
- Documentation Status - The following sections require additional information and are marked for future...
🤖 AI Enhancement Modules¶
- AI Enhancement Modules
- Overview - The AI Enhancement Modules are responsible for refining and optimizing the base...
- Architecture - The AI Enhancement Modules work in parallel to enhance the base timeline:
- Module Components - #
- AI Models and Technologies - #
- Processing Architecture - #
- Integration Points - #
- Performance Optimization - #
- Quality Assurance - #
- Development Status - Status: TODO - Implementation details not yet documented
- Documentation Status - The following sections require additional information and are marked for future...
🎬 MLT Rendering Engine¶
- MLT Rendering Engine
- Overview - The MLT Rendering Engine is responsible for generating the final video by...
- Responsibilities - Based on the Montagist documentation:
- MLT Framework Capabilities - #
- Rendering Architecture - mermaid
- Processing Pipeline - #
- MLT Framework Integration - #
- Output Formats and Codecs - #
- Performance Optimization - #
- Integration Points - #
- Error Handling and Recovery - #
- Monitoring and Observability - #
- Development Status - Status: TODO - Implementation details not yet documented
- Documentation Status - The following sections require additional information and are marked for future...
📝 Advanced Subtitle System¶
- Advanced Subtitle System
- 🎯 Overview - The Advanced Subtitle System is responsible for generating aesthetically...
- 🎯 Responsibilities - Based on the Montagist documentation:
- ⭐ Core Features - #
- 📱 Platform Configuration - #
- 🔄 Subtitle Processing Pipeline - #
- 🚀 Advanced Features - #
- 🔗 Integration Points - #
- ⚡ Performance Optimization - #
- ✅ Quality Assurance - #
- 🚧 Development Status - Status: TODO - Implementation details not yet documented
- 📚 Documentation Status - The following sections require additional information and are marked for future...
🎨 Animation Designer Bot¶
🎯 Overview¶
- Animation Designer Bot
- 🎯 Overview - The Animation Designer Bot is an advanced AI system that leverages computer...
- 🤖 Core Technology - Based on the Creative Production documentation:
- 🔗 Integration with Production Pipeline - As documented in the Creative Production module:
- 🧠 Learning and Evolution - - Continuous Training: Ongoing improvement through analysis of existing...
- 📊 Development Status - According to the Creative Production documentation:
- 🏗️ System Architecture - #
- 🔍 Computer Vision Hybrid Approach - #
- 🎥 Natron Integration - #
- ⚙️ Distributed Worker System - #
- 📝 External Standards Integration - #
- 👥 Development Team Structure - #
- 🔧 Processing Modules - #
- 📊 Technology Stack - #
- 📚 Documentation Status - The following sections require additional information and are marked for future...
🏗️ Architecture¶
- 🏗️ Animation Designer Bot - System Architecture
- 📋 Overview - The Animation Designer Bot is a comprehensive AI-driven motion graphics...
- 🎯 System Architecture Diagram - mermaid
- 🔄 Data Flow Architecture - #
- 🏗️ System Components - #
- 🔧 Technical Architecture Principles - #
- 📊 Performance Characteristics - #
- 🚀 Development Architecture - #
🔍 Computer Vision¶
- 🔍 Computer Vision Hybrid Approach
- 🎯 Overview - The Animation Designer Bot uses a breakthrough hybrid computer vision approach...
- 🌈 Dual-Rendering Methodology - #
- 🔍 Deterministic Computer Vision Pipeline - #
- 🧠 Pattern Extraction for WFC - #
- 📊 Performance Metrics - #
- 🚀 Implementation Pipeline - #
- 🔧 Technical Requirements - #
🎥 Natron Integration¶
- 🎥 Natron Integration - Technical Breakthrough
- 🚀 Breakthrough Achievement - Status: ✅ COMPLETELY FUNCTIONAL
- 📊 Breakthrough Metrics - | Metric | Before | After | Improvement |
- 🎯 Critical Achievements - #
- 🎬 Technical Demonstration - #
- 🔧 Validated Technical Methodology - #
- Script: natron_zigzag_save_project.py
- Script: natron_zigzag_render_project.py
- 🏗️ Natron Project Builder Architecture - #
- 📚 Complete Plugin Documentation - #
- Text node creation
- Transform node with animation
- Merge node for compositing
- 🔄 JSON to Natron Conversion Pipeline - #
- 🚀 Impact for Animation Designer Bot - #
- 📈 Next Steps - #
- ✅ Conclusion - The Animation Designer Bot now has complete technical capability for...
⚙️ Worker System¶
- ⚙️ Distributed Worker System
- 🎯 Overview - The Animation Designer Bot uses a sophisticated distributed worker system to...
- 🏗️ System Architecture - mermaid
- 📋 Job Queue System - #
- ⚙️ Worker Implementation - #
- Python Worker Implementation
- 🐳 Containerization and Orchestration - #
- Dockerfile for Node.js Worker
- Install system dependencies
- Install Natron
- Set working directory
- Copy package files
- Install dependencies
- Copy application code
- Create non-root user
- Switch to non-root user
- Expose port
- Health check
- Start worker
- kubernetes/worker-deployment.yaml
- 📊 Monitoring and Health Checks - #
- 🚀 Auto-scaling Configuration - #
- kubernetes/hpa.yaml
- 🔧 Configuration and Deployment - #
- .env.example
- Redis Configuration
- Worker Configuration
- Natron Configuration
- Resource Limits
- Monitoring
- deploy-workers.sh
- Deploy Redis
- Deploy Workers
- Deploy HPA
- Deploy Monitoring
- Wait for deployment
- Verify deployment
📝 Standards Integration¶
- 📝 External Standards Integration
- 🎯 Overview - The Animation Designer Bot integrates with industry-standard formats and...
- 🎨 Lottie Animations Integration - #
- 📝 Pango Markup Integration - #
- Pango Markup integration in Designer Bot
- 🔄 Bidirectional Conversion System - #
- 🛠️ Development Tools and Libraries - #
- Web rendering
- React component
- After Effects plugin
- Download from Adobe Exchange: bodymovin
- Python bindings
- System dependencies (Ubuntu/Debian)
- System dependencies (macOS)
- 📊 Performance Considerations - #
- 🔗 Integration Benefits - #
👥 Team Structure¶
- 👥 Development Team Structure
- 🎯 Team Overview - The Animation Designer Bot requires a specialized development team of 6-7...
- 📊 Technology Stack Analysis - #
- 👥 Core Team Structure - #
- 🎯 Hiring Priority Matrix - #
- 💰 Hiring Challenges and Solutions - #
- 📈 Recommended Hiring Plan - #
- 🔍 Realistic Skill Combinations - #
- 💵 Budget Estimations (USD Market) - #
- 📋 Success Factors - #
- 🚀 Team Development Strategy - #
🔧 Processing Modules¶
- 🔧 Processing Modules
- 🎯 Overview - The Animation Designer Bot's processing modules form the core logic for content...
- 🏗️ Module Architecture - mermaid
- 📄 JSON Schema Generator - #
- 🎨 Static Layout Generator - #
- ⚡ Animation Engine - #
- 🎬 Scene State Manager - #
- 🧮 4D Constraint Solver - #
- ⏱️ Timeline Optimizer - #
- ✅ Quality Validator - #
📊 Technology Stack¶
- 📊 Technology Stack
- 🎯 Complete Technology Overview - The Animation Designer Bot uses a comprehensive technology stack of 100+...
- 🏗️ Technology Architecture - mermaid
- 🎨 Frontend & User Interface - #
- ⚙️ Backend & API Layer - #
- 🤖 Artificial Intelligence & Machine Learning - #
- 🗄️ Database & Storage Technologies - #
- 🎨 Graphics & Image Processing - #
- 🎥 Rendering & Compositing - #
- 🧮 Optimization & Algorithms - #
- ☁️ Infrastructure & DevOps - #
- 🔧 Development Tools & Libraries - #
- 📊 Performance & Optimization - #
- 🔒 Security & Compliance - #
- 📈 Scalability & Performance Targets - #
🚀 Developer Guide¶
- 🚀 Developer Onboarding Guide
- 🎯 Welcome to Animation Designer Bot - This guide will help new developers understand the Animation Designer Bot...
- 📋 Quick Start Checklist - #
- 🏗️ System Architecture Overview - #
- 🔧 Development Environment Setup - #
- Clone the repository
- Install Node.js dependencies
- Install Python dependencies
- Set up pre-commit hooks
- Copy environment template
- Edit environment variables
- Database Configuration
- AI Services
- Natron Configuration
- AWS Configuration
- Development Settings
- Start PostgreSQL
- Start MongoDB
- Start Redis
- Start Elasticsearch
- Start the development environment
- Or start individual services
- 📚 Essential Documentation - #
- 🎯 Development Workflow - #
- Create feature branch
- Make changes and commit
- Push and create PR
- 🧪 Testing and Quality Assurance - #
- Run all tests
- Run specific test suites
- Run tests with coverage
- Linting
- Type checking
- Security audit
- 🐛 Debugging and Troubleshooting - #
- Check database status
- Restart databases
- Check API keys
- Test AI services
- Check Natron installation
- Test rendering pipeline
- 📈 Performance Optimization - #
- 🚀 Deployment and Production - #
- Build production version
- Start production server
- Test production build
- Deploy to staging
- Deploy to production
- Monitor deployment
- 📞 Getting Help - #
- 🎯 Success Metrics - #
📋 Implementation Details¶
- 📋 Implementation Details & Technical Specifications
- 🎯 Overview - This document captures specific implementation details, technical...
- 🔍 Advanced Computer Vision Features - #
- 🎥 Advanced Natron Integration - #
- 🎨 Advanced UI/UX Specifications - #
- 🔧 Advanced Processing Modules - #
- 📊 Advanced Monitoring and Analytics - #
- 🚀 Deployment and Scaling Specifications - #
- Advanced Kubernetes HPA configuration
- Prometheus configuration for advanced monitoring
🚀 Multi Engine Render Farm¶
🎯 Overview¶
- Multi-Engine Render Farm
- 🎯 Overview - The Multi-Engine Render Farm is a distributed computing system designed to...
- 🚀 Supported Rendering Engines - Based on the Creative Production documentation:
- 📁 File Processing System - #
- 🏗️ Infrastructure Management - #
- 📈 Scalability Architecture - As documented in the Creative Production module:
- 🏗️ Three-Zone Architecture - The Multi-Engine Render Farm operates using a three-zone architecture for...
- 📊 Development Status - According to the Creative Production documentation:
- 🖥️ Frontend Integration - #
- 📚 Documentation Status - The following sections require additional information and are marked for future...
🏗️ Architecture¶
- Multi-Engine Render Farm Architecture
- 🎯 Overview - The Multi-Engine Render Farm operates using a three-zone architecture that...
- 🏗️ Three-Zone Architecture - Based on the Media Production diagram, the system is organized into three...
- 📡 Communication Flow - #
- 🔄 Backend Zone Internal Communication - #
- 📊 Architecture Diagram - mermaid
- 🎯 Component Responsibilities - #
- 📈 Scalability Features - #
- 🔗 Integration Points - #
- ⚡ Performance Considerations - #
- 🚧 Development Status - Status: TODO - Implementation details not yet documented
- 📚 Documentation Status - The following sections require additional information and are marked for future...
🎬 Render Queue Manager¶
🎯 Overview¶
- 🎬 Render Queue Manager
- 🎯 Overview - The Render Queue Manager is the core component responsible for managing render...
- 📊 Version Status - #
- 🚀 Key Features - #
- 📊 System Architecture - #
- 🔧 Technology Stack - #
- 📈 Performance Characteristics - #
- 🎯 Use Cases - #
- 📚 Documentation Structure - This documentation is organized into comprehensive sections covering all...
- 🚀 Quick Start - #
- Clone and install V2
- Run with configuration
- Clone and build V3
- Run with configuration
- 📊 Development Status - #
- 🔗 Related Components - - Multi Engine Render Farm: Parent system overview
- 📞 Support - For technical support, feature requests, or bug reports:
🏗️ Architecture¶
- 🏗️ System Architecture
- 🎯 Overview - The Render Queue Manager architecture is designed for high-performance,...
- 📊 Version Architecture Comparison - #
- 🏛️ High-Level Architecture - #
- 🏛️ High-Level Architecture - #
- 🏗️ Component Architecture - #
- 🔄 Data Flow Architecture - #
- 🎯 Adaptive Capacity Management - #
- 🔧 Technology Stack Architecture - #
- 🛡️ Security Architecture - #
- 📊 Monitoring & Observability - #
- 🚀 Scalability Architecture - #
- 📚 Implementation Guidelines - #
📡 API Reference¶
- 📡 API Reference
- 🎯 Overview - The Render Queue Manager provides a comprehensive REST API for managing render...
- 📊 Version API Comparison - #
- 🌐 Base Configuration - #
- 🔐 Authentication - #
- 📦 Jobs API - #
- 🤖 Workers API - #
- 🎛️ Orchestration API - #
- ☁️ AWS EC2 Management API - #
- 🔍 System Administration API - #
- 📊 Error Handling - #
- 🔄 WebSocket API - #
🤖 Worker Management¶
- 🤖 Worker Management
- 🎯 Overview - Worker Management is a critical component of the Render Queue Manager that...
- 🏗️ Worker Architecture - #
- 🔧 Worker Registration - #
- 📡 Worker Communication - #
- 🎛️ Worker Orchestration - #
- 📊 Worker Monitoring - #
- 🛠️ Worker Configuration - #
- 🚀 Worker Deployment - #
- 🔄 Worker Lifecycle - #
- 📚 Best Practices - #
🎬 Job Processing¶
- 🎬 Job Processing
- 🎯 Overview - Job Processing is the core functionality of the Render Queue Manager that...
- 🏗️ Job Architecture - #
- 📝 Job Creation - #
- 🔄 Job Processing Flow - #
- 📊 Progress Tracking - #
- 🛠️ Job Management - #
- 🔄 Error Handling - #
- 📊 Job Analytics - #
- 🚀 Performance Optimization - #
🎛️ Orchestration¶
- 🎛️ Orchestration
- 🎯 Overview - Orchestration is the intelligent automation system that manages worker scaling,...
- 🏗️ Orchestration Architecture - #
- 📈 Automatic Scaling - #
- 🔍 Adaptive Capacity Management - #
- 🎛️ Orchestration Configuration - #
- 📊 Orchestration Monitoring - #
- 🚀 Advanced Features - #
- 🛠️ Orchestration API - #
- 📚 Best Practices - #
🚀 Deployment¶
- 🚀 Deployment
- 🎯 Overview - Deployment documentation provides comprehensive guides for installing,...
- 📊 Version Deployment Comparison - #
- 🏗️ Deployment Architecture - #
- 🏗️ Deployment Architecture - #
- 🔧 Prerequisites - #
- 📦 Installation - #
- Install Node.js 16+
- Verify installation
- Clone V2 repository
- Install dependencies
- Build application
- Start with PM2
- Or start directly
- Install Rust using rustup
- Add to PATH
- Verify installation
- Clone V3 repository
- Build application
- Start directly
- Or run binary
- Build Docker image
- Run container
- Launch EC2 instance
- Install Rust
- Install dependencies
- Clone and build application
- Start application
- ⚙️ Configuration - #
- Server configuration
- Database configuration
- AWS configuration
- Monitoring configuration
- 🚀 Deployment Strategies - #
- Start development server
- Start with hot reload
- Production deployment script
- Stop existing service
- Backup current version
- Deploy new version
- Update configuration
- Start service
- Verify deployment
- 📊 Database Setup - #
- Create jobs table
- Create workers table
- Create config table
- 🔍 Monitoring Setup - #
- ELK Stack setup
- 🛠️ Maintenance - #
- Maintenance script
- Rotate logs
- Clean up old jobs
- Update system packages
- Restart service
- Backup script
- Backup DynamoDB tables
- Backup configuration
- Backup logs
- Recovery script
- Restore DynamoDB backup
- Restore configuration
- Restart service
- 🚀 Scaling - #
📊 Monitoring¶
- 📊 Monitoring
- 🎯 Overview - Monitoring provides comprehensive observability for the Render Queue Manager,...
- 🏗️ Monitoring Architecture - #
- 📈 Metrics Collection - #
- 🔍 Health Checks - #
- 📊 Metrics Export - #
- HELP jobs_created_total Total number of jobs created
- TYPE jobs_created_total counter
- HELP jobs_completed_total Total number of jobs completed
- TYPE jobs_completed_total counter
- HELP jobs_failed_total Total number of jobs failed
- TYPE jobs_failed_total counter
- HELP workers_active Current number of active workers
- TYPE workers_active gauge
- HELP queue_depth Current queue depth
- TYPE queue_depth gauge
- HELP http_requests_total Total number of HTTP requests
- TYPE http_requests_total counter
- HELP http_request_duration_seconds HTTP request duration in seconds
- TYPE http_request_duration_seconds histogram
- 📝 Logging - #
- docker-compose.yml
- 🚨 Alerting - #
- alerting-rules.yml
- alertmanager.yml
- 📊 Dashboards - #
- 🔧 Monitoring Configuration - #
- Development
- Production
- 📚 Best Practices - #
👨💻 Developer Guide¶
- 👨💻 Developer Guide
- 🎯 Overview - The Developer Guide provides comprehensive information for developers working...
- 📊 Version Development Comparison - #
- 🏗️ Development Environment - #
- 🏗️ Development Environment - #
- Install Node.js 16+
- Verify installation
- Clone V2 repository
- Install dependencies
- Copy development configuration
- Set up environment variables
- Install Rust using rustup
- Add to PATH
- Verify installation
- Clone V3 repository
- Install dependencies
- Copy development configuration
- Set up environment variables
- Create test DynamoDB tables
- Start development environment
- Run tests
- Run with hot reload
- 🏗️ Project Structure - #
- 🎨 Coding Standards - #
- 🔧 Development Workflow - #
- Main branches
- Feature branches
- Release branches
- Commit message format
- Examples
- Run all tests
- Run specific test category
- Run tests with output
- Run tests in parallel
- Run tests with coverage
- 🚀 Performance Optimization - #
- Install memory profiler
- Run with memory profiling
- Analyze memory usage
- 🔧 Debugging and Troubleshooting - #
- Clean build artifacts
- Update dependencies
- Check for dependency conflicts
- Verify Rust version
- 📚 Contributing Guidelines - #
- Description - Brief description of changes
- Type of Change - - [ ] Bug fix
- Testing - - [ ] Unit tests added/updated
- Checklist - - [ ] Code follows style guidelines
- 🚀 Release Process - #
- GitHub Actions workflow
🔧 Troubleshooting¶
- 🔧 Troubleshooting
- 🎯 Overview - Troubleshooting documentation provides comprehensive guidance for diagnosing...
- 🚨 Common Issues - #
- Check system resources
- Check service status
- Restart service
- Check database connectivity
- Check DynamoDB table status
- Verify AWS credentials
- Test connectivity
- Check IAM permissions
- Check EC2 capacity
- Verify launch template
- Check security groups
- Review orchestration logs
- Check worker status
- Check queue depth
- Check system metrics
- Analyze job processing time
- Check memory usage
- Check for memory leaks
- Reduce queue size
- Scale down workers
- Check DynamoDB metrics
- Optimize capacity
- Validate configuration
- Check environment variables
- Test configuration
- Check authentication headers
- Verify secret keys
- Check IAM permissions
- Review access logs
- 🔍 Diagnostic Tools - #
- Basic health check
- Detailed health check
- System metrics
- Queue statistics
- System resources
- Process monitoring
- Network monitoring
- Real-time logs
- Filter by level
- Filter by time
- Search for specific errors
- Check instance status
- Check instance metrics
- Check launch templates
- Check table status
- Check table metrics
- Check table items
- Check bucket status
- Check bucket metrics
- 🛠️ Resolution Procedures - #
- Graceful shutdown
- Wait for cleanup
- Start service
- Verify status
- Check health
- Check table status
- If table is in CREATING state, wait
- If table is in DELETING state, recreate
- Check worker status
- Restart offline workers
- Verify worker registration
- Backup current configuration
- Reset to default configuration
- Validate configuration
- Restart service
- Check current environment
- Reset environment variables
- Restart service
- Clean up old jobs
- Clean up failed jobs
- Force scaling operation
- Check scaling status
- 🚨 Emergency Procedures - #
- Check DynamoDB backups
- Restore from backup
- Verify data integrity
- Check resource usage
- Scale down if necessary
- Clean up resources
- 📚 Prevention Strategies - #
- 📞 Support Resources - #
🤖 Workers¶
🎯 Overview¶
- 🎬 Workers
- 🎯 Overview - The Workers component manages distributed rendering workers that execute...
- 🚀 Supported Worker Types - #
- 🏗️ Worker Architecture - #
- 📁 Worker Components - #
- 📊 Performance Metrics - #
- 🔧 Configuration - #
- 📚 Documentation Structure - Each worker type includes comprehensive documentation:
- 🚀 Getting Started - #
- 📈 Future Development - #
🎬 After Effects Rendering Worker¶
🎯 Overview¶
- 🎬 After Effects Rendering Worker V4.1
- 🎯 Overview - The After Effects Rendering Worker V4.1 is an ultra-optimized rendering system...
- ✨ Key Features V4.1 - #
- 🏗️ V4.1 Simplified Architecture
- 🆔 AWS Instance Tracking (NEW V4.1) - #
- ⚡ SimpleScript Architecture (V4.1) - #
- 📊 Version Comparison - | Feature | V3 | V4.0 | V4.1 | V4.1 Improvement |
- 🚀 Quick Start V4.1 - #
- Clone project
- Install dependencies (requires NPM proxy running)
- Test AWS Instance ID detection
- Test log cleanup
- Create config.json
- Automated deploy
- Configure RDPKicker and startup script
- Verify operation
- Production mode (with AWS Instance ID detection and graceful shutdown)
- With custom shutdown configuration
- 🛑 Graceful Shutdown with Notification (NEW V4.1) - #
- 🧪 Testing V4.1 - #
- Basic worker test
- AWS Instance ID detection test
- Test with real job (verifies jobExecutor)
- SimpleScript generation test
- On AWS machine - you should see:
- 🧹 Advanced Log Management V4.1 - #
- Manual
- Automatic (Task Scheduler)
- Create scheduled task (as Admin)
- 🌐 Network Configuration - #
- Configure RDP Connector
- Connect via RDP
- Verify infrastructure
- 📚 Documentation - #
- 🔄 Migration to V4.1 - #
- 1. Backup configuration
- 2. Pull V4.1
- 3. Update dependencies
- 4. Deploy with RDPKicker
- 5. Verify AWS Instance ID detection
- 6. Verify jobs have layerID (if coming from V3)
- 🎯 Project Status V4.1 - ✅ PRODUCTION V4.1 READY
- 🔮 Roadmap - #
- 📋 System Requirements V4.1 - - Node.js: >= 16.0.0 (v22.14.0 recommended)
🏗️ Architecture¶
- 🏗️ Technical Architecture
- 🎯 Architecture Overview - The After Effects Rendering Worker V4.1 features a simplified architecture that...
- 🧩 Core Components - #
- ⚡ SimpleScript Architecture Details - #
- 🔗 After Effects Integration - #
- 📊 Performance and Optimization - #
- 🧪 Testing Strategy - #
- 🔧 Development and Debugging - #
- 1. Local development (Linux)
- 2. Test changes
- 3. Validate SimpleScript
- 4. Deploy to Windows
- 5. Remote testing
- 📁 Detailed File Structure
- 🔮 Future Architecture - #
- 🔧 Provider System - #
- ⚙️ Configuration System - #
📡 API Reference¶
- 📡 API Reference
- 🎯 Overview - The After Effects Rendering Worker V4.1 communicates with the Queue Manager...
- 🔄 Communication Cycle
- 🎯 1. Job Pickup - Endpoint: GET /api/v1/jobs/pickup
- 🔄 2. Job Status Updates - Endpoint: PUT /api/v1/jobs/{uid}
- 🛑 3. Shutdown Notification - Endpoint: POST /api/v1/workers/shutdown
- 🔄 Typical Message Sequences - #
- 🚦 Throttling and Optimizations - #
- 🔧 Authentication Headers - http
- 📝 Optional/Conditional Fields - | Field | Present When |
- 🔍 Error Codes - #
- 📊 Performance Metrics - #
- 🔧 Configuration Parameters - #
- 🧪 Testing API Endpoints - #
- 📚 SDK and Client Libraries - #
🚀 Deployment¶
- 🚀 Deployment Guide
- 🎯 Overview - This guide provides step-by-step instructions for deploying the After Effects...
- 📋 Configuration Checklist - #
- Configuration with credentials (use config.example.json as template)
- 🚀 Automated Deployment Scripts - #
- Code deployment (from any location)
- Configuration deployment (from any location)
- RDP connector (from any location)
- Complete deployment (excludes config.json for security)
- Fast deployment (only src/ and package.json)
- Deployment with config.json included
- Simulate deployment without sending files
- Deploy config.json (requires confirmation)
- Simulate configuration deployment
- Connect to Windows worker
- 🔧 SSH/Rsync and RDP Configuration - #
- Generate new key for AWS
- Copy public key to server
- Install intelligent RDP connector
- Configure PEM path if different (optional)
- Change: PEM_FILE="$HOME/Picnic/PEMS/Continuum_workers.pem"
- Reload aliases
- Use connector
- 🧪 Testing and Verification - #
- 1. Deploy code
- 2. Deploy config (first time only or changes)
- 3. Connect and verify
- Start worker
- In another terminal, test job
- Verify AWS credentials (be careful with logs)
- Check worker logs
- 🔄 Automation and Monitoring - #
- Install CloudWatch Agent
- Configure logs: C:\PicnicWorker\logs\worker.log
- Script to rotate credentials
- rotate-aws-credentials.sh
- 1. Create new credentials in IAM
- 2. Update config.json
- 3. Redeploy config
- 4. Delete old credentials
- 🔧 Quick Commands - #
- Deploy code (without credentials)
- Deploy config (only when credentials change)
- Fast deployment (only src)
- Connect via RDP (graphical interface)
- Connect via SSH (command line)
- Start worker with AWS credentials
- View logs in real time
- Verify configuration
- Restart worker
- Check worker status
- Check AE processes
- Check disk space
- Check network connectivity
- ⚠️ Security Considerations - #
- 📊 Technical Specifications - #
- 🆘 Troubleshooting - #
- Check worker logs
- Check AWS connectivity
- Test job pickup
- Verify AWS Instance ID detection
⚙️ Configuration¶
- ⚙️ Configuration
- 🎯 Overview - The After Effects Rendering Worker V4.1 uses a centralized configuration system...
- 📁 Configuration Files - #
- 🔧 Configuration Options - #
- 🌍 Environment Variables - #
- 📋 Configuration Templates - #
- 🔧 Configuration Loading - #
- 🛡️ Security Best Practices - #
- Set restrictive permissions on config.json
- Ensure only owner can read/write
- Set environment variables securely
- Clear sensitive variables after use
- 🔍 Configuration Validation - #
- 📊 Configuration Monitoring - #
- 🧪 Configuration Testing - #
- Test configuration loading
- Test with environment variables
- Run configuration validation
- Test specific configuration
- 🔄 Configuration Migration - #
- Backup current configuration
- Restore from backup
🔄 Migration¶
- 🔄 Migration Guide
- 🎯 Overview - This migration guide provides step-by-step instructions for migrating from...
- 📋 Compatibility Matrix - #
- 🚀 Migration from V3 (Vanilla) - #
- 1. Verify Node.js version
- 2. Verify Windows connectivity
- 3. Verify NPM proxy
- 4. Verify After Effects
- Backup current V3 configuration
- Clone V4.1 Worker
- Install dependencies
- Create config.json from V3 settings
- Update configuration with V3 values
- Add new V4.1 specific settings
- Verify jobs have layerID (required for V4.1)
- Update queue to V2.3+ if needed
- All jobs must include layerID in assets
- Deploy V4.1 to Windows
- Deploy configuration
- Verify deployment
- Test AWS Instance ID detection
- Test with real job
- Test SimpleScript generation
- You should see:
- Job processing should be 94% faster than V3
- Memory usage should be 50% less than V3
- 🔄 Migration from V4.0 (AST) - #
- 1. Pull V4.1
- 2. Update dependencies
- 3. Deploy (no config changes needed)
- 4. Verify performance improvement
- ⚠️ Queue Compatibility Requirements - #
- 1. Update queue server to V2.3+
- 2. Ensure all job templates include layerID
- 3. Test with sample jobs
- 4. Deploy V4.1 worker
- 🔙 Rollback Procedures - #
- 1. Stop V4.1 worker
- 2. Restore V3 configuration
- 3. Start V3 worker
- 4. Verify V3 operation
- 1. Stop V4.1 worker
- 2. Checkout V4.0 branch
- 3. Deploy V4.0
- 4. Verify V4.0 operation
- 🧪 Migration Testing - #
- Test current V3/V4.0 functionality
- Test job processing
- Test API connectivity
- Test V4.1 functionality
- Test AWS Instance ID detection
- Test SimpleScript generation
- Test performance improvements
- Test V3 job compatibility
- Test layerID requirements
- Test configuration migration
- 📊 Migration Validation - #
- Check worker status
- Check logs for errors
- Verify AWS integration
- Check performance metrics
- 🚨 Common Migration Issues - #
- Problem: Jobs missing layerID
- Solution: Update queue to V2.3+ and ensure all jobs have layerID
- Check job format
- Update job templates
- Problem: Not running on AWS or IMDS v2 disabled
- Solution: Worker will fallback to hostname
- Check AWS environment
- Verify fallback works
- Problem: Invalid configuration values
- Solution: Validate and fix configuration
- Validate configuration
- Fix configuration issues
- 📈 Migration Benefits - #
- 🔮 Post-Migration Roadmap - #
🔧 Troubleshooting¶
- 🆘 Troubleshooting
- 🎯 Overview - This troubleshooting guide provides comprehensive solutions for common issues...
- 🚨 Common Error Categories - #
- 🔌 Connectivity Troubleshooting - #
- Instead of critical error:
- For network problems:
- Verify server is running
- Check network configuration
- Test port connectivity
- Check DNS resolution
- Check host configuration in config.json
- Check secret in config.json
- Test secret manually
- ⚙️ Configuration Troubleshooting - #
- 🎬 After Effects Troubleshooting - #
- ☁️ AWS Integration Troubleshooting - #
- 📊 Performance Troubleshooting - #
- 🔍 Diagnostic Tools - #
- Run comprehensive API test
- With specific environment variables
- Validate configuration
- Test specific configuration
- Test AWS Instance ID detection
- 🚨 Emergency Procedures - #
- 📋 Verification Checklist - #
- 🔧 Prevention Strategies - #
- 🔮 Future Improvements - #
🔧 Operations¶
- 🔧 Operations
- 🎯 Overview - The Operations section covers day-to-day management, monitoring, maintenance,...
- 📊 Monitoring and Health Checks - #
- Check if worker process is running
- Check worker logs for errors
- Check system resources
- Check After Effects processes
- Check aerender availability
- Test aerender manually
- Test AWS Instance ID detection
- Check AWS credentials
- Test S3 connectivity
- Check recent job processing
- Monitor memory usage
- Check error rates
- 📝 Log Management - #
- Manual log rotation
- Automatic log cleanup (Task Scheduler)
- Successful job completion
- Failed jobs
- AWS Instance ID detection
- Shutdown events
- API connectivity issues
- Generate daily report
- Analyze performance trends
- Check error patterns
- 🔄 Maintenance Procedures - #
- 1. Check worker status
- 2. Review overnight logs
- 3. Check system resources
- 4. Verify AWS connectivity
- 5. Check disk space
- 1. Review daily performance
- 2. Clean temporary files
- 3. Archive old logs
- 4. Check for pending jobs
- 1. Full system diagnostics
- 2. Performance analysis
- 3. Security audit
- 4. Configuration validation
- 1. Rotate logs
- 2. Compress old logs
- 3. Upload logs to S3 (optional)
- 1. Check for Node.js updates
- 2. Check for After Effects updates
- 3. Update worker code
- 4. Rotate AWS credentials
- 1. Analyze performance trends
- 2. Optimize configuration
- 3. Clean up old data
- 🚨 Incident Response - #
- 1. Check if process is running
- 2. Check logs for crash information
- 3. Restart worker
- 4. Monitor startup
- 1. Check AE processes
- 2. Check AE logs
- 3. Restart AE service
- 4. Test aerender
- 1. Test AWS connectivity
- 2. Check credentials
- 3. Test S3 access
- 4. Check instance metadata
- 1. Stop all processes
- 2. Clean temporary files
- 3. Restart worker
- 4. Monitor startup
- 1. Backup current config
- 2. Restore from backup
- 3. Validate configuration
- 4. Restart worker
- 📈 Performance Optimization - #
- Clean temporary files
- Compress old logs
- Archive old data
- 🔐 Security Operations - #
- 1. Generate new credentials in AWS IAM
- 2. Update config.json
- 3. Deploy new configuration
- 4. Test new credentials
- 5. Delete old credentials from AWS IAM
- 1. Generate new secret
- 2. Update config.json
- 3. Deploy new configuration
- 4. Test new secret
- 1. Generate new SSH key
- 2. Deploy new key
- 3. Test new key
- 4. Remove old key
- Set restrictive permissions on config.json
- Set permissions on logs directory
- 📊 Reporting and Analytics - #
- Generate daily performance report
- Generate daily error report
- Generate weekly system health report
- Generate weekly performance trends report
- Generate monthly comprehensive analysis
- Generate monthly capacity planning report
- 🔧 Automation Scripts - #
- Create daily cleanup task
- Create weekly maintenance task
- Daily cleanup at 2 AM
- Weekly maintenance on Sunday at 3 AM
- Monthly report on 1st at 4 AM
- health-check.sh
- Check worker process
- Check system resources
- Check AWS connectivity
- performance-monitor.sh
- Get current performance metrics
- Log metrics
- Alert if performance is below threshold
👨💻 Developer Guide¶
- 👨💻 Developer Guide
- 🎯 Overview - This developer guide provides comprehensive information for developers working...
- 🚀 Development Setup - #
- Clone repository
- Install dependencies
- Verify installation
- Development environment variables
- 🏗️ Code Structure - #
- 🧪 Testing - #
- Run all unit tests
- Run specific test file
- Run tests with coverage
- Run integration tests
- Test with real job
- Test API connectivity
- Run performance benchmarks
- Test script generation performance
- Test memory usage
- Test AWS Instance ID detection
- Test with real job
- Test SimpleScript generation
- Test API connectivity
- Deploy to test environment
- Run production tests
- Test shutdown functionality
- 🐛 Debugging - #
- Monitor worker logs
- Filter debug messages
- Check error patterns
- Start worker with debugger
- Connect debugger
- Open Chrome DevTools at chrome://inspect
- Test script generation
- Check job pickup
- Verify job structure
- Test asset processing
- Test AWS connectivity
- Check Instance ID detection
- Test S3 access
- Test aerender availability
- Test AE script execution
- Check AE logs
- 🔧 Development Workflow - #
- Create feature branch
- Make changes
- ... code changes ...
- Run tests
- Commit changes
- Push branch
- Create pull request
- Update version
- Create release notes
- Update CHANGELOG.md
- Tag release
- Test deployment
- Production deployment
- Verify deployment
- 📚 Code Standards - #
- 🔄 Continuous Integration - #
- 🚀 Performance Optimization - #
- 🔐 Security Considerations - #
- Use environment variables for sensitive data
✅ Quality Control System¶
- Quality Control System
- 🎯 Overview - The Quality Control System employs computer vision technologies to...
- ⚙️ Core Functionality - Based on the Creative Production documentation:
- 🔗 Integration Points - As documented in the Creative Production module:
- 📊 Development Status - According to the Creative Production documentation:
- 📚 Documentation Status - The following sections require additional information and are marked for future...
📊 Visual Data Modeler¶
- Visual Data Modeler
- 🎯 Overview - The Visual Data Modeler provides an intuitive interface for defining and...
- ⚙️ Core Functionality - Based on the Creative Production documentation, the Visual Data Modeler...
- 🔗 Integration Points - As documented in the Creative Production module:
- 📊 Development Status - According to the Creative Production documentation:
- 📚 Documentation Status - The following sections require additional information and are marked for future...
🧩 Visual Logic Editor¶
- Visual Logic Editor
- 🎯 Overview - The Visual Logic Editor is a comprehensive node-based programming environment...
- 🏗️ System Architecture - Based on the Creative Production documentation, the Visual Logic Editor has:
- 🧩 Node Categories - The Visual Logic Editor includes the following node types as documented:
- 🔄 Workflow Capabilities - As documented in the Creative Production module:
- 📊 Development Status - According to the Creative Production documentation:
- 📚 Documentation Status - The following sections require additional information and are marked for future...
🎼 Render Orchestrator¶
- Render Orchestrator
- 🎯 Overview - The Render Orchestrator serves as the central coordination system for the...
- ⚙️ Core Responsibilities - Based on the Creative Production documentation:
- 🔄 Workflow Integration - As documented in the Creative Production module:
- 📊 Development Status - According to the Creative Production documentation:
- 📚 Documentation Status - The following sections require additional information and are marked for future...
📧 Email Marketing¶
🎯 Overview¶
- 📧 Email Marketing Component
- 🎯 Overview - The Email Marketing component is a comprehensive automation platform for email...
- 🏗️ Component Architecture - #
- 🔄 System Workflows - #
- 🛠️ Technology Stack - #
- 📊 Key Features - #
- 🎯 Quality Attributes - #
- 🔧 Integration Points - #
- 📈 Performance Metrics - #
- 🚀 Deployment Architecture - #
- 🔒 Security Considerations - #
- 🖥️ Frontend Integration - #
- 📚 Related Documentation - #
📋 Campaign Management System¶
- 🚀 Campaign Management System
- 🎯 Overview - The Campaign Management System is the central orchestration component for email...
- 🏗️ Architecture - #
- 🔄 Workflows - #
- 🛠️ Technical Implementation - #
- 📊 Performance Metrics - #
- 🔧 Configuration - #
- 🔒 Security & Compliance - #
- 🚀 Deployment - #
- 📚 Related Documentation - - Automation Framework
⚙️ Automation Framework¶
- 🤖 Automation Framework
- 🎯 Overview - The Automation Framework is a sophisticated multi-provider email automation...
- 🏗️ Architecture - #
- 🔄 System Workflows - #
- 🛠️ Technical Implementation - #
- 📊 Configuration - #
- Gmail Provider Configuration
- Puppeteer Configuration
- Captcha Service (optional)
- Logging
- Humanization Settings
- Test Configuration
- Install dependencies
- Create logs directory
- Run tests
- Run application
- 🎭 Humanization Features - #
- 📈 Performance Metrics - #
- 🔒 Security & Compliance - #
- 🚀 Deployment - #
- 📚 Related Documentation - - Campaign Management System
🤖 Virtual Agent System¶
- 👥 Virtual Agent System
- 🎯 Overview - The Virtual Agent System is a sophisticated simulation platform that creates...
- 🏗️ Architecture - #
- 🔄 System Workflows - #
- 🛠️ Technical Implementation - #
- 🗄️ Database Schema - #
- 📊 Agent Profile Structure - #
- 🎭 Behavioral Simulation - #
- 🔧 Advanced Configurations - #
- 🎯 Complex Temporal Behaviors - #
- 🔒 Anti-Detection Error Rates - #
- 🎯 Primary Use Cases - #
- 📈 Performance Metrics - #
- 🔒 Security & Compliance - #
- 🚀 Implementation with NocoBase - This structure will be implemented as Collections in NocoBase, leveraging:
- 🚀 Deployment - #
- 📚 Related Documentation - - Campaign Management System
📈 Data & Analytics¶
- 🔍 Data & Analytics
- 🎯 Overview - The Data & Analytics component provides comprehensive data management,...
- 🏗️ Architecture - #
- 🔄 System Workflows - #
- 🛠️ Technical Implementation - #
- 📊 Database Schema - #
- 📈 Analytics & Metrics - #
- 🔧 Configuration - #
- 🔒 Security & Compliance - #
- 🚀 Deployment - #
- 📚 Related Documentation - - Campaign Management System
📋 Planning & Strategy¶
🎯 Overview¶
- Planning & Strategy
- 🎯 Overview - The Planning & Strategy container handles the strategic planning aspects of...
- 📋 Responsibilities - - Client Onboarding: Initial discovery and briefing processes
- 🔧 Key Components - - AI Briefing Assistant
- Architecture Patterns - - Strategy Pattern: Flexible campaign strategy implementation
⚙️ Components¶
- Components Documentation
- Component Categories - #
- Component Documentation Format - Each component directory contains:
📊 Analytics & Optimization¶
🎯 Overview¶
- Analytics & Optimization
- 🎯 Overview - The Analytics & Optimization container provides comprehensive analytics,...
- 📋 Responsibilities - - Data Collection: Multi-source data integration and aggregation
- 🔧 Key Components - - Data Collector
- Architecture Patterns - - ETL Pattern: Extract, Transform, Load for data processing
⚙️ Components¶
- Components Documentation
- Component Categories - #
- Component Documentation Format - Each component directory contains:
🤝 Interaction & Collaboration¶
🎯 Overview¶
- Interaction & Collaboration
- 🎯 Overview - The Interaction & Collaboration container manages all client interactions,...
- 📋 Responsibilities - - Community Management: Social media engagement and moderation
- 🔧 Key Components - - AI Response Agent
- Architecture Patterns - - Facade Pattern: Simplified client interface
⚙️ Components¶
- Components Documentation
- Component Categories - #
- Component Documentation Format - Each component directory contains:
⚙️ Core Operations & Administration¶
🎯 Overview¶
- Core Operations & Administration
- 🎯 Overview - The Core Operations & Administration container provides the foundational...
- 📋 Responsibilities - - Authentication & Authorization: User management and access control
- 🔧 Key Components - - Central Orchestrator
- Architecture Patterns - - API Gateway Pattern: Single entry point for all external requests
⚙️ Components¶
🎯 Overview¶
- ⚙️ Components Documentation
- 📋 Component Categories - #
- 📚 Documentation Standards - Each fully documented component includes:
- 🎯 Documentation Progress - | Component | Status | Priority |
- 🔗 Related Documentation - - Core Operations & Administration Overview
- 🧩 Frontend Plugins - This section documents frontend UI plugins (primarily NocoBase-based...
🚪 API Gateway¶
🎯 Overview¶
- 🚪 API Gateway
- 🎯 Overview - The API Gateway is a critical component of Continuum's Core Operations &...
- 📋 Purpose - The API Gateway enables Continuum to function as a headless backend platform,...
- 🏗️ Architecture - mermaid
- 🔑 Key Features - #
- 📊 Component Architecture - The API Gateway is composed of several interconnected components:
- 🔌 API Structure - #
- 🚀 Quick Start - #
- Create a product
- List products
- 🔧 Core Concepts - #
- 📡 Integration Points - The API Gateway integrates with:
- 🎯 Use Cases - 1
- 📚 Documentation Structure - - Multi-App Manager: Multi-application architecture and management
- 🔗 Related Components - - Central Database: Data persistence layer
- 📈 Next Steps - Explore the detailed documentation for each component:
🌐 Multi-App Manager¶
- 🌐 Multi-App Manager
- 🎯 Overview - The Multi-App Manager is a core component of the API Gateway that enables...
- 📋 Purpose - The Multi-App Manager addresses the need for multi-tenancy and application...
- 🏗️ Architecture - mermaid
- 🔑 Key Concepts - #
- 📡 Application Routing - #
- Request to main application
- Request to sub-application
- 🛠️ Application Management API - #
- 🔧 Application Lifecycle - #
- ⚙️ Configuration - #
- Multi-app configuration
- Database isolation strategy
- Options: "schema" | "database"
- Default plugins for new applications
- 🔐 Security Considerations - #
- 💡 Best Practices - #
- 🎯 Use Cases - #
- Each client gets their own isolated application
- Separate development, staging, and production
- Separate applications for different product lines
- Custom-branded applications for partners
- 🔧 Troubleshooting - #
- List all applications to verify name
- Check application status and error details
- Review system logs for detailed error messages
- Fix configuration issue
- Retry initialization
- 📚 Related Documentation - - API Gateway: Overall API architecture
- 🔗 Integration Points - - Central Database: Stores application registry and metadata
🗃️ Collection Manager¶
- 🗃️ Collection Manager
- 🎯 Overview - The Collection Manager is a powerful component of the API Gateway that enables...
- 📋 Purpose - The Collection Manager provides:
- 🏗️ Architecture - mermaid
- 🔑 Key Concepts - #
- 📡 Collection Management API - #
- 🏷️ Field Types - #
- 🛠️ Field Management API - #
- 🔗 Relationship Management - #
- Add relationship field to posts collection
- Get post with comments
- List comments of a post
- Create comment on a post
- Get comment with author info
- Set comment author
- Add relationship to posts
- Add reverse relationship to tags
- Add tags to post
- Set tags (replace all)
- Remove tags from post
- List tags of a post
- Get user with profile
- Update user profile
- ⚙️ Field Options - #
- 🎯 Built-in Collection Features - #
- 💡 Best Practices - #
- 📚 Complete Example: Blog System - #
- Add comments relationship to blog_posts
- Add posts relationship to users
- Add reverse relationship for tags
- 🔗 Related Documentation - - API Gateway: Overall API architecture
🔐 Authentication¶
- 🔐 Authentication System
- 🎯 Overview - The Authentication System provides secure API access through API Keys, enabling...
- 📋 Purpose - The Authentication System enables:
- 🏗️ Architecture - mermaid
- 🔑 API Keys - #
- 🛠️ API Key Management - #
- Create new key
- Update applications to use new key
- Verify new key works
- Delete old key
- 🔧 Using API Keys - #
- Create key for main application
- Create key for sub-application
- ⏰ Expiration Management - #
- 1 hour expiration
- 30 days expiration
- 1 year expiration
- Never expires
- 🔐 Security Configuration - #
- .env
- Generate a random 64-character key
- 🎯 Access Levels - Continuum defines three main access levels:
- 🔗 Integration with Roles - API keys inherit all permissions from their associated role.
- Admin key - full access
- Editor key - content management only
- Viewer key - read-only access
- 📚 SDK Support - #
- List articles
- Function to make API requests
- List products
- Create product
- 🔧 Troubleshooting - #
- Verify key format
- Check key expiration
- Look for your key's expiresAt field
- Generate new key
- Check your role's permissions
- Create key with higher privileges
- List available applications
- Ensure X-App matches your key's application
- Add to .env file
- Restart server
- Regenerate all API keys
- 📊 Monitoring & Analytics - #
- Get keys expiring in next 7 days
- 🔗 Related Documentation - - Permissions System: Fine-grained access control
🛡️ Permissions¶
- 🛡️ Permissions System (ACL)
- 🎯 Overview - The Permissions System (Access Control List - ACL) provides fine-grained...
- 📋 Purpose - The ACL System enables:
- 🏗️ Architecture - mermaid
- 🔑 Core Concepts - #
- ⚙️ Permission Configuration - #
- 🔍 Conditional Permissions - #
- 🎯 Permission Examples - #
- 🔧 Managing Permissions - #
- 🔐 Security Best Practices - #
- 🎯 Common Permission Patterns - #
- 🔧 Troubleshooting - #
- Check user's role
- Check role's permissions
- Test with admin key
- If works with admin, it's a permission issue
- Check actual filter being applied
- Enable debug logging for ACL system
- Test without filter to verify data exists
- 📊 Permission Audit - #
- Test as specific role
- 🔗 Related Documentation - - Authentication: API key and user authentication
📖 API Documentation¶
- 📖 API Documentation System
- 🎯 Overview - The API Documentation System automatically generates comprehensive...
- 📋 Purpose - The API Documentation System provides:
- 🏗️ Architecture - mermaid
- 🌐 Accessing Documentation - #
- 📄 OpenAPI Specification - #
- 🎯 Using Swagger UI - #
- 🔧 Customizing Documentation - #
- 📊 Documentation Features - #
- 💡 Best Practices - #
- 🔌 External Tools Integration - #
- Generate TypeScript SDK
- Generate Python SDK
- 🔗 Related Documentation - - API Gateway: Overall API architecture
💡 Best Practices¶
- 💡 API Best Practices
- 🎯 Overview - This guide provides comprehensive best practices for working with the Continuum...
- 🏗️ API Design - #
- 🔐 Security - #
- .env
- Production keys - shorter expiration
- Development keys - can be longer
- Create new key
- Update all services
- Test thoroughly
- Delete old key after grace period
- ⚡ Performance - #
- Good: Paginated
- Bad: Fetching all records
- Good: Specific fields
- Bad: All fields
- Good: Database filter
- Bad: Fetch all, filter in app
- Then filter in application code
- Good: Sort by indexed field
- Bad: Sort by unindexed computed field
- First request
- Response includes: ETag: "abc123"
- Subsequent request
- Returns 304 Not Modified if unchanged
- 🔄 API Usage - #
- Good: Single request for multiple creates
- Bad: Multiple requests
- Good: Precise filter
- Bad: Fetch all, filter client-side
- Good: Single request with complex filter
- 🏢 Multi-Application - #
- Good
- Bad
- 📊 Monitoring & Logging - #
- 🔧 Development Workflow - #
- Development
- Staging
- Production
- Document schema changes
- Use migrations for breaking changes
- Keep backwards compatibility when possible
- 📚 Documentation - #
- 🎯 Checklist - #
- 🔗 Related Documentation - - API Gateway: Core API architecture
🔧 Troubleshooting¶
- 🔧 Troubleshooting Guide
- 🎯 Overview - This comprehensive troubleshooting guide covers common issues encountered when...
- 🔐 Authentication Issues - #
- Correct format
- Common mistakes:
- ❌ Missing "Bearer " prefix
- ❌ Extra spaces
- ❌ Wrong header name
- List your API keys to check expiration
- Look for "expiresAt" field
- Ensure APP_KEY is set in environment
- If empty or changed, all existing keys are invalid
- Set it permanently in .env
- List available applications
- Ensure X-App header matches key's application
- Create key for specific application
- Use with correct X-App header
- 🛡️ Permission Issues - #
- Get role details with permissions
- Look for the specific resource and action
- If you can list some records but not all:
- Check if filters are limiting access
- Example: Can only see own articles
- Solution: Use appropriate user context or request admin access
- If current key has limited role
- Grant public access to specific operations
- (This is configured system-wide, not per-request)
- View permissions with field configurations
- Look for "fields" or "except" in permissions
- Good: Request only allowed fields
- Bad: Requesting restricted fields
- 📦 Collection Issues - #
- Collection names are case-sensitive
- ✅ Correct
- ❌ Wrong
- Common mistake: wrong field name
- ❌ publishDate
- ✅ publishedAt
- ✅ Allowed: Add custom field
- ❌ Not allowed: Delete system field
- 🔄 CRUD Operation Issues - #
- Get collection schema to see required fields
- Include all required fields in request
- ❌ Wrong type
- ✅ Correct type
- Search for existing record
- If record exists, update it
- Use unique value
- Check if user exists
- If not, use valid user ID
- Create user first
- Response: {"data": {"id": 10, ...}}
- Then create article
- 🌐 Multi-App Issues - #
- Application names are case-sensitive and exact
- Check application server logs for detailed error
- Verify database credentials and connectivity
- Check database exists and is accessible
- ⚡ Performance Issues - #
- Identify slow queries from logs
- Add indexes to frequently filtered/sorted fields
- In database:
- ❌ Bad: Fetch all records
- ✅ Good: Paginate
- ❌ Bad: All fields
- ✅ Good: Specific fields
- ❌ Bad: Loading too many relations
- ✅ Good: Only needed relations
- ❌ Slow: LIKE with leading wildcard
- ✅ Faster: Exact match or indexed field
- 🔧 General Debugging - #
- Set environment variable
- Restart server
- Check logs for detailed request/response info
- Full verbose output
- Specific checks:
- - HTTP status code
- - Response headers
- - Response body
- - Request headers sent
- Development
- Staging
- Production
- If works in one but not another, it's environment-specific
- Access Swagger UI
- Verify:
- - Endpoint exists
- - Request format
- - Required parameters
- - Expected responses
- 📞 Getting Help - #
- System health
- Current user context
- Application info
- 🔗 Related Documentation - - API Gateway: Overall architecture
🧩 Frontend Plugins¶
🎯 Overview¶
- 🧩 Frontend Plugins
- 🎯 Overview - Frontend Plugins are specialized UI components and extensions built primarily...
- 🏗️ Architecture Role - Frontend Plugins operate as presentation layer components that:
- 🔗 Plugin-Module Relationships - Frontend plugins are designed to support one or more backend modules across...
- 📚 Plugin Documentation Index - #
- 🛠️ Technology Stack - #
- 🔧 Common Features - #
- 📈 Benefits to Backend Modules - #
- 🚀 Deployment & Usage - #
- Copy plugin to NocoBase plugins directory
- Enable plugin via NocoBase admin interface
- Navigate to: Settings → Plugin Manager → Enable Plugin
- 🔗 Related Documentation - #
- 📝 Documentation Standards - Each plugin documentation includes:
- 🎯 Future Enhancements - #
📧 Email Inbox¶
- 📧 Email Inbox Plugin
- 🎯 Overview - The Email Inbox Plugin (alf/plugin-email-inbox) is a comprehensive email...
- 🔗 Backend Integration - #
- ✨ Key Features - #
- 🛠️ Technical Architecture - #
- 📦 Installation & Setup - #
- Plugin installed as part of NocoBase workspace
- Enable from admin interface:
- Settings → Plugin Manager → @alf/plugin-email-inbox → Enable
- 🔄 Data Flow - #
- 🎯 Use Cases - #
- 🚀 Advanced Features - #
- 📚 Documentation References - #
- 🔗 Cross-References - #
- 📊 Quality Attributes - #
📤 Advanced File Uploader¶
- 📤 Advanced File Uploader Plugin
- 🎯 Overview - The Advanced File Uploader Plugin (picnic/plugin-advanced-file-uploader) is a...
- 🔗 Backend Integration - #
- ✨ Key Features - #
- 🛠️ Technical Architecture - #
- 📦 Installation & Setup - #
- Copy plugin to NocoBase
- Enable from admin interface
- Settings → Plugin Manager → Advanced File Uploader → Enable
- 🔄 Data Flow - #
- 🎯 Use Cases by Module - #
- 🚀 Advanced Features - #
- 📚 Documentation References - #
- 🔗 Cross-References - #
- 📊 Quality Attributes - #
⚡ Render Submit Action¶
- ⚡ Render Submit Action Plugin
- 🎯 Overview - The Render Submit Action Plugin (picnic/plugin-render-submit-action) is a...
- 🔗 Backend Integration - #
- ✨ Key Features - #
- 🛠️ Technical Architecture - #
- 📦 Installation & Setup - #
- Enable from NocoBase admin
- Settings → Plugin Manager → Render Submit Action → Enable
- 🔄 Data Flow - #
- 🎯 Use Cases - #
- 🚀 Customization - #
- 📚 Documentation References - #
- 🔗 Cross-References - #
- 📊 Quality Attributes - #
- 🎯 Future Enhancements - - [ ] Configurable appearance (optional)
🔄 Realtime Tables¶
- 🔄 Realtime Tables Plugin
- 🎯 Overview - The Realtime Tables Plugin (picnic/plugin-realtime-table) extends NocoBase...
- 🔗 Backend Integration - #
- ✨ Key Features - #
- 🛠️ Technical Architecture - #
- 📦 Installation & Setup - #
- Enable from NocoBase admin
- Settings → Plugin Manager → Realtime Table → Enable
- 🔄 Data Flow - #
- 🎯 Use Cases by Module - #
- 🚀 Advanced Usage - #
- 📚 Documentation References - #
- 🔗 Cross-References - #
- 📊 Quality Attributes - #
- 🐛 Troubleshooting - #
🎴 Advanced Cards¶
- 🎴 Advanced Cards Plugin
- 🎯 Overview - The Advanced Cards Plugin (picnic/plugin-advanced-cards) is a professional...
- 🔗 Backend Integration - #
- ✨ Key Features - #
- 🛠️ Technical Architecture - #
- 📦 Installation & Setup - #
- Copy to NocoBase plugins directory
- Enable in admin interface
- Settings → Plugin Manager → Advanced Cards → Enable
- 🎯 Use Cases - #
- 🚀 Advanced Features - #
- 📚 Documentation References - #
- 🔗 Cross-References - #
- 📊 Quality Attributes - #
- 🎓 Lessons Learned - #
- 🎯 Advantages Over Standard Blocks - #
🔐 Custom Login v2¶
- 🔐 Custom Login v2 Plugin
- 🎯 Overview - The Custom Login v2 Plugin (picnic/plugin-custom-login) enables branded...
- 🔗 Backend Integration - #
- ✨ Key Features - #
- 🛠️ Technical Architecture - #
- 📦 Installation & Setup - #
- Install via NocoBase CLI
- Or enable in admin interface
- Settings → Plugin Manager → Custom Login → Enable
- 🔄 Data Flow - #
- 🎯 Use Cases - #
- 🚀 Technical Details - #
- 📚 Documentation References - #
- 🔗 Cross-References - #
- 📊 Quality Attributes - #
- 🎯 Best Practices - #
- 🐛 Troubleshooting - #
- 🎯 Future Enhancements - - [ ] Multiple images with rotation
⚡ Picnic Indicator¶
- ⚡ Picnic Indicator Plugin
- 🎯 Overview - The Picnic Indicator Plugin (picnic/plugin-picnic-indicator) adds an account...
- 🔗 Backend Integration - #
- ✨ Key Features - #
- 🛠️ Technical Architecture - #
- 📦 Installation & Setup - #
- Plugin location
- Enable in admin interface
- Settings → Plugin Manager → Picnic Indicator → Enable
- 🔄 Data Flow - #
- 🎯 Use Cases - #
- 🚀 Planned Features - #
- 📚 Documentation References - #
- 🔗 Cross-References - #
- 📊 Quality Attributes - #
- 🔧 Developer Guide - #
- 🎯 Best Practices - #
- 🐛 Troubleshooting - #
- 🎯 Future Integration - #
🏗️ Architecture¶
🚀 Deployment¶
⚙️ Operations¶
📏 Standards¶
📚 Glossary¶
- Glossary
- 📁 Documentation Structure - #
- Usage Guidelines - - All documentation should reference terms defined in this glossary
📖 References¶
- References
- 📁 Documentation Structure - #
- Maintenance Guidelines - - Links should be regularly verified for validity