feat: add comprehensive documentation for Python Detector Worker; include project overview, architecture, core components, and configuration details

.gitea/workflows/build.yml

@@ -0,0 +1,34 @@
+name: Build Backend Application and Docker Image
+
+on:
+  push:
+    branches:
+      - main
+  workflow_dispatch:
+
+jobs:   
+  build-docker:
+    runs-on: ubuntu-latest
+    permissions:
+      packages: write
+    steps:
+      - name: Checkout code
+        uses: actions/checkout@v3
+
+      - name: Set up Docker Buildx
+        uses: docker/setup-buildx-action@v2
+
+      - name: Login to GitHub Container Registry
+        uses: docker/login-action@v3
+        with:
+          registry: git.siwatsystem.com
+          username: ${{ github.actor }}
+          password: ${{ secrets.RUNNER_TOKEN }}
+        
+      - name: Build and push Docker image
+        uses: docker/build-push-action@v4
+        with:
+          context: .
+          file: ./Dockerfile
+          push: true
+          tags: git.siwatsystem.com/adsist-cms/worker:latest

.gitignore

@@ -1,3 +1,12 @@
+/models
+app.log
+*.pt
 
-/__pycache__
-models
+# All pycache directories
+__pycache__/
+.mptacache
+
+mptas
+detector_worker.log
+.gitignore
+no_frame_debug.log

CLAUDE.md

@@ -0,0 +1,188 @@
+# Python Detector Worker - CLAUDE.md
+
+## Project Overview
+This is a FastAPI-based computer vision detection worker that processes video streams from RTSP/HTTP sources and runs YOLO-based machine learning pipelines for object detection and classification. The system is designed to work within a larger CMS (Content Management System) architecture.
+
+## Architecture & Technology Stack
+- **Framework**: FastAPI with WebSocket support
+- **ML/CV**: PyTorch, Ultralytics YOLO, OpenCV
+- **Containerization**: Docker (Python 3.13-bookworm base)
+- **Data Storage**: Redis integration for action handling
+- **Communication**: WebSocket-based real-time protocol
+
+## Core Components
+
+### Main Application (`app.py`)
+- **FastAPI WebSocket server** for real-time communication
+- **Multi-camera stream management** with shared stream optimization
+- **HTTP REST endpoint** for image retrieval (`/camera/{camera_id}/image`)
+- **Threading-based frame readers** for RTSP streams and HTTP snapshots
+- **Model loading and inference** using MPTA (Machine Learning Pipeline Archive) format
+- **Session management** with display identifier mapping
+- **Resource monitoring** (CPU, memory, GPU usage via psutil)
+
+### Pipeline System (`siwatsystem/pympta.py`)
+- **MPTA file handling** - ZIP archives containing model configurations
+- **Hierarchical pipeline execution** with detection → classification branching
+- **Redis action system** for image saving and message publishing
+- **Dynamic model loading** with GPU optimization
+- **Configurable trigger classes and confidence thresholds**
+
+### Testing & Debugging
+- **Protocol test script** (`test_protocol.py`) for WebSocket communication validation
+- **Pipeline webcam utility** (`pipeline_webcam.py`) for local testing with visual output
+- **RTSP streaming debug tool** (`debug/rtsp_webcam.py`) using GStreamer
+
+## Code Conventions & Patterns
+
+### Logging
+- **Structured logging** using Python's logging module
+- **File + console output** to `detector_worker.log`
+- **Debug level separation** for detailed troubleshooting
+- **Context-aware messages** with camera IDs and model information
+
+### Error Handling
+- **Graceful failure handling** with retry mechanisms (configurable max_retries)
+- **Thread-safe operations** using locks for streams and models
+- **WebSocket disconnect handling** with proper cleanup
+- **Model loading validation** with detailed error reporting
+
+### Configuration
+- **JSON configuration** (`config.json`) for runtime parameters:
+  - `poll_interval_ms`: Frame processing interval
+  - `max_streams`: Concurrent stream limit
+  - `target_fps`: Target frame rate
+  - `reconnect_interval_sec`: Stream reconnection delay
+  - `max_retries`: Maximum retry attempts (-1 for unlimited)
+
+### Threading Model
+- **Frame reader threads** for each camera stream (RTSP/HTTP)
+- **Shared stream optimization** - multiple subscriptions can reuse the same camera stream
+- **Async WebSocket handling** with concurrent task management
+- **Thread-safe data structures** with proper locking mechanisms
+
+## WebSocket Protocol
+
+### Message Types
+- **subscribe**: Start camera stream with model pipeline
+- **unsubscribe**: Stop camera stream processing
+- **requestState**: Request current worker status
+- **setSessionId**: Associate display with session identifier
+- **patchSession**: Update session data
+- **stateReport**: Periodic heartbeat with system metrics
+- **imageDetection**: Detection results with timestamp and model info
+
+### Subscription Format
+```json
+{
+  "type": "subscribe",
+  "payload": {
+    "subscriptionIdentifier": "display-001;cam-001",
+    "rtspUrl": "rtsp://...",  // OR snapshotUrl
+    "snapshotUrl": "http://...",
+    "snapshotInterval": 5000,
+    "modelUrl": "http://...model.mpta",
+    "modelId": 101,
+    "modelName": "Vehicle Detection",
+    "cropX1": 100, "cropY1": 200,
+    "cropX2": 300, "cropY2": 400
+  }
+}
+```
+
+## Model Pipeline (MPTA) Format
+
+### Structure
+- **ZIP archive** containing models and configuration
+- **pipeline.json** - Main configuration file
+- **Model files** - YOLO .pt files for detection/classification
+- **Redis configuration** - Optional for action execution
+
+### Pipeline Flow
+1. **Detection stage** - YOLO object detection with bounding boxes
+2. **Trigger evaluation** - Check if detected class matches trigger conditions
+3. **Classification stage** - Crop detected region and run classification model
+4. **Action execution** - Redis operations (image saving, message publishing)
+
+### Branch Configuration
+```json
+{
+  "modelId": "detector-v1",
+  "modelFile": "detector.pt",
+  "triggerClasses": ["car", "truck"],
+  "minConfidence": 0.5,
+  "branches": [{
+    "modelId": "classifier-v1", 
+    "modelFile": "classifier.pt",
+    "crop": true,
+    "triggerClasses": ["car"],
+    "minConfidence": 0.3,
+    "actions": [...]
+  }]
+}
+```
+
+## Stream Management
+
+### Shared Streams
+- Multiple subscriptions can share the same camera URL
+- Reference counting prevents premature stream termination
+- Automatic cleanup when last subscription ends
+
+### Frame Processing
+- **Queue-based buffering** with single frame capacity (latest frame only)
+- **Configurable polling interval** based on target FPS
+- **Automatic reconnection** with exponential backoff
+
+## Development & Testing
+
+### Local Development
+```bash
+# Install dependencies
+pip install -r requirements.txt
+
+# Run the worker
+python app.py
+
+# Test protocol compliance
+python test_protocol.py
+
+# Test pipeline with webcam
+python pipeline_webcam.py --mpta-file path/to/model.mpta --video 0
+```
+
+### Docker Deployment
+```bash
+# Build container
+docker build -t detector-worker .
+
+# Run with volume mounts for models
+docker run -p 8000:8000 -v ./models:/app/models detector-worker
+```
+
+### Testing Commands
+- **Protocol testing**: `python test_protocol.py`
+- **Pipeline validation**: `python pipeline_webcam.py --mpta-file <path> --video 0`
+- **RTSP debugging**: `python debug/rtsp_webcam.py`
+
+## Dependencies
+- **fastapi[standard]**: Web framework with WebSocket support
+- **uvicorn**: ASGI server
+- **torch, torchvision**: PyTorch for ML inference
+- **ultralytics**: YOLO implementation
+- **opencv-python**: Computer vision operations
+- **websockets**: WebSocket client/server
+- **redis**: Redis client for action execution
+
+## Security Considerations
+- Model files are loaded from trusted sources only
+- Redis connections use authentication when configured
+- WebSocket connections handle disconnects gracefully
+- Resource usage is monitored to prevent DoS
+
+## Performance Optimizations
+- GPU acceleration when CUDA is available
+- Shared camera streams reduce resource usage
+- Frame queue optimization (single latest frame)
+- Model caching across subscriptions
+- Trigger class filtering for faster inference

Dockerfile

@@ -0,0 +1,20 @@
+# Use the official Python image from the Docker Hub
+FROM python:3.13-bookworm
+
+# Set the working directory in the container
+WORKDIR /app
+
+# Copy the requirements file into the container at /app
+COPY requirements.txt .
+
+# Update apt, install libgl1, and clear apt cache
+RUN apt update && apt install -y libgl1 && rm -rf /var/lib/apt/lists/*
+
+# Install any dependencies specified in requirements.txt
+RUN pip install --no-cache-dir -r requirements.txt
+
+# Copy the rest of the application code into the container at /app
+COPY . .
+
+# Run the application
+CMD ["python3", "-m", "fastapi", "run", "--host", "0.0.0.0", "--port", "8000"]

app.log

@@ -1,601 +0,0 @@
-2025-01-09 00:43:08,967 [INFO] Will watch for changes in these directories: ['/Users/siwatsirichai/Documents/GitHub/python-detector-worker']
-2025-01-09 00:43:08,967 [INFO] Uvicorn running on http://127.0.0.1:8000 (Press CTRL+C to quit)
-2025-01-09 00:43:08,967 [INFO] Started reloader process [36467] using WatchFiles
-2025-01-09 00:43:09,356 [INFO] 1 change detected
-2025-01-09 00:43:10,532 [INFO] Started server process [36471]
-2025-01-09 00:43:10,534 [INFO] Waiting for application startup.
-2025-01-09 00:43:10,534 [INFO] Application startup complete.
-2025-01-09 00:43:17,203 [INFO] WebSocket connection accepted
-2025-01-09 00:43:17,205 [INFO] ('127.0.0.1', 59148) - "WebSocket /" [accepted]
-2025-01-09 00:43:17,207 [INFO] connection open
-2025-01-09 00:43:17,207 [INFO] Started processing streams
-2025-01-09 00:43:23,325 [INFO] Subscribed to camera camera1 with URL rtsp://192.168.0.66:8554/common_room
-2025-01-09 00:44:48,212 [INFO] 1 change detected
-2025-01-09 00:44:48,217 [WARNING] WatchFiles detected changes in 'app.py'. Reloading...
-2025-01-09 00:44:48,227 [INFO] Shutting down
-2025-01-09 00:44:48,239 [ERROR] Error in WebSocket connection: (1012, None)
-2025-01-09 00:44:48,255 [INFO] Released camera camera1
-2025-01-09 00:44:48,255 [INFO] WebSocket connection closed
-2025-01-09 00:44:48,256 [ERROR] Exception in ASGI application
-Traceback (most recent call last):
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/protocols/websockets/websockets_impl.py", line 243, in run_asgi
-    result = await self.app(self.scope, self.asgi_receive, self.asgi_send)  # type: ignore[func-returns-value]
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in __call__
-    return await self.app(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/fastapi/applications.py", line 1054, in __call__
-    await super().__call__(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/applications.py", line 113, in __call__
-    await self.middleware_stack(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/middleware/errors.py", line 152, in __call__
-    await self.app(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
-    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
-    raise exc
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
-    await app(scope, receive, sender)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 715, in __call__
-    await self.middleware_stack(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 735, in app
-    await route.handle(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 362, in handle
-    await self.app(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 95, in app
-    await wrap_app_handling_exceptions(app, session)(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
-    raise exc
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
-    await app(scope, receive, sender)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 93, in app
-    await func(session)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/fastapi/routing.py", line 383, in app
-    await dependant.call(**solved_result.values)
-  File "/Users/siwatsirichai/Documents/GitHub/python-detector-worker/app.py", line 102, in detect
-    streams.clear()
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/websockets.py", line 180, in close
-    await self.send({"type": "websocket.close", "code": code, "reason": reason or ""})
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/websockets.py", line 85, in send
-    await self._send(message)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 39, in sender
-    await send(message)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/protocols/websockets/websockets_impl.py", line 359, in asgi_send
-    raise RuntimeError(msg % message_type)
-RuntimeError: Unexpected ASGI message 'websocket.close', after sending 'websocket.close' or response already completed.
-2025-01-09 00:44:48,323 [INFO] connection closed
-2025-01-09 00:44:48,333 [INFO] Waiting for application shutdown.
-2025-01-09 00:44:48,334 [INFO] Application shutdown complete.
-2025-01-09 00:44:48,335 [INFO] Finished server process [36471]
-2025-01-09 00:44:48,728 [INFO] 1 change detected
-2025-01-09 00:44:51,790 [INFO] Started server process [36622]
-2025-01-09 00:44:51,793 [INFO] Waiting for application startup.
-2025-01-09 00:44:51,794 [INFO] Application startup complete.
-2025-01-09 00:44:52,764 [INFO] WebSocket connection accepted
-2025-01-09 00:44:52,764 [INFO] ('127.0.0.1', 59328) - "WebSocket /" [accepted]
-2025-01-09 00:44:52,765 [INFO] connection open
-2025-01-09 00:44:52,766 [INFO] Started processing streams
-2025-01-09 00:44:59,314 [INFO] Subscribed to camera camera1 with URL rtsp://192.168.0.66:8554/common_room
-2025-01-09 00:45:23,328 [ERROR] Error in WebSocket connection: (<CloseCode.ABNORMAL_CLOSURE: 1006>, '')
-2025-01-09 00:45:23,354 [INFO] Released camera camera1
-2025-01-09 00:45:23,354 [INFO] WebSocket connection closed
-2025-01-09 00:45:23,356 [ERROR] Exception in ASGI application
-Traceback (most recent call last):
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/protocols/websockets/websockets_impl.py", line 243, in run_asgi
-    result = await self.app(self.scope, self.asgi_receive, self.asgi_send)  # type: ignore[func-returns-value]
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in __call__
-    return await self.app(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/fastapi/applications.py", line 1054, in __call__
-    await super().__call__(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/applications.py", line 113, in __call__
-    await self.middleware_stack(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/middleware/errors.py", line 152, in __call__
-    await self.app(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
-    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
-    raise exc
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
-    await app(scope, receive, sender)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 715, in __call__
-    await self.middleware_stack(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 735, in app
-    await route.handle(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 362, in handle
-    await self.app(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 95, in app
-    await wrap_app_handling_exceptions(app, session)(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
-    raise exc
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
-    await app(scope, receive, sender)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 93, in app
-    await func(session)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/fastapi/routing.py", line 383, in app
-    await dependant.call(**solved_result.values)
-  File "/Users/siwatsirichai/Documents/GitHub/python-detector-worker/app.py", line 104, in detect
-    await websocket.close()
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/websockets.py", line 180, in close
-    await self.send({"type": "websocket.close", "code": code, "reason": reason or ""})
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/websockets.py", line 85, in send
-    await self._send(message)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 39, in sender
-    await send(message)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/protocols/websockets/websockets_impl.py", line 359, in asgi_send
-    raise RuntimeError(msg % message_type)
-RuntimeError: Unexpected ASGI message 'websocket.close', after sending 'websocket.close' or response already completed.
-2025-01-09 00:45:23,433 [INFO] connection closed
-2025-01-09 00:45:25,088 [INFO] WebSocket connection accepted
-2025-01-09 00:45:25,088 [INFO] ('127.0.0.1', 59396) - "WebSocket /" [accepted]
-2025-01-09 00:45:25,091 [INFO] connection open
-2025-01-09 00:45:25,092 [INFO] Started processing streams
-2025-01-09 00:45:31,313 [INFO] Subscribed to camera camera1 with URL rtsp://192.168.0.66:8554/common_room
-2025-01-09 00:45:37,901 [INFO] Shutting down
-2025-01-09 00:45:37,906 [ERROR] Error in WebSocket connection: (1012, None)
-2025-01-09 00:45:37,919 [INFO] Released camera camera1
-2025-01-09 00:45:37,919 [INFO] WebSocket connection closed
-2025-01-09 00:45:37,919 [ERROR] Exception in ASGI application
-Traceback (most recent call last):
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/protocols/websockets/websockets_impl.py", line 243, in run_asgi
-    result = await self.app(self.scope, self.asgi_receive, self.asgi_send)  # type: ignore[func-returns-value]
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in __call__
-    return await self.app(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/fastapi/applications.py", line 1054, in __call__
-    await super().__call__(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/applications.py", line 113, in __call__
-    await self.middleware_stack(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/middleware/errors.py", line 152, in __call__
-    await self.app(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
-    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
-    raise exc
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
-    await app(scope, receive, sender)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 715, in __call__
-    await self.middleware_stack(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 735, in app
-    await route.handle(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 362, in handle
-    await self.app(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 95, in app
-    await wrap_app_handling_exceptions(app, session)(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
-    raise exc
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
-    await app(scope, receive, sender)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 93, in app
-    await func(session)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/fastapi/routing.py", line 383, in app
-    await dependant.call(**solved_result.values)
-  File "/Users/siwatsirichai/Documents/GitHub/python-detector-worker/app.py", line 104, in detect
-    await websocket.close()
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/websockets.py", line 180, in close
-    await self.send({"type": "websocket.close", "code": code, "reason": reason or ""})
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/websockets.py", line 85, in send
-    await self._send(message)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 39, in sender
-    await send(message)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/protocols/websockets/websockets_impl.py", line 359, in asgi_send
-    raise RuntimeError(msg % message_type)
-RuntimeError: Unexpected ASGI message 'websocket.close', after sending 'websocket.close' or response already completed.
-2025-01-09 00:45:37,921 [INFO] connection closed
-2025-01-09 00:45:38,006 [INFO] Waiting for application shutdown.
-2025-01-09 00:45:38,007 [INFO] Application shutdown complete.
-2025-01-09 00:45:38,008 [INFO] Finished server process [36622]
-2025-01-09 00:45:38,031 [INFO] Stopping reloader process [36467]
-2025-01-09 00:46:40,345 [INFO] Will watch for changes in these directories: ['/Users/siwatsirichai/Documents/GitHub/python-detector-worker']
-2025-01-09 00:46:40,346 [INFO] Uvicorn running on http://127.0.0.1:8000 (Press CTRL+C to quit)
-2025-01-09 00:46:40,347 [INFO] Started reloader process [36868] using WatchFiles
-2025-01-09 00:46:42,402 [INFO] Started server process [36902]
-2025-01-09 00:46:42,404 [INFO] Waiting for application startup.
-2025-01-09 00:46:42,405 [INFO] Application startup complete.
-2025-01-09 00:46:42,439 [INFO] WebSocket connection accepted
-2025-01-09 00:46:42,439 [INFO] ('127.0.0.1', 59523) - "WebSocket /" [accepted]
-2025-01-09 00:46:42,440 [INFO] connection open
-2025-01-09 00:46:42,440 [INFO] Started processing streams
-2025-01-09 00:46:47,311 [INFO] Subscribed to camera camera1 with URL rtsp://192.168.0.66:8554/common_room
-2025-01-09 00:46:51,990 [ERROR] Error in WebSocket connection: (<CloseCode.ABNORMAL_CLOSURE: 1006>, '')
-2025-01-09 00:46:52,001 [INFO] Released camera camera1
-2025-01-09 00:46:52,002 [INFO] WebSocket connection closed
-2025-01-09 00:46:52,002 [ERROR] Exception in ASGI application
-Traceback (most recent call last):
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/protocols/websockets/websockets_impl.py", line 243, in run_asgi
-    result = await self.app(self.scope, self.asgi_receive, self.asgi_send)  # type: ignore[func-returns-value]
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in __call__
-    return await self.app(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/fastapi/applications.py", line 1054, in __call__
-    await super().__call__(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/applications.py", line 113, in __call__
-    await self.middleware_stack(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/middleware/errors.py", line 152, in __call__
-    await self.app(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
-    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
-    raise exc
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
-    await app(scope, receive, sender)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 715, in __call__
-    await self.middleware_stack(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 735, in app
-    await route.handle(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 362, in handle
-    await self.app(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 95, in app
-    await wrap_app_handling_exceptions(app, session)(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
-    raise exc
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
-    await app(scope, receive, sender)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 93, in app
-    await func(session)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/fastapi/routing.py", line 383, in app
-    await dependant.call(**solved_result.values)
-  File "/Users/siwatsirichai/Documents/GitHub/python-detector-worker/app.py", line 104, in detect
-    await websocket.close()
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/websockets.py", line 180, in close
-    await self.send({"type": "websocket.close", "code": code, "reason": reason or ""})
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/websockets.py", line 85, in send
-    await self._send(message)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 39, in sender
-    await send(message)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/protocols/websockets/websockets_impl.py", line 359, in asgi_send
-    raise RuntimeError(msg % message_type)
-RuntimeError: Unexpected ASGI message 'websocket.close', after sending 'websocket.close' or response already completed.
-2025-01-09 00:46:52,030 [INFO] connection closed
-2025-01-09 00:47:56,615 [INFO] WebSocket connection accepted
-2025-01-09 00:47:56,616 [INFO] ('127.0.0.1', 59664) - "WebSocket /" [accepted]
-2025-01-09 00:47:56,628 [INFO] connection open
-2025-01-09 00:47:56,631 [INFO] Started processing streams
-2025-01-09 00:48:03,306 [INFO] Subscribed to camera camera1 with URL rtsp://192.168.0.66:8554/common_room
-2025-01-09 00:48:06,345 [ERROR] Error in WebSocket connection: (<CloseCode.ABNORMAL_CLOSURE: 1006>, '')
-2025-01-09 00:48:06,352 [INFO] Released camera camera1
-2025-01-09 00:48:06,352 [INFO] WebSocket connection closed
-2025-01-09 00:48:06,353 [ERROR] Exception in ASGI application
-Traceback (most recent call last):
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/protocols/websockets/websockets_impl.py", line 243, in run_asgi
-    result = await self.app(self.scope, self.asgi_receive, self.asgi_send)  # type: ignore[func-returns-value]
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in __call__
-    return await self.app(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/fastapi/applications.py", line 1054, in __call__
-    await super().__call__(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/applications.py", line 113, in __call__
-    await self.middleware_stack(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/middleware/errors.py", line 152, in __call__
-    await self.app(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
-    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
-    raise exc
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
-    await app(scope, receive, sender)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 715, in __call__
-    await self.middleware_stack(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 735, in app
-    await route.handle(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 362, in handle
-    await self.app(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 95, in app
-    await wrap_app_handling_exceptions(app, session)(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
-    raise exc
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
-    await app(scope, receive, sender)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 93, in app
-    await func(session)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/fastapi/routing.py", line 383, in app
-    await dependant.call(**solved_result.values)
-  File "/Users/siwatsirichai/Documents/GitHub/python-detector-worker/app.py", line 104, in detect
-    await websocket.close()
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/websockets.py", line 180, in close
-    await self.send({"type": "websocket.close", "code": code, "reason": reason or ""})
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/websockets.py", line 85, in send
-    await self._send(message)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 39, in sender
-    await send(message)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/protocols/websockets/websockets_impl.py", line 359, in asgi_send
-    raise RuntimeError(msg % message_type)
-RuntimeError: Unexpected ASGI message 'websocket.close', after sending 'websocket.close' or response already completed.
-2025-01-09 00:48:06,361 [INFO] connection closed
-2025-01-09 00:48:38,544 [INFO] WebSocket connection accepted
-2025-01-09 00:48:38,545 [INFO] ('127.0.0.1', 59735) - "WebSocket /" [accepted]
-2025-01-09 00:48:38,546 [INFO] connection open
-2025-01-09 00:48:38,550 [INFO] Started processing streams
-2025-01-09 00:48:43,303 [INFO] Subscribed to camera camera1 with URL rtsp://192.168.0.66:8554/common_room
-2025-01-09 00:49:28,103 [ERROR] Error in WebSocket connection: (<CloseCode.ABNORMAL_CLOSURE: 1006>, '')
-2025-01-09 00:49:28,115 [INFO] Released camera camera1
-2025-01-09 00:49:28,116 [INFO] WebSocket connection closed
-2025-01-09 00:49:28,116 [ERROR] Exception in ASGI application
-Traceback (most recent call last):
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/protocols/websockets/websockets_impl.py", line 243, in run_asgi
-    result = await self.app(self.scope, self.asgi_receive, self.asgi_send)  # type: ignore[func-returns-value]
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in __call__
-    return await self.app(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/fastapi/applications.py", line 1054, in __call__
-    await super().__call__(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/applications.py", line 113, in __call__
-    await self.middleware_stack(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/middleware/errors.py", line 152, in __call__
-    await self.app(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
-    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
-    raise exc
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
-    await app(scope, receive, sender)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 715, in __call__
-    await self.middleware_stack(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 735, in app
-    await route.handle(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 362, in handle
-    await self.app(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 95, in app
-    await wrap_app_handling_exceptions(app, session)(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
-    raise exc
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
-    await app(scope, receive, sender)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 93, in app
-    await func(session)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/fastapi/routing.py", line 383, in app
-    await dependant.call(**solved_result.values)
-  File "/Users/siwatsirichai/Documents/GitHub/python-detector-worker/app.py", line 104, in detect
-    await websocket.close()
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/websockets.py", line 180, in close
-    await self.send({"type": "websocket.close", "code": code, "reason": reason or ""})
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/websockets.py", line 85, in send
-    await self._send(message)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 39, in sender
-    await send(message)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/protocols/websockets/websockets_impl.py", line 359, in asgi_send
-    raise RuntimeError(msg % message_type)
-RuntimeError: Unexpected ASGI message 'websocket.close', after sending 'websocket.close' or response already completed.
-2025-01-09 00:49:28,125 [INFO] connection closed
-2025-01-09 00:50:30,615 [INFO] WebSocket connection accepted
-2025-01-09 00:50:30,616 [INFO] ('127.0.0.1', 59919) - "WebSocket /" [accepted]
-2025-01-09 00:50:30,618 [INFO] connection open
-2025-01-09 00:50:30,619 [INFO] Started processing streams
-2025-01-09 00:50:35,299 [INFO] Subscribed to camera camera1 with URL rtsp://192.168.0.66:8554/common_room
-2025-01-09 00:51:20,717 [ERROR] Error in WebSocket connection: (<CloseCode.ABNORMAL_CLOSURE: 1006>, '')
-2025-01-09 00:51:20,727 [INFO] Released camera camera1
-2025-01-09 00:51:20,727 [INFO] WebSocket connection closed
-2025-01-09 00:51:20,727 [ERROR] Exception in ASGI application
-Traceback (most recent call last):
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/protocols/websockets/websockets_impl.py", line 243, in run_asgi
-    result = await self.app(self.scope, self.asgi_receive, self.asgi_send)  # type: ignore[func-returns-value]
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in __call__
-    return await self.app(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/fastapi/applications.py", line 1054, in __call__
-    await super().__call__(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/applications.py", line 113, in __call__
-    await self.middleware_stack(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/middleware/errors.py", line 152, in __call__
-    await self.app(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
-    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
-    raise exc
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
-    await app(scope, receive, sender)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 715, in __call__
-    await self.middleware_stack(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 735, in app
-    await route.handle(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 362, in handle
-    await self.app(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 95, in app
-    await wrap_app_handling_exceptions(app, session)(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
-    raise exc
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
-    await app(scope, receive, sender)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 93, in app
-    await func(session)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/fastapi/routing.py", line 383, in app
-    await dependant.call(**solved_result.values)
-  File "/Users/siwatsirichai/Documents/GitHub/python-detector-worker/app.py", line 104, in detect
-    await websocket.close()
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/websockets.py", line 180, in close
-    await self.send({"type": "websocket.close", "code": code, "reason": reason or ""})
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/websockets.py", line 85, in send
-    await self._send(message)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 39, in sender
-    await send(message)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/protocols/websockets/websockets_impl.py", line 359, in asgi_send
-    raise RuntimeError(msg % message_type)
-RuntimeError: Unexpected ASGI message 'websocket.close', after sending 'websocket.close' or response already completed.
-2025-01-09 00:51:20,732 [INFO] connection closed
-2025-01-09 00:52:20,552 [INFO] 1 change detected
-2025-01-09 00:52:20,571 [WARNING] WatchFiles detected changes in 'app.py'. Reloading...
-2025-01-09 00:52:20,681 [INFO] Shutting down
-2025-01-09 00:52:20,787 [INFO] Waiting for application shutdown.
-2025-01-09 00:52:20,790 [INFO] Application shutdown complete.
-2025-01-09 00:52:20,791 [INFO] Finished server process [36902]
-2025-01-09 00:52:21,170 [INFO] 1 change detected
-2025-01-09 00:52:23,436 [INFO] Started server process [37369]
-2025-01-09 00:52:23,438 [INFO] Waiting for application startup.
-2025-01-09 00:52:23,438 [INFO] Application startup complete.
-2025-01-09 00:52:54,852 [INFO] 1 change detected
-2025-01-09 00:52:54,860 [WARNING] WatchFiles detected changes in 'app.py'. Reloading...
-2025-01-09 00:52:54,949 [INFO] Shutting down
-2025-01-09 00:52:55,052 [INFO] Waiting for application shutdown.
-2025-01-09 00:52:55,053 [INFO] Application shutdown complete.
-2025-01-09 00:52:55,053 [INFO] Finished server process [37369]
-2025-01-09 00:52:55,426 [INFO] 1 change detected
-2025-01-09 00:52:57,074 [INFO] Started server process [37436]
-2025-01-09 00:52:57,076 [INFO] Waiting for application startup.
-2025-01-09 00:52:57,078 [INFO] Application startup complete.
-2025-01-09 00:53:06,378 [INFO] 1 change detected
-2025-01-09 00:53:08,915 [INFO] Shutting down
-2025-01-09 00:53:09,018 [INFO] Waiting for application shutdown.
-2025-01-09 00:53:09,020 [INFO] Application shutdown complete.
-2025-01-09 00:53:09,021 [INFO] Finished server process [37436]
-2025-01-09 00:53:09,044 [INFO] Stopping reloader process [36868]
-2025-01-09 00:53:11,752 [INFO] Will watch for changes in these directories: ['/Users/siwatsirichai/Documents/GitHub/python-detector-worker']
-2025-01-09 00:53:11,753 [INFO] Uvicorn running on http://127.0.0.1:8000 (Press CTRL+C to quit)
-2025-01-09 00:53:11,753 [INFO] Started reloader process [37483] using WatchFiles
-2025-01-09 00:53:13,520 [INFO] Started server process [37487]
-2025-01-09 00:53:13,522 [INFO] Waiting for application startup.
-2025-01-09 00:53:13,523 [INFO] Application startup complete.
-2025-01-09 00:53:14,050 [INFO] WebSocket connection accepted
-2025-01-09 00:53:14,050 [INFO] ('127.0.0.1', 60224) - "WebSocket /" [accepted]
-2025-01-09 00:53:14,052 [INFO] connection open
-2025-01-09 00:53:14,052 [INFO] Started processing streams
-2025-01-09 00:53:19,283 [INFO] Subscribed to camera camera1 with URL rtsp://192.168.0.66:8554/common_room
-2025-01-09 00:53:36,514 [INFO] 1 change detected
-2025-01-09 00:53:38,902 [ERROR] Error in WebSocket connection: (<CloseCode.ABNORMAL_CLOSURE: 1006>, '')
-2025-01-09 00:53:38,910 [INFO] Released camera camera1
-2025-01-09 00:53:38,911 [INFO] WebSocket connection closed
-2025-01-09 00:53:38,911 [ERROR] Exception in ASGI application
-Traceback (most recent call last):
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/protocols/websockets/websockets_impl.py", line 243, in run_asgi
-    result = await self.app(self.scope, self.asgi_receive, self.asgi_send)  # type: ignore[func-returns-value]
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in __call__
-    return await self.app(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/fastapi/applications.py", line 1054, in __call__
-    await super().__call__(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/applications.py", line 113, in __call__
-    await self.middleware_stack(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/middleware/errors.py", line 152, in __call__
-    await self.app(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
-    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
-    raise exc
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
-    await app(scope, receive, sender)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 715, in __call__
-    await self.middleware_stack(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 735, in app
-    await route.handle(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 362, in handle
-    await self.app(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 95, in app
-    await wrap_app_handling_exceptions(app, session)(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
-    raise exc
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
-    await app(scope, receive, sender)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 93, in app
-    await func(session)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/fastapi/routing.py", line 383, in app
-    await dependant.call(**solved_result.values)
-  File "/Users/siwatsirichai/Documents/GitHub/python-detector-worker/app.py", line 111, in detect
-    await websocket.close()
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/websockets.py", line 180, in close
-    await self.send({"type": "websocket.close", "code": code, "reason": reason or ""})
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/websockets.py", line 85, in send
-    await self._send(message)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 39, in sender
-    await send(message)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/protocols/websockets/websockets_impl.py", line 359, in asgi_send
-    raise RuntimeError(msg % message_type)
-RuntimeError: Unexpected ASGI message 'websocket.close', after sending 'websocket.close' or response already completed.
-2025-01-09 00:53:38,944 [INFO] connection closed
-2025-01-09 00:53:40,757 [INFO] Shutting down
-2025-01-09 00:53:40,880 [INFO] Finished server process [37487]
-2025-01-09 00:53:40,980 [ERROR] Traceback (most recent call last):
-  File "/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/asyncio/runners.py", line 44, in run
-    return loop.run_until_complete(main)
-  File "uvloop/loop.pyx", line 1512, in uvloop.loop.Loop.run_until_complete
-  File "uvloop/loop.pyx", line 1505, in uvloop.loop.Loop.run_until_complete
-  File "uvloop/loop.pyx", line 1379, in uvloop.loop.Loop.run_forever
-  File "uvloop/loop.pyx", line 557, in uvloop.loop.Loop._run
-  File "uvloop/loop.pyx", line 476, in uvloop.loop.Loop._on_idle
-  File "uvloop/cbhandles.pyx", line 83, in uvloop.loop.Handle._run
-  File "uvloop/cbhandles.pyx", line 63, in uvloop.loop.Handle._run
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/server.py", line 70, in serve
-    await self._serve(sockets)
-  File "/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/contextlib.py", line 124, in __exit__
-    next(self.gen)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/server.py", line 330, in capture_signals
-    signal.raise_signal(captured_signal)
-KeyboardInterrupt
-
-During handling of the above exception, another exception occurred:
-
-Traceback (most recent call last):
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 700, in lifespan
-    await receive()
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/lifespan/on.py", line 137, in receive
-    return await self.receive_queue.get()
-  File "/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/asyncio/queues.py", line 166, in get
-    await getter
-asyncio.exceptions.CancelledError
-
-2025-01-09 00:53:41,696 [INFO] Stopping reloader process [37483]
-2025-01-09 00:53:46,103 [INFO] Will watch for changes in these directories: ['/Users/siwatsirichai/Documents/GitHub/python-detector-worker']
-2025-01-09 00:53:46,103 [INFO] Uvicorn running on http://127.0.0.1:8000 (Press CTRL+C to quit)
-2025-01-09 00:53:46,104 [INFO] Started reloader process [37591] using WatchFiles
-2025-01-09 00:53:47,860 [INFO] Started server process [37599]
-2025-01-09 00:53:47,862 [INFO] Waiting for application startup.
-2025-01-09 00:53:47,862 [INFO] Application startup complete.
-2025-01-09 00:54:51,976 [INFO] Shutting down
-2025-01-09 00:54:52,080 [INFO] Waiting for application shutdown.
-2025-01-09 00:54:52,083 [INFO] Application shutdown complete.
-2025-01-09 00:54:52,083 [INFO] Finished server process [37599]
-2025-01-09 00:54:52,102 [INFO] Stopping reloader process [37591]
-2025-01-09 00:54:54,952 [INFO] Will watch for changes in these directories: ['/Users/siwatsirichai/Documents/GitHub/python-detector-worker']
-2025-01-09 00:54:54,953 [INFO] Uvicorn running on http://127.0.0.1:8000 (Press CTRL+C to quit)
-2025-01-09 00:54:54,953 [INFO] Started reloader process [37680] using WatchFiles
-2025-01-09 00:54:56,634 [INFO] Started server process [37693]
-2025-01-09 00:54:56,636 [INFO] Waiting for application startup.
-2025-01-09 00:54:56,636 [INFO] Application startup complete.
-2025-01-09 00:54:56,882 [INFO] WebSocket connection accepted
-2025-01-09 00:54:56,882 [INFO] ('127.0.0.1', 60381) - "WebSocket /" [accepted]
-2025-01-09 00:54:56,884 [INFO] connection open
-2025-01-09 00:54:56,885 [INFO] Started processing streams
-2025-01-09 00:55:03,279 [INFO] Subscribed to camera camera1 with URL rtsp://192.168.0.66:8554/common_room
-2025-01-09 00:55:13,896 [ERROR] Error in WebSocket connection: (<CloseCode.ABNORMAL_CLOSURE: 1006>, '')
-2025-01-09 00:55:13,907 [INFO] Released camera camera1
-2025-01-09 00:55:13,908 [INFO] WebSocket connection closed
-2025-01-09 00:55:13,908 [ERROR] Exception in ASGI application
-Traceback (most recent call last):
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/protocols/websockets/websockets_impl.py", line 243, in run_asgi
-    result = await self.app(self.scope, self.asgi_receive, self.asgi_send)  # type: ignore[func-returns-value]
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in __call__
-    return await self.app(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/fastapi/applications.py", line 1054, in __call__
-    await super().__call__(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/applications.py", line 113, in __call__
-    await self.middleware_stack(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/middleware/errors.py", line 152, in __call__
-    await self.app(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
-    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
-    raise exc
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
-    await app(scope, receive, sender)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 715, in __call__
-    await self.middleware_stack(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 735, in app
-    await route.handle(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 362, in handle
-    await self.app(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 95, in app
-    await wrap_app_handling_exceptions(app, session)(scope, receive, send)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
-    raise exc
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
-    await app(scope, receive, sender)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/routing.py", line 93, in app
-    await func(session)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/fastapi/routing.py", line 383, in app
-    await dependant.call(**solved_result.values)
-  File "/Users/siwatsirichai/Documents/GitHub/python-detector-worker/app.py", line 111, in detect
-    await websocket.close()
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/websockets.py", line 180, in close
-    await self.send({"type": "websocket.close", "code": code, "reason": reason or ""})
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/websockets.py", line 85, in send
-    await self._send(message)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/starlette/_exception_handler.py", line 39, in sender
-    await send(message)
-  File "/Users/siwatsirichai/Library/Python/3.9/lib/python/site-packages/uvicorn/protocols/websockets/websockets_impl.py", line 359, in asgi_send
-    raise RuntimeError(msg % message_type)
-RuntimeError: Unexpected ASGI message 'websocket.close', after sending 'websocket.close' or response already completed.
-2025-01-09 00:55:13,943 [INFO] connection closed
-2025-01-09 00:55:14,603 [INFO] Shutting down
-2025-01-09 00:55:14,704 [INFO] Waiting for application shutdown.
-2025-01-09 00:55:14,705 [INFO] Application shutdown complete.
-2025-01-09 00:55:14,705 [INFO] Finished server process [37693]
-2025-01-09 00:55:14,721 [INFO] Stopping reloader process [37680]

config.json

@@ -3,5 +3,5 @@
   "max_streams": 5,
   "target_fps": 2,
   "reconnect_interval_sec": 5,
-  "max_retries": 3
+  "max_retries": -1
 }

debug/rtsp_webcam.py

@@ -0,0 +1,51 @@
+import cv2
+import gi
+import time
+
+gi.require_version('Gst', '1.0')
+from gi.repository import Gst
+
+# Initialize GStreamer
+Gst.init(None)
+
+# Open the default webcam
+cap = cv2.VideoCapture(0)
+
+# Define the RTSP pipeline using GStreamer
+rtsp_pipeline = (
+    "appsrc ! videoconvert ! video/x-raw,format=I420 ! x264enc tune=zerolatency bitrate=2048 speed-preset=ultrafast "
+    "! rtph264pay config-interval=1 pt=96 ! udpsink host=127.0.0.1 port=8554"
+)
+
+# Create GStreamer pipeline
+pipeline = Gst.parse_launch(rtsp_pipeline)
+appsrc = pipeline.get_by_name("appsrc")
+
+# Start streaming
+pipeline.set_state(Gst.State.PLAYING)
+time.sleep(1)
+
+while cap.isOpened():
+    ret, frame = cap.read()
+    if not ret:
+        break
+
+    # Convert frame to I420 format (YUV420)
+    frame = cv2.cvtColor(frame, cv2.COLOR_BGR2YUV_I420)
+    data = frame.tobytes()
+
+    # Push frame to GStreamer pipeline
+    buf = Gst.Buffer.new_allocate(None, len(data), None)
+    buf.fill(0, data)
+    appsrc.emit("push-buffer", buf)
+
+    # Display frame locally (optional)
+    cv2.imshow("RTSP Streaming", frame)
+    
+    if cv2.waitKey(1) & 0xFF == ord('q'):
+        break
+
+# Cleanup
+cap.release()
+cv2.destroyAllWindows()
+pipeline.set_state(Gst.State.NULL)

pipeline_webcam.py

@@ -0,0 +1,137 @@
+import argparse
+import os
+import cv2
+import time
+import logging
+import shutil
+import threading  # added threading
+import yaml  # for silencing YOLO
+
+from siwatsystem.pympta import load_pipeline_from_zip, run_pipeline
+
+# Configure logging
+logging.basicConfig(level=logging.INFO, format="%(asctime)s [%(levelname)s] %(message)s")
+
+# Silence YOLO logging
+os.environ["YOLO_VERBOSE"] = "False"
+for logger_name in ["ultralytics", "ultralytics.hub", "ultralytics.yolo.utils"]:
+    logging.getLogger(logger_name).setLevel(logging.WARNING)
+
+# Global variables for frame sharing
+global_frame = None
+global_ret = False
+capture_running = False
+
+def video_capture_loop(cap):
+    global global_frame, global_ret, capture_running
+    while capture_running:
+        global_ret, global_frame = cap.read()
+        time.sleep(0.01)  # slight delay to reduce CPU usage
+
+def clear_cache(cache_dir: str):
+    if os.path.exists(cache_dir):
+        shutil.rmtree(cache_dir)
+
+def log_pipeline_flow(frame, model_tree, level=0):
+    """
+    Wrapper around run_pipeline that logs the model flow and detection results.
+    Returns the same output as the original run_pipeline function.
+    """
+    indent = "  " * level
+    model_id = model_tree.get("modelId", "unknown")
+    logging.info(f"{indent}→ Running model: {model_id}")
+    
+    detection, bbox = run_pipeline(frame, model_tree, return_bbox=True)
+    
+    if detection:
+        confidence = detection.get("confidence", 0) * 100
+        class_name = detection.get("class", "unknown")
+        object_id = detection.get("id", "N/A")
+        
+        logging.info(f"{indent}✓ Detected: {class_name} (ID: {object_id}, confidence: {confidence:.1f}%)")
+        
+        # Check if any branches were triggered
+        triggered = False
+        for branch in model_tree.get("branches", []):
+            trigger_classes = branch.get("triggerClasses", [])
+            min_conf = branch.get("minConfidence", 0)
+            
+            if class_name in trigger_classes and detection.get("confidence", 0) >= min_conf:
+                triggered = True
+                if branch.get("crop", False) and bbox:
+                    x1, y1, x2, y2 = bbox
+                    cropped_frame = frame[y1:y2, x1:x2]
+                    logging.info(f"{indent}  ⌊ Triggering branch with cropped region {x1},{y1} to {x2},{y2}")
+                    branch_result = log_pipeline_flow(cropped_frame, branch, level + 1)
+                else:
+                    logging.info(f"{indent}  ⌊ Triggering branch with full frame")
+                    branch_result = log_pipeline_flow(frame, branch, level + 1)
+                
+                if branch_result[0]:  # If branch detection successful, return it
+                    return branch_result
+        
+        if not triggered and model_tree.get("branches"):
+            logging.info(f"{indent}  ⌊ No branches triggered")
+    else:
+        logging.info(f"{indent}✗ No detection for {model_id}")
+    
+    return detection, bbox
+
+def main(mpta_file: str, video_source: str):
+    global capture_running
+    CACHE_DIR = os.path.join(".", ".mptacache")
+    clear_cache(CACHE_DIR)
+    logging.info(f"Loading pipeline from local file: {mpta_file}")
+    model_tree = load_pipeline_from_zip(mpta_file, CACHE_DIR)
+    if model_tree is None:
+        logging.error("Failed to load pipeline.")
+        return
+
+    cap = cv2.VideoCapture(video_source)
+    if not cap.isOpened():
+        logging.error(f"Cannot open video source {video_source}")
+        return
+
+    # Start video capture in a separate thread
+    capture_running = True
+    capture_thread = threading.Thread(target=video_capture_loop, args=(cap,))
+    capture_thread.start()
+
+    logging.info("Press 'q' to exit.")
+    try:
+        while True:
+            # Use the global frame and ret updated by the thread
+            if not global_ret or global_frame is None:
+                continue  # wait until a frame is available
+            
+            frame = global_frame.copy()  # local copy to work with
+
+            # Replace run_pipeline with our logging version
+            detection, bbox = log_pipeline_flow(frame, model_tree)
+            
+            if bbox:
+                x1, y1, x2, y2 = bbox
+                cv2.rectangle(frame, (x1, y1), (x2, y2), (0, 255, 0), 2)
+                label = detection["class"] if detection else "Detection"
+                cv2.putText(frame, label, (x1, y1 - 10),
+                            cv2.FONT_HERSHEY_SIMPLEX, 0.9, (36, 255, 12), 2)
+
+            cv2.imshow("Pipeline Webcam", frame)
+            if cv2.waitKey(1) & 0xFF == ord('q'):
+                break
+    finally:
+        # Stop capture thread and cleanup
+        capture_running = False
+        capture_thread.join()
+        cap.release()
+        cv2.destroyAllWindows()
+        clear_cache(CACHE_DIR)
+        logging.info("Cleaned up .mptacache directory on shutdown.")
+
+if __name__ == "__main__":
+    parser = argparse.ArgumentParser(description="Run pipeline webcam utility.")
+    parser.add_argument("--mpta-file", type=str, required=True, help="Path to the local pipeline mpta (ZIP) file.")
+    parser.add_argument("--video", type=str, default="0", help="Video source (default webcam index 0).")
+    args = parser.parse_args()
+    video_source = int(args.video) if args.video.isdigit() else args.video
+    main(args.mpta_file, video_source)

pympta.md

@@ -0,0 +1,204 @@
+# pympta: Modular Pipeline Task Executor
+
+`pympta` is a Python module designed to load and execute modular, multi-stage AI pipelines defined in a special package format (`.mpta`). It is primarily used within the detector worker to run complex computer vision tasks where the output of one model can trigger a subsequent model on a specific region of interest.
+
+## Core Concepts
+
+### 1. MPTA Package (`.mpta`)
+
+An `.mpta` file is a standard `.zip` archive with a different extension. It bundles all the necessary components for a pipeline to run.
+
+A typical `.mpta` file has the following structure:
+
+```
+my_pipeline.mpta/
+├── pipeline.json
+├── model1.pt
+├── model2.pt
+└── ...
+```
+
+- **`pipeline.json`**: (Required) The manifest file that defines the structure of the pipeline, the models to use, and the logic connecting them.
+- **Model Files (`.pt`, etc.)**: The actual pre-trained model files (e.g., PyTorch, ONNX). The pipeline currently uses `ultralytics.YOLO` models.
+
+### 2. Pipeline Structure
+
+A pipeline is a tree-like structure of "nodes," defined in `pipeline.json`.
+
+- **Root Node**: The entry point of the pipeline. It processes the initial, full-frame image.
+- **Branch Nodes**: Child nodes that are triggered by specific detection results from their parent. For example, a root node might detect a "vehicle," which then triggers a branch node to detect a "license plate" within the vehicle's bounding box.
+
+This modular structure allows for creating complex and efficient inference logic, avoiding the need to run every model on every frame.
+
+## `pipeline.json` Specification
+
+This file defines the entire pipeline logic. The root object contains a `pipeline` key for the pipeline definition and an optional `redis` key for Redis configuration.
+
+### Top-Level Object Structure
+
+| Key        | Type   | Required | Description                                             |
+| ---------- | ------ | -------- | ------------------------------------------------------- |
+| `pipeline` | Object | Yes      | The root node object of the pipeline.                   |
+| `redis`    | Object | No       | Configuration for connecting to a Redis server.         |
+
+### Redis Configuration (`redis`)
+
+| Key        | Type   | Required | Description                                             |
+| ---------- | ------ | -------- | ------------------------------------------------------- |
+| `host`     | String | Yes      | The hostname or IP address of the Redis server.         |
+| `port`     | Number | Yes      | The port number of the Redis server.                    |
+| `password` | String | No       | The password for Redis authentication.                  |
+| `db`       | Number | No       | The Redis database number to use. Defaults to `0`.      |
+
+### Node Object Structure
+
+| Key                 | Type          | Required | Description                                                                                                                            |
+| ------------------- | ------------- | -------- | -------------------------------------------------------------------------------------------------------------------------------------- |
+| `modelId`           | String        | Yes      | A unique identifier for this model node (e.g., "vehicle-detector").                                                                    |
+| `modelFile`         | String        | Yes      | The path to the model file within the `.mpta` archive (e.g., "yolov8n.pt").                                                            |
+| `minConfidence`     | Float         | Yes      | The minimum confidence score (0.0 to 1.0) required for a detection to be considered valid and potentially trigger a branch.              |
+| `triggerClasses`    | Array<String> | Yes      | A list of class names that, when detected by the parent, can trigger this node. For the root node, this lists all classes of interest. |
+| `crop`              | Boolean       | No       | If `true`, the image is cropped to the parent's detection bounding box before being passed to this node's model. Defaults to `false`.    |
+| `branches`          | Array<Node>   | No       | A list of child node objects that can be triggered by this node's detections.                                                          |
+| `actions`           | Array<Action> | No       | A list of actions to execute upon a successful detection in this node.                                                                 |
+
+### Action Object Structure
+
+Actions allow the pipeline to interact with Redis. They are executed sequentially for a given detection.
+
+#### Action Context & Dynamic Keys
+
+All actions have access to a dynamic context for formatting keys and messages. The context is created for each detection event and includes:
+
+- All key-value pairs from the detection result (e.g., `class`, `confidence`, `id`).
+- `{timestamp_ms}`: The current Unix timestamp in milliseconds.
+- `{uuid}`: A unique identifier (UUID4) for the detection event.
+- `{image_key}`: If a `redis_save_image` action has already been executed for this event, this placeholder will be replaced with the key where the image was stored.
+
+#### `redis_save_image`
+
+Saves the current image frame (or cropped sub-image) to a Redis key.
+
+| Key              | Type   | Required | Description                                                                                             |
+| ---------------- | ------ | -------- | ------------------------------------------------------------------------------------------------------- |
+| `type`           | String | Yes      | Must be `"redis_save_image"`.                                                                           |
+| `key`            | String | Yes      | The Redis key to save the image to. Can contain any of the dynamic placeholders.                        |
+| `expire_seconds` | Number | No       | If provided, sets an expiration time (in seconds) for the Redis key.                                    |
+
+#### `redis_publish`
+
+Publishes a message to a Redis channel.
+
+| Key       | Type   | Required | Description                                                                                             |
+| --------- | ------ | -------- | ------------------------------------------------------------------------------------------------------- |
+| `type`    | String | Yes      | Must be `"redis_publish"`.                                                                              |
+| `channel` | String | Yes      | The Redis channel to publish the message to.                                                            |
+| `message` | String | Yes      | The message to publish. Can contain any of the dynamic placeholders, including `{image_key}`.           |
+
+### Example `pipeline.json` with Redis
+
+This example demonstrates a pipeline that detects vehicles, saves a uniquely named image of each detection that expires in one hour, and then publishes a notification with the image key.
+
+```json
+{
+  "redis": {
+    "host": "redis.local",
+    "port": 6379,
+    "password": "your-super-secret-password"
+  },
+  "pipeline": {
+    "modelId": "vehicle-detector",
+    "modelFile": "vehicle_model.pt",
+    "minConfidence": 0.6,
+    "triggerClasses": ["car", "truck"],
+    "actions": [
+      {
+        "type": "redis_save_image",
+        "key": "detections:{class}:{timestamp_ms}:{uuid}",
+        "expire_seconds": 3600
+      },
+      {
+        "type": "redis_publish",
+        "channel": "vehicle_events",
+        "message": "{\"event\":\"new_detection\",\"class\":\"{class}\",\"confidence\":{confidence},\"image_key\":\"{image_key}\"}"
+      }
+    ],
+    "branches": []
+  }
+}
+```
+
+## API Reference
+
+The `pympta` module exposes two main functions.
+
+### `load_pipeline_from_zip(zip_source: str, target_dir: str) -> dict`
+
+Loads, extracts, and parses an `.mpta` file to build a pipeline tree in memory. It also establishes a Redis connection if configured in `pipeline.json`.
+
+- **Parameters:**
+  - `zip_source` (str): The file path to the local `.mpta` zip archive.
+  - `target_dir` (str): A directory path where the archive's contents will be extracted.
+- **Returns:**
+  - A dictionary representing the root node of the pipeline, ready to be used with `run_pipeline`. Returns `None` if loading fails.
+
+### `run_pipeline(frame, node: dict, return_bbox: bool = False)`
+
+Executes the inference pipeline on a single image frame.
+
+- **Parameters:**
+  - `frame`: The input image frame (e.g., a NumPy array from OpenCV).
+  - `node` (dict): The pipeline node to execute (typically the root node returned by `load_pipeline_from_zip`).
+  - `return_bbox` (bool): If `True`, the function returns a tuple `(detection, bounding_box)`. Otherwise, it returns only the `detection`.
+- **Returns:**
+  - The final detection result from the last executed node in the chain. A detection is a dictionary like `{'class': 'car', 'confidence': 0.95, 'id': 1}`. If no detection meets the criteria, it returns `None` (or `(None, None)` if `return_bbox` is `True`).
+
+## Usage Example
+
+This snippet, inspired by `pipeline_webcam.py`, shows how to use `pympta` to load a pipeline and process an image from a webcam.
+
+```python
+import cv2
+from siwatsystem.pympta import load_pipeline_from_zip, run_pipeline
+
+# 1. Define paths
+MPTA_FILE = "path/to/your/pipeline.mpta"
+CACHE_DIR = ".mptacache"
+
+# 2. Load the pipeline from the .mpta file
+# This reads pipeline.json and loads the YOLO models into memory.
+model_tree = load_pipeline_from_zip(MPTA_FILE, CACHE_DIR)
+
+if not model_tree:
+    print("Failed to load pipeline.")
+    exit()
+
+# 3. Open a video source
+cap = cv2.VideoCapture(0)
+
+while True:
+    ret, frame = cap.read()
+    if not ret:
+        break
+
+    # 4. Run the pipeline on the current frame
+    # The function will handle the entire logic tree (e.g., find a car, then find its license plate).
+    detection_result, bounding_box = run_pipeline(frame, model_tree, return_bbox=True)
+
+    # 5. Display the results
+    if detection_result:
+        print(f"Detected: {detection_result['class']} with confidence {detection_result['confidence']:.2f}")
+        if bounding_box:
+            x1, y1, x2, y2 = bounding_box
+            cv2.rectangle(frame, (x1, y1), (x2, y2), (0, 255, 0), 2)
+            cv2.putText(frame, detection_result['class'], (x1, y1 - 10),
+                        cv2.FONT_HERSHEY_SIMPLEX, 0.9, (36, 255, 12), 2)
+
+    cv2.imshow("Pipeline Output", frame)
+
+    if cv2.waitKey(1) & 0xFF == ord('q'):
+        break
+
+cap.release()
+cv2.destroyAllWindows()
+```

requirements.txt

@@ -3,4 +3,7 @@ uvicorn
 torch
 torchvision
 ultralytics
-opencv-python
+opencv-python
+websockets
+fastapi[standard]
+redis

siwatsystem/pympta.py

@@ -0,0 +1,324 @@
+import os
+import json
+import logging
+import torch
+import cv2
+import requests
+import zipfile
+import shutil
+import traceback
+import redis
+import time
+import uuid
+from ultralytics import YOLO
+from urllib.parse import urlparse
+
+# Create a logger specifically for this module
+logger = logging.getLogger("detector_worker.pympta")
+
+def load_pipeline_node(node_config: dict, mpta_dir: str, redis_client) -> dict:
+    # Recursively load a model node from configuration.
+    model_path = os.path.join(mpta_dir, node_config["modelFile"])
+    if not os.path.exists(model_path):
+        logger.error(f"Model file {model_path} not found. Current directory: {os.getcwd()}")
+        logger.error(f"Directory content: {os.listdir(os.path.dirname(model_path))}")
+        raise FileNotFoundError(f"Model file {model_path} not found.")
+    logger.info(f"Loading model for node {node_config['modelId']} from {model_path}")
+    model = YOLO(model_path)
+    if torch.cuda.is_available():
+        logger.info(f"CUDA available. Moving model {node_config['modelId']} to GPU")
+        model.to("cuda")
+    else:
+        logger.info(f"CUDA not available. Using CPU for model {node_config['modelId']}")
+
+    # Prepare trigger class indices for optimization
+    trigger_classes = node_config.get("triggerClasses", [])
+    trigger_class_indices = None
+    if trigger_classes and hasattr(model, "names"):
+        # Convert class names to indices for the model
+        trigger_class_indices = [i for i, name in model.names.items() 
+                                if name in trigger_classes]
+        logger.debug(f"Converted trigger classes to indices: {trigger_class_indices}")
+
+    node = {
+        "modelId": node_config["modelId"],
+        "modelFile": node_config["modelFile"],
+        "triggerClasses": trigger_classes,
+        "triggerClassIndices": trigger_class_indices,
+        "crop": node_config.get("crop", False),
+        "minConfidence": node_config.get("minConfidence", None),
+        "actions": node_config.get("actions", []),
+        "model": model,
+        "branches": [],
+        "redis_client": redis_client
+    }
+    logger.debug(f"Configured node {node_config['modelId']} with trigger classes: {node['triggerClasses']}")
+    for child in node_config.get("branches", []):
+        logger.debug(f"Loading branch for parent node {node_config['modelId']}")
+        node["branches"].append(load_pipeline_node(child, mpta_dir, redis_client))
+    return node
+
+def load_pipeline_from_zip(zip_source: str, target_dir: str) -> dict:
+    logger.info(f"Attempting to load pipeline from {zip_source} to {target_dir}")
+    os.makedirs(target_dir, exist_ok=True)
+    zip_path = os.path.join(target_dir, "pipeline.mpta")
+    
+    # Parse the source; only local files are supported here.
+    parsed = urlparse(zip_source)
+    if parsed.scheme in ("", "file"):
+        local_path = parsed.path if parsed.scheme == "file" else zip_source
+        logger.debug(f"Checking if local file exists: {local_path}")
+        if os.path.exists(local_path):
+            try:
+                shutil.copy(local_path, zip_path)
+                logger.info(f"Copied local .mpta file from {local_path} to {zip_path}")
+            except Exception as e:
+                logger.error(f"Failed to copy local .mpta file from {local_path}: {str(e)}", exc_info=True)
+                return None
+        else:
+            logger.error(f"Local file {local_path} does not exist. Current directory: {os.getcwd()}")
+            # List all subdirectories of models directory to help debugging
+            if os.path.exists("models"):
+                logger.error(f"Content of models directory: {os.listdir('models')}")
+                for root, dirs, files in os.walk("models"):
+                    logger.error(f"Directory {root} contains subdirs: {dirs} and files: {files}")
+            else:
+                logger.error("The models directory doesn't exist")
+            return None
+    else:
+        logger.error(f"HTTP download functionality has been moved. Use a local file path here. Received: {zip_source}")
+        return None
+
+    try:
+        if not os.path.exists(zip_path):
+            logger.error(f"Zip file not found at expected location: {zip_path}")
+            return None
+            
+        logger.debug(f"Extracting .mpta file from {zip_path} to {target_dir}")
+        # Extract contents and track the directories created
+        extracted_dirs = []
+        with zipfile.ZipFile(zip_path, "r") as zip_ref:
+            file_list = zip_ref.namelist()
+            logger.debug(f"Files in .mpta archive: {file_list}")
+            
+            # Extract and track the top-level directories
+            for file_path in file_list:
+                parts = file_path.split('/')
+                if len(parts) > 1:
+                    top_dir = parts[0]
+                    if top_dir and top_dir not in extracted_dirs:
+                        extracted_dirs.append(top_dir)
+            
+            # Now extract the files
+            zip_ref.extractall(target_dir)
+            
+        logger.info(f"Successfully extracted .mpta file to {target_dir}")
+        logger.debug(f"Extracted directories: {extracted_dirs}")
+        
+        # Check what was actually created after extraction
+        actual_dirs = [d for d in os.listdir(target_dir) if os.path.isdir(os.path.join(target_dir, d))]
+        logger.debug(f"Actual directories created: {actual_dirs}")
+    except zipfile.BadZipFile as e:
+        logger.error(f"Bad zip file {zip_path}: {str(e)}", exc_info=True)
+        return None
+    except Exception as e:
+        logger.error(f"Failed to extract .mpta file {zip_path}: {str(e)}", exc_info=True)
+        return None
+    finally:
+        if os.path.exists(zip_path):
+            os.remove(zip_path)
+            logger.debug(f"Removed temporary zip file: {zip_path}")
+
+    # Use the first extracted directory if it exists, otherwise use the expected name
+    pipeline_name = os.path.basename(zip_source)
+    pipeline_name = os.path.splitext(pipeline_name)[0]
+    
+    # Find the directory with pipeline.json
+    mpta_dir = None
+    # First try the expected directory name
+    expected_dir = os.path.join(target_dir, pipeline_name)
+    if os.path.exists(expected_dir) and os.path.exists(os.path.join(expected_dir, "pipeline.json")):
+        mpta_dir = expected_dir
+        logger.debug(f"Found pipeline.json in the expected directory: {mpta_dir}")
+    else:
+        # Look through all subdirectories for pipeline.json
+        for subdir in actual_dirs:
+            potential_dir = os.path.join(target_dir, subdir)
+            if os.path.exists(os.path.join(potential_dir, "pipeline.json")):
+                mpta_dir = potential_dir
+                logger.info(f"Found pipeline.json in directory: {mpta_dir} (different from expected: {expected_dir})")
+                break
+    
+    if not mpta_dir:
+        logger.error(f"Could not find pipeline.json in any extracted directory. Directory content: {os.listdir(target_dir)}")
+        return None
+        
+    pipeline_json_path = os.path.join(mpta_dir, "pipeline.json")
+    if not os.path.exists(pipeline_json_path):
+        logger.error(f"pipeline.json not found in the .mpta file. Files in directory: {os.listdir(mpta_dir)}")
+        return None
+
+    try:
+        with open(pipeline_json_path, "r") as f:
+            pipeline_config = json.load(f)
+        logger.info(f"Successfully loaded pipeline configuration from {pipeline_json_path}")
+        logger.debug(f"Pipeline config: {json.dumps(pipeline_config, indent=2)}")
+        
+        # Establish Redis connection if configured
+        redis_client = None
+        if "redis" in pipeline_config:
+            redis_config = pipeline_config["redis"]
+            try:
+                redis_client = redis.Redis(
+                    host=redis_config["host"],
+                    port=redis_config["port"],
+                    password=redis_config.get("password"),
+                    db=redis_config.get("db", 0),
+                    decode_responses=True
+                )
+                redis_client.ping()
+                logger.info(f"Successfully connected to Redis at {redis_config['host']}:{redis_config['port']}")
+            except redis.exceptions.ConnectionError as e:
+                logger.error(f"Failed to connect to Redis: {e}")
+                redis_client = None
+        
+        return load_pipeline_node(pipeline_config["pipeline"], mpta_dir, redis_client)
+    except json.JSONDecodeError as e:
+        logger.error(f"Error parsing pipeline.json: {str(e)}", exc_info=True)
+        return None
+    except KeyError as e:
+        logger.error(f"Missing key in pipeline.json: {str(e)}", exc_info=True)
+        return None
+    except Exception as e:
+        logger.error(f"Error loading pipeline.json: {str(e)}", exc_info=True)
+        return None
+
+def execute_actions(node, frame, detection_result):
+    if not node["redis_client"] or not node["actions"]:
+        return
+
+    # Create a dynamic context for this detection event
+    action_context = {
+        **detection_result,
+        "timestamp_ms": int(time.time() * 1000),
+        "uuid": str(uuid.uuid4()),
+    }
+
+    for action in node["actions"]:
+        try:
+            if action["type"] == "redis_save_image":
+                key = action["key"].format(**action_context)
+                _, buffer = cv2.imencode('.jpg', frame)
+                expire_seconds = action.get("expire_seconds")
+                if expire_seconds:
+                    node["redis_client"].setex(key, expire_seconds, buffer.tobytes())
+                    logger.info(f"Saved image to Redis with key: {key} (expires in {expire_seconds}s)")
+                else:
+                    node["redis_client"].set(key, buffer.tobytes())
+                    logger.info(f"Saved image to Redis with key: {key}")
+                # Add the generated key to the context for subsequent actions
+                action_context["image_key"] = key
+            elif action["type"] == "redis_publish":
+                channel = action["channel"]
+                message = action["message"].format(**action_context)
+                node["redis_client"].publish(channel, message)
+                logger.info(f"Published message to Redis channel '{channel}': {message}")
+        except Exception as e:
+            logger.error(f"Error executing action {action['type']}: {e}")
+
+def run_pipeline(frame, node: dict, return_bbox: bool=False):
+    """
+    - For detection nodes (task != 'classify'):
+        • runs `track(..., classes=triggerClassIndices)`
+        • picks top box ≥ minConfidence
+        • optionally crops & resizes → recurse into child
+        • else returns (det_dict, bbox)
+    - For classify nodes:
+        • runs `predict()`
+        • returns top (class,confidence) and no bbox
+    """
+    try:
+        task = getattr(node["model"], "task", None)
+
+        # ─── Classification stage ───────────────────────────────────
+        if task == "classify":
+            # run the classifier and grab its top-1 directly via the Probs API
+            results = node["model"].predict(frame, stream=False)
+            # nothing returned?
+            if not results:
+                return (None, None) if return_bbox else None
+
+            # take the first result's probs object
+            r     = results[0]
+            probs = r.probs
+            if probs is None:
+                return (None, None) if return_bbox else None
+
+            # get the top-1 class index and its confidence
+            top1_idx  = int(probs.top1)
+            top1_conf = float(probs.top1conf)
+
+            det = {
+                "class": node["model"].names[top1_idx],
+                "confidence": top1_conf,
+                "id": None
+            }
+            execute_actions(node, frame, det)
+            return (det, None) if return_bbox else det
+
+
+        # ─── Detection stage ────────────────────────────────────────
+        # only look for your triggerClasses
+        tk = node["triggerClassIndices"]
+        res = node["model"].track(
+            frame,
+            stream=False,
+            persist=True,
+            **({"classes": tk} if tk else {})
+        )[0]
+
+        dets, boxes = [], []
+        for box in res.boxes:
+            conf = float(box.cpu().conf[0])
+            cid  = int(box.cpu().cls[0])
+            name = node["model"].names[cid]
+            if conf < node["minConfidence"]:
+                continue
+            xy = box.cpu().xyxy[0]
+            x1,y1,x2,y2 = map(int, xy)
+            dets.append({"class": name, "confidence": conf,
+                         "id": box.id.item() if hasattr(box, "id") else None})
+            boxes.append((x1, y1, x2, y2))
+
+        if not dets:
+            return (None, None) if return_bbox else None
+
+        # take highest‐confidence
+        best_idx = max(range(len(dets)), key=lambda i: dets[i]["confidence"])
+        best_det = dets[best_idx]
+        best_box = boxes[best_idx]
+
+        # ─── Branch (classification) ───────────────────────────────
+        for br in node["branches"]:
+            if (best_det["class"] in br["triggerClasses"]
+                    and best_det["confidence"] >= br["minConfidence"]):
+                # crop if requested
+                sub = frame
+                if br["crop"]:
+                    x1,y1,x2,y2 = best_box
+                    sub = frame[y1:y2, x1:x2]
+                    sub = cv2.resize(sub, (224, 224))
+
+                det2, _ = run_pipeline(sub, br, return_bbox=True)
+                if det2:
+                    # return classification result + original bbox
+                    execute_actions(br, sub, det2)
+                    return (det2, best_box) if return_bbox else det2
+
+        # ─── No branch matched → return this detection ─────────────
+        execute_actions(node, frame, best_det)
+        return (best_det, best_box) if return_bbox else best_det
+
+    except Exception as e:
+        logging.error(f"Error in node {node.get('modelId')}: {e}")
+        return (None, None) if return_bbox else None

test_protocol.py

@@ -0,0 +1,125 @@
+#!/usr/bin/env python3
+"""
+Test script to verify the worker implementation follows the protocol
+"""
+import json
+import asyncio
+import websockets
+import time
+
+async def test_protocol():
+    """Test the worker protocol implementation"""
+    uri = "ws://localhost:8000"
+    
+    try:
+        async with websockets.connect(uri) as websocket:
+            print("✓ Connected to worker")
+            
+            # Test 1: Check if we receive heartbeat (stateReport)
+            print("\n1. Testing heartbeat...")
+            try:
+                message = await asyncio.wait_for(websocket.recv(), timeout=5)
+                data = json.loads(message)
+                if data.get("type") == "stateReport":
+                    print("✓ Received stateReport heartbeat")
+                    print(f"  - CPU Usage: {data.get('cpuUsage', 'N/A')}%")
+                    print(f"  - Memory Usage: {data.get('memoryUsage', 'N/A')}%")
+                    print(f"  - Camera Connections: {len(data.get('cameraConnections', []))}")
+                else:
+                    print(f"✗ Expected stateReport, got {data.get('type')}")
+            except asyncio.TimeoutError:
+                print("✗ No heartbeat received within 5 seconds")
+            
+            # Test 2: Request state
+            print("\n2. Testing requestState...")
+            await websocket.send(json.dumps({"type": "requestState"}))
+            try:
+                message = await asyncio.wait_for(websocket.recv(), timeout=5)
+                data = json.loads(message)
+                if data.get("type") == "stateReport":
+                    print("✓ Received stateReport response")
+                else:
+                    print(f"✗ Expected stateReport, got {data.get('type')}")
+            except asyncio.TimeoutError:
+                print("✗ No response to requestState within 5 seconds")
+            
+            # Test 3: Set session ID
+            print("\n3. Testing setSessionId...")
+            session_message = {
+                "type": "setSessionId",
+                "payload": {
+                    "displayIdentifier": "display-001",
+                    "sessionId": 12345
+                }
+            }
+            await websocket.send(json.dumps(session_message))
+            print("✓ Sent setSessionId message")
+            
+            # Test 4: Test patchSession
+            print("\n4. Testing patchSession...")
+            patch_message = {
+                "type": "patchSession",
+                "sessionId": 12345,
+                "data": {
+                    "currentCar": {
+                        "carModel": "Civic",
+                        "carBrand": "Honda"
+                    }
+                }
+            }
+            await websocket.send(json.dumps(patch_message))
+            
+            # Wait for patchSessionResult
+            try:
+                message = await asyncio.wait_for(websocket.recv(), timeout=5)
+                data = json.loads(message)
+                if data.get("type") == "patchSessionResult":
+                    print("✓ Received patchSessionResult")
+                    print(f"  - Success: {data.get('payload', {}).get('success')}")
+                    print(f"  - Message: {data.get('payload', {}).get('message')}")
+                else:
+                    print(f"✗ Expected patchSessionResult, got {data.get('type')}")
+            except asyncio.TimeoutError:
+                print("✗ No patchSessionResult received within 5 seconds")
+            
+            # Test 5: Test subscribe message format (without actual camera)
+            print("\n5. Testing subscribe message format...")
+            subscribe_message = {
+                "type": "subscribe",
+                "payload": {
+                    "subscriptionIdentifier": "display-001;cam-001",
+                    "snapshotUrl": "http://example.com/snapshot.jpg",
+                    "snapshotInterval": 5000,
+                    "modelUrl": "http://example.com/model.mpta",
+                    "modelName": "Test Model",
+                    "modelId": 101,
+                    "cropX1": 100,
+                    "cropY1": 200,
+                    "cropX2": 300,
+                    "cropY2": 400
+                }
+            }
+            await websocket.send(json.dumps(subscribe_message))
+            print("✓ Sent subscribe message (will fail without actual camera/model)")
+            
+            # Listen for a few more messages to catch any errors
+            print("\n6. Listening for additional messages...")
+            for i in range(3):
+                try:
+                    message = await asyncio.wait_for(websocket.recv(), timeout=2)
+                    data = json.loads(message)
+                    msg_type = data.get("type")
+                    print(f"  - Received {msg_type}")
+                    if msg_type == "error":
+                        print(f"    Error: {data.get('error')}")
+                except asyncio.TimeoutError:
+                    break
+            
+            print("\n✓ Protocol test completed successfully!")
+            
+    except Exception as e:
+        print(f"✗ Connection failed: {e}")
+        print("Make sure the worker is running on localhost:8000")
+
+if __name__ == "__main__":
+    asyncio.run(test_protocol())

worker.md

@@ -0,0 +1,483 @@
+# Worker Communication Protocol
+
+This document outlines the WebSocket-based communication protocol between the CMS backend and a detector worker. As a worker developer, your primary responsibility is to implement a WebSocket server that adheres to this protocol.
+
+## 1. Connection
+
+The worker must run a WebSocket server, preferably on port `8000`. The backend system, which is managed by a container orchestration service, will automatically discover and establish a WebSocket connection to your worker.
+
+Upon a successful connection from the backend, you should begin sending `stateReport` messages as heartbeats.
+
+## 2. Communication Overview
+
+Communication is bidirectional and asynchronous. All messages are JSON objects with a `type` field that indicates the message's purpose, and an optional `payload` field containing the data.
+
+- **Worker -> Backend:** You will send messages to the backend to report status, forward detection events, or request changes to session data.
+- **Backend -> Worker:** The backend will send commands to you to manage camera subscriptions.
+
+## 3. Dynamic Configuration via MPTA File
+
+To enable modularity and dynamic configuration, the backend will send you a URL to a `.mpta` file when it issues a `subscribe` command. This file is a renamed `.zip` archive that contains everything your worker needs to perform its task.
+
+**Your worker is responsible for:**
+
+1. Fetching this file from the provided URL.
+2. Extracting its contents.
+3. Interpreting the contents to configure its internal pipeline.
+
+**The contents of the `.mpta` file are entirely up to the user who configures the model in the CMS.** This allows for maximum flexibility. For example, the archive could contain:
+
+- AI/ML Models: Pre-trained models for libraries like TensorFlow, PyTorch, or ONNX.
+- Configuration Files: A `config.json` or `pipeline.yaml` that defines a sequence of operations, specifies model paths, or sets detection thresholds.
+- Scripts: Custom Python scripts for pre-processing or post-processing.
+- API Integration Details: A JSON file with endpoint information and credentials for interacting with third-party detection services.
+
+Essentially, the `.mpta` file is a self-contained package that tells your worker *how* to process the video stream for a given subscription.
+
+## 4. Messages from Worker to Backend
+
+These are the messages your worker is expected to send to the backend.
+
+### 4.1. State Report (Heartbeat)
+
+This message is crucial for the backend to monitor your worker's health and status, including GPU usage.
+
+- **Type:** `stateReport`
+- **When to Send:** Periodically (e.g., every 2 seconds) after a connection is established.
+
+**Payload:**
+
+```json
+{
+  "type": "stateReport",
+  "cpuUsage": 75.5,
+  "memoryUsage": 40.2,
+  "gpuUsage": 60.0,
+  "gpuMemoryUsage": 25.1,
+  "cameraConnections": [
+    {
+      "subscriptionIdentifier": "display-001;cam-001",
+      "modelId": 101,
+      "modelName": "General Object Detection",
+      "online": true,
+      "cropX1": 100,
+      "cropY1": 200,
+      "cropX2": 300,
+      "cropY2": 400
+    }
+  ]
+}
+```
+
+> **Note:**
+>
+> - `cropX1`, `cropY1`, `cropX2`, `cropY2` (optional, integer) should be included in each camera connection to indicate the crop coordinates for that subscription.
+
+### 4.2. Image Detection
+
+Sent when the worker detects a relevant object. The `detection` object should be flat and contain key-value pairs corresponding to the detected attributes.
+
+- **Type:** `imageDetection`
+
+**Payload Example:**
+
+```json
+{
+  "type": "imageDetection",
+  "subscriptionIdentifier": "display-001;cam-001",
+  "timestamp": "2025-07-14T12:34:56.789Z",
+  "data": {
+    "detection": {
+      "carModel": "Civic",
+      "carBrand": "Honda",
+      "carYear": 2023,
+      "bodyType": "Sedan",
+      "licensePlateText": "ABCD1234",
+      "licensePlateConfidence": 0.95
+    },
+    "modelId": 101,
+    "modelName": "US-LPR-and-Vehicle-ID"
+  }
+}
+```
+
+### 4.3. Patch Session
+
+> **Note:** Patch messages are only used when the worker can't keep up and needs to retroactively send detections. Normally, detections should be sent in real-time using `imageDetection` messages. Use `patchSession` only to update session data after the fact.
+
+Allows the worker to request a modification to an active session's data. The `data` payload must be a partial object of the `DisplayPersistentData` structure.
+
+- **Type:** `patchSession`
+
+**Payload Example:**
+
+```json
+{
+  "type": "patchSession",
+  "sessionId": 12345,
+  "data": {
+    "currentCar": {
+        "carModel": "Civic",
+        "carBrand": "Honda",
+        "licensePlateText": "ABCD1234"
+    }
+  }
+}
+```
+
+The backend will respond with a `patchSessionResult` command.
+
+#### `DisplayPersistentData` Structure
+
+The `data` object in the `patchSession` message is merged with the existing `DisplayPersistentData` on the backend. Here is its structure:
+
+```typescript
+interface DisplayPersistentData {
+    progressionStage: "welcome" | "car_fueling" | "car_waitpayment" | "car_postpayment" | null;
+    qrCode: string | null;
+    adsPlayback: {
+        playlistSlotOrder: number; // The 'order' of the current slot
+        adsId: number | null;
+        adsUrl: string | null;
+    } | null;
+    currentCar: {
+        carModel?: string;
+        carBrand?: string;
+        carYear?: number;
+        bodyType?: string;
+        licensePlateText?: string;
+        licensePlateType?: string;
+    } | null;
+    fuelPump: { /* FuelPumpData structure */ } | null;
+    weatherData: { /* WeatherResponse structure */ } | null;
+    sessionId: number | null;
+}
+```
+
+#### Patching Behavior
+
+- The patch is a **deep merge**.
+- **`undefined`** values are ignored.
+- **`null`** values will set the corresponding field to `null`.
+- Nested objects are merged recursively.
+
+## 5. Commands from Backend to Worker
+
+These are the commands your worker will receive from the backend.
+
+### 5.1. Subscribe to Camera
+
+Instructs the worker to process a camera's RTSP stream using the configuration from the specified `.mpta` file.
+
+- **Type:** `subscribe`
+
+**Payload:**
+
+```json
+{
+  "type": "subscribe",
+  "payload": {
+    "subscriptionIdentifier": "display-001;cam-002",
+    "rtspUrl": "rtsp://user:pass@host:port/stream",
+    "snapshotUrl": "http://go2rtc/snapshot/1",
+    "snapshotInterval": 5000,
+    "modelUrl": "http://storage/models/us-lpr.mpta",
+    "modelName": "US-LPR-and-Vehicle-ID",
+    "modelId": 102,
+    "cropX1": 100,
+    "cropY1": 200,
+    "cropX2": 300,
+    "cropY2": 400
+  }
+}
+```
+
+> **Note:**
+>
+> - `cropX1`, `cropY1`, `cropX2`, `cropY2` (optional, integer) specify the crop coordinates for the camera stream. These values are configured per display and passed in the subscription payload. If not provided, the worker should process the full frame.
+>
+> **Important:**
+> If multiple displays are bound to the same camera, your worker must ensure that only **one stream** is opened per camera. When you receive multiple subscriptions for the same camera (with different `subscriptionIdentifier` values), you should:
+>
+> - Open the RTSP stream **once** for that camera if using RTSP.
+> - Capture each snapshot only once per cycle, and reuse it for all display subscriptions sharing that camera.
+> - Capture each frame/image only once per cycle.
+> - Reuse the same captured image and snapshot for all display subscriptions that share the camera, processing and routing detection results separately for each display as needed.
+> This avoids unnecessary load and bandwidth usage, and ensures consistent detection results and snapshots across all displays sharing the same camera.
+
+### 5.2. Unsubscribe from Camera
+
+Instructs the worker to stop processing a camera's stream.
+
+- **Type:** `unsubscribe`
+
+**Payload:**
+
+```json
+{
+  "type": "unsubscribe",
+  "payload": {
+    "subscriptionIdentifier": "display-001;cam-002"
+  }
+}
+```
+
+### 5.3. Request State
+
+Direct request for the worker's current state. Respond with a `stateReport` message.
+
+- **Type:** `requestState`
+
+**Payload:**
+
+```json
+{
+  "type": "requestState"
+}
+```
+
+### 5.4. Patch Session Result
+
+Backend's response to a `patchSession` message.
+
+- **Type:** `patchSessionResult`
+
+**Payload:**
+
+```json
+{
+  "type": "patchSessionResult",
+  "payload": {
+    "sessionId": 12345,
+    "success": true,
+    "message": "Session updated successfully."
+  }
+}
+```
+
+### 5.5. Set Session ID
+
+Allows the backend to instruct the worker to associate a session ID with a subscription. This is useful for linking detection events to a specific session. The session ID can be `null` to indicate no active session.
+
+- **Type:** `setSessionId`
+
+**Payload:**
+
+```json
+{
+  "type": "setSessionId",
+  "payload": {
+    "displayIdentifier": "display-001",
+    "sessionId": 12345
+  }
+}
+```
+
+Or to clear the session:
+
+```json
+{
+  "type": "setSessionId",
+  "payload": {
+    "displayIdentifier": "display-001",
+    "sessionId": null
+  }
+}
+```
+
+> **Note:**
+>
+> - The worker should store the session ID for the given subscription and use it in subsequent detection or patch messages as appropriate. If `sessionId` is `null`, the worker should treat the subscription as having no active session.
+
+## Subscription Identifier Format
+
+The `subscriptionIdentifier` used in all messages is constructed as:
+
+```
+displayIdentifier;cameraIdentifier
+```
+
+This uniquely identifies a camera subscription for a specific display.
+
+### Session ID Association
+
+When the backend sends a `setSessionId` command, it will only provide the `displayIdentifier` (not the full `subscriptionIdentifier`).
+
+**Worker Responsibility:**
+
+- The worker must match the `displayIdentifier` to all active subscriptions for that display (i.e., all `subscriptionIdentifier` values that start with `displayIdentifier;`).
+- The worker should set or clear the session ID for all matching subscriptions.
+
+## 6. Example Communication Log
+
+This section shows a typical sequence of messages between the backend and the worker. Patch messages are not included, as they are only used when the worker cannot keep up.
+
+> **Note:** Unsubscribe is triggered when a user removes a camera or when the node is too heavily loaded and needs rebalancing.
+
+1.  **Connection Established** & **Heartbeat**
+    *   **Worker -> Backend**
+    ```json
+    {
+      "type": "stateReport",
+      "cpuUsage": 70.2,
+      "memoryUsage": 38.1,
+      "gpuUsage": 55.0,
+      "gpuMemoryUsage": 20.0,
+      "cameraConnections": []
+    }
+    ```
+2.  **Backend Subscribes Camera**
+    *   **Backend -> Worker**
+    ```json
+    {
+      "type": "subscribe",
+      "payload": {
+        "subscriptionIdentifier": "display-001;entry-cam-01",
+        "rtspUrl": "rtsp://192.168.1.100/stream1",
+        "modelUrl": "http://storage/models/vehicle-id.mpta",
+        "modelName": "Vehicle Identification",
+        "modelId": 201
+      }
+    }
+    ```
+3.  **Worker Acknowledges in Heartbeat**
+    *   **Worker -> Backend**
+    ```json
+    {
+      "type": "stateReport",
+      "cpuUsage": 72.5,
+      "memoryUsage": 39.0,
+      "gpuUsage": 57.0,
+      "gpuMemoryUsage": 21.0,
+      "cameraConnections": [
+        {
+          "subscriptionIdentifier": "display-001;entry-cam-01",
+          "modelId": 201,
+          "modelName": "Vehicle Identification",
+          "online": true
+        }
+      ]
+    }
+    ```
+4.  **Worker Detects a Car**
+    *   **Worker -> Backend**
+    ```json
+    {
+      "type": "imageDetection",
+      "subscriptionIdentifier": "display-001;entry-cam-01",
+      "timestamp": "2025-07-15T10:00:00.000Z",
+      "data": {
+        "detection": {
+          "carBrand": "Honda",
+          "carModel": "CR-V",
+          "bodyType": "SUV",
+          "licensePlateText": "GEMINI-AI",
+          "licensePlateConfidence": 0.98
+        },
+        "modelId": 201,
+        "modelName": "Vehicle Identification"
+      }
+    }
+    ```
+    *   **Worker -> Backend**
+    ```json
+    {
+      "type": "imageDetection",
+      "subscriptionIdentifier": "display-001;entry-cam-01",
+      "timestamp": "2025-07-15T10:00:01.000Z",
+      "data": {
+        "detection": {
+          "carBrand": "Toyota",
+          "carModel": "Corolla",
+          "bodyType": "Sedan",
+          "licensePlateText": "CMS-1234",
+          "licensePlateConfidence": 0.97
+        },
+        "modelId": 201,
+        "modelName": "Vehicle Identification"
+      }
+    }
+    ```
+    *   **Worker -> Backend**
+    ```json
+    {
+      "type": "imageDetection",
+      "subscriptionIdentifier": "display-001;entry-cam-01",
+      "timestamp": "2025-07-15T10:00:02.000Z",
+      "data": {
+        "detection": {
+          "carBrand": "Ford",
+          "carModel": "Focus",
+          "bodyType": "Hatchback",
+          "licensePlateText": "CMS-5678",
+          "licensePlateConfidence": 0.96
+        },
+        "modelId": 201,
+        "modelName": "Vehicle Identification"
+      }
+    }
+    ```
+5.  **Backend Unsubscribes Camera**
+    *   **Backend -> Worker**
+    ```json
+    {
+      "type": "unsubscribe",
+      "payload": {
+        "subscriptionIdentifier": "display-001;entry-cam-01"
+      }
+    }
+    ```
+6.  **Worker Acknowledges Unsubscription**
+    *   **Worker -> Backend**
+    ```json
+    {
+      "type": "stateReport",
+      "cpuUsage": 68.0,
+      "memoryUsage": 37.0,
+      "gpuUsage": 50.0,
+      "gpuMemoryUsage": 18.0,
+      "cameraConnections": []
+    }
+    ```
+## 7. HTTP API: Image Retrieval
+
+In addition to the WebSocket protocol, the worker exposes an HTTP endpoint for retrieving the latest image frame from a camera.
+
+### Endpoint
+
+```
+GET /camera/{camera_id}/image
+```
+
+- **`camera_id`**: The full `subscriptionIdentifier` (e.g., `display-001;cam-001`).
+
+### Response
+
+- **Success (200):** Returns the latest JPEG image from the camera stream.
+    - `Content-Type: image/jpeg`
+    - Binary JPEG data.
+
+- **Error (404):** If the camera is not found or no frame is available.
+    - JSON error response.
+
+- **Error (500):** Internal server error.
+
+### Example Request
+
+```
+GET /camera/display-001;cam-001/image
+```
+
+### Example Response
+
+- **Headers:**
+    ```
+    Content-Type: image/jpeg
+    ```
+- **Body:** Binary JPEG image.
+
+### Notes
+
+- The endpoint returns the most recent frame available for the specified camera subscription.
+- If multiple displays share the same camera, each subscription has its own buffer; the endpoint uses the buffer for the given `camera_id`.
+- This API is useful for debugging, monitoring, or integrating with external systems that require direct image access.