4245 Commits

Author SHA1 Message Date
Nicolas Mowen
5ef4f2d440 Finalize process 2025-06-12 11:52:14 -06:00
Nicolas Mowen
e8dd382280 Add more processes 2025-06-12 11:40:02 -06:00
Nicolas Mowen
4b913953a1 Convert camera tracking to process 2025-06-12 11:22:15 -06:00
Nicolas Mowen
bd2cc18260 Move to using process for logging 2025-06-12 10:42:10 -06:00
Nicolas Mowen
9414a11df4 Use global log queue 2025-06-12 09:55:53 -06:00
Nicolas Mowen
270d8f14c7 Fix typing 2025-06-12 09:45:17 -06:00
Josh Hawkins
1ac655bc6d Logging bugfix (#18465)
* use mp Manager to handle logging queues

A Python bug (https://github.com/python/cpython/issues/91555) was preventing logs from the embeddings maintainer process from printing. The bug is fixed in Python 3.14, but a viable workaround is to use the multiprocessing Manager, which better manages mp queues and causes the logging to work correctly.

* consolidate

* fix typing
2025-06-12 09:33:17 -06:00
Nicolas Mowen
1c9eafb6fc Cleanup 2025-06-12 09:32:04 -06:00
Nicolas Mowen
1e74566d15 Remove before_run from process util
The before_run never actually ran because:

You're right to suspect an issue with before_run not being called and a potential deadlock. The way you've implemented the run_wrapper using __getattribute__ for the run method of BaseProcess is a common pitfall in Python's multiprocessing, especially when combined with how multiprocessing.Process works internally.

Here's a breakdown of why before_run isn't being called and why you might be experiencing a deadlock:

The Problem: __getattribute__ and Process Serialization
When you create a multiprocessing.Process object and call start(), the multiprocessing module needs to serialize the process object (or at least enough of it to re-create the process in the new interpreter). It then pickles this serialized object and sends it to the newly spawned process.

The issue with your __getattribute__ implementation for run is that:

run is retrieved during serialization: When multiprocessing tries to pickle your Process object to send to the new process, it will likely access the run attribute. This triggers your __getattribute__ wrapper, which then tries to bind run_wrapper to self.
run_wrapper is bound to the parent process's self: The run_wrapper closure, when created in the parent process, captures the self (the Process instance) from the parent's memory space.
Deserialization creates a new object: In the child process, a new Process object is created by deserializing the pickled data. However, the run_wrapper method that was pickled still holds a reference to the self from the parent process. This is a subtle but critical distinction.
The child's run is not your wrapped run: When the child process starts, it internally calls its own run method. Because of the serialization and deserialization process, the run method that's ultimately executed in the child process is the original multiprocessing.Process.run or the Process.run if you had directly overridden it. Your __getattribute__ magic, which wraps run, isn't correctly applied to the Process object within the child's context.
2025-06-12 09:30:04 -06:00
Nicolas Mowen
05a3115304 Fix typing 2025-06-12 09:25:22 -06:00
Nicolas Mowen
5533a6d310 Catch correct errors 2025-06-12 09:10:14 -06:00
Nicolas Mowen
036d1949e7 Cleanup 2025-06-12 08:57:58 -06:00
Nicolas Mowen
85dcfdd670 Only store PID instead of entire process reference 2025-06-12 08:56:56 -06:00
Nicolas Mowen
4dd5e9c66e Use forkserver 2025-06-12 08:07:19 -06:00
Nicolas Mowen
acac743dea Correct order 2025-06-11 16:35:08 -06:00
Nicolas Mowen
d3e34ca4fd Use separate zmq proxy for object detection 2025-06-11 15:12:19 -06:00
Nicolas Mowen
16ad0e5477 Don't assume camera sizes 2025-06-11 12:55:52 -06:00
Nicolas Mowen
3aeb6b8440 Use count correctly 2025-06-11 12:20:54 -06:00
Nicolas Mowen
4a396cf8ac Set runtime 2025-06-11 12:07:27 -06:00
Nicolas Mowen
6f16ecdd48
Dynamic Management of Cameras (#18671)
* Add base class for global config updates

* Add or remove camera states

* Move camera process management to separate thread

* Move camera management fully to separate class

* Cleanup

* Stop camera processes when stop command is sent

* Start processes dynamically when needed

* Adjust

* Leave extra room in tracked object queue for two cameras

* Dynamically set extra config pieces

* Add some TODOs

* Fix type check

* Simplify config updates

* Improve typing

* Correctly handle indexed entries

* Cleanup

* Create out SHM

* Use ZMQ for signaling object detectoin is completed

* Get camera correctly created

* Cleanup for updating the cameras config

* Cleanup

* Don't enable audio if no cameras have audio transcription

* Use exact string so similar camera names don't interfere

* Add ability to update config via json body to config/set endpoint

Additionally, update the config in a single rather than multiple calls for each updated key

* fix autotracking calibration to support new config updater function

---------

Co-authored-by: Josh Hawkins <32435876+hawkeye217@users.noreply.github.com>
2025-06-11 12:25:30 -05:00
Nicolas Mowen
28fba7122d
Refactor TensorRT (#18643)
* Combine base and arm trt detectors

* Remove unused deps for amd64 build

* Add missing packages and cleanup ldconfig

* Expand packages for tensorflow model training

* Cleanup

* Refactor training to not reserve memory
2025-06-09 08:25:33 -06:00
Josh Hawkins
9a5162752c
Make Birdseye clickable (#18628)
* keep track of layout changes and publish on change

* websocket hook

* clickable overlay div to navigate to full camera view
2025-06-08 12:06:17 -06:00
FL42
eb83f2ac47
fix: Initialize GenAI client if GenAI is enabled globally (#18623) 2025-06-08 06:55:29 -06:00
FL42
76201c0c7f
feat: enable using GenAI for cameras with GenAI disabled from the API (#18616) 2025-06-07 13:43:29 -05:00
Jimmy
ab7b12da54
Add Mesa Teflon as a TFLite detector (#18310)
* Refactor common functions for tflite detector implementations

* Add detector using mesa teflon delegate

Non-EdgeTPU TFLite can use the standard .tflite format

* Add mesa-teflon-delegate from bookworm-backports to arm64 images
2025-06-06 13:41:04 -06:00
Nicolas Mowen
8409100623
Classification Model Metrics (#18595)
* Add speed and rate metrics for custom classification models

* Use metrics for classification models

* Use keys

* Cast to list
2025-06-06 11:29:44 -05:00
Nicolas Mowen
be8ee068e2
Live classification model training (#18583)
* Implement model training via ZMQ and add model states to represent training

* Get model updates working

* Improve toasts and model state

* Clean up logging

* Add back in
2025-06-05 09:13:12 -06:00
Nicolas Mowen
85d721eb6b
Classification Model UI (#18571)
* Setup basic training structure

* Build out route

* Handle model configs

* Add image fetch APIs

* Implement model training screen with dataset selection

* Implement viewing of training images

* Adjust directories

* Implement viewing of images

* Add support for deleting images

* Implement full deletion

* Implement classification model training

* Improve naming

* More renaming

* Improve layout

* Reduce logging

* Cleanup
2025-06-04 18:09:55 -05:00
Josh Hawkins
eb1fe9fe20
Audio transcription tweaks (#18540)
* use model runner

* unload whisper model when live transcription is complete
2025-06-03 06:53:48 -05:00
Josh Hawkins
645868e099
Upgrade PaddleOCR models to v4 (rec) and v5 (det) (#18505)
The PP_OCRv5 text detection models have greatly improved over v3. The v5 recognition model makes improvements to challenging handwriting and uncommon characters, which are not necessary for LPR, so using v4 seemed like a better choice to continue to keep inference time as low as possible. Also included is the full dictionary for Chinese character support.
2025-06-01 14:21:12 -06:00
Nicolas Mowen
568e620963
Tiered recordings (#18492)
* Implement tiered recording

* Add migration for record config

* Update docs

* Update reference docs

* Fix preview query

* Fix incorrect accesses

* Fix

* Fix

* Fix

* Fix
2025-05-30 17:01:39 -06:00
Nicolas Mowen
caf3e9fc8c
Intel updates (#18493)
* Update openvino and onnxruntime

* Install icd and level-zero-gpu deps from intel directly

* Install

* Add dep

* Fix package install
2025-05-30 15:30:21 -06:00
Nicolas Mowen
20e0addae1
Implement API to train classification models (#18475) 2025-05-29 17:51:32 -06:00
Josh Hawkins
2bd6fa53fe
Audio transcription support (#18398)
* install new packages for transcription support

* add config options

* audio maintainer modifications to support transcription

* pass main config to audio process

* embeddings support

* api and transcription post processor

* embeddings maintainer support for post processor

* live audio transcription with sherpa and faster-whisper

* update dispatcher with live transcription topic

* frontend websocket

* frontend live transcription

* frontend changes for speech events

* i18n changes

* docs

* mqtt docs

* fix linter

* use float16 and small model on gpu for real-time

* fix return value and use requestor to embed description instead of passing embeddings

* run real-time transcription in its own thread

* tweaks

* publish live transcriptions on their own topic instead of tracked_object_update

* config validator and docs

* clarify docs
2025-05-27 10:26:00 -05:00
Nicolas Mowen
512b7e16e1
Fix incorrectly running lpr (#18390) 2025-05-25 11:02:48 -06:00
Nicolas Mowen
5f40e6e2b9
Add basic config editor when Frigate can't startup (#18383)
* Start Frigate in safe mode when config does not validate

* Add safe mode page that is just the config editor

* Adjust Frigate config editor when in safe mode

* Cleanup

* Improve log message
2025-05-24 11:47:15 -05:00
Nicolas Mowen
87d0102624
Add ability to configure when custom classification models run (#18380)
* Add config to control when classification models are run

* Cleanup
2025-05-24 11:18:46 -05:00
Nicolas Mowen
3892f8c732
Update ROCm to 6.4.1 (#18364)
* Update rocm to 6.4.1

* Quick fix
2025-05-23 12:05:04 -05:00
Josh Hawkins
9392ffc300
Implement support for no recordings indicator on timeline (#18363)
* Indicate no recordings on the history timeline with gray hash marks

This commit includes a new backend API endpoint and the frontend changes needed to support this functionality

* don't show slashes for now
2025-05-23 08:55:48 -06:00
Nicolas Mowen
8a1da3a89f
Initial custom classification model config support (#18362)
* Add basic config for defining a teachable machine model

* Add model type

* Add basic config for teachable machine models

* Adjust config for state and object

* Use config to process

* Correctly check for objects

* Remove debug

* Rename to not be teachable machine specific

* Cleanup
2025-05-23 09:46:53 -05:00
Nicolas Mowen
5dd30b273a
Dynamically update masks and zones for cameras (#18359)
* Include config publisher in api

* Call update topic for passed topics

* Update zones dynamically

* Update zones internally

* Support zone and mask reset

* Handle updating objects config

* Don't put status for needing to restart Frigate

* Cleanup http tests

* Fix tests
2025-05-22 20:51:23 -06:00
Nicolas Mowen
559af44682 Dynamic Config Updates (#18353)
* Create classes to handle publishing and subscribing config updates

* Cleanup

* Use config updater

* Update handling for enabled config

* Cleanup

* Recording config updates

* Birdseye config updates

* Handle notifications

* handle review

* Update motion
2025-05-22 12:24:34 -06:00
Nicolas Mowen
7d994d7f9d Update ROCm to 6.4.0 (#18264)
* Update to rocm 6.4.0

* Update URL

* Remove old env var
2025-05-22 12:24:34 -06:00
Josh Hawkins
c16e536b46
Fixes (#18338)
* improve spacing of face selection in mobile drawer

* fix spacing

* sort face names alphabetically

* Improve face selection dialog

* Use a state to track when face image loads

The naturalWidth and naturalHeight will always be 0 until the image loads. So we use onLoad and a state to track loading and then calculate the area after it has loaded

* Verify that a camera only tracks objects that are possible to track

* Fix test

* genai docs tweak

* Disable openvino model cache

* Clenaup

* Sanitize floats for estimated speed and angle

Users can configure speed zones in such a way that velocity estimates from Norfair cause a value of inf to be stored as an estimated speed. FastAPI doesn't serialize inf as a float, so trying to return this value would result in an API error. Sanitizing the value before storing should correct this.

---------

Co-authored-by: Nicolas Mowen <nickmowen213@gmail.com>
2025-05-22 09:38:14 -06:00
Josh Hawkins
49c6073de6
Add ability to specify separator used in proxy headers (#18336) 2025-05-21 06:02:13 -06:00
Luca Paolini
2a8b62acb1
Disable autoCorrect, autoCapitalize and spellCheck on username input. (#18333) 2025-05-21 06:10:13 -05:00
Josh Hawkins
37d40558b7
Fixes (#18319)
* Add Thai (still need to merge weblate)

* Apply attribute logic to all label types

* Fix area check

---------

Co-authored-by: Nicolas Mowen <nickmowen213@gmail.com>
2025-05-20 16:47:05 -06:00
Josh Hawkins
afe513336c
fix missing i18n keys (#18309) 2025-05-19 16:45:02 -05:00
Josh Hawkins
8a143b4284
Fixes (#18304)
* fix recordings check

* Only calculate inpoint offset for beginning of hour segment

* Cleanup

* Fix seeking

* add Czech

* explore i18n fix

---------

Co-authored-by: Nicolas Mowen <nickmowen213@gmail.com>
2025-05-19 14:43:22 -06:00
Nicolas Mowen
717517aeb5
Misc fixes (#18289)
* Fix key not moved

* Account for HLS start offset when seeking and calculating update time
2025-05-18 18:23:01 -05:00