[Detector Support]: NixOS+Coral: high detector CPU usage #16450

motiejus · 2025-02-10T17:07:13Z

motiejus
Feb 10, 2025

Describe the problem you are having

Detector (process name frigate.process:<camera name>) shows high CPU usage, even though coral seems to be configured.

Version

0.14.1

Frigate config file

cameras:
  vno4-dome-panorama:
    detect:
      enabled: true
    enabled: true
    ffmpeg:
      hwaccel_args: preset-vaapi
      inputs:
      - path: rtsp://frigate:{FRIGATE_RTSP_PASSWORD}@192.168.188.10/cam/realmonitor?channel=1&subtype=0
        roles:
        - audio
        - record
      - path: rtsp://frigate:{FRIGATE_RTSP_PASSWORD}@192.168.188.10/cam/realmonitor?channel=1&subtype=2
        roles:
        - detect
      output_args:
        record: preset-record-generic-audio-copy
  vno4-dome-ptz:
    detect:
      enabled: true
    enabled: true
    ffmpeg:
      inputs:
      - path: rtsp://frigate:{FRIGATE_RTSP_PASSWORD}@192.168.188.10/cam/realmonitor?channel=2&subtype=0
        roles:
        - audio
        - record
      - path: rtsp://frigate:{FRIGATE_RTSP_PASSWORD}@192.168.188.10/cam/realmonitor?channel=2&subtype=2
        roles:
        - detect
      output_args:
        record: preset-record-generic-audio-copy
database:
  path: /var/lib/frigate/frigate.db
detectors:
  coral:
    device: usb
    enabled: true
    type: edgetpu
mqtt:
  enabled: false
record:
  enabled: true
  retain:
    days: 7
    mode: all

docker-compose file or Docker CLI command

systemctl status frigate | cat                                                                                                              19:05:36 [2/9611]
● frigate.service
     Loaded: loaded (/etc/systemd/system/frigate.service; enabled; preset: ignored)
     Active: active (running) since Mon 2025-02-10 19:01:08 EET; 4min 28s ago
 Invocation: 048e4fbe96644a1dac840888bacb2d0c
    Process: 2881253 ExecStartPre=/nix/store/8sn0j196x4qrnahwmncc8r070hkh62kz-unit-script-frigate-pre-start/bin/frigate-pre-start (code=exited, status=0/SUCCESS)
    Process: 2881278 ExecStartPre=/nix/store/qmr6p29c5380rzmf0768rgrhlh9ffvlm-frigate-clear-cache (code=exited, status=0/SUCCESS)
   Main PID: 2881286 (python3.12)
         IP: 604.8M in, 11.9M out
         IO: 20.2M read, 463.2M written
      Tasks: 173 (limit: 38128)
     Memory: 1.1G (peak: 1.1G)
        CPU: 7min 26.088s
     CGroup: /system.slice/frigate.service
             ├─2881286 /nix/store/kjgslpdqchx1sm7a5h9xibi5rrqcqfnl-python3-3.12.8/bin/python3.12 -m frigate
             ├─2881576 frigate.logger
             ├─2881588 frigate.recording_manager
             ├─2881597 frigate.review_segment_manager
             ├─2881615 /nix/store/kjgslpdqchx1sm7a5h9xibi5rrqcqfnl-python3-3.12.8/bin/python3.12 -c "from multiprocessing.resource_tracker import main;main(55)"
             ├─2881616 frigate.detector.coral
             ├─2881618 frigate.output
             ├─2881632 ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 1280x720 -i pipe: -threads 1 -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:
             ├─2881637 ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 1280x720 -i pipe: -threads 1 -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:
             ├─2881642 ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 1280x720 -i pipe: -threads 1 -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:
             ├─2881643 frigate.process:vno4-dome-panorama
             ├─2881656 frigate.process:vno4-dome-ptz
             ├─2881665 frigate.capture:vno4-dome-panorama
             ├─2881670 ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -
user_agent "FFmpeg Frigate/0.14.1" -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i "rtsp://frigate:*@192.168.188.10/cam/realmonitor?channel=1&subtype=2" -r 5 -vf fps=5,scale_vaapi=w=1280:h=720:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:
             ├─2881673 ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -
user_agent "FFmpeg Frigate/0.14.1" -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i "rtsp://frigate:*@192.168.188.10/cam/realmonitor?channel=1&subtype=0" -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy /var/cache/frigate/vno4-dome-panorama@%Y%m%d%H%M%
S%z.mp4
             ├─2881674 frigate.capture:vno4-dome-ptz
             ├─2881682 ffmpeg -hide_banner -loglevel warning -threads 2 -user_agent "FFmpeg Frigate/0.14.1" -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -ti
meout 5000000 -use_wallclock_as_timestamps 1 -i "rtsp://frigate:*@192.168.188.10/cam/realmonitor?channel=2&subtype=2" -r 5 -vf fps=5,scale=1280:720 -threads 2 -f rawvideo -pix_fmt yu
v420p pipe:
             └─2881685 ffmpeg -hide_banner -loglevel warning -threads 2 -user_agent "FFmpeg Frigate/0.14.1" -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -ti
meout 5000000 -use_wallclock_as_timestamps 1 -i "rtsp://frigate:*@192.168.188.10/cam/realmonitor?channel=2&subtype=0" -f segment -segment_time 10 -segment_format mp4 -reset_timestamp
s 1 -strftime 1 -c copy /var/cache/frigate/vno4-dome-ptz@%Y%m%d%H%M%S%z.mp4

Relevant Frigate log output

Feb 10 19:01:08 fwminex systemd[1]: Started frigate.service.
Feb 10 19:01:08 fwminex frigate[2881286]: 2025-02-10 19:01:08.876136: I tensorflow/core/util/port.cc:153] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable `TF_ENABLE_ONEDNN_OPTS=0`.
Feb 10 19:01:08 fwminex frigate[2881286]: 2025-02-10 19:01:08.901742: I tensorflow/core/platform/cpu_feature_guard.cc:210] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
Feb 10 19:01:08 fwminex frigate[2881286]: To enable the following instructions: AVX2 AVX_VNNI FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
Feb 10 19:01:12 fwminex frigate[2881286]: /nix/store/h3yf645zpckm2cdjs436zfwrsm3vbm4w-frigate-0.14.1/lib/python3.12/site-packages/frigate/util/services.py:299: SyntaxWarning: invalid escape sequence '\d'
Feb 10 19:01:12 fwminex frigate[2881286]:   for result in re.findall('"Video/\d":{[a-z":\d.,%]+}', reading):
Feb 10 19:01:12 fwminex frigate[2881576]: [2025-02-10 19:01:12] frigate.app                    INFO    : Starting Frigate (0.14.1)
Feb 10 19:01:12 fwminex frigate[2881576]: [2025-02-10 19:01:12] frigate.app                    INFO    : Creating directory: /var/cache/frigate/model_cache
Feb 10 19:01:12 fwminex frigate[2881576]: [2025-02-10 19:01:12] frigate.util.config            INFO    : Checking if frigate config needs migration...
Feb 10 19:01:12 fwminex frigate[2881576]: [2025-02-10 19:01:12] frigate.util.config            ERROR   : Config file is read-only, unable to migrate config file.
Feb 10 19:01:12 fwminex frigate[2881576]: [2025-02-10 19:01:12] frigate.util.services          WARNING : Did not detect hwaccel, using a GPU for accelerated video decoding is highly recommended
Feb 10 19:01:13 fwminex frigate[2881286]: [rtsp @ 0x3136e3c0] method OPTIONS failed: 401 Unauthorized
Feb 10 19:01:13 fwminex frigate[2881286]: [ WARN:[email protected]] global cap_gstreamer.cpp:1173 isPipelinePlaying OpenCV | GStreamer warning: GStreamer: pipeline have not been created
Feb 10 19:01:13 fwminex frigate[2881286]: [ERROR:[email protected]] global cap.cpp:164 open VIDEOIO(GSTREAMER): raised OpenCV exception:
Feb 10 19:01:13 fwminex frigate[2881286]: OpenCV(4.9.0) /build/source/modules/videoio/src/cap_gstreamer.cpp:1468: error: (-215:Assertion failed) uridecodebin in function 'open'
Feb 10 19:01:13 fwminex frigate[2881286]: [rtsp @ 0x3136e3c0] method OPTIONS failed: 401 Unauthorized
Feb 10 19:01:13 fwminex frigate[2881286]: [ WARN:[email protected]] global cap_gstreamer.cpp:1173 isPipelinePlaying OpenCV | GStreamer warning: GStreamer: pipeline have not been created
Feb 10 19:01:13 fwminex frigate[2881286]: [ERROR:[email protected]] global cap.cpp:164 open VIDEOIO(GSTREAMER): raised OpenCV exception:
Feb 10 19:01:13 fwminex frigate[2881286]: OpenCV(4.9.0) /build/source/modules/videoio/src/cap_gstreamer.cpp:1468: error: (-215:Assertion failed) uridecodebin in function 'open'
Feb 10 19:01:13 fwminex frigate[2881576]: [2025-02-10 19:01:13] peewee_migrate.logs            INFO    : Starting migrations
Feb 10 19:01:13 fwminex frigate[2881576]: [2025-02-10 19:01:13] peewee_migrate.logs            INFO    : There is nothing to migrate
Feb 10 19:01:13 fwminex frigate[2881576]: [2025-02-10 19:01:13] frigate.app                    INFO    : Recording process started: 2881588
Feb 10 19:01:13 fwminex frigate[2881576]: [2025-02-10 19:01:13] frigate.app                    INFO    : Recording process started: 2881597
Feb 10 19:01:13 fwminex frigate[2881576]: [2025-02-10 19:01:13] detector.coral                 INFO    : Starting detection process: 2881616
Feb 10 19:01:13 fwminex frigate[2881576]: [2025-02-10 19:01:13] frigate.detectors.plugins.edgetpu_tfl INFO    : Attempting to load TPU as usb
Feb 10 19:01:13 fwminex frigate[2881576]: [2025-02-10 19:01:13] frigate.app                    INFO    : Output process started: 2881618
Feb 10 19:01:13 fwminex frigate[2881576]: [2025-02-10 19:01:13] frigate.app                    INFO    : Camera processor started for vno4-dome-panorama: 2881643
Feb 10 19:01:13 fwminex frigate[2881576]: [2025-02-10 19:01:13] frigate.app                    INFO    : Camera processor started for vno4-dome-ptz: 2881656
Feb 10 19:01:13 fwminex frigate[2881576]: [2025-02-10 19:01:13] frigate.app                    INFO    : Capture process started for vno4-dome-panorama: 2881665
Feb 10 19:01:13 fwminex frigate[2881576]: [2025-02-10 19:01:13] frigate.app                    INFO    : Capture process started for vno4-dome-ptz: 2881674
Feb 10 19:01:16 fwminex frigate[2881616]: INFO: Created TensorFlow Lite XNNPACK delegate for CPU.
Feb 10 19:01:16 fwminex frigate[2881576]: [2025-02-10 19:01:16] frigate.detectors.plugins.edgetpu_tfl INFO    : TPU found

Install method

NixOS 24.11

Hardware: Framework 12
CPU 12th Gen Intel(R) Core(TM) i5-1240P

Object Detector

Coral

Screenshots of the Frigate UI's System metrics pages

Any other information that may be helpful

Both incoming streams are 1280x720p:

NickM-27 · 2025-02-10T17:26:57Z

NickM-27
Feb 10, 2025
Collaborator Sponsor

You should upgrade to 0.15 and use qsv instead of vaapi

19 replies

motiejus Feb 11, 2025
Author

Any intuition on what the multiprocessing does would he appreciated. :)

Here is a profile with a bit more Python functions (--call-graph fp):

NickM-27 Feb 11, 2025
Collaborator Sponsor

multiprocessing is one of the ways that data is communicated across different processes, and to be clear this high cpu usage is very unusual and we've not really seen other users experiencing it so I do think Josh's suggestion is correct that something is not installed or configured the same way as it is in the docker container

motiejus Feb 11, 2025
Author

Yes, I agree now this is indeed an environment-related issue. I started frigate:0.14.1 Docker container with the same config, and frigate.process: processes take much less CPU.

I'll go ahead and try to tackle this on NixOS side.

hawkeye217 Feb 11, 2025
Collaborator

Great, we'll close this for now. Let us know if you discover the issue.

motiejus Feb 11, 2025
Author

Filed one under NixOS: NixOS/nixpkgs#381280

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Detector Support]: NixOS+Coral: high detector CPU usage #16450

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 1 comment 19 replies

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

[Detector Support]: NixOS+Coral: high detector CPU usage #16450

motiejus Feb 10, 2025

Describe the problem you are having

Version

Frigate config file

docker-compose file or Docker CLI command

Relevant Frigate log output

Install method

Object Detector

Screenshots of the Frigate UI's System metrics pages

Any other information that may be helpful

Replies: 1 comment · 19 replies

NickM-27 Feb 10, 2025 Collaborator Sponsor

motiejus Feb 11, 2025 Author

NickM-27 Feb 11, 2025 Collaborator Sponsor

motiejus Feb 11, 2025 Author

hawkeye217 Feb 11, 2025 Collaborator

motiejus Feb 11, 2025 Author

motiejus
Feb 10, 2025

Replies: 1 comment 19 replies

NickM-27
Feb 10, 2025
Collaborator Sponsor

motiejus Feb 11, 2025
Author

NickM-27 Feb 11, 2025
Collaborator Sponsor

motiejus Feb 11, 2025
Author

hawkeye217 Feb 11, 2025
Collaborator

motiejus Feb 11, 2025
Author