LEDs are freezing

[ManuVice]

I have a single LED segment with 223 LEDs, controlled by a Raspberry Pi 4 and a RP2040 (Raspberry Pi Pico). Initially, I used HyperSerialPico, but encountered an issue where the LEDs would randomly freeze. To temporarily resolve it, I used a script on my phone to reset the USB port via MQTT (usbreset /dev/ttyACM0), which made the Ambilight work again. However, the freezing occurred unpredictably.

Because of this, I switched to HyperSPI, which initially appeared more stable. Unfortunately, the LEDs still freeze occasionally, and I can no longer reset the system via USB since the connection is now over SPI. I tried power-cycling the level shifter, but the LEDs remained frozen. The only way to restore proper functionality is to power off both the LEDs and the level shifter.

I ran a benchmark to measure the frame rate and achieved 111 FPS. When I set the update frequency to 100 Hz, the LEDs freeze within less than 5 minutes. At 50 Hz, the system lasts longer, but eventually the LEDs still freeze.

At this point, I have no idea what's causing the issue or how to debug it further. I'm hoping someone here might have an idea or suggestion.

Log

[awawa-dev]

Hi
When you used HyperSerialPico when the LEDs have frozen what was the output in the logs when you stop/start device (force detection must be disabled because it limits the logs and it was workaround for the systemd bug)? The LEDs didnt resume after such software restart?

[ManuVice]

It crashed after a few days. This time I cannot restart it using usbreset... after power off LED strips + level shifter + usbreset pico it works again.

https://notebin.de/?b45348f28a2cb453#74hhLtKrECGiUyXWXNEJ5RVDyHZdGz7cSJe9MMyFybfp

after "restart"

https://notebin.de/?03f3608ca5cab133#4ZLmxcABwAQbNVzoiFwDQMSHMCVywh83mvkoMVJ89hU3

[awawa-dev]

Seems Pico has crashed and there is a trace in the logs:
2025-05-28T22:21:00.125Z [LEDDEVICE0_ADALIGHT] Could not detect HyperSerialEsp8266/HyperSerialESP32/HyperSerialPico device
Ideally, it would be better to test it now without all electronics/electrics connected to Pico, including level shifter and led: just the USB cable. But if it takes that long to crash, it will probably be problematic.

[ManuVice]

No, last time with HyperSPI and HyperSerialPico it was stable for 2–3 days, but then it started crashing more frequently. Today it crashed after about 30 minutes.
Do you think I should get a new board? Would it make sense to switch to an ESP32 over SPI?

I will now turn off LED + level shifter and will report.

2025-05-29T09:57:29.413Z [COMPONENTCTRL0] LED device: enabled
2025-05-29T09:57:29.413Z [LEDDEVICE0_ADALIGHT] (LedDevice.cpp:246) Enable the device
2025-05-29T09:57:29.414Z [SMOOTHING0] Using alternative smoothing input (0)
2025-05-29T09:57:29.433Z [SMOOTHING0] Using alternative smoothing procedure (0)
2025-05-29T09:57:29.933Z [NET_DISCOVERY] Found Pico/RP2040 at ttyACM0:-1 (Pico)
2025-05-29T09:57:29.896Z [SERVICE_mDNS] Starting the network discovery thread
2025-05-29T09:57:29.998Z [NET_DISCOVERY] Found Home Assistant at 10.0.0.5:443 (9764fe065e6f4cf4a851478b02caac6b.local)
2025-05-29T09:59:28.109Z [V4L2:USB VIDEO: USB] Video cache: size: 1, hits: 2988, needed: 1, cleanup: 0, limit: 8
2025-05-29T09:59:28.117Z [PERFORMANCE] [USB: FPS = 25.01, decoding = 3ms, frames = 1500, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.01, processed = 1500], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:00:28.129Z [PERFORMANCE] [USB: FPS = 25.01, decoding = 3ms, frames = 1501, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.01, processed = 1501], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:01:28.138Z [PERFORMANCE] [USB: FPS = 25.01, decoding = 3ms, frames = 1501, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.01, processed = 1500], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:02:28.121Z [PERFORMANCE] [USB: FPS = 25.01, decoding = 3ms, frames = 1500, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.01, processed = 1501], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:03:28.138Z [PERFORMANCE] [USB: FPS = 25.01, decoding = 4ms, frames = 1501, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.01, processed = 1501], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:04:28.113Z [PERFORMANCE] [USB: FPS = 25.01, decoding = 3ms, frames = 1500, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.01, processed = 1500], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:05:28.134Z [PERFORMANCE] [USB: FPS = 25.00, decoding = 4ms, frames = 1501, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.00, processed = 1500], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:06:28.138Z [PERFORMANCE] [USB: FPS = 25.00, decoding = 3ms, frames = 1500, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.00, processed = 1500], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:07:28.107Z [PERFORMANCE] [USB: FPS = 25.00, decoding = 4ms, frames = 1499, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.00, processed = 1500], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:08:28.120Z [PERFORMANCE] [USB: FPS = 25.00, decoding = 3ms, frames = 1500, invalid = 0, mode = direct], [INSTANCE0: FPS = 24.99, processed = 1500], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:09:28.124Z [PERFORMANCE] [USB: FPS = 25.00, decoding = 4ms, frames = 1500, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.00, processed = 1500], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:10:28.131Z [PERFORMANCE] [USB: FPS = 25.00, decoding = 3ms, frames = 1500, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.00, processed = 1500], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:11:28.136Z [PERFORMANCE] [USB: FPS = 25.00, decoding = 3ms, frames = 1500, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.00, processed = 1500], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:12:28.139Z [PERFORMANCE] [USB: FPS = 25.00, decoding = 3ms, frames = 1500, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.00, processed = 1500], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:13:28.105Z [PERFORMANCE] [USB: FPS = 25.00, decoding = 2ms, frames = 1499, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.00, processed = 1499], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:14:28.114Z [PERFORMANCE] [USB: FPS = 25.00, decoding = 3ms, frames = 1500, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.00, processed = 1500], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:15:28.116Z [PERFORMANCE] [USB: FPS = 25.00, decoding = 4ms, frames = 1500, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.00, processed = 1500], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:16:28.124Z [PERFORMANCE] [USB: FPS = 25.00, decoding = 4ms, frames = 1500, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.00, processed = 1500], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:17:28.116Z [PERFORMANCE] [USB: FPS = 25.00, decoding = 3ms, frames = 1500, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.00, processed = 1500], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:18:28.131Z [PERFORMANCE] [USB: FPS = 25.01, decoding = 3ms, frames = 1501, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.01, processed = 1501], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:19:28.109Z [PERFORMANCE] [USB: FPS = 25.01, decoding = 2ms, frames = 1500, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.01, processed = 1500], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:20:28.125Z [PERFORMANCE] [USB: FPS = 25.01, decoding = 2ms, frames = 1501, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.01, processed = 1501], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:21:28.135Z [PERFORMANCE] [USB: FPS = 25.01, decoding = 3ms, frames = 1501, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.01, processed = 1500], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:22:28.117Z [PERFORMANCE] [USB: FPS = 25.01, decoding = 3ms, frames = 1500, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.01, processed = 1501], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:23:28.135Z [PERFORMANCE] [USB: FPS = 25.01, decoding = 4ms, frames = 1501, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.01, processed = 1501], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:24:28.106Z [PERFORMANCE] [USB: FPS = 25.01, decoding = 4ms, frames = 1500, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.01, processed = 1500], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:25:28.124Z [PERFORMANCE] [USB: FPS = 25.01, decoding = 3ms, frames = 1501, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.01, processed = 1501], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:26:28.134Z [PERFORMANCE] [USB: FPS = 25.01, decoding = 3ms, frames = 1501, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.01, processed = 1500], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:27:28.116Z [PERFORMANCE] [USB: FPS = 25.01, decoding = 4ms, frames = 1500, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.01, processed = 1501], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:28:28.136Z [PERFORMANCE] [USB: FPS = 25.01, decoding = 4ms, frames = 1501, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.01, processed = 1501], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:29:28.109Z [PERFORMANCE] [USB: FPS = 25.01, decoding = 3ms, frames = 1500, invalid = 0, mode = direct], [INSTANCE0: FPS = 25.01, processed = 1500], [LED0: FPS = 100.00, send = 6000, processed = 6000, dropped = 0]
2025-05-29T10:30:07.315Z [LEDDEVICE0_ADALIGHT] (ProviderSerial.cpp:293) Timeout after 1000ms: 0 frames already dropped
2025-05-29T10:30:08.316Z [LEDDEVICE0_ADALIGHT] (ProviderSerial.cpp:293) Timeout after 1000ms: 1 frames already dropped
2025-05-29T10:30:09.318Z [LEDDEVICE0_ADALIGHT] (ProviderSerial.cpp:293) Timeout after 1000ms: 2 frames already dropped
2025-05-29T10:30:10.319Z [LEDDEVICE0_ADALIGHT] (ProviderSerial.cpp:293) Timeout after 1000ms: 3 frames already dropped
2025-05-29T10:30:11.320Z [LEDDEVICE0_ADALIGHT] (ProviderSerial.cpp:293) Timeout after 1000ms: 4 frames already dropped
2025-05-29T10:30:12.322Z [LEDDEVICE0_ADALIGHT] (ProviderSerial.cpp:293) Timeout after 1000ms: 5 frames already dropped
2025-05-29T10:30:12.322Z [LEDDEVICE0_ADALIGHT] (ProviderSerial.cpp:146) Flush was successful
2025-05-29T10:30:42.977Z [LEDDEVICE0_ADALIGHT] (ProviderSerial.cpp:164) Serial port is closed: ttyACM0
2025-05-29T10:30:42.977Z [LEDDEVICE0_ADALIGHT] (LedDevice.cpp:380) Stopping refresh timer
2025-05-29T10:30:42.977Z [LEDDEVICE0_ADALIGHT] Device 'adalight' is disabled due to an error: 'Timeout writing data to ttyACM0'

[ManuVice]

new post 😄 without LED and levelshifter it crashed immediately
I have restarted my RaspberryPI4 before this try

2025-05-29T10:44:11.579Z [LEDDEVICE0_ADALIGHT] DETECTED DEVICE USING HyperSerialEsp8266/HyperSerialESP32/HyperSerialPico FIRMWARE (Welcome! Awa driver 9.) at 1 msec
2025-05-29T10:44:11.579Z [LEDDEVICE0_ADALIGHT] (LedDevice.cpp:63) Switch on
2025-05-29T10:44:11.579Z [LEDDEVICE0_ADALIGHT] (LedDevice.cpp:139) Power On
2025-05-29T10:44:11.579Z [LEDDEVICE0_ADALIGHT] (LedDevice.cpp:366) Starting timer with interval = 10ms
2025-05-29T10:44:11.579Z [COMPONENTCTRL0] LED device: enabled
2025-05-29T10:44:11.579Z [SMOOTHING0] Using alternative smoothing input (0)
2025-05-29T10:44:11.599Z [SMOOTHING0] Using alternative smoothing procedure (0)
2025-05-29T10:44:11.630Z [WEBSERVER] Apply Webserver settings
2025-05-29T10:44:11.630Z [WEBSERVER] Set document root to: :/www
2025-05-29T10:44:11.631Z [WEBSERVER] Started: 'HyperHDR WebServer (HTTP)' on port: 8090
2025-05-29T10:44:11.631Z [SSDP] (SSDPHandler.cpp:93) The local address is empty
2025-05-29T10:44:11.631Z [WEBSERVER] Initialize Webserver
2025-05-29T10:44:11.631Z [WEBSERVER] Apply Webserver settings
2025-05-29T10:44:11.631Z [WEBSERVER] Set document root to: :/www
2025-05-29T10:44:11.665Z [WEBSERVER] Setup SSL certificate
2025-05-29T10:44:11.668Z [WEBSERVER] Setup private SSL key
2025-05-29T10:44:11.668Z [WEBSERVER] Started: 'HyperHDR WebServer (HTTPS)' on port: 8092
2025-05-29T10:44:11.668Z [SSDP] (SSDPHandler.cpp:42) SSDPHandler is initializing
2025-05-29T10:44:11.675Z [SSDP] (SSDPHandler.cpp:183) The local address is: 10.0.0.11
2025-05-29T10:44:11.675Z [SSDP] (SSDPServer.cpp:94) Initialize the SSDP server
2025-05-29T10:44:11.677Z [SSDP] Starting the SSDP server
2025-05-29T10:44:12.274Z [WEBSERVER] Web server resources initialized: /usr/share/hyperhdr/bin/../lib/web_resources.rcc
2025-05-29T10:44:12.627Z [WEBSOCKET] (WebSocketClient.cpp:40) New connection from ::ffff:10.0.0.52
2025-05-29T10:44:12.849Z [WEBSOCKET] (HyperAPI.cpp:946) log streaming activated for client ::ffff:10.0.0.52
2025-05-29T10:44:13.157Z [NET_DISCOVERY] Found Pico/RP2040 at ttyACM0:-1 (Pico)
2025-05-29T10:44:13.132Z [SERVICE_mDNS] Starting the network discovery thread
2025-05-29T10:44:13.193Z [NET_DISCOVERY] Found Home Assistant at 10.0.0.5:443 (9764fe065e6f4cf4a851478b02caac6b.local)
2025-05-29T10:45:19.890Z [WEBSOCKET] (HyperAPI.cpp:955) log streaming deactivated for client ::ffff:10.0.0.52
2025-05-29T10:45:23.740Z [LEDDEVICE0_ADALIGHT] (ProviderSerial.cpp:293) Timeout after 1000ms: 0 frames already dropped
2025-05-29T10:45:24.741Z [LEDDEVICE0_ADALIGHT] (ProviderSerial.cpp:293) Timeout after 1000ms: 1 frames already dropped
2025-05-29T10:45:25.742Z [LEDDEVICE0_ADALIGHT] (ProviderSerial.cpp:293) Timeout after 1000ms: 2 frames already dropped
2025-05-29T10:45:26.744Z [LEDDEVICE0_ADALIGHT] (ProviderSerial.cpp:293) Timeout after 1000ms: 3 frames already dropped
2025-05-29T10:45:27.745Z [LEDDEVICE0_ADALIGHT] (ProviderSerial.cpp:293) Timeout after 1000ms: 4 frames already dropped
2025-05-29T10:45:28.746Z [LEDDEVICE0_ADALIGHT] (ProviderSerial.cpp:293) Timeout after 1000ms: 5 frames already dropped
2025-05-29T10:45:28.746Z [LEDDEVICE0_ADALIGHT] (ProviderSerial.cpp:146) Flush was successful
2025-05-29T10:46:04.715Z [LEDDEVICE0_ADALIGHT] (ProviderSerial.cpp:164) Serial port is closed: ttyACM0
2025-05-29T10:46:04.715Z [LEDDEVICE0_ADALIGHT] (LedDevice.cpp:380) Stopping refresh timer
2025-05-29T10:46:04.715Z [LEDDEVICE0_ADALIGHT] Device 'adalight' is disabled due to an error: 'Timeout writing data to ttyACM0'
2025-05-29T10:46:04.716Z [COMPONENTCTRL0] LED device: disabled

[ManuVice]

My ESP32 didn't work well with the firmware, so I switched back to HyperSPI with the Pico and changed to a different USB cable. Maybe the cable is faulty.

rst:0x10 (RTCWDT_RTC_RESET),boot:0x13
(SPI_FAST_FLASH_BOOT) [11:16:34]invalid header: 0x6f697067

edit: crashed again with 100 Hz after some minutes... I bought a Adafruit RP2040 Scorpio 😆 it will arrive at saturday 👍

[ManuVice]

Hi again. With Adafruit RP2040 Scorpio HyperSPI I have to exact same problem. Benchmark 110 Hz, with 100 Hz it crashed. Only way to work again is to power off/on my LED strip.

Soo... Maybe a problem with my LED strip 😄 What if I have set an incorrect LED value?

[awawa-dev]

Try HyperSerialPico and test it to see if it crashes. Upload your config so I will test it with my board.

[ManuVice]

ok back to HyperSerialPico 😃
I have rechecked my LED number configuration, everything was set correctly.

I think it's running like last time. After I reflashed the Pico, everything is running at 100 Hz for the time being. After a few days it starts and the LEDs start to freeze faster and faster. I'll report back.

current config:
HyperHDR-21.0.0.0-Backup-2025-06-08.json

[awawa-dev]

Thank you. I will check it in my free time but I will run it for max 24H using color effect and then I will close the port. I will verify if the device did not report an error during this time and if it correctly reported FPS when closed. However, I do not know if I will be able to debug the board in such conditions (potentially long time until the error occurs).

[ManuVice]

Hi.. I was at vacation for a week. For now its working with HyperSerialPico 👍

[awawa-dev]

That's good to hear :) I've already tested it on my setup for 24H and it passed. But I plan to repeat the test using your config and also using a very battered usb-c cable to see if that has any effect.

[ManuVice]

Everything's working fine so far. HyperSerialPico is running, and I’m not touching it again 😄 Thanks for your help 🙂

[awawa-dev]

Great! Thank you so much for your support again – really appreciate it! 😃