Heap issues, or emoncms issues?

Twice in the past week, my dashboards have been stuck. When I check my feeds, they’re >24 hours out.
I rebooted the Iottawatt, that took a long time for it to come back; but eventually it did and then I got reporting for a few days.
I see the Iottawatt on my network, I even see it sending/receiving data. But on EMONCMS I see that it hasn’t received feeds in 15 hours. In my 2+ years of using this, I’ve never had issues. Now I’ve hadd issues 2x in the last week.
I have plenty of credit on emoncms. My status page: Emoncms - dashboard view

I checked the log this time on the iottawatt and I’m seeing:
8/06/22 18:08:15 Heap memory has degraded below safe minimum, restarting.

I’m guessing that the backed up files could cause heap issues, but I haven’t seen them previously.

Full log:
8/06/22 23:58:59z ESP8266 ID: 6991547, RTC PCF8523 (68)
8/06/22 23:58:59z IoTaWatt 5.0, Firmware version 02_07_05
8/06/22 23:58:59z SPIFFS mounted.
8/06/22 17:58:59 Local time zone: -7:00, using DST/BST when in effect.
8/06/22 17:58:59 device name: IotaWatt
8/06/22 17:58:59 HTTP server started
8/06/22 17:58:59 emoncms: Starting, interval:10, url:http://emoncms.org
8/06/22 17:58:59 timeSync: service started.
8/06/22 17:58:59 statService: started.
8/06/22 17:58:59 dataLog: service started.
8/06/22 17:59:01 dataLog: Last log entry 08/06/22 17:58:55
8/06/22 17:59:04 historyLog: service started.
8/06/22 17:59:04 historyLog: Last log entry 08/06/22 17:58:00
8/06/22 18:03:10 WiFi connected. SSID=chaoshq, IP=169.254.188.174, channel=10, RSSI -47db
8/06/22 18:03:10 MDNS responder started for hostname IotaWatt
8/06/22 18:03:10 LLMNR responder started for hostname IotaWatt
8/06/22 18:03:10 Updater: service started. Auto-update class is MINOR
8/06/22 18:08:15 Heap memory has degraded below safe minimum, restarting.

** Restart **

SD initialized.
8/07/22 00:08:16z Real Time Clock is running. Unix time 1659830896
8/07/22 00:08:16z Reset reason: Software/System restart
8/07/22 00:08:16z Trace: 31:120, 31:122, 31:123, 31:123, 21:110, 21:110, 31:1, 1:6[6], 1:1[13], 1:2[14], 9:0[14], 9:0, 9:1, 8:4, 8:6, 8:8, 8:9, 9:3, 9:5, 9:9, 1:2, 1:3, 1:3, 1:6[1], 1:6[2], 1:6[3], 1:5[21], 1:6[4], 21:0, 21:1, 21:10, 21:10
8/07/22 00:08:16z ESP8266 ID: 6991547, RTC PCF8523 (68)
8/07/22 00:08:16z IoTaWatt 5.0, Firmware version 02_07_05
8/07/22 00:08:16z SPIFFS mounted.
8/06/22 18:08:16 Local time zone: -7:00, using DST/BST when in effect.
8/06/22 18:08:16 device name: IotaWatt
8/06/22 18:08:16 HTTP server started
8/06/22 18:08:16 emoncms: Starting, interval:10, url:http://emoncms.org
8/06/22 18:08:16 timeSync: service started.
8/06/22 18:08:16 statService: started.
8/06/22 18:08:16 dataLog: service started.
8/06/22 18:08:18 dataLog: Last log entry 08/06/22 18:08:15
8/06/22 18:08:21 historyLog: service started.
8/06/22 18:08:21 historyLog: Last log entry 08/06/22 18:08:00
8/06/22 18:12:27 WiFi connected. SSID=chaoshq, IP=169.254.188.174, channel=10, RSSI -47db
8/06/22 18:12:27 MDNS responder started for hostname IotaWatt
8/06/22 18:12:27 LLMNR responder started for hostname IotaWatt
8/06/22 18:12:27 Updater: service started. Auto-update class is MINOR
8/06/22 18:17:22 Heap memory has degraded below safe minimum, restarting.

** Restart **

SD initialized.
8/07/22 00:17:23z Real Time Clock is running. Unix time 1659831443
8/07/22 00:17:23z Reset reason: Software/System restart
8/07/22 00:17:23z Trace: 1:3, 1:6[1], 1:6[2], 1:6[2], 1:6[3], 1:5[31], 1:6[4], 31:0, 31:1, 31:2[5], 31:120, 21:100[31], 21:101, 31:120, 31:122, 31:123, 31:123, 21:110, 21:110, 31:1, 1:6[6], 1:3, 1:3, 1:6[1], 1:6[2], 1:6[3], 1:5[21], 1:6[4], 21:0, 21:1, 21:10, 21:10
8/07/22 00:17:23z ESP8266 ID: 6991547, RTC PCF8523 (68)
8/07/22 00:17:23z IoTaWatt 5.0, Firmware version 02_07_05
8/07/22 00:17:23z SPIFFS mounted.
8/06/22 18:17:23 Local time zone: -7:00, using DST/BST when in effect.
8/06/22 18:17:23 device name: IotaWatt
8/06/22 18:17:23 HTTP server started
8/06/22 18:17:23 emoncms: Starting, interval:10, url:http://emoncms.org
8/06/22 18:17:23 timeSync: service started.
8/06/22 18:17:23 statService: started.
8/06/22 18:17:23 dataLog: service started.
8/06/22 18:17:25 dataLog: Last log entry 08/06/22 18:17:20
8/06/22 18:17:28 historyLog: service started.
8/06/22 18:17:28 historyLog: Last log entry 08/06/22 18:17:00
8/06/22 18:21:34 WiFi connected. SSID=chaoshq, IP=169.254.188.174, channel=10, RSSI -46db
8/06/22 18:21:34 MDNS responder started for hostname IotaWatt
8/06/22 18:21:34 LLMNR responder started for hostname IotaWatt
8/06/22 18:21:34 Updater: service started. Auto-update class is MINOR
8/06/22 18:26:39 Heap memory has degraded below safe minimum, restarting.

** Restart **

SD initialized.
8/07/22 00:26:40z Real Time Clock is running. Unix time 1659832000
8/07/22 00:26:40z Reset reason: Software/System restart
8/07/22 00:26:40z Trace: 1:3, 1:6[1], 1:6[2], 1:6[2], 1:6[3], 1:5[31], 1:6[4], 31:0, 31:1, 31:2[5], 31:120, 21:100[31], 21:101, 31:120, 31:122, 31:123, 31:123, 21:110, 21:110, 31:1, 1:6[6], 1:3, 1:3, 1:6[1], 1:6[2], 1:6[3], 1:5[21], 1:6[4], 21:0, 21:1, 21:10, 21:10
8/07/22 00:26:40z ESP8266 ID: 6991547, RTC PCF8523 (68)
8/07/22 00:26:40z IoTaWatt 5.0, Firmware version 02_07_05
8/07/22 00:26:40z SPIFFS mounted.
8/06/22 18:26:40 Local time zone: -7:00, using DST/BST when in effect.
8/06/22 18:26:40 device name: IotaWatt
8/06/22 18:26:40 HTTP server started
8/06/22 18:26:40 emoncms: Starting, interval:10, url:http://emoncms.org
8/06/22 18:26:40 timeSync: service started.
8/06/22 18:26:40 statService: started.
8/06/22 18:26:40 dataLog: service started.
8/06/22 18:26:42 dataLog: Last log entry 08/06/22 18:26:35
8/06/22 18:26:45 historyLog: service started.
8/06/22 18:26:45 historyLog: Last log entry 08/06/22 18:26:00
8/06/22 18:30:51 WiFi connected. SSID=chaoshq, IP=169.254.188.174, channel=10, RSSI -47db
8/06/22 18:30:51 MDNS responder started for hostname IotaWatt
8/06/22 18:30:51 LLMNR responder started for hostname IotaWatt
8/06/22 18:30:51 Updater: service started. Auto-update class is MINOR
8/06/22 18:35:51 Heap memory has degraded below safe minimum, restarting.

** Restart **

SD initialized.
8/07/22 00:35:52z Real Time Clock is running. Unix time 1659832552
8/07/22 00:35:52z Reset reason: Software/System restart
8/07/22 00:35:52z Trace: 31:120, 31:122, 31:123, 31:123, 21:110, 21:110, 31:1, 1:6[6], 1:1[12], 1:2[13], 9:0[13], 9:0, 9:1, 8:4, 8:6, 8:8, 8:9, 9:3, 9:5, 9:9, 1:2, 1:3, 1:3, 1:6[1], 1:6[2], 1:6[3], 1:5[21], 1:6[4], 21:0, 21:1, 21:10, 21:10
8/07/22 00:35:52z ESP8266 ID: 6991547, RTC PCF8523 (68)
8/07/22 00:35:52z IoTaWatt 5.0, Firmware version 02_07_05
8/07/22 00:35:52z SPIFFS mounted.
8/06/22 18:35:52 Local time zone: -7:00, using DST/BST when in effect.
8/06/22 18:35:52 device name: IotaWatt
8/06/22 18:35:52 HTTP server started
8/06/22 18:35:52 emoncms: Starting, interval:10, url:http://emoncms.org
8/06/22 18:35:52 timeSync: service started.
8/06/22 18:35:52 statService: started.
8/06/22 18:35:52 dataLog: service started.
8/06/22 18:35:54 dataLog: Last log entry 08/06/22 18:35:50
8/06/22 18:35:57 historyLog: service started.
8/06/22 18:35:57 historyLog: Last log entry 08/06/22 18:35:00
8/06/22 18:40:03 WiFi connected. SSID=chaoshq, IP=169.254.188.174, channel=10, RSSI -47db
8/06/22 18:40:03 MDNS responder started for hostname IotaWatt
8/06/22 18:40:03 LLMNR responder started for hostname IotaWatt
8/06/22 18:40:03 Updater: service started. Auto-update class is MINOR
8/06/22 18:45:08 Heap memory has degraded below safe minimum, restarting.

** Restart **

SD initialized.
8/07/22 00:45:09z Real Time Clock is running. Unix time 1659833109
8/07/22 00:45:09z Reset reason: Software/System restart
8/07/22 00:45:09z Trace: 31:120, 31:122, 31:123, 31:123, 21:110, 21:110, 31:1, 1:6[6], 1:1[11], 1:2[12], 9:0[12], 9:0, 9:1, 8:4, 8:6, 8:8, 8:9, 9:3, 9:5, 9:9, 1:2, 1:3, 1:3, 1:6[1], 1:6[2], 1:6[3], 1:5[21], 1:6[4], 21:0, 21:1, 21:10, 21:10
8/07/22 00:45:09z ESP8266 ID: 6991547, RTC PCF8523 (68)
8/07/22 00:45:09z IoTaWatt 5.0, Firmware version 02_07_05
8/07/22 00:45:09z SPIFFS mounted.
8/06/22 18:45:09 Local time zone: -7:00, using DST/BST when in effect.
8/06/22 18:45:09 device name: IotaWatt
8/06/22 18:45:09 HTTP server started
8/06/22 18:45:09 emoncms: Starting, interval:10, url:http://emoncms.org
8/06/22 18:45:09 timeSync: service started.
8/06/22 18:45:09 statService: started.
8/06/22 18:45:09 dataLog: service started.
8/06/22 18:45:11 dataLog: Last log entry 08/06/22 18:45:05
8/06/22 18:45:14 historyLog: service started.
8/06/22 18:45:14 historyLog: Last log entry 08/06/22 18:45:00
8/06/22 18:49:20 WiFi connected. SSID=chaoshq, IP=169.254.188.174, channel=10, RSSI -47db
8/06/22 18:49:20 MDNS responder started for hostname IotaWatt
8/06/22 18:49:20 LLMNR responder started for hostname IotaWatt
8/06/22 18:49:20 Updater: service started. Auto-update class is MINOR
8/06/22 18:54:25 Heap memory has degraded below safe minimum, restarting.

** Restart **

SD initialized.
8/07/22 00:54:26z Real Time Clock is running. Unix time 1659833666
8/07/22 00:54:26z Reset reason: Software/System restart
8/07/22 00:54:26z Trace: 31:120, 31:122, 31:123, 31:123, 21:110, 21:110, 31:1, 1:6[6], 1:1[13], 1:2[14], 9:0[14], 9:0, 9:1, 8:4, 8:6, 8:8, 8:9, 9:3, 9:5, 9:9, 1:2, 1:3, 1:3, 1:6[1], 1:6[2], 1:6[3], 1:5[21], 1:6[4], 21:0, 21:1, 21:10, 21:10
8/07/22 00:54:26z ESP8266 ID: 6991547, RTC PCF8523 (68)
8/07/22 00:54:26z IoTaWatt 5.0, Firmware version 02_07_05
8/07/22 00:54:26z SPIFFS mounted.
8/06/22 18:54:26 Local time zone: -7:00, using DST/BST when in effect.
8/06/22 18:54:26 device name: IotaWatt
8/06/22 18:54:26 HTTP server started
8/06/22 18:54:26 emoncms: Starting, interval:10, url:http://emoncms.org
8/06/22 18:54:26 timeSync: service started.
8/06/22 18:54:26 statService: started.
8/06/22 18:54:26 dataLog: service started.
8/06/22 18:54:28 dataLog: Last log entry 08/06/22 18:54:25
8/06/22 18:54:31 historyLog: service started.
8/06/22 18:54:31 historyLog: Last log entry 08/06/22 18:54:00
8/06/22 18:58:37 WiFi connected. SSID=chaoshq, IP=169.254.188.174, channel=10, RSSI -47db
8/06/22 18:58:37 MDNS responder started for hostname IotaWatt
8/06/22 18:58:37 LLMNR responder started for hostname IotaWatt
8/06/22 18:58:37 Updater: service started. Auto-update class is MINOR
8/06/22 19:00:37 Updater: Auto-update is current for class MINOR.
8/06/22 19:00:37 emoncms: Start posting at 08/06/22 16:38:30

The IP it’s listing is suspect like it can’t connect to my wifi. Last week when I had the issue, it did take a long time for it to reconnect to my (new in last two months) mesh network. It’s been on the new mesh network since I upgraded it and haven’t had any problems, but don’t want to rule it out:
Logs show: 169.254.188.174
Actual local IP: 192.168.xx.206.

Almost without exception, degraded heap is caused by WiFi problems. There isn’t much I can do about it. Try stopping the Emoncms uploader to see if it gives relief.

Interesting i have 40 devices on a 3 mesh wifi 6 system, this is obviously a 2.4ghz device. I’ll try to stick it to one just in case it’s hunting or something.

It is working again. I didn’t do anything. I’ll look at logs again.