Restart: Software Watchdog (resolved)

Simsala · April 3, 2020, 10:13pm

Hi Bob, one device is constantly rebooting, do you have an idea what could be wrong? Update channel was set to minor, rebooting started probably Feb 10 th (at this date uploading to emoncms stopped).


** Restart **

SD initialized.
4/03/20 22:07:43z Real Time Clock is running. Unix time 1585951663 
4/03/20 22:07:43z Reset reason: Software Watchdog
4/03/20 22:07:43z Trace:  3:6, 3:6, 3:6, 3:6, 3:6, 3:6, 1:6, 1:1, 1:2[1], 9:0[1], 9:0, 9:1, 8:4, 8:6, 8:8, 8:9, 9:3, 9:5, 9:9, 1:2, 1:3, 1:4, 1:5[5], 5:0, 5:2, 1:6, 1:3, 1:4, 1:5[3], 3:0, 3:6, 3:6
4/03/20 22:07:43z ESP8266 ChipID: 2329763
4/03/20 22:07:43z IoTaWatt 4.x, Firmware version 02_05_02
4/03/20 22:07:43z SPIFFS mounted.
4/03/20 22:07:44z Local time zone: +0:00
4/03/20 22:07:44z device name: IotaWatt
4/03/20 22:07:44z MDNS responder started for hostname IotaWatt
4/03/20 22:07:45z LLMNR responder started for hostname IotaWatt
4/03/20 22:07:45z HTTP server started
4/03/20 22:07:45z timeSync: service started.
4/03/20 22:07:45z statService: started.
4/03/20 22:07:45z dataLog: service started.
4/03/20 22:07:50z dataLog: Last log entry 04/03/20 22:07:40
4/03/20 22:07:51z WiFi connected. SSID=FRITZ!Box 7580 NJ, IP=192.168.2.72, channel=11, RSSI -63db
4/03/20 22:07:51z Updater: service started. Auto-update class is MINOR
4/03/20 22:07:51z EmonService: started. url=my.rexometer.de:80, node=IotaWatt, interval=10, encrypted
4/03/20 22:07:52z EmonService: Start posting at 02/10/20 00:48:40
4/03/20 22:07:53z Updater: Auto-update is current for class MINOR.

** Restart **

SD initialized.
4/03/20 22:07:57z Real Time Clock is running. Unix time 1585951677 
4/03/20 22:07:57z Reset reason: Software Watchdog
4/03/20 22:07:57z Trace:  18:3, 18:4, 18:5, 1:6, 1:3, 1:4, 1:5[5], 5:0, 5:4, 21:110, 21:110, 21:110, 1:6, 1:1[2], 1:2[3], 9:0[3], 9:0, 9:1, 8:4, 8:6, 8:8, 8:9, 9:3, 9:5, 9:9, 1:2, 1:3, 1:4, 1:5[3], 3:0, 3:6, 3:6
4/03/20 22:07:57z ESP8266 ChipID: 2329763
4/03/20 22:07:57z IoTaWatt 4.x, Firmware version 02_05_02
4/03/20 22:07:57z SPIFFS mounted.
4/03/20 22:07:58z Local time zone: +0:00
4/03/20 22:07:58z device name: IotaWatt
4/03/20 22:07:58z MDNS responder started for hostname IotaWatt
4/03/20 22:07:59z LLMNR responder started for hostname IotaWatt
4/03/20 22:07:59z HTTP server started
4/03/20 22:07:59z timeSync: service started.
4/03/20 22:07:59z statService: started.
4/03/20 22:07:59z dataLog: service started.
4/03/20 22:08:04z dataLog: Last log entry 04/03/20 22:07:50
4/03/20 22:08:05z historyLog: service started.
4/03/20 22:08:06z historyLog: Last log entry 04/03/20 22:07:00
4/03/20 22:08:06z WiFi connected. SSID=FRITZ!Box 7580 NJ, IP=192.168.2.72, channel=11, RSSI -63db
4/03/20 22:08:06z Updater: service started. Auto-update class is MINOR
4/03/20 22:08:07z EmonService: started. url=my.rexometer.de:80, node=IotaWatt, interval=10, encrypted
4/03/20 22:08:08z EmonService: Start posting at 02/10/20 00:48:40
4/03/20 22:08:09z Updater: Auto-update is current for class MINOR.

** Restart **

SD initialized.
4/03/20 22:08:11z Real Time Clock is running. Unix time 1585951691 
4/03/20 22:08:11z Reset reason: Software Watchdog
4/03/20 22:08:11z Trace:  1:1[3], 1:2, 9:0, 9:0, 8:4, 8:6, 8:8, 8:9, 1:2, 1:3, 1:4, 1:5[5], 5:0, 5:2, 1:6, 1:3, 1:4, 1:5[3], 3:0, 3:6, 3:6, 3:6, 3:6, 3:6, 3:6, 1:6, 1:3, 1:4, 1:5[3], 3:0, 3:6, 3:6
4/03/20 22:08:11z ESP8266 ChipID: 2329763
4/03/20 22:08:11z IoTaWatt 4.x, Firmware version 02_05_02
4/03/20 22:08:11z SPIFFS mounted.
4/03/20 22:08:12z Local time zone: +0:00
4/03/20 22:08:12z device name: IotaWatt
4/03/20 22:08:12z MDNS responder started for hostname IotaWatt
4/03/20 22:08:13z LLMNR responder started for hostname IotaWatt
4/03/20 22:08:13z HTTP server started
4/03/20 22:08:13z timeSync: service started.
4/03/20 22:08:13z statService: started.
4/03/20 22:08:13z dataLog: service started.
4/03/20 22:08:18z dataLog: Last log entry 04/03/20 22:08:05
4/03/20 22:08:19z historyLog: service started.
4/03/20 22:08:20z historyLog: Last log entry 04/03/20 22:07:00
4/03/20 22:08:20z WiFi connected. SSID=FRITZ!Box 7580 NJ, IP=192.168.2.72, channel=11, RSSI -62db
4/03/20 22:08:20z Updater: service started. Auto-update class is MINOR
4/03/20 22:08:21z EmonService: started. url=my.rexometer.de:80, node=IotaWatt, interval=10, encrypted
4/03/20 22:08:22z EmonService: Start posting at 02/10/20 00:48:40
4/03/20 22:08:22z Updater: Auto-update is current for class MINOR.

** Restart **

SD initialized.
4/03/20 22:08:26z Real Time Clock is running. Unix time 1585951706 
4/03/20 22:08:26z Reset reason: Software Watchdog
4/03/20 22:08:26z Trace:  9:9, 1:2, 1:3, 1:4, 1:5[3], 3:0, 3:6, 3:6, 3:6, 3:6, 3:6, 3:6, 1:6, 1:1[1], 1:2[2], 9:0[2], 9:0, 9:1, 8:4, 8:6, 8:8, 8:9, 9:3, 9:5, 9:9, 1:2, 1:3, 1:4, 1:5[3], 3:0, 3:6, 3:6
4/03/20 22:08:26z ESP8266 ChipID: 2329763
4/03/20 22:08:26z IoTaWatt 4.x, Firmware version 02_05_02
4/03/20 22:08:26z SPIFFS mounted.
4/03/20 22:08:27z Local time zone: +0:00
4/03/20 22:08:27z device name: IotaWatt
4/03/20 22:08:27z MDNS responder started for hostname IotaWatt
4/03/20 22:08:28z LLMNR responder started for hostname IotaWatt
4/03/20 22:08:28z HTTP server started
4/03/20 22:08:28z timeSync: service started.
4/03/20 22:08:28z statService: started.
4/03/20 22:08:28z dataLog: service started.
4/03/20 22:08:35z dataLog: Last log entry 04/03/20 22:08:20
4/03/20 22:08:35z historyLog: service started.
4/03/20 22:08:36z historyLog: Last log entry 04/03/20 22:08:00
4/03/20 22:08:36z WiFi connected. SSID=FRITZ!Box 7580 NJ, IP=192.168.2.72, channel=11, RSSI -63db
4/03/20 22:08:37z Updater: service started. Auto-update class is MINOR
4/03/20 22:08:37z EmonService: started. url=my.rexometer.de:80, node=IotaWatt, interval=10, encrypted
4/03/20 22:08:38z EmonService: Start posting at 02/10/20 00:48:40
4/03/20 22:08:38z Updater: Auto-update is current for class MINOR.

** Restart **

SD initialized.
4/03/20 22:08:42z Real Time Clock is running. Unix time 1585951722 
4/03/20 22:08:42z Reset reason: Software Watchdog
4/03/20 22:08:42z Trace:  8:8, 8:9, 9:3, 9:5, 9:9, 1:2, 1:3, 1:4, 1:5[3], 3:0, 3:6, 3:6, 3:6, 3:6, 3:6, 3:6, 1:6, 1:1[3], 1:2, 9:0, 9:0, 8:4, 8:6, 8:8, 8:9, 1:2, 1:3, 1:4, 1:5[3], 3:0, 3:6, 3:6
4/03/20 22:08:42z ESP8266 ChipID: 2329763
4/03/20 22:08:42z IoTaWatt 4.x, Firmware version 02_05_02
4/03/20 22:08:42z SPIFFS mounted.
4/03/20 22:08:43z Local time zone: +0:00
4/03/20 22:08:43z device name: IotaWatt
4/03/20 22:08:43z MDNS responder started for hostname IotaWatt
4/03/20 22:08:44z LLMNR responder started for hostname IotaWatt
4/03/20 22:08:44z HTTP server started
4/03/20 22:08:44z timeSync: service started.
4/03/20 22:08:44z statService: started.
4/03/20 22:08:44z dataLog: service started.
4/03/20 22:08:49z dataLog: Last log entry 04/03/20 22:08:35
4/03/20 22:08:50z historyLog: service started.
4/03/20 22:08:51z historyLog: Last log entry 04/03/20 22:08:00
4/03/20 22:08:51z WiFi connected. SSID=FRITZ!Box 7580 NJ, IP=192.168.2.72, channel=11, RSSI -63db
4/03/20 22:08:51z Updater: service started. Auto-update class is MINOR
4/03/20 22:08:52z EmonService: started. url=my.rexometer.de:80, node=IotaWatt, interval=10, encrypted
4/03/20 22:08:53z EmonService: Start posting at 02/10/20 00:48:40
4/03/20 22:08:53z Updater: Auto-update is current for class MINOR.

** Restart **

SD initialized.
4/03/20 22:09:00z Real Time Clock is running. Unix time 1585951740 
4/03/20 22:09:00z Reset reason: Software Watchdog
4/03/20 22:09:00z Trace:  9:9, 1:2, 1:3, 1:4, 1:5[3], 3:0, 3:6, 3:6, 3:6, 3:6, 3:6, 3:6, 1:6, 1:1[2], 1:2[3], 9:0[3], 9:0, 9:1, 8:4, 8:6, 8:8, 8:9, 9:3, 9:5, 9:9, 1:2, 1:3, 1:4, 1:5[3], 3:0, 3:6, 3:6
4/03/20 22:09:00z ESP8266 ChipID: 2329763
4/03/20 22:09:00z IoTaWatt 4.x, Firmware version 02_05_02
4/03/20 22:09:00z SPIFFS mounted.
4/03/20 22:09:01z Local time zone: +0:00
4/03/20 22:09:01z device name: IotaWatt
4/03/20 22:09:01z MDNS responder started for hostname IotaWatt
4/03/20 22:09:02z LLMNR responder started for hostname IotaWatt
4/03/20 22:09:02z HTTP server started
4/03/20 22:09:02z timeSync: service started.
4/03/20 22:09:02z statService: started.
4/03/20 22:09:02z dataLog: service started.
4/03/20 22:09:07z dataLog: Last log entry 04/03/20 22:08:55
4/03/20 22:09:08z historyLog: service started.
4/03/20 22:09:09z historyLog: Last log entry 04/03/20 22:08:00
4/03/20 22:09:09z WiFi connected. SSID=FRITZ!Box 7580 NJ, IP=192.168.2.72, channel=11, RSSI -63db
4/03/20 22:09:09z Updater: service started. Auto-update class is MINOR
4/03/20 22:09:10z EmonService: started. url=my.rexometer.de:80, node=IotaWatt, interval=10, encrypted
4/03/20 22:09:11z EmonService: Start posting at 02/10/20 00:48:40
4/03/20 22:09:12z Updater: Auto-update is current for class MINOR.

** Restart **

SD initialized.
4/03/20 22:09:15z Real Time Clock is running. Unix time 1585951755 
4/03/20 22:09:15z Reset reason: Software Watchdog
4/03/20 22:09:15z Trace:  3:6, 1:6, 1:3, 1:4, 1:5[3], 3:0, 3:6, 3:6, 3:6, 3:6, 3:6, 3:6, 1:6, 1:1, 1:2[1], 9:0[1], 9:0, 9:1, 8:4, 8:6, 8:8, 8:9, 9:3, 9:5, 9:9, 1:2, 1:3, 1:4, 1:5[3], 3:0, 3:6, 3:6
4/03/20 22:09:15z ESP8266 ChipID: 2329763
4/03/20 22:09:15z IoTaWatt 4.x, Firmware version 02_05_02
4/03/20 22:09:15z SPIFFS mounted.
4/03/20 22:09:16z Local time zone: +0:00
4/03/20 22:09:16z device name: IotaWatt
4/03/20 22:09:16z MDNS responder started for hostname IotaWatt
4/03/20 22:09:17z LLMNR responder started for hostname IotaWatt
4/03/20 22:09:17z HTTP server started
4/03/20 22:09:17z timeSync: service started.
4/03/20 22:09:17z statService: started.
4/03/20 22:09:17z dataLog: service started.
4/03/20 22:09:22z dataLog: Last log entry 04/03/20 22:09:10

overeasy · April 3, 2020, 11:17pm

Can’t be sure but it looks like there is a problem reading the datalog to get data to post to Emoncms. These problems are rare, but usually indicate damage to the datalog.

When was this system commissioned? If more than a year ago, that would be consistent with an old problem caused datalog damage that a couple of systems have recently tripped over.

There are a couple of ways to approach this:

You can remove the SDcard and delete the current log (/iotawatt/iotalog.log). The history log should be OK.

Another approach that might work to get it running if you can’t access it would be to manually post an entry to the Emoncms node with a timestamp greater than 2/10/2020 like 1581465600 which is 2/12/2020. Update any input on node IotaWatt with any value and that timestamp and restart the IotaWatt to ause it to start posting later.

Simsala · April 4, 2020, 9:46am

Thanks Bob, that was exactly the problem. I was able to stop the web server via the status interface and set the upload history to a later date.

Interestingly, the data was available in emoncms until March 23rd, but according to Iotawatt the last upload was on February 10th. I used the method to set a manual timestamp in emoncms for all feeds, but that did not solve the restarts, and the status interface showed still Februar 10th as last upload date. Setting also the history upload date to April 24 fixed it finally.

It has been running since August 2018:

overeasy · April 4, 2020, 11:53am

Right. IoTaWatt looks at the inputs, not the feeds.

Simsala · April 4, 2020, 12:45pm

Ah, that explains a lot! Makes sense, the IoTaWatt cannot know which feeds are created.