Glowing-red after update to 02_05_05 [Resolved]

john · April 12, 2020, 1:11pm

Hi,

I noticed that my iotawatt was nowhere to be seen on my network. Tried to do a reboot by unplugging the power adapter, but it was only showing red-green-green for a while then red-red-red.

I took the sd-card out and i found that it was working fine at firmware 02_05_02.

Log of time of update

SD initialized.
3/16/20 13:54:22z Real Time Clock is running. Unix time 1584366862 
3/16/20 13:54:22z Reset reason: Hardware Watchdog
3/16/20 13:54:22z Trace:  18:0, 18:2, 18:3, 18:2, 18:3, 18:2, 18:3, 18:2, 18:3, 18:2, 18:3, 18:2, 18:3, 18:2, 18:3, 18:2, 18:3, 18:2, 18:3, 18:2, 18:3, 18:2, 18:3, 18:2, 18:3, 18:2, 18:3, 18:2, 18:3, 18:2, 18:3, 18:4
3/16/20 13:54:22z ESP8266 ChipID: 2527436
3/16/20 13:54:22z IoTaWatt 4.x, Firmware version 02_05_02
3/16/20 13:54:22z SPIFFS mounted.
3/16/20 14:54:23 Local time zone: +1:00
3/16/20 14:54:23 Using Daylight Saving Time (BST) when in effect.
3/16/20 14:54:23 device name: IotaWatt
3/16/20 14:54:23 MDNS responder started for hostname IotaWatt
3/16/20 14:54:23 LLMNR responder started for hostname IotaWatt
3/16/20 14:54:23 HTTP server started
3/16/20 14:54:23 timeSync: service started.
3/16/20 14:54:23 statService: started.
3/16/20 14:54:23 dataLog: service started.
3/16/20 14:54:26 dataLog: Last log entry 03/16/20 14:54:10
3/16/20 14:54:28 influxDB: started, url=192.168.1.21:8086, db=iotawatt, interval=10
3/16/20 14:54:32 WiFi connected. SSID=John-Arvid's, IP=192.168.1.242, channel=6, RSSI -71db
3/16/20 14:54:32 Updater: service started. Auto-update class is MINOR
3/16/20 14:54:33 Updater: Auto-update is current for class MINOR.
3/16/20 14:54:35 influxDB: Start posting at 03/16/20 14:53:20
3/16/20 14:55:23 historyLog: service started.
3/16/20 14:55:24 historyLog: Last log entry 03/16/20 14:54:00
3/23/20 20:11:42 Updater: Update from 02_05_02 to 02_05_05
3/23/20 20:11:42 Updater: download 02_05_05
3/23/20 20:11:54 Updater: Release downloaded 12590ms, size 816696
3/23/20 20:12:04 Updater: signature verified
3/23/20 20:12:11 Updater: firmware upgraded to version 02_05_05
3/23/20 20:12:11 Updater: Firmware updated, restarting.

** Restart **

SD initialized.
3/23/20 19:12:20z Real Time Clock is running. Unix time 1584990740 
3/23/20 19:12:20z Reset reason: Software/System restart
3/23/20 19:12:20z Trace:  9:0, 9:1, 8:4, 8:6, 8:8, 8:9, 9:3, 9:5, 9:9, 1:2, 1:3, 1:4, 1:5[19], 1:6, 1:1[10], 1:2[11], 9:0[11], 9:0, 9:1, 8:4, 8:6, 8:8, 8:9, 9:3, 9:5, 9:9, 1:2, 1:3, 1:4, 1:5[5], 5:0, 5:7
3/23/20 19:12:20z ESP8266 ChipID: 2527436
3/23/20 19:12:20z IoTaWatt 4.x, Firmware version 02_05_05
3/23/20 19:12:20z Updater: Installing update files for version 02_05_05
3/23/20 19:12:20z Updater: Installing GRAPH.HTM
3/23/20 19:12:20z Updater: Installing GRAPH.JS
3/23/20 19:12:20z Updater: Installing GRAPH2.HTM
3/23/20 19:12:21z Updater: Installing GRAPH2.JS
3/23/20 19:12:21z Updater: Installing INDEX.HTM
3/23/20 19:12:22z Updater: Installing TABLES.TXT
3/23/20 19:12:22z Updater: Installing CNFSTYLE.CSS
3/23/20 19:12:22z Updater: Installing EDIT.HTM
3/23/20 19:12:23z Updater: Installation complete.
3/23/20 19:12:23z SPIFFS mounted.
3/23/20 20:12:23 Local time zone: +1:00
3/23/20 20:12:23 Using Daylight Saving Time (BST) when in effect.
3/23/20 20:12:23 device name: IotaWatt
3/23/20 20:12:23 LLMNR responder started for hostname IotaWatt
3/23/20 20:12:23 HTTP server started
3/23/20 20:12:23 timeSync: service started.
3/23/20 20:12:23 statService: started.
3/23/20 20:12:24 dataLog: service started.
3/23/20 20:12:27 dataLog: Last log entry 03/23/20 20:11:55
3/23/20 20:12:28 influxDB: started, url=http://192.168.1.21:8086, db=iotawatt, interval=10
3/23/20 20:13:24 historyLog: service started.
3/23/20 20:13:25 historyLog: Last log entry 03/23/20 20:11:00
3/23/20 21:12:24 WiFi disconnected more than 60 minutes, restarting.

Should/could I flash to the old firmware? Or is it something else I should/could do?

Thanks

overeasy · April 12, 2020, 2:28pm

Hello John,

It’s not clear what is going on with your system right now. 02_05_05 was deployed to MINOR on March 23 after being in ALPHA and BETA for more than a month. Shortly thereafter, a problem with the ability to address with the .local address was uncovered, so on March 26, MINOR was reverted to 02_05_02, which is how it stands right now.

That’s the history, but what you are reporting is not a symptom of the underlying problem with 02_05_05, which was not a fatal flaw.

Can you post the state/transitions of the LED when you power up the device now, and also post the remainder of the message log to see what’s happened since March 23?

If you refer, you can upload the message log to me in a private message.

john · April 12, 2020, 3:33pm

Thanks for your reply overeasy.

Understand. Is there a way to get more information from the device?

After some testing the state is now straight to red-red-red (or red blinking between bright and not so bright, same pace as the wifi led on the ESP-12S)
I have left it connected to usb serial and this is the current output:

rdl▒▒|▒c▒N
▒l▒
"|▒▒▒▒p▒▒|c▒B▒p~▒N▒loo▒▒"
cpp▒drlrlrllܾ▒▒$▒|▒▒l▒
c|▒▒▒▒s▒c▒
#▒▒Nn▒loo▒▒▒
#p▒$rlrlp▒o▒▒l
▒▒
c
o▒|$▒l▒p
▒▒NN▒$▒▒l`▒no
l Nr▒▒▒o
▒l`r▒▒▒
▒l ▒r▒p▒
l▒{▒`▒n▒
SPI started.

** Restart **

SD initialized.
4/12/20 13:37:42z Real Time Clock is running. Unix time 1586698662
4/12/20 13:37:42z Reset reason: External System
4/12/20 13:37:42z Trace:  8:2, 9:2, 1:2, 1:3, 1:4, 1:1[9], 1:2[10], 9:0[10], 9:0, 9:1, 8:2[10], 8:2, 9:2, 1:2, 1:3, 1:4, 1:1[10], 1:2[11], 9:0[11], 9:0, 9:1, 8:2[11], 8:2, 9:2, 1:2, 1:3, 1:4, 1:1[11], 1:2[12], 9:0[12], 9:0, 9:1
4/12/20 13:37:42z ESP8266 ChipID: 2527436
4/12/20 13:37:42z IoTaWatt 4.x, Firmware version 02_05_05
4/12/20 13:37:42z SPIFFS mounted.
4/12/20 15:37:42 Local time zone: +1:00
4/12/20 15:37:42 Using Daylight Saving Time (BST) when in effect.
4/12/20 15:37:42 device name: IotaWatt
4/12/20 15:37:42 LLMNR responder started for hostname IotaWatt
4/12/20 15:37:42 HTTP server started
4/12/20 15:37:42 timeSync: service started.
4/12/20 15:37:42 statService: started.
4/12/20 15:37:42 dataLog: service started.
4/12/20 15:37:46 dataLog: Last log entry 04/12/20 15:37:35
4/12/20 15:37:46 historyLog: service started.
4/12/20 15:37:47 historyLog: Last log entry 04/12/20 15:37:00
4/12/20 15:37:47 influxDB: started, url=http://192.168.1.21:8086, db=iotawatt, interval=10
4/12/20 16:37:43 WiFi disconnected more than 60 minutes, restarting.

 ets Jan  8 2013,rst cause:2, boot mode:(3,7)

load 0x4010f000, len 1392, room 16
tail 0
chksum 0xd0
csum 0xd0
v3d128e5c
~ld

SPI started.

** Restart **

SD initialized.
4/12/20 14:37:44z Real Time Clock is running. Unix time 1586702264
4/12/20 14:37:44z Reset reason: Software/System restart
4/12/20 14:37:44z Trace:  9:0[13], 9:0, 9:1, 8:2[13], 8:2, 9:2, 1:2, 1:3, 1:4, 1:1[13], 1:2[14], 9:0[14], 9:0, 9:1, 8:2[14], 8:2, 9:2, 1:2, 1:3, 1:4, 1:1[14], 1:2, 9:0, 9:0, 8:2, 8:2, 1:2, 1:3, 1:4, 1:5[21], 21:0, 21:2
4/12/20 14:37:44z ESP8266 ChipID: 2527436
4/12/20 14:37:44z IoTaWatt 4.x, Firmware version 02_05_05
4/12/20 14:37:44z SPIFFS mounted.
4/12/20 16:37:44 Local time zone: +1:00
4/12/20 16:37:44 Using Daylight Saving Time (BST) when in effect.
4/12/20 16:37:44 device name: IotaWatt
4/12/20 16:37:44 LLMNR responder started for hostname IotaWatt
4/12/20 16:37:44 HTTP server started
4/12/20 16:37:44 timeSync: service started.
4/12/20 16:37:44 statService: started.
4/12/20 16:37:44 dataLog: service started.
4/12/20 16:37:48 dataLog: Last log entry 04/12/20 16:37:40
4/12/20 16:37:48 historyLog: service started.
4/12/20 16:37:49 historyLog: Last log entry 04/12/20 16:37:00
4/12/20 16:37:49 influxDB: started, url=http://192.168.1.21:8086, db=iotawatt, interval=10
Low sample count 35

The logs after march 23 is this:

** Restart **

SD initialized.
3/23/20 20:12:25z Real Time Clock is running. Unix time 1584994345 
3/23/20 20:12:25z Reset reason: Software/System restart
3/23/20 20:12:25z Trace:  1:3, 1:4, 1:3, 1:4, 1:3, 1:4, 1:3, 1:4, 1:3, 1:4, 1:3, 1:4, 1:3, 1:4, 1:1[10], 1:2[11], 9:0[11], 9:0, 9:1, 8:4, 8:6, 8:8, 8:9, 9:3, 9:5, 9:9, 1:2, 1:3, 1:4, 1:5[21], 21:0, 21:2
3/23/20 20:12:25z ESP8266 ChipID: 2527436
3/23/20 20:12:25z IoTaWatt 4.x, Firmware version 02_05_05
3/23/20 20:12:25z SPIFFS mounted.
3/23/20 21:12:25 Local time zone: +1:00
3/23/20 21:12:25 Using Daylight Saving Time (BST) when in effect.
3/23/20 21:12:25 device name: IotaWatt
3/23/20 21:12:25 LLMNR responder started for hostname IotaWatt
3/23/20 21:12:25 HTTP server started
3/23/20 21:12:25 timeSync: service started.
3/23/20 21:12:25 statService: started.
3/23/20 21:12:26 dataLog: service started.
3/23/20 21:12:29 dataLog: Last log entry 03/23/20 21:12:20
3/23/20 21:12:30 influxDB: started, url=http://192.168.1.21:8086, db=iotawatt, interval=10
3/23/20 21:13:26 historyLog: service started.
3/23/20 21:13:27 historyLog: Last log entry 03/23/20 21:12:00
3/23/20 22:12:26 WiFi disconnected more than 60 minutes, restarting.

** Restart **

SD initialized.
3/23/20 21:12:27z Real Time Clock is running. Unix time 1584997947 
3/23/20 21:12:27z Reset reason: Software/System restart
3/23/20 21:12:27z Trace:  1:3, 1:4, 1:3, 1:4, 1:3, 1:4, 1:3, 1:4, 1:3, 1:4, 1:3, 1:4, 1:3, 1:4, 1:1[7], 1:2[8], 9:0[8], 9:0, 9:1, 8:4, 8:6, 8:8, 8:9, 9:3, 9:5, 9:9, 1:2, 1:3, 1:4, 1:5[21], 21:0, 21:2
3/23/20 21:12:27z ESP8266 ChipID: 2527436
3/23/20 21:12:27z IoTaWatt 4.x, Firmware version 02_05_05
3/23/20 21:12:27z SPIFFS mounted.
3/23/20 22:12:27 Local time zone: +1:00
3/23/20 22:12:27 Using Daylight Saving Time (BST) when in effect.
3/23/20 22:12:27 device name: IotaWatt
3/23/20 22:12:27 LLMNR responder started for hostname IotaWatt
3/23/20 22:12:27 HTTP server started
3/23/20 22:12:27 timeSync: service started.
3/23/20 22:12:27 statService: started.
3/23/20 22:12:28 dataLog: service started.
3/23/20 22:12:31 dataLog: Last log entry 03/23/20 22:12:25
3/23/20 22:12:32 influxDB: started, url=http://192.168.1.21:8086, db=iotawatt, interval=10
3/23/20 22:13:28 historyLog: service started.
3/23/20 22:13:29 historyLog: Last log entry 03/23/20 22:12:00
3/23/20 23:12:28 WiFi disconnected more than 60 minutes, restarting.

** Restart **

SD initialized.
3/23/20 22:12:29z Real Time Clock is running. Unix time 1585001549 
3/23/20 22:12:29z Reset reason: Software/System restart
3/23/20 22:12:29z Trace:  1:3, 1:4, 1:3, 1:4, 1:3, 1:4, 1:3, 1:4, 1:3, 1:4, 1:3, 1:4, 1:3, 1:4, 1:1[4], 1:2[5], 9:0[5], 9:0, 9:1, 8:4, 8:6, 8:8, 8:9, 9:3, 9:5, 9:9, 1:2, 1:3, 1:4, 1:5[21], 21:0, 21:2
3/23/20 22:12:29z ESP8266 ChipID: 2527436
3/23/20 22:12:29z IoTaWatt 4.x, Firmware version 02_05_05
3/23/20 22:12:29z SPIFFS mounted.
3/23/20 23:12:29 Local time zone: +1:00
3/23/20 23:12:29 Using Daylight Saving Time (BST) when in effect.
3/23/20 23:12:29 device name: IotaWatt
3/23/20 23:12:29 LLMNR responder started for hostname IotaWatt
3/23/20 23:12:29 HTTP server started
3/23/20 23:12:29 timeSync: service started.
3/23/20 23:12:29 statService: started.
3/23/20 23:12:30 dataLog: service started.
3/23/20 23:12:33 dataLog: Last log entry 03/23/20 23:12:25
3/23/20 23:12:34 influxDB: started, url=http://192.168.1.21:8086, db=iotawatt, interval=10
3/23/20 23:13:30 historyLog: service started.
3/23/20 23:13:31 historyLog: Last log entry 03/23/20 23:12:00
3/24/20 00:12:30 WiFi disconnected more than 60 minutes, restarting.

** Restart **

SD initialized.
3/23/20 23:12:31z Real Time Clock is running. Unix time 1585005151 
3/23/20 23:12:31z Reset reason: Software/System restart
3/23/20 23:12:31z Trace:  9:0, 9:1, 8:4, 8:6, 8:8, 8:9, 9:3, 9:5, 9:9, 1:2, 1:3, 1:4, 1:5[19], 1:6, 1:1[4], 1:2[5], 9:0[5], 9:0, 9:1, 8:4, 8:6, 8:8, 8:9, 9:3, 9:5, 9:9, 1:2, 1:3, 1:4, 1:5[21], 21:0, 21:2
3/23/20 23:12:31z ESP8266 ChipID: 2527436
3/23/20 23:12:31z IoTaWatt 4.x, Firmware version 02_05_05
3/23/20 23:12:31z SPIFFS mounted.
3/24/20 00:12:31 Local time zone: +1:00
3/24/20 00:12:31 Using Daylight Saving Time (BST) when in effect.
3/24/20 00:12:31 device name: IotaWatt
3/24/20 00:12:31 LLMNR responder started for hostname IotaWatt
3/24/20 00:12:31 HTTP server started
3/24/20 00:12:31 timeSync: service started.
3/24/20 00:12:31 statService: started.
3/24/20 00:12:32 dataLog: service started.
3/24/20 00:12:35 dataLog: Last log entry 03/24/20 00:12:30
3/24/20 00:12:36 influxDB: started, url=http://192.168.1.21:8086, db=iotawatt, interval=10
3/24/20 00:13:32 historyLog: service started.
3/24/20 00:13:33 historyLog: Last log entry 03/24/20 00:12:00
3/24/20 01:12:32 WiFi disconnected more than 60 minutes, restarting.

** Restart **

SD initialized.
3/24/20 00:12:33z Real Time Clock is running. Unix time 1585008753 
3/24/20 00:12:33z Reset reason: Software/System restart
3/24/20 00:12:33z Trace:  9:1, 8:4, 8:6, 8:8, 8:9, 9:3, 9:5, 9:9, 1:2, 1:3, 1:4, 1:3, 1:4, 1:3, 1:4, 1:3, 1:4, 1:3, 1:4, 1:3, 1:4, 1:3, 1:4, 1:3, 1:4, 1:3, 1:4, 1:3, 1:4, 1:5[21], 21:0, 21:2
3/24/20 00:12:33z ESP8266 ChipID: 2527436
3/24/20 00:12:33z IoTaWatt 4.x, Firmware version 02_05_05
3/24/20 00:12:33z SPIFFS mounted.
3/24/20 01:12:33 Local time zone: +1:00
3/24/20 01:12:33 Using Daylight Saving Time (BST) when in effect.
3/24/20 01:12:33 device name: IotaWatt
3/24/20 01:12:33 LLMNR responder started for hostname IotaWatt
3/24/20 01:12:33 HTTP server started
3/24/20 01:12:33 timeSync: service started.
3/24/20 01:12:33 statService: started.
3/24/20 01:12:34 dataLog: service started.
3/24/20 01:12:36 dataLog: Last log entry 03/24/20 01:12:30
3/24/20 01:12:38 influxDB: started, url=http://192.168.1.21:8086, db=iotawatt, interval=10
3/24/20 01:13:34 historyLog: service started.
3/24/20 01:13:35 historyLog: Last log entry 03/24/20 01:12:00
3/24/20 02:12:34 WiFi disconnected more than 60 minutes, restarting.

Basically just a loop with restaring after wifi disconnected for 60 minutes. I also uploaded the file since I can’t paste all the content here. (Also I could not find any sensitive information other than my ssid and ip in the logs)
IOTAMSGS.TXT (563.4 KB)
Thanks

john · April 12, 2020, 4:27pm

I can dump the firmware and do other tests if it helps.

overeasy · April 12, 2020, 5:02pm

The good news is that your IoTaWatt is, and has been, logging your power throughout this period. Looking at the log, I think the LED should be what I describe as “glowing red”. The RED-RED-RED sequence described in the troubleshooting documentation blinks for half-second on, half-second off, three times, then off for a second, repeat. By the log, it is not doing that.

The dull red, like dull green, means it is logging normally. Red in this case indicates that it is not connected to WiFi. That’s the primary problem here. If you power cycle the unit, that is remove the USB power, you should get RED-GREEN-GREEN on the led for the first three minutes after power up. During that time, it should be in AP mode and you can connect to it to select your WiFi network and enter the password (IotaWatt), as in the getting started documentation.

Assuming your WiFi has not changed, I don’t know why it can no longer connect, but it should go into AP mode after a power on reset to specify. Once you successfully connect, the unit will revert to 02_05_02. If you have the serial monitor connected, you will see that happening. Allow that to complete and it will restart under the old release.

john · April 12, 2020, 5:33pm

Ok, that is good. Then I only loose data today.

Understand, then it is glowing red.

I have now tested with two different wireless networks, but it is the same, red-green-green then glowing red.

Also regarding serial monitor, when I had that connected the led was always glowing red. (As soon as SPI started)

john · April 12, 2020, 5:40pm

It also looks like it won’t go into AP mode when SPI is started. So I can’t see what happens when I try to connect to wifi through the “config portal”.

overeasy · April 12, 2020, 6:13pm

What’s probably happening is that it does a power-on start when you connect the USB cable but then restarts when you start the serial monitor. The AP only comes up with a power-on restart.

So can you try it by connecting the USB power supply, watching for RGG, then looking for the AP with your phone or tablet?

john · April 12, 2020, 6:15pm

Yes, that is what I have done. (#6 third line)
Just wanted to add my discovery about the SPI start.

overeasy · April 12, 2020, 6:24pm

There is no significance to the SPI start. When you power it up with the USB power supply, you should get RGG.

Follow the instructions here.

john · April 12, 2020, 7:06pm

I mean I did all that in two different occasions.

I have connected the device to a separate USB power supply and got the red-green-green led for 3 minutes. During this time I connected to the iotaxxxxx ssid and entered the information to connect to the wifi. This did not make any difference, the device was still showing red-green-green for a while before going to glowing-red led.

john · April 12, 2020, 7:27pm

I have dumped the complete firmware from the device if you want to troubleshoot it sometime.

My solution ended up with flashing the 02_05_02 firmware manually and it works as it should.

Thank you for your input, and thank you for this great product!

overeasy · April 12, 2020, 8:00pm

There is something missing here, because 02_05_05 does connect and reconnect fine, the only issue is the mDNS responder. But glad you got up and running.

Just a heads-up - 02_05_05 is built on an updated ESP core, and has a newer version of lwip. The most recent release now in ALPHA and BETA is 02_05_07 - which is 02_05_05 with a few fixes. That release is teed up for MINOR release at the end of the month and I have no reason to believe it will work any differently than 02_05_05.

Given that there is no explanation for what happened with 02_05_05, you may want to anticipate what may happen when 02_05_07 is auto-updated. I have no reason to believe it will be any different than 02_05_05 with respect to connecting to WiFi.

john · April 13, 2020, 8:07am

Yes something is missing, but as said before, I can send you the dumped firmware and you can upload it to your device to see what behavior you get.

Yeah I thought about that so I turned off the auto update, I will try to enable it at a later point when I have the time to troubleshoot.