Iotawatt restarting every 5 min

Support
1

My iotawatt has been running flawlessly for about 3 yrs. It became unresponsive yesterday.

Background details:

  1. WiFi connection appears fine. I can ping it reliably and occasionally see the website with all configuration missing.
  2. Switched data uploader from emoncms to local Influxdb a week ago. Was working fine until I had a problem with Influx and had to delete the db. iotawatt appeared to handle the db deletion and was in process of uploading stored data. Successfully uploaded from Jan to Apr 2020 before stopping
  3. iotawatt has restarted 277 times since yesterday (every 5 min or so)
  4. Removed SD Card and noticed the dates on many of the files have changed to 2097 or 2098.
  5. Included recent snippets from iotamsgs.txt below. Left out most of the restarts but included the last couple of normal looking restarts as well as the two most recent restarts which appear to fail similarly.
  6. FW version is 02_06_05

Any suggestions how to proceed?

iotamsgs.txt snippet:
iotamsgs snippet 20210814.txt (9.4 KB)

SD Card Directory:

image
image1534×722 68.4 KB

2

The file modified dates are a red-herring. IoTaWatt does not set them.

It appears to be hung up reading the datalog while uploading data to influxDB1 on or shortly after 04/02/21 19:08:30. Can you try setting the upload history date in your influxDB1 setup to 04/03/21, restart the IoTaWatt (or wait 5 minutes).

Hopefully it will step over whatever the problem is. If not, more drastic measures may be needed. Let me know if this works.

3

The influxDB1 setup on iotawatt? When I hit the website everything is blank - there is no configuration visible on the website. The information appears to be in the files on the SD but the website has lost all the setup info. I’ll share some screenshots shortly after I finish backing up the SD card.

4

Try stopping your influx server.

5

I’ll try but I’m suspicious of the iotalog.log file. I can’t seem to copy it. I’ve tried normal windows explorer and win32 diskimager and both fail or hang.

6

Yes, it probably has a bad block. I’m trying to get you past that and get your influx loaded. Probably will end up recreating the current log after that.

Stopping the influx server should cause IoTaWatt to stop trying to read those blocks so you can access the config and skip over those sectors.

7

I’ve stopped influx and will wait 5 min to see if I can see the home page

8

You will need to reload the browser window.

9

Very good. It restarted and is working again. Do I need a new SD card?

10

That would be a good idea, but lets try to get your data to influx.

First press the stop button in the influx section of the status display and wait till it indicates stopped.

Set the upload from date in influx to 04/03/21

Restart your influx server

Press start in the influx status display to restart the upload.

11

I changed the upload date to Jul 1,2020 just to be safe. It was previously failing around Apr 2020. But now I have the same issue (unrelated to Iotawatt) with my influxdb. It won’t restart. Last time I had to remove the db and start over but will try some other methods.

In any case, Iotawatt is running but it may be a while before I get influx working again. Is there some way to delete the data in iotawatt older than 1 year? I don’t really need that data. Or is there a better method of fixing the log file?

On a side note I’m extremely impressed with how reliable this device has been and how easy it is to debug when there’s a problem!

12

You’re going the wrong way.

influxDB_v1: Start posting at 04/02/21 19:08:30

Can you start it at 04/03/21 please?

13

I will once I get influxdb working

14

Started at 04/03/21 and it’s busy rewriting the data to influx which I had to reinstall.

15

Ok, that should take a few hours. Your unit wasn’t logging much during that restarting period.

Cross your fingers that it completes. Given its three years old and this problem, you do probably want to get an 8GB SDHC card, preferably level 10.

When the upload is done. And you have the card, I’ll walk you though the switch. I think you should be able to retain your history log.

16

Thanks for you help. I’ll replace the card once it’s finished updating. I will note that when I look at the data using the Graph2 page I can see all the data around Apr 2,2021 but I see Request Error when I try and look at data between Aug 3,2020 and Aug 8 for example. I can see data from Jul to Aug but when I try and zoom in on a section I see the Request Error when I zoom in closer.

17

Hmmm. What happens when you try to plot “this month to date”? Can you post a screenshot of the error?

18

Month to date works fine. Around Aug 10,2020 though I get the error shown below. Can’t fit it all in a screenshot but the range is shown as well as the data:

image
image2045×535 66.6 KB

Request error {“range”:[1596965090,1597278515],“labels”:[“Time”,“Sink_Cooktop_Lights”], “data”:[[1596965040,1.6],[1596965640,1.6],[1596966240,1.6],[1596966840,1.6],[1596967440,1.6],[1596968040,1.6],[1596968640,1.6],[1596969240,1.6],[1596969840,1.6],[1596970440,1.6],[1596971040,1.6],[1596971640,1.6],[1596972240,1.6],[1596972840,1.6],[1596973440,1.6],[1596974040,1.6],[1596974640,1.6],[1596975240,1.6],[1596975840,1.6],[1596976440,1.6],[1596977040,1.6],[1596977640,1.6],[1596978240,1.6],[1596978840,1.6],[1596979440,1.6],[1596980040,1.5],[1596980640,1.6],[1596981240,1.6],[1596981840,1.6],[1596982440,1.6],[1596983040,1.5],[1596983640,1.5],[1596984240,1.5],[1596984840,1.5],[1596985440,1.4],[1596986040,1.4],[1596986640,1.4],[1596987240,1.4],[1596987840,1.5],[1596988440,1.4],[1596989040,1.4],[1596989640,1.4],[1596990240,1.5],[1596990840,1.5],[1596991440,1.5],[1596992040,1.5],[1596992640,1.5],[1596993240,1.5],[1596993840,1.5],[1596994440,1.5],[1596995040,1.5],[1596995640,1.4],[1596996240,1.4],[1596996840,1.5],[1596997440,1.4],[1596998040,1.4],[1596998640,1.4],[1596999240,1.4],[1596999840,1.4],[1597000440,1.4],[1597001040,1.4],[1597001640,1.4],[1597002240,1.4],[1597002840,1.4],[1597003440,1.4],[1597004040,1.4],[1597004640,1.4],[1597005240,1.4],[1597005840,1.4],[1597006440,1.4],[1597007040,1.4],[1597007640,1.4],[1597008240,1.5],[1597008840,1.5],[1597009440,1.4],[1597010040,1.4],[1597010640,1.5],[1597011240,1.5],[1597011840,1.5],[1597012440,1.5],[1597013040,1.4],[1597013640,1.4],[1597014240,1.5],[1597014840,1.5],[1597015440,1.5],[1597016040,1.5],[1597016640,1.5],[1597017240,1.5],[1597017840,1.5],[1597018440,1.5],[1597019040,1.5],[1597019640,1.5],[1597020240,1.5],[1597020840,1.4],[1597021440,1.5],[1597022040,1.5],[1597022640,1.5],[1597023240,1.4],[1597023840,1.4],[1597024440,1.4],[1597025040,1.4],[1597025640,1.4],[1597026240,1.4],[1597026840,1.4],[1597027440,1.4],[1597028040,1.4],[1597028640,1.4],[1597029240,1.4],[1597029840,1.4],[1597030440,1.4],[1597031040,1.4],[1597031640,1.4],[1597032240,1.4],[1597032840,1.4],[1597033440,1.4],[1597034040,1.5],[1597034640,1.5],[1597035240,1.5],[1597035840,1.5],[1597036440,1.4],[1597037040,1.5],[1597037640,1.5],[1597038240,1.5],[1597038840,1.5],[1597039440,1.5],[1597040040,1.5],[1597040640,1.6],[1597041240,1.6],[1597041840,1.5],[1597042440,1.5],[1597043040,1.5],[1597043640,1.5],[1597044240,1.5],[1597044840,1.5],[1597045440,1.6],[1597046040,1.6],[1597046640,1.6],[1597047240,1.6],[1597047840,1.5],[1597048440,1.5],[1597049040,1.5],[1597049640,1.6],[1597050240,1.5],[1597050840,1.5],[1597051440,1.5],[1597052040,1.6],[1597052640,1.6],[1597053240,1.6],[1597053840,1.6],[1597054440,1.6],[1597055040,1.6],[1597055640,1.6],[1597056240,1.6],[1597056840,1.6],[1597057440,1.6],[1597058040,1.6],[1597058640,1.6],[1597059240,1.6],[1597059840,1.6],[1597060440,1.6],[1597061040,1.5],[1597061640,1.5],[1597062240,1.5],[1597062840,1.5],[1597063440,1.5],[1597064040,1.5],[1597064640,1.5],[1597065240,1.5],[1597065840,1.5],[1597066440,1.5],[1597067040,1.5],[1597067640,1.5],[1597068240,1.5],[1597068840,1.5],[1597069440,1.5],[1597070040,1.5],[1597070640,1.5],[1597071240,1.4],[1597071840,1.5],[1597072440,1.5],[1597073040,1.5],[1597073640,1.5],[1597074240,1.5],[1597074840,1.4],[1597075440,1.4],[1597076040,1.4],[1597076640,1.4],[1597077240,1.4],[1597077840,1.4],[1597078440,1.4],[1597079040,1.4],[1597079640,1.4],[1597080240,1.4],[1597080840,1.4],[1597081440,1.4],[1597082040,1.3],[1597082640,1.4],[1597083240,1.4],[1597083840,1.4],[1597084440,1.4],[1597085040,1.3],[1597085640,1.4],[1597086240,1.5],[1597086840,1.4],[1597087440,1.4],[1597088040,1.3],[1597088640,1.4],[1597089240,1.4],[1597089840,1.4],[1597090440,1.4],[1597091040,1.4],[1597091640,1.4],[1597092240,1.4],[1597092840,1.4],[1597093440,1.4],[1597094040,1.4],[1597094640,1.4],[1597095240,1.5],[1597095840,1.4],[1597096440,1.4],[1597097040,1.4],[1597097640,1.4],[1597098240,1.5],[1597098840,1.5],[1597099440,1.4],[1597100040,1.4],[1597100640,1.4],[1597101240,1.4],[1597101840,1.4],[1597102440,1.4],[1597103040,1.4],[1597103640,1.5],[1597104240,1.5],[1597104840,1.5],[1597105440,1.5],[1597106040,1.5],[1597106640,1.4],[1597107240,1.5],[1597107840,1.5],[1597108440,1.5],[1597109040,1.5],[1597109640,1.5],[1597110240,1.5],[1597110840,1.5],[1597111440,1.5],[1597112040,1.5],[1597112640,1.5],[1597113240,1.5],[1597113840,1.5],[1597114440,1.5],[1597115040,1.4],[1597115640,1.4],[1597116240,1.3],[1597116840,1.4],[1597117440,1.4],[1597118040,1.4],[1597118640,1.4],[1597119240,1.5],[1597119840,1.5],[1597120440,1.4],[1597121040,1.4],[1597121640,1.5],[1597122240,1.4],[1597122840,1.5],[1597123440,1.5],[1597124040,1.5],[1597124640,1.5],[1597125240,1.5],[1597125840,1.5],[1597126440,1.5],[1597127040,1.5],[1597127640,1.5],[1597128240,1.5],[1597128840,1.5],[1597129440,1.5],[1597130040,1.5],[1597130640,1.5],[1597131240,1.5],[1597131840,1.5],[1597132440,1.5],[1597133040,1.5],[1597133640,1.5],[1597134240,1.5],[1597134840,1.5],[1597135440,1.5],[1597136040,1.5],[1597136640,1.5],[1597137240,1.5],[1597137840,1.5],[1597138440,1.5],[1597139040,1.5],[1597139640,1.5],[1597140240,1.5],[1597140840,1.5],[1597141440,1.5],[1597142040,1.5],[1597142640,1.5],[1597143240,1.5],[1597143840,1.6],[1597144440,1.5],[1597145040,1.5],[1597145640,1.6],[1597146240,1.6],[1597146840,1.5],[1597147440,1.5],[1597148040,1.5],[1597148640,1.5],[1597149240,1.5],[1597149840,1.5],[1597150440,1.4],[1597151040,1.4],[1597151640,1.4],[1597152240,1.5],[1597152840,1.5],[1597153440,1.5],[1597154040,1.5],[1597154640,1.5],[1597155240,1.5],[1597155840,1.5],[1597156440,1.4],[1597157040,1.4],[1597157640,1.4],[1597158240,1.4],[1597158840,1.5],[1597159440,1.4],[1597160040,1.4],[1597160640,1.4],[1597161240,1.4],[1597161840,1.4],[1597162440,1.4],[1597163040,1.4],[1597163640,1.4],[1597164240,1.4],[1597164840,1.4],[1597165440,1.5],[1597166040,1.4],[1597166640,1.4],[1597167240,1.5],[1597167840,1.4],[1597168440,1.4],[1597169040,1.4],[1597169640,1.4],[1597170240,1.4],[1597170840,1.4],[1597171440,1.4],[1597172040,1.4],[1597172640,1.4],[1597173240,1.4],[1597173840,1.4],[1597174440,1.4],[1597175040,1.4],[1597175640,1.4],[1597176240,1.4],[1597176840,1.4],[1597177440,1.4],[1597178040,1.5],[1597178640,1.5],[1597179240,1.5],[1597179840,1.4],[1597180440,1.4],[1597181040,1.4],[1597181640,1.4],[1597182240,1.4],[1597182840,1.4],[1597183440,1.4],[1597184040,1.4],[1597184640,1.4],[1597185240,1.4],[1597185840,1.4],[1597186440,1.4],[1597187040,1.4],[1597187640,1.4],[1597188240,1.4],[1597188840,1.4],[1597189440,1.4],[1597190040,1.3],[1597190640,1.4],[1597191240,1.3],[1597191840,77.4],[1597192440,40.2],[1597193040,1.4],[1597193640,1.4],[1597194240,1.5],[1597194840,1.5],[1597195440,1.4],[1597196040,1.4],[1597196640,1.4],[1597197240,1.4],[1597197840,1.4],[1597198440,1.4],[1597199040,1.5],[1597199640,1.5],[1597200240,1.5],[1597200840,1.5],[1597201440,1.5],[1597202040,1.4],[1597202640,1.5],[1597203240,1.5],[1597203840,1.5],[1597204440,1.5],[1597205040,1.5],[1597205640,1.5],[1597206240,1.5],[1597206840,1.5],[1597207440,1.5],[1597208040,1.5],[1597208640,1.6],[1597209240,1.5],[1597209840,1.5],[1597210440,1.5],[1597211040,1.5],[1597211640,1.5],[1597212240,1.5],[1597212840,1.5],[1597213440,1.6],[1597214040,1.6],[1597214640,1.6],[1597215240,1.6],[1597215840,1.5],[1597216440,1.5],[1597217040,1.6],[1597217640,1.6],[1597218240,1.6],[1597218840,1.6],[1597219440,1.6],[1597220040,1.5],[1597220640,1.5],[1597221240,1.5],[1597221840,1.6],[1597222440,1.6],[1597223040,1.6],[1597223640,1.6],[1597224240,1.6],[1597224840,1.6],[1597225440,1.6],[1597226040,1.6],[1597226640,1.6],[1597227240,1.5],[1597227840,1.5],[1597228440,1.6],[1597229040,1.6],[1597229640,1.5],[1597230240,1.6],[1597230840,1.5],[1597231440,1.6],[1597232040,1.6],[1597232640,1.5],[1597233240,1.5],[1597233840,1.5],[1597234440,1.5],[1597235040,1.5],[1597235640,1.6],[1597236240,1.6],[1597236840,1.6],[1597237440,1.5],[1597238040,1.5],[1597238640,1.5],[1597239240,1.5],[1597239840,1.5],[1597240440,1.5],[1597241040,1.5],[1597241640,1.5],[1597242240,1.5],[1597242840,1.5],[1597243440,1.5],[1597244040,1.5],[1597244640,1.5],[1597245240,1.5],[1597245840,1.4],[1597246440,1.5],[1597247040,1.5],[1597247640,1.4],[1597248240,1.4],[1597248840,1.4],[1597249440,1.4],[1597250040,1.4],[1597250640,1.4],[1597251240,1.5],[1597251840,1.5],[1597252440,1.5],[1597253040,1.5],[1597253640,1.5],[1597254240,1.4],[1597254840,1.4],[1597255440,1.3],[1597256040,1.3],[1597256640,1.4],[1597257240,1.4],[1597257840,1.4],[1597258440,1.4],[1597259040,1.4],[1597259640,1.4],[1597260240,1.4],[1597260840,1.3],[1597261440,1.4],[1597262040,1.4],[1597262640,1.4],[1597263240,1.4],[1597263840,1.3],[1597264440,1.4],[1597265040,1.4],[1597265640,1.4],[1597266240,1.4],[1597266840,1.4],[1597267440,1.4],[1597268040,1.4],[1597268640,1.4],[1597269240,1.4],[1597269840,1.4],[1597270440,1.4],[1597271040,1.4],[1597271640,1.4],[1597272240,1.4],[1597272840,1.4],[1597273440,1.4],[1597274040,1.5],[1597274640,1.4],[1597275240,1.4],[1597275840,1.4],[1597276440,1.4],[1597277040,1.2],[1597277640,0.9],[1597278240,1.1],[1597278480,null]

19

That may be a bug in query. All of the data points are there, it appears to be just malformed json missing a closing bracket.

20

All the errors I saw ended with a null value if that means anything.