Airvantage stops working

I have an issue with the connection to airvantage. My system has been running fine for more than one month. But a few days ago it stopped uploading data to AVMS. I can see the following in the log:

07:42:49 INFO | AirVantage[668]/AirVantage T=main | agent_platform_core_nm.c ConnectionStateHandler() 93 | Network interface '' is not connected 07:43:55 INFO | modemDaemon[633]/le_pa T=main | pa_mrc_qmi.c pa_mrc_GetNetworkRegState() 1471 | called 07:43:56 daemon.info dnsmasq[194]: reading /etc/resolv.conf 07:43:56 daemon.info dnsmasq[194]: using nameserver 192.168.10.30#53 07:43:56 daemon.info dnsmasq[194]: using nameserver 192.168.1.11#53 07:43:59 INFO | dcsDaemon[628]/dataConnectionService T=Data Thread | dcsServer.c AddNameserversToResolvConf() 771 | Set DNS '80.251.201.177' '80.251.201.178' 07:44:04 INFO | AirVantage[668]/AirVantage T=main | agent_platform_core_nm.c ConnectionStateHandler() 93 | Network interface 'rmnet0' is connected 07:44:04 INFO | AirVantage[668]/AirVantage T=main | M3DA-SESSION(default.lua) () 78 | Opening default session #4 07:44:05 INFO | AirVantage[668]/AirVantage T=main | M3DA-SESSION(default.lua) () 92 | Closing default session #4 with status 200. 07:44:05 =ERR= | AirVantage[668]/AirVantage T=main | ASSCON(init.lua) () 179 | Asset ({ "@sys" }) sent an unsupported EMP command (PData) 07:44:05 INFO | AirVantage[668]/AirVantage T=main | RACON-ASSET-TREE(tree.lua) () 272 | Asset tree acknowledges ticket 1319770375 (path:'commands.ReadNode', status:'-1') 07:44:05 =ERR= | AirVantage[668]/AirVantage T=main | ASSCON(init.lua) () 179 | Asset ({ "@sys" }) sent an unsupported EMP command (PAcknowledge) 07:44:05 =ERR= | AirVantage[668]/AirVantage T=main | ASSCON(init.lua) () 157 | Asset ({ "@sys" }) executing (SendData) reports error: '...cal/agent-runtime/lua/agent/devman/cmds/ReadNode.lua:48: BAD_PARAMETER: unsupported EMP command'

In the system I normally have my own application that also uploads some specific data to the AVMS. But I have stopped it and now it is only the default airvantage application running.

If I don’t remember wrong I had a similar issue a few months ago but it was fixed by upgrading to v 15.01 of Legato.

Any ideas what is wrong?

Reinstalling the Legato Framework on the WP7 module solved the problem. But will it happen again in a few months time?

Almost exactly one month since last time the connection to airvantage stopped working again. Exactly the same error shown in the log as last time. I also looked up in the log to initialization part of the airvantage agent and I did see an error there also. As you can see in the log below there is an an error when initializing the DataManagement module. Can anyone help me sort out why this happen within a one month interval. At the moment the only way to recover seems to be to reinstall the legato framework on the WP7104.

08:23:34 INFO | supervisor[1575]/security T=main | proc.c StartProc() 741 | Execing 'agent' 08:23:34 -WRN- | _UNKNOWN_[1575]/framework T=main | mem.c le_mem_ForceAlloc() 663 | Memory pool 'ClientThreadData' overflowed. Expanded to 1 blocks. 08:23:34 INFO | _UNKNOWN_[1575]/<invalid> T=main | clientMain.c InitClient() 30 | Data Connection Service Client is ready. 08:23:34 INFO | AirVantage[1575]/AirVantage T=main | GENERAL(init.lua) () 269 | ************************************************************ 08:23:34 INFO | AirVantage[1575]/AirVantage T=main | GENERAL(init.lua) () 270 | Starting Agent ... 08:23:34 INFO | AirVantage[1575]/AirVantage T=main | GENERAL(init.lua) () 271 | Agent: 11.0-DEV 08:23:34 INFO | AirVantage[1575]/AirVantage T=main | GENERAL(init.lua) () 272 | Lua VM: Lua 5.1.4 (+meta pairs/ipairs) (+patch-lua-5.1.4-3) 08:23:34 INFO | AirVantage[1575]/AirVantage T=main | GENERAL(init.lua) () 273 | System: Linux swi-mdm9x15 3.4.91-yocto-standard #1 PREEMPT Thu Jan 29 01:55:37 EST 2015 armv7l 08:23:34 INFO | AirVantage[1575]/AirVantage T=main | GENERAL(init.lua) () 274 | ************************************************************ 08:23:34 INFO | AirVantage[1575]/AirVantage T=main | GENERAL(init.lua) () 292 | Device ID = "355604050020395" 08:23:34 INFO | AirVantage[1575]/AirVantage T=main | GENERAL(init.lua) () 138 | Module [AssetConnector] initialized 08:23:34 INFO | AirVantage[1575]/AirVantage T=main | SHELL(telnet.lua) () 421 | Binding a shell server at address *, port 2000 08:23:34 INFO | AirVantage[1575]/AirVantage T=main | GENERAL(init.lua) () 138 | Module [Lua Shell] initialized 08:23:34 INFO | AirVantage[1575]/AirVantage T=main | GENERAL(init.lua) () 138 | Module [NetworkManager] initialized 08:23:35 =ERR= | AirVantage[1575]/AirVantage T=main | GENERAL(init.lua) () 136 | Failed to initialize module [DataManagement], err=...vantage/usr/local/agent-runtime/lua/persist/file.lua:270: cannot deserialize: end of string 08:23:35 INFO | AirVantage[1575]/AirVantage T=main | SRVCON(srvcon.lua) () 179 | Server URL = "tcp://eu.airvantage.net:44900" 08:23:35 INFO | AirVantage[1575]/AirVantage T=main | GENERAL(init.lua) () 138 | Module [ServerConnector] initialized 08:23:35 INFO | AirVantage[1575]/AirVantage T=main | ASSCON(init.lua) () 188 | Connection received from asset [table: 0x11cb10] at '<local ipc=table: 0xe15f8>:0' 08:23:35 INFO | AirVantage[1575]/AirVantage T=main | ASSCON(init.lua) () 109 | Asset registered, name="@sys", id=table: 0x11cb10. 08:23:35 INFO | AirVantage[1575]/AirVantage T=main | GENERAL(init.lua) () 138 | Module [DeviceManagement] initialized 08:23:35 INFO | AirVantage[1575]/AirVantage T=main | GENERAL(init.lua) () 138 | Module [ApplicationContainer] initialized 08:23:35 INFO | AirVantage[1575]/AirVantage T=main | GENERAL(init.lua) () 138 | Module [Update] initialized 08:23:35 =ERR= | AirVantage[1575]/AirVantage T=main | GENERAL(init.lua) () 148 | Agent initialization finished with some errors: 08:23:35 =ERR= | AirVantage[1575]/AirVantage T=main | GENERAL(init.lua) () 149 | [DataManagement] failed with ...vantage/usr/local/agent-runtime/lua/persist/file.lua:270: cannot deserialize: end of string

Hi krima919,

I am searching for an explanation to your problems.
In the meantime, could you confirm me that rebooting the device or restarting the airvantage application doesn’t change anything to the problem?
As you mention reinstalling the Legato framework as the only recovery solution, I’m trying to have better understanding of potential root cause.

Regards,

Restart of Airvantage app does not help.
Restart of application framework does not help.
Power cycle the WP7104 does not help.

I needed to have it working tomorrow so today I just installed the Legato framework again and changed the server to eu.airvantage.net and everything is working again.

Hi,

Both logs make me think that there is a configuration file corrupted in the airvantage application.
Is there any other file corruption clue on the device?
Does your device usage imply frequent hardware reboot / power loss?

Regards,

This is running on the WP7104 dev kit. It is powered using the normal power supply used with the dev kit and it is located at my desk in the office. There should be no hardware resets during normal operation. But of course it happens maybe 10 times every month that I manually power cycle the board for different reasons. The last time it stopped working was during the night, at 4 AM. The last time before that was ob a Saturday afternoon. So for sure I did not cut power manually but of course I can’t guarantee that there is power all the time.

I will add some logging in my application to see if there are any unwanted resets.

Now it happened again. Yesterday evening it stopped working. The complete log could be downloaded on the link below. At Jun 24 19:49 it is no longer working. As you can see from the log there is no reset of the system.

https://www.dropbox.com/s/814su0cgbuh23sf/logread.txt?dl=0