Blog 2Smart (EN)

Collection and analysis of statistics - a useful tool for product improvement

Tools for device performance analysis
It has been several weeks since assembling a small series of our own devices (Wi-Fi relays). During this time, the simple firmware based on ESPHome was replaced with a more advanced Custom version based on the 2Smart Cloud platform SDK toolkit. The ability to update Custom firmware over the air was put to the test.

The devices were used by the creator's friends and colleagues, each of whom found their use for the smart relay. One of them connected a house lamp to it and controlled the lighting with voice commands. Another one installed a relay on a power strip and controlled the power of devices connected to the strip through a mobile app. (E.g. charging a smartphone or a laptop).  Lastly, one person connected an oil cooler to a relay to remotely turn on the heating when coming home from work in the evening.

After collecting the data of device usage by the real users, we decided to analyze it using the built-in analytics tools of the 2Smart Cloud platform.

Statistics of the vendor device usage

It was already possible to see the following device statistics on the main screen of the vendor's cabinet:

  • The total number of devices.
  • The number of devices in online/offline status.
  • The number of connected devices for each created product.

General statistics of vendor devices on the main screen

More detailed data is available in charts and tables in the "Statistics" section.

The usage statistics for a particular product can be viewed from the product's settings screen by clicking on the "Open Statistics" link.

Link to product statistics on the settings screen

Number of devices by date

It was fascinating to see how the number of devices being used increased once the author's friends received them as gifts.

Statistics of the number of devices by date

The number of devices of the required version by date

In this section, it is convenient to control how quickly the firmware of the devices is updated after the release of a new version. Four active relay users had the new firmware version a mere 24 hours after the update was uploaded to the platform. One user was still away from home and has disabled the relay. Its update should come right after returning when the device is powered on and connected to the Internet.

Statistics of the number of devices of the required version by date

The number of devices in each version as of now

The following screen shows how many users are using the current version of the firmware at moment.

The statistics are thoroughly detailed and show how many devices with the current firmware are active, and how many are disabled.

Statistics of the number of devices of the required version by date

The number of users with devices

Per our example, the graph on the next screen is almost identical to the graph on the screen showing the number of devices. Each user controls one Wi-Fi relay, but once we offer our colleagues different devices, the statistics will change.

Statistics showing the number of users with devices

Relay user feedback

The best feedback one can receive on the usefulness of the device is, of course, the statistics in the vendor's cabinet. None of the friends and colleagues accepted the gift just out of politeness and then put it on the shelf to collect dust. Everyone uses the relay regularly, which the charts and tables show us brilliantly.

In a personal conversation, users noted the usability of different options for controlling the relay. Some people use only the mobile app, and that's more than enough. For example, to switch on the oil radiator in the room with a relay when they come home from work. By the time of arrival, the room is already warmed up and with the absence of people, electricity is not consumed for heating.

Others made use of voice commands to control relays. E.g. to turn off a house lamp before bed.

One user showed great interest in the Telegram bot. The desktop version of the messenger app is always open on a laptop while working. It turns the charging of the same laptop on and off, practically without interrupting any work-time.

Considering that the vendor has no need to do anything to make these methods of managing IoT devices functional and they work “out of the box”, the choice of using the 2Smart Cloud platform should be considered a success.

This experience even makes one think about optimizing the process of producing smart relays and setting up mass production as a small business.

All articles about IoT device creation and support

  1. Learn your way around the IoT platform – create your first device and control it from your smartphone without an MCU
  2. How to create a Wi-Fi switch to control via a mobile app and Telegram bot
  3. 4 stages of using the platform to create a new IoT device
  4. How to create an IoT device on a printed circuit board and take it from prototype to finished product
  5. How to write firmware for an IoT device based on an SDK
  6. How to update the firmware and mobile application of ready-made devices within 5 minutes
  7. Collection and analysis of statistics – a useful tool for product improvement
Made on