Potential in the application of fast data in various fields

During 4.0 Industry, companies are investing more in collecting and generating data from Internet of Things (IoT) networks. The development of 5G networking technology, artificial intelligence (AI), and machine learning leads to the faster advancement of fully automated smart factories, smart cities, autonomous vehicles, and other fields.

Potential in the application of fast data in various fields

Fast Data is the amount of data collected, transmitted and processed in real time from many sources, including: mobile devices, sensors, surveillance cameras. The number of sources can be up to hundreds, even millions of different devices. The characteristics of Fast Data are low data volume but fast processing, low latency and continuous.

Applications and software play an important role in optimizing the ability to analyze and process Fast Data. In addition, the selection of hardware and storage devices must match the requirements of speed, latency, reliability, and can operate in harsh conditions and environments.

Fast Data currently has potential applications in two main areas: autonomous vehicles and drones.

Autonomous vehicles

Autonomous vehicle systems require high performance and efficient management of large amounts of high-speed data from sensors, infotainment systems, operating systems, and maps. Sensor data will make up the largest portion of in-vehicle data storage, with most data coming from advanced driver assistance systems (ADAS) and vehicle-to-environment communication (V2X).

Some of the space will be for multimedia entertainment, games, voice AI applications, and other features. In addition, the "black box" will become a legal and safety requirement by regulatory authorities.

Autonomous vehicles

Unlike current 2D navigation maps, high definition (HD) maps differ greatly in update rate, positioning method, and amount of data collected. Due to the high frequency of data updates, HD maps often use real-time online updates via 5G mobile networks. Map includes static layer, semi-static layer, semi-dynamic layer and dynamic layer; The base static class updates monthly or as needed.

Storage solutions using nand flash play an important role in autonomous vehicle systems, providing storage, quick start-up and data storage to record important events, store AI models and HD maps. The system will need to process a lot of data with high speed and reliability as the car becomes smarter.

Drone

With an average flight time of around 30 minutes, the amount of new save data created can be as little as 150 GB. With high resolution maps, 3D modeling and AI integration will generate more data.

MicroSD cards are still the primary storage device in the drone. However, in order to provide more storage capacity and speed, some specialized flying devices are implementing integrated eMMC, UFS, and even SSD storage for some special purposes.

Drone

AI-powered drones with more autonomy and longer flight distances in the future will require more storage capacity. Accompanied by requirements for enhanced HD map navigation, higher resolution captured data (video, 4K images) and other data.

Fast Data storage solution of the future

In the above two applications, as well as in other real-time data analysis fields, the gap between storage devices and computing and data analysis is tending to establish closer together, even local storage right on that device.

In addition to standard storage types such as embedded nand flash memory, memory cards, and SSDs, certain units use storage solutions that are larger in scale, faster in capacity, and faster in speed. A good example is the WD Ultrastar Data24 storage using NVMe-over-Fabric (NVMe-oF) technology. This is a high-speed storage system with a capacity of up to 368 TB that is directly connected to edge servers for real-time storage and analysis of Fast Data.

Data has a lot of potential in the future. Most organizations are looking for ways to collect and create more value from it, including a combination of people and machines. Storage infrastructure is the part that helps to leverage the value of data. Choosing the right storage equipment and solutions will help optimize investment and operating costs, and open up new business opportunities.

In particular, NVMe-oF technology is considered as the Fast Data storage solution of the future.