When it comes to folding in the folding screen mobile phone, many people will naturally focus on the hinge axis, but in fact, there are sensors that can make the phone interact and experience changes between folding and folding. As long as a little review of the development of smart phones can be found, gravity sensing, light sensing, gyroscope, pressure sensing and other sensor modules can be described as a step by step to achieve the improvement of interactive experience.
At the recent ST Sensor Conference 2023, a slide revealed how the folding screen uses sensors to achieve clamshell detection, the principle is to use two accelerometers to calculate the opening and closing Angle, while detecting whether the device is in a shaking or vertical state. The LSM6DSV16X ST solution not only combines accelerometer data with data provided by the gyroscope, but also fuses the data into embedded sensor fusion algorithms.
Many operations that seem to come easily in daily use are inseparable from the perception of sensors.
Sensors that revolutionize interaction
For example, vAFE, which is constantly opening up new application areas, can realize the perception of the hand held by the user of a mobile phone or camera. In the real wireless headset, it can also detect whether it is worn into the ear, helping to realize the operation of touch and long press. In wearable devices, movement tracking is possible. It can also help achieve energy savings in iot devices.
Smart glasses that are preparing for generation also need the help of sensors, and ST provides integrated solutions for smart glasses that integrate MEMS and image sensors for motion status tracking and gesture recognition, Bluetooth communication, and wireless charging functions. In addition, in the increasingly digitalized automobile, the DMS solution of a single LED light cooperated by ST and SmartEye realizes the monitoring of tired driving and ensures the safety of travel.
The cooperation between STMicroelectronics and PISON will even subvert the interaction of all devices in the future. The two sides are realizing the prediction of the brain through the perception of nerves. With the help of ST's ENG sensor and PISON's machine learning algorithm, the prediction of the first 30-80ms of the action intention can be realized. In the future, people may only need a definite idea of a device to get corresponding interactive feedback.
Age of online life
Today's online life is mirrored by the vast number of sensors that are woven throughout our lives. Davide Bruno, Vice President of Marketing and Applications for MEMS and Image Sensor Sub-products and head of the Smartphone Innovation Center at ST Asia Pacific Simulator, MEMS and Sensor Products (AMS), believes that humans have actually experienced three different eras, namely the offline era and the online era. And the online life we live in today. The age of online life is also the age of the explosion of sensors and cloud connectivity.
"In the age of online living, our sensors are no longer used as traditional passive components or devices." Davide Bruno says sensors are not limited to sensing and reading signals from the surrounding environment, but need to improve overall system performance and reduce energy consumption in more operating models with high accuracy.
Taking many sports watches as an example, it not only provides real-time data detection, but also regularly uploads these data to the device and the cloud for integrated analysis to provide users with real-time reference information. While obtaining and monitoring these data, it is also necessary to ensure that the battery life of the wearable device with limited battery capacity is not affected, and at the same time, it is necessary to allow users to ensure a smooth experience through sufficient performance during use. At present, ST has achieved the forefront of the market in the field of battery life of other wearable devices such as smart watches, so that smart phones say goodbye to power anxiety.
In summary, wisdom, safety and precision are the three important elements in today's online life era, and ST also integrates these characteristics into its products.
Opening new doors for edge AI
Today's intelligent imaging field can be described as an effective example of accelerated edge AI empowerment, the path recognition of sweeping robots, the gesture operation of emerging electronic devices, the face recognition of smart phones, and the control of XR devices are inseparable from the dual blessing of sensors and AI.
The combination of AI and sensors enables data processing in smart sensors, smart nodes, and smart gateways, resulting in lower latency, reduced dependence on network transmission, and lower power consumption, and because the data is analyzed locally, it also avoids the risk of leakage of sensitive data and privacy.
STMicroelectronics is helping customers move into the field of artificial intelligence, and ISPU can help implement its own neural network side, including solutions based on its own artificial intelligence algorithms. At the same time, vAFE opens a new door for AI to interconnect with external sensors, and customers can effectively connect ISpus or other sensors through vAFE.
"We will do our best to make smart sensors more powerful and allow more data to be processed efficiently at the sensor layer." Francesco Bianchi, product market manager for MEMS sensors at ST.
In order to ensure low cost and low power consumption while implementing edge AI, ST also provides customers with a large number of neural network models (STM32 AI Model Zoo), and has been optimized for edge AI products, microcontrollers, sensors, and can help customers find the best edge AI model. "We've covered a lot of application use cases in our Model Zoo, and customers can learn from them." Davide Bruno.
About US
Heisener Electronic is a famous international One Stop Purchasing Service Provider of Electronic Components. Based on the concept of Customer-orientation and Innovation, a good process control system, professional management team, advanced inventory management technology, we can provide one-stop electronic component supporting services that Heisener is the preferred partner for all the enterprises and research institutions.
