Apple's on-board real-time AR navigation system exposure, AR navigation is the use of windshield rendering

The basic vehicle AR has long been integrated into daily life, such as when reversing, the screen displayed on the car screen helps the driver reversing.

There are other manufacturers of automotive AR, such as the Mercedes-Benz AR windshield can display information on the road conditions, dashboard, speed and other information on the glass, but also supports gesture recognition, can maximize the safety of driving.

There are HUDs that were very hot last year.

And Apple's AR car technology is not so primitive, but the real-time AR navigation system.

Recently, Apple patented a car-mounted AR navigation system that was submitted in 16 years. Apple’s AR navigation is based on windshields. Not only front windscreens, but also sideways and back glass are available. AR function.

Through Apple's on-board AR navigation, it is possible to clearly understand the objects or people on the route and route that may influence, and let Xiaobai An, who is new to the road, drive his car.

So now take a look at this AR navigation system with Marmalade.

Firstly, LiDAR (laser detection and measurement, a technology that uses GPS and airborne laser scanning to establish 3D models) and depth sensors collect information from each point, and all collected data are called point clouds and collected data points. Include the depth, direction, height, and color of the point scanned by the surface of the object in the local area.

Then the 3D model of the environment is constructed from the point cloud data and compared with the environment. Because the measurement of the on-board sensor is always limited, the environment cannot be completely recognized, for example, it is blocked. By identifying the surface and surface normals of the 3D model and then integrating them into the environment, we can get the correct image of the entire environment.

Therefore, when the route is blocked by the object, it can also recognize the road. And it is displayed behind the blockage.

For example, the road behind the endless mountains.

Or it is an uphill road blocked by other buildings.

It is also possible to identify the location and direction of travel and speed of other vehicles via the GPS network and display them.

This point is extremely useful in big corners. For example, on the mountain road, the big bend is the most fearful. Through this technology, you can rest assured.

(However, involving the leakage of personal information, it cannot be said whether it will actually be implemented.)

The basic principle is finished, but the real driving environment is very complicated. How to properly collect information under complex environmental conditions and pass the information to the driver correctly is a problem that must be considered.

The first is the problem of how to collect information in a complex environment, such as haze, heavy snow, heavy rain, and darkness, or if you have not cleaned it for too long, the sensor is covered with dust. At this time, the usefulness of 3D modeling is demonstrated. Through the collection of a large number of real-world images, the system will generate 3D data in advance because the environment will not change, and all the sensors need to identify the information is greatly reduced, and the data is extracted. When extracted directly from 3D data, and 3D data is faster than point cloud data, there is also information that point cloud data does not have, such as 3D meshes, textures, and other geometric information. This complements the missing AR information.

Moreover, 3D data can also be used as a guide for point data queries to narrow the scope of the query. Through these functions, the system can query a large number of point data in real time. It also makes it possible to identify other vehicle speeds, accelerations, and turns in real time.

The 3D data of the surrounding environment is also generated in advance by the direction in which the vehicle is traveling.

The average person in the car has a must-have weapon - sunglasses, to help us see the road in the glare of the sun. By recognizing the direction and intensity of sunlight, the system will adjust the AR light transmittance and position to make the driver see clearly.

In addition to the fact that the sensor recognizes the intensity of sunlight, the patent also mentions that the sun intensity can be calculated by geography method through the time and altitude of the GPS. (Can only explain this way, the geographical knowledge of the ball sauce stopped in high school)

Or when the AR information needs to be projected in the blue sky, the system will recognize the color and change the color of the AR into a more contrasting color, such as red. This is also true for other objects.

At the same time, in the frequently-traveled route (for example, off-duty), the past driving data will be recorded for reference.

As mentioned in the patent, the system is not limited to the category of cars. Cars, trucks, motorcycles, buses, even trains, and high-speed trains are also available. At this stage, trains and high-speed trains traveling at high speeds are used to prevent collisions. It is judged by the command of the control center and the signal lights on the railway. It is a good choice through this AR system.

Aircraft, helicopters, and ships can also use this system.

And the system is also suitable for smart phones, notebooks, headsets or glasses, helmets, goggles. Very flexible.

Apple's AR navigation patent can be said to take into account most of the road conditions and gives a good solution.

However, a problem does not give a solution. The windshield is an irregular surface, and the design of the vehicle itself, such as wind resistance, wiper, and aesthetics, will not change. Irregular surfaces can cause serious distortion. How to make the picture quality and stable is not solved in this patent. Perhaps in another Apple patent.

PVC Trunking

Pvc Trunking,Pvc Cable Trunking,Plastic Cable Trunking,Pvc Electrical Trunking

FOSHAN SHUNDE LANGLI HARDWARE ELECTRICAL CO.LTD , https://www.langliplastic.com