July 8, 2017 10:10 am JST

The AR windshield of the future due by the end of the year

More advanced forms of this 'Pokemon Go' tech to reach us around 2020

KAORU KUBONO, Nikkei Automotive staff writer

TOKYO -- Augmented reality, or AR, could be on car windshields by the end of the year.

AR systems are set to become options drivers can choose when buying cars. They can superimpose route indicators, pedestrian alerts and other graphic information in the driver's field of view.

The technology promises safety and convenience enhancements, and is expected to take off around 2020, when more companies are expected to bring products to market.

German autoparts maker Continental is leading the way. This year it plans to mass-produce AR head-up displays -- translucent projections, sometimes referred to as HUDs, that allow pilots or drivers to see information without having to look down -- and market them to European makers of luxury cars.

Japanese rivals plan to market their own AR options around 2020.

In automotive AR, text and images are imposed on a windshield right in the driver's line of sight. Some images can be made to appear relative to actual objects ahead.

The technology is becoming commercially viable thanks to advances in driver assistance systems that use cameras to recognize and map the immediate streetscape around a vehicle. These systems can now appear to "draw" lines right on the road that drivers can follow to their destinations.

The rapid adoption of these cameras has made them more affordable -- and relieved AR developers from having to build their own cameras from scratch, an expensive endeavor.

Automakers, too, are getting into the game. Last year, Germany's BMW unveiled a concept car loaded with AR features. Its system can, for example, impose an image to help the driver see a bicyclist in his blind spot. And the projected images move as the vehicle does.

In Japan, Toyota Motor and Mazda Motor have started to study the possibility of introducing AR for the sake of safety.

As for this year, automotive AR is expected to be limited to simple functions, such as indicating what lane to be in. But in the years ahead, the systems will gain more skills, like imposing images on dangerous obstacles to make the driver more aware.

As self-driving technology advances and drivers are freed from steering, AR may create new business opportunities. One possibility is an automotive version of the "Pokemon Go" smartphone game. Such a game would impose characters on windshields to make the journey somewhat adventurous. Another possibility -- displaying ads from stores and other businesses a car is about to approach.

Automakers believe the leading AR technology companies stand a chance to gain a strong position in the automotive industry as they will obviate the need for all the gauges and displays on the dashboards of today.

The companies gunning for this kind of leverage include Continental, Denso and Nippon Seiki. Meanwhile, Konica Minolta and Pioneer are trying to enter the field by tweaking proprietary technologies.

Continental's technology combines a conventional HUD and a monocular camera originally developed for driver assistance systems. With the camera, the system can detect lane dividing lines and the vehicle ahead, then superimpose graphics accordingly.

It uses arrows to guide the driver along the shortest route to his or her destination. In addition, it can impose lines on the vehicle ahead to indicate that the adaptive cruise control is engaged and the system is following that particular vehicle. It can also show a dotted line on the road between the driver's car and the one ahead to help the driver keep a safe distance.

In a prototype system, graphic images are made to appear as though they are 7.5 meters ahead of the driver's eyes. Information that is not directly related to the driver's view, such as speed, appears 2.4 meters ahead. This is the same as on conventional HUDs.

The images that seem to be imposed on objects are produced using a digital micromirror -- a device composed of a large number of tiny mirrors arrayed on a flat surface, each mirror representing a single pixel on a computer display. By changing the angle of the individual mirrors, the device can reflect light from a source so as to form desired images in specific locations.

Images created by this device are then magnified as they bounce off multiple concave mirrors set up behind the dashboard until finally they are projected onto the windshield.

Drivers need only keep their eyes on the AR-enhanced road ahead.

This story has been reorganized from an article originally carried in the June 2017 issue of Nikkei Automotive.

Toyota Motor Corp.

Japan

Market(Ticker): TKS(7203)
Sector:
Industry:
Consumer Durables
Motor Vehicles
Market cap(USD): 179,114M
Shares: 3,263M

Mazda Motor Corp.

Japan

Market(Ticker): TKS(7261)
Sector:
Industry:
Consumer Durables
Motor Vehicles
Market cap(USD): 8,586.93M
Shares: 599.87M

DENSO Corp.

Japan

Market(Ticker): TKS(6902)
Sector:
Industry:
Producer Manufacturing
Auto Parts: OEM
Market cap(USD): 34,274.5M
Shares: 794.06M

Nippon Seiki Co., Ltd.

Japan

Market(Ticker): TKS(7287)
Sector:
Industry:
Producer Manufacturing
Auto Parts: OEM
Market cap(USD): 1,208.87M
Shares: 60.90M

Konica Minolta, Inc.

Japan

Market(Ticker): TKS(4902)
Sector:
Industry:
Electronic Technology
Electronic Equipment/Instruments
Market cap(USD): 4,373.54M
Shares: 502.66M

Pioneer Corp.

Japan

Market(Ticker): TKS(6773)
Sector:
Industry:
Consumer Durables
Electronics/Appliances
Market cap(USD): 717.09M
Shares: 372.22M

Get Insights on Asia In Your Inbox

To read the full story, Subscribe or Log in

Get your first month for $0.99

Redeemable only through the Subscribe button below

Once subscribed, you can…

  • Read all stories with unlimited access (5 articles per month without subscription)
  • Use our smartphone and tablet apps

To read the full story, Subscribe or Log in

3 months for $9
SUBSCRIBE TODAY

Take advantage of this limited offer.
Subscribe now to get unlimited access to all articles.

To read the full story, Update your account

We could not renew your subscription.
You need to update your payment information.

To read the full story, Subscribe or Log in

Once subscribed, you can…

  • Read all stories with unlimited access (5 articles per month without subscription)
  • Use our smartphone and tablet apps

To read the full story, Subscribe or Log in

3 months for $9
SUBSCRIBE TODAY

Take advantage of this limited offer.
Subscribe now to get unlimited access to all articles.

To read the full story, Update your account

We could not renew your subscription.
You need to update your payment information.