Head-up display

A head-up display, or HUD, is any transparent display that presents data without requiring the user to look away from his or her usual viewpont. The origin of the name stems from the user being able to view information with their head "up" and looking forward, instead of angled down looking at lower instruments.

Although they were initially developed for military aviation, HUDs are now used in commercial aircraft, automobiles, and other applications.

History

The first HUDs were essentially advancements of static gun sight technology for military fighter aircraft. Rudimentary HUDs simply projected a “pipper” to aid aircraft gun aiming. As HUDs advanced, more (and more complex) information was added. HUDs soon displayed computed gunnery solutions, using aircraft information such as airspeed and angle of attack, thus greatly increasing the accuracy pilots could achieve in air to air battles.

In Great Britain, it was soon noted that pilots flying with new gun-sights were becoming better at piloting their aircraft.Fact|date=September 2008 At this point, the HUD expanded its use beyond a weapon aiming instrument into a piloting tool. In the 1960s, French test-pilot Gilbert Klopfstein created the first modern HUD, and a standardized system of HUD symbols so that pilots would only have to learn one system and could more easily transition between aircraft. 1975 saw the development of the modern HUD to be used in instrument flight rules approaches to landing.Spitzer, Cary R., ed. "Digital Avionics Handbook." Head-Up Displays. Boca Raton, FL: CRC Press, 2001.] Klopfstein pioneered HUD technology in military fighter jets and helicopters, aiming to centralize critical flight data within the pilot's field of vision. This approach sought to increase the pilot’s scan efficiency and reduce “task saturation” and information overload.

In the 1970s, the HUD was introduced to commercial aviation. [Pope, Stephen. "The Future of Head-Up Display Technology." Aviation International News. Jan. 2006. 12 February 2007 [http://www.ainonline.com/Issues/01_06/01_06_future_60.htm] ]

In 1988, the Oldsmobile Cutlass Supreme became the first production car with a head-up display. ["Oldsmobiles Pace "the Race"" Oldsmobile Club of America. 2006. 12 February 2007 [http://www.oldsclub.org/History/PaceCars/IndyOldsPaceCars.htm#1988%20Oldsmobile%20Cutlass%20Supreme] ]

Until a few years ago, the Embraer 190 and Boeing 737 New Generation Aircraft (737-600,700,800, and 900 series) were the only commercial passenger aircraft to come with an optional HUD. Now, however, the technology is becoming more common with aircraft such as the Canadair RJ, Airbus A318 and several business jets featuring the device. Furthermore, the Airbus A320, A330, A340 and A380 families are currently undergoing the certification process for a HUD. [ [http://www.airbus.com/en/presscentre/pressreleases/pressreleases_items/07_12_03_a318_hud.html Airbus A318 approved for Head Up Display ] ]

Types

There are two types of HUD. Fixed HUDs require the user to look through a display element attached to the airframe or vehicle chassis. The system determines the image to be presented depending solely on the orientation of the vehicle. Most aircraft HUDs are fixed. Helmet mounted displays (HMD) are technically a form of HUD, the distinction being that they feature a display element that moves with the orientation of the user's "head" vice the airframe. Many modern fighters (such as F/A-18, F-22, Eurofighter) use both a HUD and an HMD concurrently. The F-35 Lightning II was designed without a HUD, relying solely on the HMD, making it the first modern military fighter not to have a fixed HUD.

Factors

There are several factors that engineers must consider when designing a HUD:

*field of vision - Since a person’s eyes are at two different points, they see two different images. To prevent a person’s eyes from having to change focus between the outside world and the display of the HUD, the display is "Collimated" (focused at infinity). In automobiles the display is generally focused around the distance to the bumper.

*eyebox - displays can only be viewed while the viewer’s eyes are within a 3-dimensional area called the Head Motion Box or “Eyebox”. Modern HUD Eyeboxes are usually about 5 by 3 by 6 inches. This allows the viewer some freedom of head movement. It also allows the pilot the ability to view the entire display as long as one of his eyes is inside the Eyebox.

*luminance/contrast - displays must be adjustable in luminance and contrast to account for ambient lighting, which can vary widely (e.g., from the glare of bright clouds to a moonless night approach to a minimally lit field).

*display accuracy - aircraft HUD components must be very precisely aligned with the aircraft's three axes – a process called boresighting – so that displayed data conforms to reality typically with an accuracy of ±7.0 milliradians. Note that in this case the word "conform" means, "when an object is projected on the combiner and the actual object is visible, they will be aligned." This allows the display to show the pilot exactly where the artificial horizon is, as well as the aircraft’s projected path with great accuracy. When Enhanced Vision is used, for example, the display of runway lights must be aligned with the actual runway lights when the real lights become visible. Boresighting is done during the aircraft's building process and can also be performed in the field on many aircraft. Newer micro-display imaging technologies are being introduced, including liquid crystal display (LCD), liquid crystal on silicon (LCoS), digital micro-mirrors (DMD), and organic light-emitting diode (OLED).

*installation - installation of HUD components must be compatible with other avionics, displays, etc.

Components

A typical HUD contains three primary components: A Combiner, the Projector Unit, and the video generation computer.

Combiner

The combiner is the part of the unit which is located directly in front of the pilot. It is the surface onto which the information is projected so that the pilot can view and use it. On some aircraft the combiner is concave in shape and on others it is flat. It has a special coating that reflects the monochromatic light projected onto it from the Projector Unit while allowing all other wavelengths of light to pass through. On some aircraft it is easily removable (or can be rotated out of the way) by aircrew.

Projection Unit

The Projection Unit projects the image onto the combiner for the pilot to view. In the early days of HUDs, this was done through refraction, although modern HUDs use reflection. The projection unit uses a Cathode Ray Tube, light emitting diode, or liquid crystal display to project the image. Projection Units can be either below (as with most fighter aircraft) or above (as with transport/commercial aircraft) the combiner.

Video generation computer

The computer is usually located with the other avionics equipment and provides the interface between the HUD (i.e. the projection unit) and the systems/data to be displayed. On aircraft, these computers are typically dual independent redundant systems. They receive input directly from the sensors (pitot-static, gyroscopic, navigation, etc.) aboard the aircraft and do their own computations rather than receiving previously computed data from the flight computers. Computers are integrated with the aircraft's systems and allow connectivity onto several different data buses such as the ARINC 429, ARINC 629, and MIL-STD-1553.

Symbology

Typical aircraft HUDs display airspeed, altitude, a horizon line, heading, turn/bank and slip/skid indicators. These instruments are the minimum required by [http://www.airweb.faa.gov/Regulatory_and_Guidance_Library/rgFAR.nsf/MainFrame?OpenFrameSet 14 CFR Part 91.]

Other symbols and data are also available in some HUDs.
*boresight or waterline symbol - is fixed on the display and shows where the nose of the aircraft is actually pointing.

*flight path vector (FPV) or velocity vector symbol - shows where the aircraft is actually going, the sum of all energies acting on the aircraft. [ "Forces in a Climb" NASA Glenn Research Center [http://www.grc.nasa.gov/WWW/K-12/airplane/climb.html] ] For example, if the aircraft is pitched up but is losing energy, then the FPV symbol will be below the horizon even though the boresight symbol is above the horizon. During approach and landing, a pilot can fly the approach by keeping the FPV symbol at the desired descent angle and touchdown point on the runway.

*acceleration indicator or energy cue - typically to the left of the FPV symbol, it is above it if the aircraft is accelerating, and below the FPV symbol if decelerating.

Since being introduced on HUDs, both the FPV and acceleration symbols are becoming standard on head-down displays (HDD). The actual form of the FPV symbol on an HDD is not standardized but is usually a simple aircraft drawing, such as a circle with two short angled lines, (180 ± 30 degrees) and "wings" on the ends of the descending line. Keeping the FPV on the horizon allows the pilot to fly level turns in various angles of bank.

*angle of attack indicator - shows the wing's angle relative to the airmass, often displayed as "α".

*navigation data and symbols - for approaches and landings, the flight guidance system can provide visual cues based on navigation aids such as an Instrument Landing System or augmented Global Positioning System such as the Wide Area Augmentation System. Typically this is a circle which fits inside the flight path vector symbol. By "flying to" the guidance cue, the pilot flies the aircraft along the correct flight path.

Military aircraft specific applications

In addition to the generic information described above, military applications include weapons system and sensor data, such as:
*target designation (TD) indicator - places a cue over an air or ground target (which is typically derived from radar or inertial navigation system data).

*V_c - closing velocity with target.

*Range - to target, waypoint, etc.

*Launch Acceptability Region (LAR) - displays when an air-air or air-ground weapon can be successfully launched to reach a specified target.

*weapon seeker or sensor line of sight - shows where a seeker or sensor is pointing.

*weapon status - includes type and number of weapons selected, available, arming, etc.

V/STOL approaches and landings

During the 1980s, the military tested the use of HUDs in vertical take off and landings (VTOL) and short take off and landing (STOL) aircraft. A HUD format was developed at NASA Ames Research Center to provide pilots of V/STOL aircraft with complete flight guidance and control information for Category-IIIC terminal-area flight operations. These flight operations cover a large spectrum, from STOL operations on land-based runways to VTOL operations on aircraft carriers. The principal features of this display format are the integration of the flightpath and pursuit guidance information into a narrow field of view, easily assimilated by the pilot with a single glance, and the superposition of vertical and horizontal situation information. The display is a derivative of a successful design developed for conventional transport aircraft. [Merrick, Vernon K., Glenn G. Farris, and Andrejs A. Vangas. “A Head Up Display for Applicatoin to V/STOL Aircraft Approach and Landing.” NASA Ames Research Center 1990.]

Civil aircraft specific applications

The use of head-up displays allows commercial aircraft substantial flexibility in their operations. Systems have been approved which allow reduced-visibility takeoffs and landings, as well as full Category IIIc landings. [ORDER: 8700.1 APPENDIX: 3 BULLETIN TYPE: Flight Standards Handbook Bulletin for General Aviation (HBGA) BULLETIN NUMBER: HBGA 99-16 BULLETIN TITLE: Category III Authorization for Parts 91 and 125 Operators with Head-Up Guidance Systems (HGS); LOA and Operations EFFECTIVE DATE: 8-31-99 [http://www.faa.gov/library/manuals/examiners_inspectors/8700/hbga/media/hbga9916.doc] (Document)] [ Falcon 2000 Becomes First Business Jet Certified Category IIIA by JAA and FAA; Aviation Weeks Show News Online September 7, 1998 ] [ Design Guidance for a HUD System is contained in Draft Advisory Circular AC 25.1329-1X, "Approval of Flight Guidance Systems" dated 10/12/2004 [http://www.airweb.faa.gov/Regulatory_and_Guidance_Library/rgDAC.nsf/0/650d5669656fd15086256eeb0066a6cf?OpenDocument] ] Studies have shown that the use of a HUD during landings decreases the lateral deviation from centerline in all landing conditions although the touchdown point along the centerline is not changed. [ HUD With a Velocity (Flight Path) Vector Reduces Lateral Error During Landing in Restricted Visibility; International Journal of Aviation Psychology, 2007, Vol. 17 No 1, pages 91-108 ]

The image to the right, of a HUD in a NASA Gulfstream V, shows several different HUD elements, including the combiner in front of the pilot. The green 'glare' in the lower right corner of the combiner is a result of backscatter of off-axis light from the projection unit, as well as reflection from ambient light in the flight deck. Because the combiner has a pronounced vertical and horizontal curve to help focus the image, compensation is applied to the display symbols so they appear flat when projected onto the curved surface. When not in use, this combiner can swing up and lock in a stowed position.

The Projector Unit in the Gulfstream GV image would be directly above the pilot's head. In smaller aircraft the design of the projection unit can present interesting spacing and placement issues, as room has to be left for the pilot not only when normally seated but during turbulence and when getting in and out of the seat.

= Enhanced Flight Vision Systems, EFVS =

In more advanced systems, such as the FAA-labeled Enhanced Flight Vision System, DOT Docket FAA-2003-14449-45 [http://dms.dot.gov/search/document.cfm?documentid=343133&docketid=14449] Enhanced Flight Vision Systems. ] a real-world visual image can be overlaid onto the combiner. Typically an infrared camera (either single or multi-band) is installed in the nose of the aircraft to display a conformed image to the pilot. In one EVS Enhanced Vision System is an industry accepted term which the FAA decided not to use because "the FAA believes would be confused with the system definition and operational concept found in 91.175(l) and (m) installation, the camera is actually installed at the top of the vertical stabilizer rather than "as close as practical to the pilots eye position." When used with a HUD however, the camera must be mounted as close as possible to the pilots eye point as the image is expected to "overlay" the real world as the pilot looks through the combiner. "Registration" or the accurate overlay of the EVS image with the real world image is one feature closely examined by the authorities prior to approval of a HUD based EVS. When the pilot is coming in for a landing and "sees" the runway and runway lights through the EVS display, it is really a good thing when they come out under the clouds and the real world runway is right where the camera said it was as the pilot has a very short period of time to (a) take in the reality of "what is displayed is not what is real" (b) decide that action needs to be taken (c) take action and (d) allow the airplane some time to respond. During the design of such a system, the supplier would perform a safety analysis to determine the consequences of "EFVS Image not aligned with real world at or below decision height." Using regulatory guidance (FAA Advisory Circular 25.1309-1A [http://www.airweb.faa.gov/Regulatory_and_Guidance_Library/rgAdvisoryCircular.nsf/ACNumber/50BFE03B65AF9EA3862569D100733174?OpenDocument] for example) this would be initially evaluated as a Major hazard [There are typically five hazard categories Catastrophic - loss of life cannot be prevented; Hazardous - loss of life cannot be prevented except with exceptional skill or intervention; Major - loss of life or injury can be prevented if everything goes as planned; Minor - within the expected abilities and training of crews to handle; and No Effect - customer satisfaction is not a concern of safety. ] where if it does occur the design community anticipates that the flight crew will be able to take the appropriate action. The pilot may choose to initiate a missed approach (climb immediately and then figure out what to do because altitude and speed are your friend when trying to deal with "unexpected events") or perhaps to immediately blank the HUD/EVS display (typically there is a thumb switch on the control column for exactly this circumstance) and continue the landing using what can be seen through the window.

While the EVS display can greatly help, the FAA has only "relaxed" operating regulations [14 CFR Part 91.175 change 281 "Takeoff and Landing under IFR"] where an aircraft with EVS operating can perform a CATEGORY I [http://en.wikipedia.org/wiki/Instrument_Landing_System#ILS_categories] approach to CATEGORY II minimums. In all other cases the flight crew must comply with all "unaided" visual restrictions. (For example if the runway visibility is restricted because of fog, even though EVS may provide a clear visual image it is not appropriate (or actually legal) to maneuver the aircraft using only the EVS below 100' agl.)

= Synthetic vision systems, SVS =

HUD systems are also being designed to utilize a synthetic vision system (SVS), which use terrain databases to create a realistic and intuitive view of the outside world. [ Part 23 Synthetic Vision Approval Approach; FAA Synthetic Vision Workshop, Lowell Foster, February 14, 2006. [http://www.faa.gov/aircraft/air_cert/design_approvals/transport/media/Pt23ApproachSlides.pdf] ] [For additional information see Evaluation of Alternate Concepts for Synthetic Vision Flight Displays with Weather-Penetrating Sensor Image Inserts During Simulated Landing Approaches, NASA/TP-2003-212643 [http://techreports.larc.nasa.gov/ltrs/PDF/2003/tp/NASA-2003-tp212643.pdf] ] [No More Flying Blind, NASA [http://www.nasa.gov/vision/earth/improvingflight/svs_reno.html] ]

In SVS image to the right, immediately visible indicators include the airspeed tape on the left, altitude tape on the right, and turn/bank/slip/skid displays at the top center. The boresight symbol (-/-) is in the center and directly below that is the Flight Path Vector symbol (the circle with short wings and a vertical stabilizer). The horizon line is visible going across the display with a break at the center, and directly to the left are the numbers at ±10 degrees with a short line at ±5 degrees (The +5 degree line is easier to see) which, along with the horizon line, show the pitch of the aircraft.

The aircraft in the image is wings level (i.e. the flight path vector symbol is relative to the horizon line and there is zero roll on the turn/bank indicator). Airspeed is 140 knots, altitude is 9450 feet, heading is 343 degrees (the number below the turn/bank indicator). Close inspection of image shows a small purple circle which is displaced from the Flight Path Vector slightly to the lower right. This is the guidance cue coming from the Flight Guidance System. When stabilized on the approach, this purple symbol should be centered "within" the FPV.

The terrain is entirely computer generated from a high resolution terrain database.

In some systems, the SVS will calculate the aircraft's current flight path, or possible flight path (based on an aircraft performance model, the aircraft's current energy, and surrounding terrain) and then turn any obstructions red to alert the flight crew. Such a system could have prevented the crash of American Airlines Flight 965 in 1995.

On the left side of the display is an SVS-unique symbol, which looks like a purple, dimishing sideways ladder, and which continues on the right of the display. The two together define a "tunnel in the sky." This symbol defines the desired trajectory of the aircraft in three dimensions. For example, if the pilot had selected an airport to the left, then this symbol would curve off to the left and down. The pilot keeps the flight path vector alongside the trajectory symbol and so will fly the optimum path. This path would be based on information stored in the Flight Management System's data base and would show the FAA-approved approach for that airport.

The Tunnel In The Sky can also greatly assist the pilot when more precise four dimensional flying is required, such as the decreased vertical or horizontal clearance requirements of RNP. Under such conditions the pilot is given a graphical depiction of where the aircraft should be and where it should be going rather than the pilot having to mentally integrate altitude, airspeed, heading, energy AND longitude and latitude to correctly fly the aircraft. ["A Review of Pathway-In-The Sky Displays, FAA Presentation to 2003 Digital Avionics System Conference Synthetic Vision Workshop, Dick Newman, 15 February 2006 [http://www.faa.gov/aircraft/air_cert/design_approvals/transport/media/PathwayintheSky-RLN.pdf] ]

Automotive applications

Head-up displays are becoming increasingly available in production cars, and usually offer speedometer, tachometer, and navigation system displays. BMW, Citroën, GM, and Nissan currently offer some form of HUD system. Motorcycle helmet HUDs are also commercially available. [Mike, Werner. "Test Driving the SportVue Motorcycle HUD." Motorcycles in the Fast Lane. 8 November 2005. 14 February 2007 [http://www.motorbiker.org/blogs.nsf/dx/11082005093020MWEBYZ.htm] ]

Add-on HUD systems also exist, projecting the display onto a glass combiner mounted on the windshield. These systems have been marketed to police agencies for use with in-vehicle computers.

Developmental / experimental uses

HUDs have been proposed or are being experimentally developed for a number of other applications. In the military, a HUD can be used to overlay tactical information such as the output of a laser rangefinder or squadmate locations to infantrymen. A prototype HUD has also been developed that displays information on the inside of a swimmer's goggles. [Clothier, Julie. "Smart Goggles Easy on the Eyes." CNN.Com. 27 June 2005. CNN. 22 February 2007 [http://edition.cnn.com/2005/TECH/06/23/spark.goggle/index.html?section=cnn_tech] ]

HUD systems that project information directly onto the wearer’s retina with a low-powered laser (virtual retinal display) are also in experimentation. ["Virtual Retinal Display (VRD) Technology." Virtual Retinal Display Technology. Naval Postgraduate School. 13 February 2007 [http://www.cs.nps.navy.mil/people/faculty/capps/4473/projects/fiambolis/vrd/vrd_full.html] .] [Lake, Matt. "How It Works: Retinal Displays Add a Second Data Layer." New York Times 26 April 2001. 13 February 2006 [http://www.nytimes.com/2001/04/26/technology/26HOWW.html] . (registration required)]

See also

*Helmet mounted display
*Head-mounted display
*Augmented reality
*EyeTap
*Scanned-beam display
*Wearable computer

Notes

External links

* [http://news.bbc.co.uk/2/hi/technology/4607449.stm BBC Article - 'Pacman comes to life virtually']
* [http://www.springerlink.com/content/k12155354t11x228/ 'Clinical evaluation of the ‘head-up’ display of anesthesia data']

Commercially available HUDs

* [http://www.lumus-optical.com/ Lumus]
* [http://www.el-op.com/category/head-up_displays.html El-Op]
* [http://www.trivisio.com/prototyping.html Trivisio Monocular]
* [http://www.microvision.com/wearable.html Microvision]
* [http://www.myvu.com/ Myvu (Previously called MicroOptical Consumer Electronics)]
* [http://techon.nikkeibp.co.jp/english/NEWS_EN/20050606/105475/?ST=english/ Olympus Prototypes]
* [http://www.rockwellcollins.com/ecat/br/Rockwell_Collins.html Rockwell Collins Head Up Displays]
* [http://www.baesystems.com Bae Systems]

Commercially available EVS cameras

* [http://www.cmcelectronics.ca/En/Prodserv/Commav/commav_evs_overview_en.html CMC Electronics IR Camera and systems]
* [http://www.kollsman.com/products/commercial-aviation-systems/enhanced-vision-system.asp Kollsman Enhanced Vision System]
* [http://www.max-viz.com/ Max-Viz IR Camera and systems]