Waveguide Display with Exit Pupil Expander

MAIMUUTAMAN KOULUTUNNO UNITI US010025093B2
(12) United States Patent (10 ) Patent No.: US 10 ,025 ,093 B2

Wall et al. (45) Date of Patent : Jul. 17 , 2018
(54 ) WAVEGUIDE -BASED DISPLAYS WITH EXIT USPC ............ 235/454 ; 359 /626 , 622, 633; 385 / 10
PUPIL EXPANDER See application file for complete search history .
(71) Applicant: Microsoft Technology Licensing, LLC , (56 ) References Cited
Redmond , WA (US) U . S. PATENT DOCUMENTS
(72) Inventors : Richard Andrew Wall , Kirkland , WA 7 ,436 ,568 B1 10 /2008 Kuykendall
(US) ; Tuomas Vallius, Espoo ( FI); 7 ,460, 305 B2 12 /2008 Powell et al.
Mikko Juhola , Muurla (FI) 7 ,589, 900 B1 * 9 / 2009 Powell ............... GO2B 27 / 0927
359/622
(73 ) Assignee : MICROSOFT TECHNOLOGY 7 ,613 , 373 B1 11/ 2009 DeJong
LICENSING , LLC , Redmond , WA 8 ,259 ,239 B2 9 /2012 Hua
8 ,314 ,993 B2 11/ 2012 Levola
(US) 8 , 903 ,207 B1 12/ 2014 Brown et al.
2005/ 0248849 A1 11/ 2005 Urey et al .
(* )
@ Notice : Subject to any disclaimer, the term of this 2009 /0237810 AL 9/ 2009 Frazier et al.
patent is extended or adjusted under 35 2010 /0079861 A1 4 /2010 Powell
U .S .C . 154 (b ) by 34 days. (Continued )
(21) Appl. No.: 15/097,646 OTHER PUBLICATIONS
(22 ) Filed : Apr. 13 , 2016 Powell , et al., “Novel approach to exit pupil expansion for wearable
displays” , In Proceedings of SPIE , vol.4711, Aug . 5 , 2002, 3 pages.
(65 ) Prior Publication Data (Continued )
US 2017 /0299860 A1 Oct. 19 , 2017 Primary Examiner - Daniel Hess
(51) Int. CI. (74 ) Attorney, Agent, or Firm — Arent Fox LLP
GO2B 27/ 10 ( 2006 . 01)
GO2B 27/00 ( 2006 .01) (57) ABSTRACT
GO2B 27 /01 ( 2006 .01) A near eye or heads up display system includes a scan beam
F21V 8 /00 ( 2006 .01) projector engine, an optical waveguide, and an exit pupil
GO2B 3/00 ( 2006 .01) expander (EPE ) optically coupled between the scan beam
GO2B 3 / 04 ( 2006 .01) projector engine and the optical waveguide . The EPE
(52 ) U .S . CI. improves the optical performance of the display system . The
CPC ....... G02B 27 / 0081 (2013 . 01 ); G02B 3 /0062 EPE could include a diffusive optical element, diffractive
( 2013.01); G02B 3 /04 (2013 . 01 ); G02B 6 / 003 optical element, micro - lens array (MLA ), or relay of
aspherical lenses . A dual MLA EPE may have cells that
(2013.01 ); G02B 6 /0026 ( 2013 .01); GO2B prevent cross - talk between adjacent pixels . A dual MLA
27 /0172 (2013 .01); GO2B 2027 /0118 EPE may have a non -periodic lens array. The optical power
(2013 .01); G02B 2027 /0123 (2013 .01) of one MLA may be different from the other MLA .
(58) Field of Classification Search
CPC . ......... GO2F 1 /29; GO2B 27 /00 ; G02B 27 /81 18 Claims, 14 Drawing Sheets
106
110
- 1.08
24 208
D
Laser
203
207 - -- - 112
renden -- 0
- 214
114 ,116 -
(side view )
2
US 10 ,Page
025 ,2093 B2
( 56 ) References Cited
U . S . PATENT DOCUMENTS
2012 /0257282 Al 10 / 2012 Hudman
2013/0051730 A 2 / 2013 Travers et al .
2013 /0300999 A1 11/ 2013 De Jong et al.
2014 /0140653 AL 5 / 2014 Brown et al.
2014 /0225915 A1 8 /2014 Theimer et al.
2015 /0289762 Al 10 / 2015 Popovich et al.
OTHER PUBLICATIONS
Urey, Hakan , “ Diffractive exit-pupil expander for display applica
tions” , In Journal of Applied Optics, vol. 40 , Issue 32 , Nov. 10 ,
2001, 3 pages .
Lewis, Jonathan , “What Microsoft 's HoloLens announcement
means for the AR industry ” , Published on : Feb . 3 , 2015 Available
at: http ://trulifeoptics. com /blog /what -microsofts -hololens -an
nouncement-means- for -the -ar -industry .
“ International Search Report and Written Opinion Issued in PCT
Application No . PCT/US2017 /026258 " , Dated Jul. 6 , 2017, 13
Pages.
Powell , et al., " Exit Pupil Expander: Image Quality Performance
Enhancements and Environmental Testing Results” , In Proceedings
of SPIE , Helmet- and Head -Mounted Displays VIII: Technologies
and Applications, Sep . 11, 2003 , pp . 308 -320 .
* cited by examiner
U . S . Patent Jul. 17 , 2018 Sheet 1 of 14 US 10 ,025 ,093 B2
100
100
108
106 tam 1C(
.
FIG)
view
side
110
-
110 1
-
116
114
,
112
2
106
110 108
112
tand 1B(
.
FIG)
view
top
112
1A
.
FIG )
view
front
(
100 100
ZA
U . S . Patent Jul. 17 , 2018 Sheet 2 of 14 US 10 ,025 , 093 B2
200
108
- 112
106
FRA
-
110
116
,
114
208
2Aview
.
FIG)side
(
Laser 203 .
207
205
204
100
106
118
117
FIG . 2B
(front view )
100
112
106
116
,
114
116
,
114
YA
308
)
300 306 .view

3A
FIG)
side
(
Laser203 207
205
204
U . S . Patent Jul. 17 , 2018 Sheet 5 of 14 US 10 ,025, 093 B2
100
114
327
FIG . 3B
(front view )
302
400
204 100B 100G 100R

12B 1126 112R
108 ) 108 ) 108
WA
12281
422G
214
308 308 110
116B 116G 116R
FIG . 4
308
306
302
FIG . 5
308
306
302
FIG . 6A
612 -
000 00 0 0
FIG . 6B
706
702
720 704
706 ( 1 )
712(1Y 2 720 714 (1) 734
71212 )
www
706 ( 2 ) N714(2) -*-*-*- -to+
732
- *
**...---... 706 (3) 714(3)
-- -------------------- -- ------ -
--- -- ------- - ---
-- ------------ ------
.. .....**
7 12 --- ---------- - ---
-------------------------------
*****- -- --- ... 706 ( 4 )
..--
*.
rom*****-----
---* 712(4 ) 1714 (4)
F
*
**
***
706 (5 )
712(5 ) 14 (5)
706 (6 ) 714 (6 )
712 (6 )
706 7 ) 1714 (7 )
712(7 ) mwandi
706 ( 8 ) 714 (8 )
712 (8 )
71219 ) 706 (9) 714 (9 )
yeyeeeeeeeeeeeeeeeeeeeeeeeeeeeeee
FIG . 7A
U . S . Patent Jul. 17 , 2018 Sheet 10 of 14 US 10 ,025 ,093 B2
716
721
723
722 ( 1 ) 724 ( 1 )
* 742
734
72212 / 1162) 724(2)

732
722(3) 17198) 724(3)

*:somóvienservice,<**** * 744
DI
744
cocomando..
**-
.-
.-.
monopis
'- *convicc
*
*
**
*
**
**
**
*come
como 722(4 ) 17164 7 24 (4)
722 (5 ) 172637 724 (5)
724 (6 )
722 (6 )
|706 7 247)
72217 FIG . 7B
atent Jul. 17 , 2018 Sheet 11 of 14 US 10 , 025, 093 B2
. . .
20€
.
818
OZ8
HUWINNIN *
*
w
*
*
**
*
*
*
*
*
*
*
918
.
*
*
**
*
**
*
YAN N
*
*
*
*
*
* *
*
.
*
*
*
*
**
"
. *
**
*V
*
**
**
* *
*
*
**
** w *
*
**
**
*
*
*
**
*
*
*
*
*
*
*
**
*
*
*
*
*
*
**
*
*
***
*
*
*
*
*
*
*
*
*
*
*
*
*
*
*
*
18
$ * *
.
.
...
.**
*
*
* .
*
*
* *
*
*
*
w
;
;
;
;-
;
?
???
-
?
";
- **
????????
*
*
*
* *
*
*
**
*
*
*
*
**
*
**
* *****
*
*
218 .
.
*
*
**
*
** * in
w•••
*
. *
*
-
* *;
;
-
*
* .
*
*
*
**
V
-
-
* .
-
-
*
*
* *
*
*
-
*
*
.
.
**
**
90€
.
228
913
'
8
OL8
018
808 W
*
*
908 wwwww
.
.
*
*
*
008
208
08
108
U . S . Patent Jul. 17 , 2018 Sheet 12 of 14 US 10 , 025, 093 B2
20€
*
*
*
*
.*
*
,
.
,
-
:5
"-WWW
*.
. *
*
*
*
*
*
*
***
*
.
.
.
www
.
.
.
.
*
*
**
*
*
**
*
**
*
**
**
*
**
**
*
*
*
*
**
816
*
*
**
*
*.
*
*..
ir
H
*
mere com
.
ter
.* *
*
*
*
*
** *
*
**
*
**rripitype
*
*
*
*
**
*
.
*
*
*
**
*
**
*
*
**
*
**
*
***
!
.
.*.
*
*
* *
*
**
* *
*
*
* *
*
**
*
*
**
*
**
*
*
**
*
**
*
**
* *
*
**
*
*
*
*
*
*
* *
***
**
**
*
*
* *
*
*
**
*
*
**
*
*
**
*
*
**
*
*
* *
**
**
*
**
**
* *
* *
**
**
* " *
*
**
* *
*
**
*
* *
* **
*
**
*
**
*
;;
6
:
5
* *
*
**
* * *
*
*
.**
**
**
**
** .
*
,
, *
v
*
* .
.
.
*
* * *
916
* ,
,,*
916
*
* .
. *
*
* *
*
* .
.
* *
*
*
* *
**
* . -
-
*
V
*
* -
.
.
* *
*
** *
*
-
-
*
*
*
*
.
.
6918
*
.
*
*
vas *
*
**
*
*
-
-
*
*
*
*
Y
006
006 *
*
-
*
*
ex . . . . . . . . . . . . . . . . . . . . . ,
. .. .. :
216
*
806
*
.
.
.
VPN *
-
-
906
106 .
7
206
106
U . S . Patent Jul. 17 , 2018 Sheet 13 of 14 US 10 , 025, 093 B2
1000
Scan a lightbeam using a scan beam projector
1004
Expand an exit pupil of the light beam from the scan beam
projector using an exitpupil expander
Optically couple the light beam from the exit pupil expander 1006
into an input- coupler of an opticalwaveguide
Diffract the lightbeam from the input- coupler to an 1008

intermediate diffractive element in the optical waveguide
Diffract the lightbeam from the intermediate diffractive 1010

element to an output- coupler in the opticalwaveguide
pomies in die transport antanen

Diffract the lightbeam from the output- coupler to outside of
the opticalwaveguide
FIG . 10
U . S . Patent Jul . 17 , 2018 Sheet 14 of 14 ? US 10 ,025 , 093 B2
FIG
11
.
214
-
M
136
100
1 18 116 4104
2014
306
112
111 1 16 342
US 10 ,025 ,093 B2
WAVEGUIDE - BASED DISPLAYS WITH EXIT FIG . 5 is a diagram of a light pattern from one embodi
PUPIL EXPANDER ment of an EPE and imaging lens, in which the EPE
comprises a diffuser.
BACKGROUND FIG . 6A is a diagram of one embodiment of an EPE and
5 imaging lens , in which the EPE comprises a diffractive
Various types of computing , entertainment, and /ormobile optical element (DOE ).
devices can be implemented with a transparent or semi FIG . 6B is a diagram of one embodiment of a far-field
transparent display through which a user of a device can pattern of the DOE EPE of FIG . 6A .
view the surrounding environment. Such devices, which can FIG . 7A is a diagram of one embodiment of small portion
be referred to as see -through , mixed reality display device of an EPE , in which the EPE comprises a micro -lens array
systems, or as augmented reality (AR ) systems, enable a (MLA ).
user to see through the transparent or semi-transparent FIG . 7B depicts another embodiment of a dual MLA EPE .
display of a device to view the surrounding environment, FIG . 8 is a diagram of one embodiment of an aspherical
and also see images of virtual objects ( e .g ., text, graphics, 15 lens relay with an EPE at an intermediate image plane.
video , etc .) that are generated for display to appear as a part F IG . 9 is a diagram on one embodiment of an EPE that
of, and /or overlaid upon , the surrounding environment. comprises a relay of refractive optical elements .
These devices, which can be implemented as head FIG . 10 is a flowchart of one embodiment of a process of
mounted display (HMD ) glasses or other wearable near eye providing an image in a display system having an EPE .
display devices , or as a heads up display , but are not limited 20 FIG . 11 depicts a top view of a portion of head mounted
thereto , often utilize optical waveguides to replicate an display device (HMD ).
image , e .g., produced by a display engine, to a location
where a user of a device can view the image as a virtual DETAILED DESCRIPTION
image in an augmented reality environment. As this is still
an emerging technology , there are certain challenges asso - 25 Certain embodiments of the present technology relate to
ciated with utilizing waveguides and/ or other optical struc - a near eye or heads up display system that includes a scan
tures to display images of virtual objects to a user. beam projector, an exit pupil expander, and an optical
waveguide . The exit pupil expander improves the optical
SUMMARY performance of the display system .
30 Scan beam projectors (also known as light engines ) are
Certain embodiments described herein relate to a near eye strong candidates for use in head mounted displays (HMD)
or heads up display system that includes a scan beam am due to their small size, low power requirements , and high
projector, an optical waveguide , and an exit pupil expander brightness . It may be desirable to plane the scan beam
(EPE ). The EPE may be configured to expand an exit pupil projector pupil coincident at the entrance pupil of a wave
associated with the scan beam projector prior to delivering 35 guide or otherwise pupil replicating component . The con
a light beam from the scan beam projector to the optical ventional architecture of scan beam projectors, however,
waveguide . The exit pupil expander improves optical per- with a hermetically -sealed scan mirror for example , results
formance of the display system . in an internally - buried exit pupil that makes them hard to
In one embodiment, an apparatus comprises a scan beam couple with other components that deliver the light to the
projector configured to project a light beam , an optical 40 user' s eyes.
waveguide, and an exit pupil expander optically coupled In addition , the mirror size in scan beam projectors is
between the scan beam projector and the optical waveguide . typically minimized to increase frame rate and scan angle,
The optical waveguide comprises a bulk -substrate , an input - resulting in a small beam aperture that results in a small exit
coupler an output-coupler, and a diffractive optical element pupil. This small exit pupil presents challenges in using the
between the input-coupler and the output-coupler. The exit 45 scan beam projector in a near eye or heads up display system
pupil expander is configured to couple the light beam from or the like.
the scan beam projector into the input-coupler . The waveguide itself may serve as a pupil expander.
This Summary is provided to introduce a selection of However, when a scan beam projector is coupled with a
concepts in a simplified form that are further described waveguide pupil expander, the replicated pupil from the
below in the Detailed Description . This Summary is not 50 scan beam projector may result in an output intensity from
intended to identify key features or essential features of the the waveguide that suffers from the effects of an under- filled
claimed subject matter , nor is it intended to be used as an aid pupil distribution . This effect is discussed in more detail
in determining the scope of the claimed subject matter. below with respect to FIG . 2B .
In one embodiment, an exit pupil expander is optically
BRIEF DESCRIPTION OF THE DRAWINGS 55 coupled between a scan beam projector and a waveguide.
This may improve optical performance and may homog
FIGS. 1A , 13 and 1C are front, top and side views, enize the pupil distribution in the waveguide. This improved
respectively , of an exemplary waveguide . optical performance of embodiments of a display system as
FIG . 2A is side view of an exemplary display system . discussed in more detail below with respect to FIG . 3B .
FIG . 2B shows a front view of the waveguide of FIG . 2A . 60 FIGS. 1A , 13 and 1C are front, top and side views,
FIG . 3A shows one embodiment of a display system respectively , of exemplary planar optical waveguide 100
having an exit pupil expander optically coupled between the that can be part of a waveguide assembly that is used to
scan beam projector and the waveguide. replicate an image from a scan beam projector. The planar
FIG . 3B depicts an example pupil distribution in wave - optical waveguide 100 will often be referred to hereafter
guide of FIG . 3A . 65 more succinctly simply as an optical waveguide 100 , or even
FIG . 4 is side view of a display system according to an more succinctly as a waveguide 100 . The optical waveguide
embodiment of the present technology . 100 may also be referred to as a pupil replication system .
US 10 ,025 ,093 B2
Referring to FIGS. 1A , 1B and 1C , the planar optical certain embodiments , the intermediate -component is con
waveguide 100 includes a bulk - substrate 106 having an figured as a fold - grating . In other embodiments , the inter
input- coupler 112 and an output -coupler 116 . The input - mediate - component is a mirror based component, rather
coupler 112 is configured to couple light corresponding to an than a grating based component.
image associated with an entrance pupil into the bulk - 5 The input -coupler 112 , the intermediate - component 114
substrate 106 of the waveguide . The output -coupler 116 is and the output -coupler 116 can be referred to collectively
configured to couple the light corresponding to the image herein as optical components 112 , 114 and 116 of the
associated with the entrance pupil , which travels in the waveguide , or more succinctly as components 112 , 114 and
planar optical waveguide 100 from the input- coupler 112 to 116 .
the output-coupler 116 , out of the waveguide 100 so that the 10 It is possible that a waveguide includes an input-coupler
light is output and imaged from an exit pupil. and an output-coupler , without including an intermediate
The bulk - substrate 106 , which can be made of glass or components . In such embodiments , the input- coupler would
optical plastic , but is not limited thereto , includes a first be configured to couple light into the waveguide and in a
major planar surface 108 and a second major planar surface direction toward the output -coupler. In one such embodi
110 opposite and parallel to the first major planar surface 15 ments the output- coupler can provide one of horizontal or
108. The first major planar surface 108 can alternatively be vertical pupil expansion , depending upon implementation .
referred to as the front-side major surface 108 (or more The waveguide 100 is not required to provide pupil expan
simply the front -side surface 108 ) , and the second major sion , whether intermediate -component 114 is included or
planar surface 110 can alternatively be referred to as the not .
back -side major surface 110 (or more simply the back -side 20 In FIG . 1A , the input-coupler 112 , the intermediate
surface 110 ). As the term “ bulk ” is used herein , a substrate component 114 and the output- coupler 116 are shown as
is considered to be “ bulk ” substrate where the thickness of having rectangular outer peripheral shapes, but can have
the substrate (between its major surfaces) is at least forty alternative outer peripheral shapes. For example, the input
times (i.e ., 40x ) the wavelength of the light for which the coupler 112 can alternatively have a circular outer peripheral
substrate is being used as an optical transmission medium . 25 shape, but is not limited thereto . For another example , the
For an example , where the light ( for which the substrate is intermediate -component can have a triangular or hexagonal
being used as an optical transmission medium ) is red light outer peripheral shape , but is not limited thereto . Further, it
having a wavelength of 620 nm , the substrate will be is noted that the corners of each of the peripheral shapes,
considered a bulk - substrate where the thickness of the e. g ., where generally rectangular or triangular, can be cham
substrate (between its major surfaces ) is at least 24 ,800 nm , 30 fered or rounded , but are not limited thereto . These are just
i. e., at least 24 .8 um . In accordance with certain embodi- a few exemplary outer peripheral shapes for the input
ments, the bulk -substrate 106 has a thickness of at least 25 coupler 112 , the intermediate -component 114 and the out
um between its major planar surfaces 108 and 110 . In put - coupler 116 , which are not intended to be all encom
specific embodiments, the bulk -substrate 106 has a thickness passing.
(between its major surfaces) within a range of 25 um to 1000 35 As can best be appreciated from FIGS . 1B and 1C , the
um . The bulk - substrate 106 , and more generally the wave - input- coupler 112 , the intermediate - component 114 and the
guide 100 , is transparent,meaning that it allows light to pass output- coupler 116 are all shown as being provided in or on
through it so that a user can see through the waveguide 100 a same surface (i.e ., the back -side surface 110 ) of the
and observe objects on an opposite side of the waveguide waveguide 100 . In such a case , the input-coupler 112 can be
100 than the user ' s eye( s ). 40 transmissive ( e. g., a transmission grating), the intermediate
The planar optical waveguide 100 in FIGS . 1A , 1B and component 114 can be reflective (e. g ., a reflective grating),
1C is also shown as including an intermediate -component and the output -coupler 116 can also be reflective (e . g ., a
114 , which can alternatively be referred to as an intermedi- further reflective grating ). The input- coupler 112 , the inter
ate -zone, a folding grating, or a folding component. Where mediate -component 114 and the output- coupler 116 can
the waveguide 100 includes the intermediate - component 45 alternatively all be provided in the front- side surface 110 of
114 , the input- coupler 112 is configured to couple light into the waveguide 100 . In such a case , the input- coupler 112 can
the waveguide 100 and more specifically , into the bulk - be reflective ( e . g ., a reflective grating ) , the intermediate
substrate 106 of the waveguide 100 ) and in a direction of the component 114 can be reflective ( e . g ., a further reflective
intermediate - component 114. The intermediate -component grating ), and the output -coupler 116 can also be transmissive
114 is configured to redirect such light in a direction of the 50 (e . g ., a transmission grating ).
output-coupler 116 . Further, the intermediate -component Alternatively, the input-coupler 112 , the intermediate
114 may be configured to perform one of horizontal or component 114 and the output -coupler 116 can all be
vertical pupil expansion , and the output- coupler 116 may be embedded (also referred to as immersed ) in the bulk
configured to perform the other one of horizontal or vertical substrate 106 . For example, the bulk -substrate 106 can be
pupil expansion . For example , the intermediate - component 55 separated into two halves (that are parallel to the major
114 can be configured to perform horizontal pupil expan surfaces 108 and 110 ), and the input-coupler 112 , the
sion , and the output- coupler 116 can be configured to intermediate - component 114 and the output- coupler 116 can
vertical pupil expansion . Alternatively, if the intermediate be provided in (e. g., etched into ) one of the inner surfaces of
component 114 were repositioned , e .g ., to be below the the two halves, and the inner surfaces of the two halves can
input- coupler 112 and to the left of the output- coupler 116 60 be adhered to one another. Alternatively , the bulk -substrate
shown in FIG . 1A , then the intermediate - component 114 can 106 can be separated into two halves ( that are parallel to the
be configured to perform vertical pupil expansion , and the major surfaces 108 and 110 ) , and the input- coupler 112 , the
output -coupler 116 can be configured to perform horizontal intermediate - component 114 and the output- coupler 116 can
pupil expansion . Such pupil expansion provides for an be provided between the inner surfaces of the two halves.
increased eye box , compared to if pupil expansion were not 65 Other implementations for embedding the input- coupler
performed , thereby making the embodiments described 112 , the intermediate - component 114 and the output- coupler
herein practical for use in a near eye or heads up display. In 116 in the bulk -substrate 106 are also possible , and within
US 10 ,025 ,093 B2
the scope of the embodiments described herein . It is also diffraction grating , instead of being a surface grating , can
possible that one of the input -coupler 112 , the intermediate - alternatively be a volume grating , such as a Bragg diffraction
component 114 and the output-coupler 116 is provided in or grating. It is also possible that one or more of the couplers
on the front-side surface 108 of the waveguide 100 , another are manufactured as SRGs and then covered within another
one of the components 112 , 114 and 116 is provided in or on 5 material, e . g ., using an aluminum deposition process ,
the back -side surface 110 , and the last one of the compo - thereby essentially burying the SRGs such that the major
nents 112 , 114 and 116 is embedded or immersed in the planar waveguide surface (s ) including the SRG ( s ) is / are
bulk -substrate 106 . More generally , unless stated otherwise , substantially smooth . Such a coupler is one example of a
any individual one of the input- coupler 112 , the intermedi- hybrid of a surface and volume diffraction grating. Any one
ate -component 114 and the output- coupler 116 can be pro - 10 of the input- coupler 112 , the intermediate - component 114
vided in or on either one of the major planar surfaces 108 or and the output-coupler 116 can be , e. g., a surface diffraction
110 of the bulk -substrate 106 , or embedded therebetween . grating , or a volume diffraction grating , or a hybrid of a
The input- coupler 112 , the intermediate - component 114 surface and volume diffraction grating . In accordance with
and the output- coupler 116 can each be implemented as a embodiments described herein , each diffraction grating can
diffraction grating, or more generally, as a diffractive optical 15 have a preferential linear polarization orientation specified
element (DOE). Such DOEs can be produced using holo - by a direction of the grating lines of the diffraction grating ,
graphic processes , in which case, the DOEs can be more wherein the coupling efficiency for light having the prefer
specifically referred to as holographic optical elements ential linear polarization orientation will be higher than for
(HOES). The input- coupler 112 can alternatively be imple - light having a non -preferential linear polarization orienta
mented as a prism , a reflective polarizer or can be mirror 20 tion .
based. Similarly , the output- coupler 116 can alternatively be Where the input-coupler 112 , the intermediate -component
implemented as a prism , a reflective polarizer or can be 114 and/ or the output -coupler 116 is an SRG , each such SRG
mirror based . Depending upon the specific configuration and can be etched into one of the major planar surfaces 108 or
implementation , any one of the input-coupler 112 , the inter - 110 of the bulk - substrate 106 . In such embodiments, the
mediate -component 114 and the output -coupler 116 can be 25 SRG can be said to be formed “ in ” the bulk -substrate 106 .
reflective , diffractive or refractive , or a combination thereof, Alternatively , each SRG can be physically formed in a
and can be implemented , e . g ., as a linear grating type of coating that covers one of the major planar surfaces 108 or
coupler, a holographic grating type of coupler, a prism or 110 of the bulk - substrate 106 , in which case each such SRG
another type of optical coupler. The intermediate -component can be said to be formed “ on ” the bulk -substrate 106 . Either
114 , as noted above , can be implemented using a fold - 30 way , the components 112 , 114 and 116 are considered parts
grating, or can alternatively be implemented as a mirror of the waveguide 100.
based pupil expander , but is not limited thereto . Where the Referring specifically to FIG . 1A , in an exemplary
input- coupler 112 is a diffraction grating, it can be referred embodiment, the input- coupler 112 can have surface grat
to more specifically as an input diffraction grating 112 . ings that extend in a vertical (y ) direction , the output-coupler
Where the intermediate - component 114 is a diffraction grat- 35 116 can have surface gratings that extend in a horizontal ( X )
ing , it can be referred to more specifically as an intermediate direction , and the intermediate -component 114 can have
diffraction grating 114 . Similarly , where the output-coupler surface gratings that extend diagonal ( e.g., - 45 degrees)
116 is a diffraction grating, it can be referred to more relative to the horizontal and vertical directions. This is just
specifically as an output diffraction grating 116 . an example . Other variations are also possible and within the
A diffraction grating is an optical component that may 40 scope of embodiments of the present technology.
contain a periodic structure that causes incident light to split More generally, the input -coupler 112 , the intermediate
and change direction due to an optical phenomenon known component 114 and the output- coupler 116 can have various
as diffraction . The splitting (known as optical orders ) and different outer peripheral geometries, can be provided in or
angle change depend on the characteristics of the diffraction on either of the major planar surfaces of the bulk - substrate,
grating . When the periodic structure is on the surface of an 45 or can be embedded in the bulk - substrate 106 , and can be
optical component, it is referred to a surface grating . When implemented using various different types of optical struc
the periodic structure is due to varying of the surface itself , tures, as can be appreciated from the above discussion , and
it is referred to as a surface relief grating (SRG ) . For will further be appreciated from the discussion below .
example , an SRG can include uniform straight grooves in a In general, light corresponding to an image , which is
surface of an optical component that are separated by 50 coupled into the waveguide via the input- coupler 112 , can
uniform straight groove spacing regions. Groove spacing travel through the waveguide from the input- coupler 112 to
regions can be referred to as “ lines” , “ grating lines” or the output- coupler 114 , by way of total internal refection
“ filling regions” . The nature of the diffraction by an SRG (TIR ). TIR is a phenomenon which occurs when a propa
depends on the wavelength , polarization and angle of light gating light wave strikes a medium boundary (e. g., of the
incident on the SRG and various optical characteristics of 55 bulk -substrate 106 ) at an angle larger than the critical angle
the SRG , such as refractive index , line spacing , groove with respect to the normal to the surface . In other words, the
depth , groove profile , groove fill ratio and groove slant critical angle ( ..) is the angle of incidence above which TIR
angle. An SRG can be fabricated by way of a suitable occurs, which is given by Snell's Law , as is known in the art.
microfabrication process , which may involve etching of More specifically , Snell' s law specifies that the critical angle
and /or deposition on a substrate to fabricate a desired 60 (2 .) is specified using the following equation :
periodic microstructure on the substrate to form an optical 0 = sin -|(n2 /nl)
component, which may then be used as a production master
such as a mold or mask for manufacturing further optical where
components . An SRG is an example of a Diffractive Optical the critical angle for two optical mediums ( e . g ., the
Element (DOE ). When a DOE is present on a surface (e .g . 65 bulk -substrate 106 , and air or some other medium that is
when the DOE is an SRG ), the portion of that surface adjacent to the bulk - substrate 106 ) that meet at a medium
spanned by that DOE can be referred to as a DOE area . A boundary ,
US 10 ,025 ,093 B2
nl is the index of refraction of the optical medium in numerical aperture (NA ) convertor. There is an imaging lens
which light is traveling towards themedium boundary ( e.g., 308 between the EPE 306 and waveguide 100 . The exitpupil
the bulk -substrate 106 , once the light is couple therein ), and expander 306 provides an expanded exit pupil 302 prior to
n2 is the index of refraction of the opticalmedium beyond coupling to the waveguide 100 , which increases overall
the medium boundary (e. g., air or some other medium 5 system performance .
adjacent to the bulk - substrate 106 ). The scan beam projector 204 can include, e. g ., red , green
The concept of light traveling through the waveguide 100 , and /or blue light emitting elements that are configured to
from the input-coupler 112 to the output-coupler 114 , by respectively produce red light within a corresponding red
way of TIR , can be better appreciated from FIG . 4 , which is wavelength range , green light within a corresponding green
discussed below . 10
wavelength range and blue lightwithin a corresponding blue
As noted above, scan beam projectors (also known as wavelength range . For a more specific example , one ormore
light engines) are strong candidates for use in head mounted red light emitting elements can produce light within a red
displays (HMD ) due to their small size, low power require wavelength range ( e . g ., from 600 nm to 650 nm ); one or
ments, and high brightness . FIG . 2A shows a side view of a
scan beam projector 204 . imaging lens 208 . waveguide 100. 15 more green light emitting elements can produce light within
andThe
human eye 214 . a green wavelength range ( e .g ., from 500 nm to 550 nm );
scan beam projector 204 includes a laser 203 , control and one or more blue light emitting elements can produce
logic 205 , and a scanning mirror 207 . Briefly , the laser 203 light within a blue wavelength range ( e. g ., from 430 nm to
may include a red laser., a green laser, and a blue laser. Other 480 nm ). The waveguide 100 can transfer light correspond
color lasers could be used . The laser could be a mono -color 20 ing to the image from an entrance pupil of the waveguide to
laser . The scanning mirror 207 may be a micro -electro - an exit pupil of the waveguide , where the image can be
mechanical system (MEMS) scanning mirror. The control viewed by for example , a human eye 214 .
logic 205 may control the scanning mirror 207 and the laser The exit pupil expander 306 may be manufactured in
203. The light from the laser is relayed onto the scanning multiple diffractive or refractive forms including, but not
mirror 207 that scans the laser light into a raster pattern . The 25 limited to , ground glass or holographic diffusers, diffractive
raster pattern from the scanning mirror 207 is relayed to beamsplitters, engineered diffusers or non - periodic refrac
imaging lens 208 , which focuses the raster pattern onto the tive elements , and microlens arrays (MLAs). FIGS. 5 - 9
input- coupler 112. show various embodiments ofexit pupil expanders that may
The sealed scanning mirror 207 may result in an inter - be used in FIG . 3A .
nally -buried exit pupil, which makes it difficult to couple to 30 Note that in one embodiment, the waveguide 100 com
the waveguide 100 . In addition , the mirror size of the prises intermediate diffractive element 114 , as shown in FIG .
scanning mirror 207 is typically minimized to increase 3A . In another embodiment, the waveguide 100 comprises
resolution and frequency , resulting in a small beam aperture input -coupler 112 and output coupler 116 , but does not have
that results in a small exit pupil . intermediate diffractive element 114 .
The small exit pupil can present problems when coupling 35 FIG . 3B depicts an example pupil distribution 327 in
the beam from the scan beam projector 204 to the input- waveguide 100 of FIG . 3A . The example pupil distribution
coupler 112 of the waveguide 100 . An exit pupil distribution 327 is represented by a number of circles , which are partially
117 is depicted in waveguide 100 of FIG . 2B . The example overlapping . FIG . 3B shows a front view of the waveguide
pupil distribution in FIG . 2B is the result of coupling scan of FIG . 3A . The example pupil distribution in FIG . 3B is the
beam projector 204 to the input - coupler 112 of the wave - 40 result of using an exit pupil expander 306 with the scan
guide 100 , as depicted in FIG . 2A . However, the scan beam beam projector 204 and waveguide 100 , as depicted in FIG .
projector 204 is not depicted in FIG . 2B . 3A . However , the scan beam projector 204 is not depicted in
The pupil distribution 117 is depicted as a group of black FIG . 3B . FIG . 3B shows that the pupil distribution in the
circles, each of which represents a pupil as the light moves waveguide 100 is homogenized, as a result of using the exit
through the waveguide 100 . The light from scan beam 45 pupil expander 306 . The light may travel through the wave
projector 204 enters input- coupler 112 , as represented by guide 100 of FIG . 3B in a similar manner as described with
pupil 118 . Input- coupler 112 may diffract the light towards respect to FIG . 2B .
intermediate- component 114 . Some of the light may travel FIG . 4 is a diagram showing further details of one
in the general direction of the x -axis (by TIR ) within the embodiment of a display system 302 having an exit pupil
waveguide 100 . Intermediate - component 114 may diffract a 50 expander 306 between a scan beam projector 204 and
portion of the light in the general direction of the y -axis . waveguide 100 . The display system 300 is shown as includ
Again , this diffracted light may travel by TIR within the ing three waveguides labeled 100R , 100G , 100B ( each of
waveguide to the output - coupler 116 . A portion of this light which can be similar to the waveguide 100 introduced with
may continue to travel in the general direction of the y - axis reference to FIGS. 1A , 1B and 1C ) and a scan beam
by TIR within the waveguide 100 . Output- coupler 116 may 55 projector 204 that generates an image including angular
diffract a portion of the light out of the waveguide 100 . The content that is coupled into the waveguides 100R , 100G and
light may be output in the general direction of the z - axis . 100B by the input- couplers 112R , 112G and 112B .
FIG . 2B depicts an under - filled pupil distribution , which FIG . 4 also shows an exit pupil expander 306 optically
may result from the small exit pupil of the scan beam coupled between the scan beam projector 204 and the three
projector 204 . The small exit pupil of the scan beam 60 waveguides 100R , 100G , 100B . Also depicted is an imaging
projector 204 results in pupil 118 being relatively small . The lens 308 between the exit pupil expander 306 and the three
under- filled pupil distribution is represented by the relatively waveguides 100R , 100G , 100B .
small size of the pupils within the waveguide 100. FIG . 4 also shows a human eye 214 that is viewing the
FIG . 3A shows one embodiment of a display system 300 image (as a virtual image ) within an eye box that is proxi
having an exit pupil expander 306 optically coupled between 65 mate the output-couplers 116R , 116G and 116B . Explained
the scan beam projector 204 and the waveguide 100 . The another way, the human eye 214 is viewing the image from
exit pupil expander 306 may also be referred to as a an exit pupil associated with the waveguides 100R , 100G
US 10 ,025 ,093 B2
10
and 100B . The display system 300 can be, e .g., a near eye or larger input and output angular ranges are also possible ,
display or a heads up display . and within the scope of embodiments described herein .
The waveguides 100R , 100G and 100B can be configured , Each input- coupler 112 and output -coupler 116 of a
respectively , to transfer red , green and blue light correspond waveguide 100 can have a preferential polarization orien
ing to an image from an entrance pupil to an exit pupil . More 5 tation , wherein the coupling efficiency for light having the
specifically , an input- coupler 112R of the waveguide 100R preferential polarization orientation will be higher than for
can be configured to couple light (corresponding to the light light having
having aa non
nona --coupler
preferential polarization orientation . For
preferen
image ) within a red wavelength range into the waveguide example , where is a diffraction grating, the pref
100R , and the output-coupler 116R of the waveguide 100R 10 erential polarization orientation may be specified by a direc
tion of the grating lines of the diffraction grating. If the scan
can be configured to couple light (corresponding to the beam projector 204 is configured to output an image com
image ) within the red wavelength range (which has travelled
from the input- coupler 112R to the output- coupler 116F by then the light
prising having a first linear polarization orientation ,
input- coupler 112 and the output - coupler 116 of one
way of TIR ) out of the waveguide 100R . Similarly , an or more waveguides 100 (that is /are configured to transfer
input -coupler 112G of the waveguide 100G can be config - 15 light corresponding to the image from an entrance pupil to
ured to couple light (corresponding to the image ) within a an exit pupil , where the image can be viewed , and to perform
green wavelength range into the waveguide 100G , and the pupil expansion ) can be configured to have the first linear
output- coupler 116G of the waveguide 100G can be config - polarization orientation as its preferential linear polarization
ured to couple light ( corresponding to the image ) within the orientation .
green wavelength range (which has travelled from the 20 The preferential polarization orientation of a coupler ( e.g .,
input- coupler 112G to the output- coupler 116G by way of 112 or 116 ) can be a linear polarization orientation , which
TIR ) out of the waveguide 100G . Further , an input-coupler can either be a P linear polarization orientation , or an S
112B of the waveguide 100B can be configured to couple linear polarization orientation , which orientations are
light ( corresponding to the image ) within a blue wavelength orthogonal relative to one another. It is also possible that the
range into the waveguide 100B , and the output- coupler 25 preferential linear polarization orientation of a coupler can
116B of the waveguide 100B can be configured to couple be a polarization that is neither a P linear polarization
light (corresponding to the image ) within the blue wave - orientation , nor an S linear polarization orientation , but
length range (which has travelled from the input- coupler rather, is a polarization orientation that is oriented some
112B to the output- coupler 116B by way of TIR ) out of the where between the S and P linear polarization orientations.
waveguide 100B . In accordance with an embodiment, the 30 The P linear polarization orientation is also known as
red wavelength range is from 600 nm to 650 nm , the green transverse -magnetic ( TM ), and the S linear polarization
wavelength range is from 500 nm to 550 nm , and the blue orientation is also known as transverse - electric ( TE ). The
wavelength range is from 430 nm to 480 nn . Other wave - input - coupler 112 and the output- coupler 116 of a wave
length ranges are also possible. guide 100 can have the samepreferential linear polarization
The waveguides 100R , 100G and 100B can be referred to 35 orientation . Alternatively, the input- coupler 112 and the
collectively as the waveguides 100 , or individually as a output - coupler 116 of a waveguide 100 can have different
waveguide 100 . Two or more of the waveguides 100 can be preferential linear polarization orientations from one
referred to as a waveguide assembly 400 . More specifically , another , which may be the case , e . g ., where the waveguide
multiple waveguides 100 can be stacked , back - to -back , to 100 includes in intermediate -component 114 that rotates the
provide the waveguide assembly 400 . The distance between 40 polarization of internally reflected light as the light travels
adjacent waveguides 100 of the waveguide assembly 400 within the waveguide from the input- coupler 112 to the
can be , e . g ., between approximately 50 micrometers (um ) intermediate -component 114 , and then from the intermedi
and 300 um , but is not limited thereto . While not specifically ate - component 114 to the output- coupler 116 . It is also
shown, spacers can be located between adjacentwaveguides possible that a preferential polarization of one or more of the
100 to maintain a desired spacing therebetween . The input- 45 couplers is a circular polarization .
couplers 1126 , 112R and 112B can be referred to collec - The imaging lens 308 is arranged to receive a display
tively as the input - couplers 112 , or individually as an image from the EPE 306 , to collimate and project the display
input-coupler 112 . Similarly , the output-couplers 116G , image at a given defined field of view , and to form a pupil
116R and 116B can be referred to collectively as the at the location of the input- couplers 112 of the waveguides
output -couplers 116 , or individually as an output -coupler 50 100 , in one embodiment. Note that the pupil location is not
116 . While the waveguide assembly 400 is shown as includ required to be completely coincident with the input- couplers
ing three waveguides 100 , it is also possible that a wave- 112 . Also note that imaging lens 308 is simplified . For
guide assembly include more or fewer than three wave - example , imaging lens 308 could comprise more than one
guides , as will be described in additional detail below . lens . Also , imaging lens 308 could include one or more lens
Each of the input- couplers 112 have an input angular 55 between the scan beam projector 204 and the EPE 306 .
range, and each of the output-coupler 116 have an output In accordance with an embodiment, an entrance pupil
angular range . In accordance with certain embodiments, all associated with the waveguide may be approximately the
of the input-couplers 112 have substantially the same input same size as an exit pupil associated with the EPE 306 , e .g .,
angular range , and all of the output-couplers 116 have 5 mm in some embodiments, but is not limited thereto . Note
substantially the same output angular range . In accordance 60 that the entrance pupil associated with the waveguide may
with certain embodiments , the input angular range for the be substantially larger than an exit pupil associated with the
input- couplers 112 is substantially the same as the output scan beam projector 204 .
angular range for the output-couplers 116 . Values are con - FIG . 4 is not intended illustrate the precise locations of the
sidered to be substantially the same if they are within 5 % of scan beam projector 204 relative to the EPE 306 . Rather,
one another. In accordance with certain embodiments, the 65 FIG . 4 is intended to illustrate that the EPE 306 utilizes light,
input angular range and the output angular range are each generated by the scan beam projector 204 , to produce an
approximately + / – 15 degrees relative to the normal. Smaller image . For example, various optical elements, such as
US 10 ,025 ,093 B2
lenses , mirrors , birdbath optics and /or beam splitters may be range . For example , the light source assembly 210 can
included between the scan beam projector 204 and the EPE include red , green and blue light emitting diode (LEDs),
306 . super luminescent light emitting diodes ( SLEDs), a quantum
Also , the imaging lens 308 is representative of one dot light emitting diodes (CD -LED ), or laser diodes (LDs),
possible configuration between the EPE 306 and the wave - 5 but is not limited thereto . In accordance with an embodi
guide 100 . There may be a complex series of lenses between ment, the red wavelength range is from 600 nm to 650 nm ,
the EPE 306 and the waveguide 100 . the green wavelength range is from 500 nm to 550 nm , and
Regardless of the exact configuration , eventually light the blue wavelength range is from 430 nm to 480 nn , as
associated with the image is caused to be incident on the noted above. Narrower or wider wavelength ranges are also
input-couplers 112 of the waveguides 100 , so that the light 10 possible .
associated with the image can travel, by way of total internal In FIG . 4 , the thick dotted arrowed line 422R is repre
reflection ( TIR ), from the input- couplers 112 to the output- sentative of red ( R ) light corresponding to an image that is
couplers 116 , where the light is output and imaged from an output by the scan beam projector 204 , the thick dashed
exit pupil by a human eye. When light exits the waveguide arrowed line 422G is representative of green (G ) light
100 , proximate the output- couplers 116 , a human eye, which 15 corresponding to the image that is output by the scan beam
has a lens in it, receives the collection of angles associated projector 204 , and the thick solid arrowed line 422B is
with a pupil and coverts it back to an image, e .g ., the image representative of blue (B ) light corresponding to the image
produced by the scan beam projector 204 in FIG . 4 . that is output by the scan beam projector 204 . While the
As noted above in the discussion of FIGS. 1A - 1C , each of waveguides 100R , 100G and 100B are shown as being
the waveguides 100 can optionally include an intermediate - 20 stacked in a specific order, the order in which the wave
component 114 which may perform one of horizontal and guides 100 are stacked can be changed .
vertical pupil expansion , and the output -coupler 116 can When implemented as an input diffraction grating, the
perform the other one of horizontal or vertical pupil expan input-coupler 112B is designed to diffract blue light within
sion . Where the waveguides 100 , and more specifically the an input angular range (e . g ., +/ – 15 degrees relative to the
components 114 and/ or 116 thereof is /are configured to 25 normal) and within the blue wavelength range ( e . g ., from
perform pupil expansion, then an expanded pupil ( relative to 430 nm to 480 nn ) into the waveguide 100B , such that an
the input at input coupler 112 ) is converted to an image by angle of the diffractively in - coupled blue light exceeds the
the lens of a human eye . critical angle for the waveguide 100B and can thereby travel
In FIG . 4 , the scan beam projector 204 is shown as facing by way of TIR from the input -coupler 112B to the output
theback - side surface 110 of the waveguides 100 , and the eye 30 coupler 116B . Further, the input- coupler 112B is designed to
214 is shown as facing the front- side surfaces 108 opposite transmit light outside the blue wavelength range , so that
and parallel to the back -side surfaces 110 . This provides for light outside the blue wavelength range (such as light within
a periscope type of configuration in which light enters the the green and red wavelength ranges ) will pass through the
waveguides on one side of each waveguide 100 , and exits waveguide 100B .
the waveguides at an opposite side of each waveguide 100 . 35 When implemented as an input diffraction grating , the
Alternatively , each of the input- couplers 112 and the output- input -coupler 112G is designed to diffract green light within
couplers 116 can be implemented in a manner such that the an input angular range ( e.g ., + / – 15 degrees relative to the
scan beam projector 204 and the eye 214 are proximate to normal) and within the green wavelength range ( e . g ., from
and face a same major planar surface ( 108 or 110 ). 500 nm to 550 nm ) into the waveguide 100G , such that an
The waveguides 100 can be incorporated into a see - 40 angle of the diffractively in - coupled green light exceeds the
through mixed reality display device system ( see , for critical angle for the waveguide 100G and can thereby travel
example, FIG . 11 ), but is not limited to use therewith . A by way of TIR from the input-coupler 112G to the output
separate instance of each of the waveguide assemblies 400 coupler 116G . Further, the input- coupler 112G is designed to
the scan beam projector 204 , and EPE 306 can be provided transmit light outside the green wavelength range , so that
for each of the left and right eyes of a user. In certain 45 light outside the green wavelength range ( such as light
embodiments , such waveguide assemblies 400 may be posi- within the red wavelength range ) will pass through the
tioned next to orbetween see - through lenses, which may be waveguide 100G .
standard lenses used in eye glasses and can be made to any When implemented as an input diffraction grating , the
prescription (including no prescription ). Where a see - input -coupler 112R is designed to diffract red light within an
through mixed reality display device system is implemented 50 input angular range ( e . g ., + / – 15 degrees relative to the
as head -mounted display (HMD ) glasses including a frame, normal) and within the red wavelength range (e . g ., from 600
the scan beam projector 204 can be located to the side of the nm to 650 nm ) into the waveguide 100R , such that an angle
frame so that it sits near to a user 's temple . Alternatively, the of the diffractively in -coupled red light exceeds the critical
scan beam projector 204 can be located in a central portion angle for the waveguide 100R and can thereby travelby way
of the HMD glasses that rests above a nose bridge of a user. 55 of TIR from the input- coupler 112R to the output-coupler
Other locations for the scan beam projector 204 are also 116R . Further, the input-coupler 112R is designed to trans
possible . In these instances, the user can also be referred to mit light outside the red wavelength range , so that light
as a wearer. Where there is a separate waveguide assembly outside the red wavelength range will pass through the
400 for each of the left and right eyes of a user, there can be waveguide 100R .
a separate scan beam projector 204 for each of the wave - 60 More generally , each of the waveguides 100 can include
guide assemblies 400, and thus , for each of the left and right an input- coupler 112 that is configured to couple - in light
eyes of the user. within an input angular range ( e . g ., + / – 15 degrees relative to
The scan beam projector 204 can include red , green the normal) and within a specific wavelength range into the
and/ or blue light sources that are configured to respectively waveguide, such that an angle of the in - coupled light
produce red light within a corresponding red wavelength 65 exceeds the critical angle for the waveguide 100 and can
range, green light within a corresponding green wavelength thereby travel by way of TIR from the input- coupler 112 to
range and blue light within a corresponding blue wavelength the output -coupler 116 of the waveguide 100, and such that
US 10 ,025 ,093 B2
13 14
light outside the specific wavelength range is transmitted substrate could comprise a variety of materials, including
and passes through the waveguide 100 . but not limited to , silicon oxide , silicon , and germanium .
Referring still to FIG . 4 , the solid thick arrowed lines In one embodiment, the diffuser EPE 306 is a holographic
shown within the waveguide 100B are representative of blue diffuser. A holographic diffuser may be formed by recording
light traveling by way of TIR from the input-coupler 112B 5 a laser speckle pattern into some medium . For example, a
to the output -coupler 116B . The dashed thick arrowed lines photoresist may be exposed to a laser speckle pattern that
shown within the waveguide 100G are representative of results from illuminating a diffuser (e.g., ground glass) with
green light traveling by way of TIR from the input-coupler a laser.
112G to the output- coupler 116G . The dotted thick arrowed In one embodiment, the diffuser EPE 306 is a diffractive
lines shown within the waveguide 100R are representative " diffuser. In one embodiment, the diffractive diffusers is a
of red light traveling by way of TIR from the input -coupler computer -generated diffractive optical element (DOE). A
112R to the output-coupler 116R . diffractive diffuser may be formed using either binary - or
In FIG . 4 the solid thick arrowed lines directed from the gray - scale lithography fabrication methods, as two
output -coupler 116B of the waveguide 100B toward the 16 examples.
human eye 214 at a first angle (zero degrees relative to the In one embodiment, the diffuser EPE 306 is a ground
normal, in this example ) are representative of blue light that glass diffuser. The foregoing are just some examples of a
is purposefully out- coupled by the output- coupler 116B of diffuser EPE 306 . Other types of diffusersmay be used in a
the waveguide 100B for viewing by the human eye 214 . diffuser EPE 306 .
In FIG . 4 the dashed thick arrowed lines directed from the 20 FIG . 6A is a diagram of one embodiment of an EPE 306
output -coupler 116 of the waveguide 100G toward the and imaging lens 308 , in which the EPE 306 comprises a
human eye 214 at a first angle (zero degrees relative to the diffractive optical element (DOE) . Moreover, the exit pupil
normal, in this example ) are representative of green light is expanded as a result of the light diffraction by the DOE .
that is purposefully out -coupled by the output-coupler 116G This EPE will be referred to herein as a “ DOE EPE .” The
of the waveguide 100G for viewing by the human eye 214 . 25 DOE EPE 306 may be used in the display system of FIG . 3A
In FIG . 4 the dotted thick arrowed lines directed from the or 4 , but is not limited thereto .
output- coupler 116R of the waveguide 100R toward the In this example , a beam of light is depicted entering the
human eye 214 at a first angle ( zero degrees relative to the DOE EPE 306 . This beam of light originates from a beam
normal, in this example ) are representative of red light that scan projector (not depicted in FIG . 6A ), in accordance with
is purposefully out-coupled by the output-coupler 116R of 30 embodiments. There may be other optical elements between
the waveguide 100R for viewing by the human eye 214 . the beam scan projector and the DOE EPE 306 . The DOE
In FIG . 4 , the waveguide assembly 400 was shown and EPE 306 diffracts the light into diffraction orders. In
described as including the waveguide 100R for guiding red example in FIG . 6A , a zeroth , first and second diffraction
lightwithin a red wavelength range , the waveguide 100G for order are depicted . Additional diffraction orders are not
guiding green light within a green wavelength range, and the 35 depicted so as to simplify the diagram . After leaving the
waveguide 100B for guiding blue light within a blue wave - imaging lens 308 an expanded exit pupil 302 results . FIG .
length range . In alternative embodiments , a first waveguide 6A shows a view from the y - Z perspective . In one embodi
may guide both blue and green light, while a second ment, the light pattern from the DOE EPE 306 is rotationally
waveguide guides the red light. In such an embodiment, an symmetric . For example , the light pattern may be symmetric
input- coupler would be configured to couple both blue and 40 if the DOE EPE 306 is rotated about the optical axis . Thus ,
green light into a waveguide, and an output-coupler would a view from the x -z perspective may be similar to that
be configured to couple both blue and green light out of the depicted in FIG . 6A .
waveguide. This is just an example , as other variations are FIG . 6B is a diagram of one embodiment of a far - field
also possible and within the scope of the embodiments of the pattern 612 of the DOE EPE 306 of FIG . 6A . FIG . 6B
present technology. 45 depicts many more diffractive orders than FIG . 6A . Also
In one embodiment, the EPE 306 comprises one ormore note that the light pattern in FIG . 6B may be somewhat
elements that diffuse light. FIG . 5 is a diagram of a light idealized in that the light intensity is not necessarily the
pattern from one embodiment of an EPE 306 and imaging same for each of the wavelengths/ colors .
lens 308 , in which the EPE 306 comprises an element that FIG . 7A is a diagram of one embodiment of small portion
diffuses light. Moreover , the exit pupil is expanded as a 50 of an EPE 306 , in which the EPE 306 comprises a micro - lens
result of the diffusion . This EPE will be referred to herein as array (MLA ). In this case , there are two MLAs 702 , 704 .
a " diffuser EPE .” The diffuser EPE 306 may be used in the Hence , the EPE 306 may be referred to as a dual MLA EPE
display system of FIG . 3A or 4 , but is not limited thereto . In 306 . The dual MLA EPE 306 may be used in the display
this example , a beam of light is depicted entering the diffuser system of FIG . 3A or 4 , but is not limited thereto .
EPE 306 . This beam of light originates from a beam scan 55 The dual MLA EPE 306 has a body 706 , a first MLA 702,
projector (not depicted in FIG . 5 ), in accordance with and a second MLA 704 . The body 706 has a number of cells
embodiments . There may be other optical elements between 706 ( 1 )- 706 ( 9 ). The first MLA 702 has lenses 712 ( 1 )-712 ( 9 ).
the beam scan projector and the EPE 306 . Lenses 712 ( 1) -712 ( 9 ) may form an array in the x -y plane.
The diffuser EPE 306 diffuses (or scatters ) the light. The second MLA 702 has lenses 714 ( 1 )- 71409 ) . Lenses
which is focused by imaging lens 308 resulting in an 60 714 ( 1 )-714 ( 9 ) may form an array in the x - y plane . Thus ,
expanded exit pupil 302 . FIG . 5 shows a view from the y - Z there may be many more lenses in both the x - and y - direc
perspective . In one embodiment, the light pattern from the tion for each MLA 702 , 704 .
diffuser EPE 306 is rotationally symmetric . Thus , a view Reference numeral 732 points to a number of arrows that
from the x -z perspective may be similar to that depicted in represent a portion of the light beam from a scan beam
FIG . 5 . 65 projector 204 that are received by lens 712 (2 ). Reference
In one embodiment, a diffuser EPE 306 is fabricating by numeral 734 points to a number of arrows that represent a
lithographically etching a pattern into a substrate . The portion of the light beam that are output by lens 714 (2 ). In
US 10 ,025 ,093 B2
15 16
one embodiment, this portion of the light beam corresponds spatial location of the lenses . For example, there is a
to one “ virtual pixel” in the image projected by the scan relatively large gap 742 between lens 724 (1 ) and 724 (2 ). The
beam projector 204 . relatively large gap 742 results in a relatively large distance
In one embodiment, each of the lenses 712 corresponds to between the centers of the two lenses 724 (1 ), 724 ( 2 ).
one virtual pixel in the image projected by the scan beam 5 However , there is a relatively small gap 744 between lens
projector 204 . Likewise , each of the lenses 714 may corre - 724 ( 3 ) and 724 ( 4 ). The relatively small gap 744 results in a
spond to one virtual pixel. Likewise, each of the cells 716 relatively small distance between the centers of the two
may correspond to one virtual pixel. FIG . 7A shows an lenses 724 (3 ), 724 (4 ). Hence , the lenses 724 in MLA 723 are
example of a portion of the light beam 732 entering lens non -periodic . Note that the difference in gap size in FIG . 7B
712 ( 2 ) passing through cell 706 ( 2 ) and leaving lens 714 ( 2 ). 10 may be exaggerated to better illustrate the concept.
Thus, collectively lens 712 ( 2 ) , cell 706 ( 2 ) and lens 714 ( 2 ) FIG . 7B just shows the y - Z plane. Note that each MLA
may process the light associated with one virtual pixel. 721 , 723 may extend in the x - y plane . The non - periodic
Other groups of one lens 712 from MLA 702, one cell 706 nature of the lenses 724 is depicted with respect to the
and one lens from MLA 704 may process the light associated y - direction . The lenses 724 may be non -periodic with
with one virtual pixel in a similar manner. In FIG . 7A , the 15 respect to a different direction parallel to the x -y plane . For
numbering 712 (n ), cell 706 ( n ) and lens 714 ( n ) is used to example , the lenses 724 may be non - periodic with respect to
show which elements are associated with the same virtual the x - direction . The lenses 724 may be non -periodic with
pixel. In one embodiment, the image from the scan beam respect to a direction in the X - y plane other than the
projector 204 comprises virtual pixels in an (x ,y ) array. In X - direction or the y -direction .
this case , each MLA could be an (x ,y ) array of lenses. 20 Another way of expressing the relationship between the
Note that it may be possible for there to be cross -talk lenses 722 in MLA 721 and lenses 724 in MLA 723 is that
between virtual pixels as the MLE EPE 306 processes the lenses 724 in MLA 723 are shifted relative to their coun
light . The MLA in FIG . 7A is configured in a manner to terpart in MLA 721. Moreover, the amount of shift varies
reduce or eliminate cross -talk between virtual pixels , in one depending on the location of the lenses . For example, lens
embodiment. The cells 706 are configured , in one embodi- 25 724 ( 1 ) is shifted in the x -y plane relative to its counterpart
ment, to reduce or prevent light that enters a cell 706 from lens 722( 1 ) in MLA 721. Likewise , lens 724 ( 3 ) is shifted in
passing to another cell 706 . For example , light that enters the x - y plane relative to its counterpart lens 722 ( 3 ) in MLA
cell 706 ( 2 ) may be prevented from going into cell 706 ( 1 ), or 721 . However, the amount of shift in these two cases is
706 ( 3 ). Note that there may be other cells adjacent to cell different. For example, the shift may be greater for the first
706 ( 2) that are not depicted in FIG . 7A . In one embodiment, 30 example than for the second . This different amount of shift
the cells 706 are "blackened ” on sides that physically may result in a different angle of refraction . Since the angle
separate the cells 706 to prevent light from escaping to an of refraction depends on the location of the lenses in the x - y
adjacent cell . The black lines between cells 706 represent a plane , this is one example of a spatially (in the x -y plane )
barrier that prevents cross -talk between cells 706 . Two of the dependent angle of refraction .
lines 720 that surround cell 706 ( 1 ) are labeled . 35 Note that although FIG . 7B depicts the lenses 724 on the
In the embodiment of FIG . 7A , the lenses in MLA 704 output side of the EPE as being non -periodic , in one
have a different optical power than the lenses in MLA 702 . embodiment, the lenses 722 on the input side of the EPE are
This is represented by lenses 714 being slightly larger than non -periodic but the lenses 724 on the output side of the EPE
lenses 712 . In one embodiment, this results in a different NA
are periodic . In one embodiment, the lenses on both sides of
for MLA 702 than for MLA 704 . In one embodiment, the 40 the EPE are non -periodic . In this latter case , there may still
NA for MLA 704 is greater than the NA for MLA 702. be some shift between the corresponding lenses on each side
FIG . 7B depicts another embodiment of a dual MLA EPE of the EPE .
306 . The dual MLA EPE 306 may be used in the display For ease of explanation , the lenses in MLA 721 and MLA
system of FIG . 3A or 4 , but is not limited thereto . The dual 723 are depicted as being about the same size in FIG . 7B .
MLA EPE 306 has a body 706 , a first MLA 702 , and a 45 However, the lenses in MLA 721 and MLA 723 could be a
second MLA 704 . The body 706 may have a number of cells different size , similar to as discussed with respect to the
706 ( 1 ) -706 ( 7 ). The first MLA 721 has lenses 722 ( 1 ) -722 (7 ). embodiment of FIG . 7A . Also note that the difference in the
Lenses 722 ( 1 )- 722 ( 7 ) may reside in the x - y plane . The size of the gaps 742, 744 may be exaggerated to better
second MLA 723 has lenses 724 ( 1 )- 724 ( 7 ). Lenses 724 ( 1 ) - explain the principle .
7247) may reside in the x -y plane . Thus , there may bemany 50 Note that various features in FIGS. 7A and 7B may be
more lenses in both the x - and y - direction for each MLA . combined in a dual MLA EPE 306 . In one embodiment, a
As with FIG . 7A , reference numerals 732 and 734 rep dualMLA EPE 306 has cells that prevent cross - talk between
resent light associated with one “ virtual pixel” in the image virtual pixels, has lenses with greater optical power on the
projected by the scan beam projector 204 . In this case , light output side than the input side , and has a non -periodic lens
associated with arrows 732 is input by lens 722 (2 ), passes 55 array on the output side .
through cell 716 (2 ), and out of lens 724 ( 2 ). Other virtual Not all of these three features need to be present in a dual
pixels may be processed in a similar manner by other sets of MLA EPE 306 . In one embodiment, a dual MLA EPE 306
a lens 722 (n ), cell 716 (n ), and lens 724 ( n ), where “ n ” refers has cells that prevent cross - talk and has lenses with greater
to one of the virtual pixels . optical power on the output side than the input side (but does
In this embodiment, lenses 722 ( 1 )- 722( 7 ) are periodic . By 60 not have a non -periodic lens array ) . In one embodiment, a
periodic it is meant that the distance between centers of dual MLA EPE 306 has cells that prevent cross - talk and has
adjacent lenses is uniform . However, lenses 724 ( 1 )- 724 (7 ) a non -periodic lens array (but does not have lenses with
are not periodic . Thus, for lenses 724 (1 ) -724 ( 7 ), the distance greater optical power on the output side than the input side ).
between the centers of adjacent lenses 724 varies from one In one embodiment, a dual MLA EPE 306 has lenses with
neighboring pair to another. Each of the lenses 724 in the 65 greater optical power on the output side than the input side
second MLA 723 has the same diameter, in this example . and has a non - periodic lens array on the output side (but
Thus, the space between lenses 724 may vary based on the does not have cells that prevent cross-talk ).
US 10 ,025 ,093 B2
17 18
In some embodiments, only one of these three features is can be better with the relay of refractive optical elements
present in a dual MLA EPE 306 . In one embodiment, a dual 900 compared to using just a diffuser EPE , a DOE EPE , or
MLA EPE 306 has cells that prevent cross -talk . In one a MLA EPE .
embodiment, a dual MLA EPE 306 has lenses with greater The relay of refractive optical elements 900 comprises an
optical power on the output side than the input side . In one 5 entrance pupil 901 and an expanded exit pupil 302 . As one
embodiment, a dual MLA EPE 306 has a non -periodic lens example , the entrance pupil 901 could be about 1 mm . The
array on the output side. expanded exit pupil 302 could be about 3 mm . However,
As noted above , the imaging lens 308 may comprise a pupil these are just examples , both the entrance pupil 901 and
number of optical elements . FIG . 8 is a diagram of one 10 In one 302 could be larger or smaller.
embodimentof an aspherical lens relay 800 with an EPE 306 10 ROE 900 embodiment , the FOV at the input of the relay of
is different from the FOV at the output. In one
at an intermediate image plane. The aspherical lens relay
comprises lenses 802 , 804 , 806 , 808 , 810 , 812 , 814 , 816 ,embodiment, the FOV is larger at the input of the relay of
refractive optical elements 900 than at the output . As one
818, and 820 . The lenses 802, 804 , 806 , 808 , 810 , 812 , 814, example , the FOV at the input might be about 110 degrees
816 , 818 , and 820 can bemade of glass or optical plastic. In 15 and the FOV at the output might be about 40 degrees .
one embodiment, the lens relay corrects for chromatic However, these are just examples.
effects , such as chromatic aberration . The EPE 306 is located One variation of the relay of refractive optical elements
on the intermediate image plane between lens 810 and 812 . 900 in FIG . 9 is to have a curved exit pupil expander at the
A wide variety of different types of EPES 306 can be used curved intermediate image plane. This would allow for pupil
in the aspherical lens relay . In one embodiment, the EPE 306 20 magnification. Any of the exit pupil expanders described
in FIG . 8 comprises a diffuser EPE . In one embodiment, the herein could be used at the curved intermediate image plane.
EPE 306 in FIG . 8 comprises a DOE EPE . In one embodi- Note that an EPE 306 can include any combination of
ment, the EPE 306 in FIG . 8 comprises a dual MLA EPE . elements that diffuse , diffract, or refract light. Thus , in one
Thus, the EPEs discussed with respect to FIGS. 5 , 6A , 6B , embodiment, the EPE 306 includes an optical element that
7A , and/or 7B could be used at the intermediate image plane 25 expands a pupil size by scattering ( or diffusing ) light and an
in FIG . 8 . However, the EPE 306 in the aspherical lens relay optical element that expands a pupil size by diffracting light.
800 is not limited to those embodiments . In one embodiment, the EPE 306 includes an optical element
FIG . 8 shows a y -z plane. The lenses in the aspherical lens that expands a pupil size by scattering (or diffusing ) light
relay are rotationally symmetric , in one embodiment. Thusin, 30 and an optical element that expands a pupil size by refracting
the aspherical lens relay may have a similar appearance in light. In one embodiment, the EPE 306 includes an optical
element that expands a pupil size by diffracting light and an
the x -z plane. optical element that expands a pupil size by refracting light.
The aspherical lens relay 800 comprises an entrance pupil In one embodiment, the EPE 306 includes an optical element
801. This entrance pupil 801 may have about the same size that expands a pupil size by scattering (or diffusing) light, an
as the exit pupil of the scan beam projector 204 . However
owever , z
it is not required that the entrance pupil 801 be about the, 35 optical element that expands a pupil size by diffracting light,
and an optical element that expands a pupil size by refracting
same size as the exit pupil of the scan beam projector 204. light.
The pupil size is expanded into expanded exit pupil 302 at FIG . 10 is a flowchart of one embodiment of a process
the output of the aspherical lens relay 800 . In one embodi 1000 of providing an image in a display system 300 having
ment, it is the EPE 306 that performs the pupil expansion . 40 an EPE 306 . FIG . 10 is a high level flow diagram that is used
For example , the aspherical lenses are not required to to summarize methods according to various embodiments of
perform pupil expansion . As one example , the entrance pupil the present technology . Such methods can be for use with a
801 could be about 1 mm . The expanded exit pupil 302 near eye or heads up display system that includes an EPE
could be about 4 mm to 5 mm . However, these are just optically coupled between a scan beam projector and a
examples . 45 waveguide.
In one embodiment, the field of view (FOV) at the input S tep 1002 includes scanning a light beam from a scan
of relay 800 is about the same as the FOV at the output of beam projector 204 . Step 1002 may include forming an
relay 800 . As one example , the FOV could be about 60 image have “ virtual pixels.”
degrees at both the input and the output . FIG . 8 depicts a Step 1004 includes expanding an exit pupil of the light
region 822 . In one embodiment, the portion of the MLA 50 beam from the scan beam projector 204 using an exit pupil
depicted in FIG . 7A or 7B can be used in region 822 . expander 306 . In one embodiment , the EPE 306 is a diffuser
In one embodiment, the EPE 306 does not include a EPE . In one embodiment, the EPE 306 is a DOE EPE . In one
diffuser EPE , a DOE EPE , or a MLA EPE . Instead , the EPE embodiment, the EPE 306 is a dual MLA EPE . In one
306 is formed from a relay of refractive optical elements embodiment, the EPE 306 comprises a relay of aspherical
having one or more aspherical lenses . FIG . 9 is a diagram on 55 lenses .
one embodiment of an EPE 306 that comprises a relay of In one embodiment, step 1004 includes channeling por
refractive optical elements 900 having one or more aspheri- tions of the light beam that correspond to pixels (e.g ., virtual
cal lenses . The relay of refractive optical elements (ROE ) pixels ) in the image through different physical sections ( e. g .,
900 comprises lenses 902, 904 , 906 , 916 , 918, and 920 . The cells 706 in FIG . 7A or cells 716 in FIG . 7B ) of the exit pupil
lenses 902 , 904 , 906 , 916 , 918 , and 920 can be made of glass 60 expander (e.g ., a dual MLA EPE 306 ) while preventing cross
or optical plastic . Note that one or more of the lenses are talk between adjacent pixels .
aspherical lenses. FIG . 9 shows a y -z plane. The lenses in the In one embodiment, step 1004 includes refracting the
lens relay 900 are rotationally symmetric in one embodi light beam from lenses in the microlens array ( e.g ., MLA
ment. Thus , the lens relay 900 may have a similar appear - 723 in FIG . 7B ) at different angles depending on a spatial
ance in the x - z plane . 65 location of the lenses in the microlens array . For example ,
Also depicted is a curved intermediate image plane , as the lenses 724 in MLA 723 may be non -periodic such that
represented by lines 908 , 910 , and 912 . The image quality the angle of refraction of one lens (e. g., lens 724 ( 1 )) is
US 10,025 ,093 B2
20
different from the angle of refraction of another lens (e .g ., Mounted to or inside temple 102 is an image source ,
lens 724 (3 )). Thus, the angle of refraction may depend on which ( in one embodiment) includes scan beam projector
the physical location (in , for example , an x - y plane ) of the 204 for projecting a virtual image and EPE 306 for expand
lens within the MLA . This may be referred to as a “ spatially ing the pupil from the image from scan beam projector into
dependent refraction angle ." 5 waveguide 100 . In one embodiment, there may also be one
In one embodiment, step 1004 includes applying a first or more lenses between the scan beam projector 204 and
optical power to the light beam at an input of the exit pupil waveguide 100 .
expander, and applying a second optical power to the light Control circuits 136 provide various electronics that sup
beam at an output of the exit pupil expanded . Note that the port the other components of head mounted display device
second optical power is not equal to the first optical power, 10 2 . Inside , or mounted to temple 102 , are ear phones 130 ,
in one embodiment. For example, lenses 712 in MLA 702 in inertial and/ or magnetic sensors 132 and temperature sensor
FIG . 7A may have a different optical power than lenses 714 138 . In one embodiment inertial and magnetic sensors 132
in MLA 704. Note that lenses 712 in MLA 702 in FIG . 7A include a three axis magnetometer 132A , three axis gyro
may have a different curvature than lenses 714 in MLA 704, 132B and three axis accelerometer 132C . The inertial and /or
in one embodiment. 15 magnetic sensors are for sensing position , orientation , and
Step 1006 includes optically coupling the light beam from sudden accelerations of head mounted display device 2 .
the exit pupil expander 306 into an input-coupler of an Scan beam projector 204 projects an image through EPE
optical waveguide. The optical waveguide 100 depicted in 306 . Waveguide 100 transmits light from Scan beam pro
FIG . 1A , 1B , 1C , or 4 could be used . For purpose of jector 204 to the eye 214 of the user wearing head mounted
illustration, reference will be made in process 1000 to 20 display device 2 . Waveguide 100 also allows light from in
elements in FIGS. 1A , 1B , 1C , and 4 . However, process front of the head mounted display device 2 to be transmitted
1000 is not limited to those examples . through waveguide 100 to eye 214 , as depicted by arrow
Step 1008 includes diffracting the light beam from the 142 , thereby allowing the user to have an actual direct view
input- coupler 112 to an intermediate diffractive element 114 of the space in front of head mounted display device 2 in
in the optical waveguide . Note that in one embodiment, the 25 addition to receiving a virtual image from scan beam pro
waveguide 100 does not have an intermediate diffractive jector 204 0 . Thus, the walls of waveguide 100 may be
element 114 . In this case , step 1008 is not performed . see - through . Waveguide 100 includes input coupler 112 and
Instead , the light beam from the input - coupler 112 may be output coupler 116 . Optionally, waveguide 100 includes an
diffracted to an output- coupler in the optical waveguide 116 . intermediate element 114 (not depicted in FIG . 11 ).
Step 1010 includes diffracting the light beam from the 30 Opacity filter 1114 , which is aligned with waveguide 100 ,
intermediate diffractive element 114 to an output- coupler in selectively blocks natural light, either uniformly or on a
the optical waveguide 116 . Step 1010 may include expand per -pixel basis , from passing through waveguide 100 . In one
ing the pupil in either a vertical or a horizontal direction . embodiment, the opacity filter can be a see - through LCD
Step 1012 includes diffracting the light beam from the panel, electro chromic film , PDLC (Polymer dispersed Liq
output -coupler 116 to outside of the optical waveguide 100 . 35 uid Crystal) or similar device which is capable of serving as
This may include diffracting the light beam into a human eye an opacity filter. Such a see -through LCD panel can be
214 . Step 1012 may include expanding the pupil in either a obtained by removing various layers of substrate, backlight
vertical or a horizontal direction (the expansion may be and diffusers from a conventional LCD . The LCD panel can
horizontal if step 1010 was vertical expansion or vertical if include one or more light- transmissive LCD chips which
step 1010 was horizontal expansion ). 40 allow light to pass through the liquid crystal. Such chips are
FIG . 11 depicts a top view of a portion of head mounted used in LCD projectors , for instance .
display device (HMD ) 2 , including a portion of the frame Opacity filter 1114 can include a dense grid of pixels ,
that includes temple 102 and nose bridge 1104 . Various where the light transmissivity of each pixel is individually
embodiments of EPES 306 disclosed herein may be used in controllable between minimum and maximum transmissivi
the HMD 2 . Only the right side of head mounted display 45 ties . While a transmissivity range of 0 - 100 % is ideal ,more
device 2 is depicted . limited ranges are also acceptable . As an example, a mono
A portion of the frame of head mounted display device 2 chrome LCD panel with no more than two polarizing filters
will surround a display (that includes one ormore lenses). In is sufficient to provide an opacity range ofabout 50 % to 99 %
order to show the components of head mounted display per pixel, up to the resolution of the LCD . At the minimum
device 2 , a portion of the frame surrounding the display is 50 of 50 % , the lens will have a slightly tinted appearance ,
not depicted . The display includes a waveguide 100, opacity which is tolerable . 100 % transmissivity represents a per
filter 1114 , see -through lens 1116 and see -through lens 1118 . fectly clear lens . An “ alpha” scale can be defined from
In one embodiment, opacity filter 1114 is behind and aligned 0 - 100 % , where 0 % allows no light to pass and 100 % allows
with see -through lens 1116 , waveguide 100 is behind and all light to pass . The value of alpha can be set for each pixel
aligned with opacity filter 1114 , and see -through lens 1118 55 by the opacity filter control circuit 224 described below .
is behind and aligned with light- guide optical element 112 . A mask of alpha values can be used from a rendering
See -through lenses 1116 and 1118 are standard lenses used pipeline , after z -buffering with proxies for real-world
in eye glasses and can be made to any prescription ( includ - objects . When the system renders a scene for the augmented
ing no prescription ). In one embodiment, see - through lenses reality display, it takes note of which real -world objects are
1116 and 1118 can be replaced by a variable prescription 60 in front ofwhich virtual objects . If a virtual object is in front
lens. In some embodiments , head mounted display device 2 of a real-world object, then the opacity should be on for the
will include only one see -through lens or no see - through coverage area of the virtual object. If the virtual is ( virtually )
lenses. In another alternative , a prescription lens can go behind a real-world object, then the opacity should be off, as
inside waveguide 100 . Opacity filter 1114 filters out natural well as any color for that pixel, so the user will only see the
light (either on a per pixel basis or uniformly ) to enhance the 65 real-world object for that corresponding area (a pixel or
contrast of the virtual imagery. Waveguide 100 channels more in size ) of real light. Coverage would be on a pixel
artificial light to the eye . by -pixel basis , so the system could handle the case of part
US 10 ,025 ,093 B2
21 22
of a virtual object being in front of a real -world object, part configured to scan a light beam from the laser with the
of the virtual object being behind the real-world object, and scanning mirror; a pupil replicator including a bulk -sub
part of the virtual object being coincident with the real strate, an input-coupler an output-coupler, and a diffractive
world object. Displays capable of going from 0 % to 100 % optical element between the input- coupler and the output
opacity at low cost, power, and weight are the most desirable 5 coupler, the output- coupler configured to deliver the light
for this use . Moreover, the opacity filter can be rendered in beam to an eye of a wearer of the see- through , near eye
color, such as with a color LCD or with other displays such display system ; and an exit pupil expander optically coupled
as organic LEDs, to provide a wide field of view . between the scan beam projector and the pupil replicator, the
FIG . 11 only shows half of head mounted display device exit pupil expander configured to couple the light beam into
2 . A full head mounted display device 2 would include 10 the input- coupler.
(where applicable ) another set lenses, another opacity filter In accordance with certain embodiments described herein ,
another waveguide 100 , another scan beam projector 204, an apparatus comprises a scan beam projector configured to
another lens , earphones, and temperature sensor. project a light beam , an optical waveguide, and an exit pupil
In the above description and the FIGS . described therein , expander optically coupled between the scan beam projector
the waveguides 100 were typically described and shown as 15 and the optical waveguide . The exit pupil expander is
being planar waveguides that each include a pair of planar configured to couple the light beam into the optical wave
opposing main surfaces . In an alternative embodiment, one guide . The exit pupil expander comprises a dual microlens
or both of the main surfaces of a waveguide could be array comprising a first microlens array that is configured to
non -planar, e .g ., curved . In the above description and the receive the light beam in first lenses in a first plane and a
FIGS. described therein , the waveguides 100 were typically 20 second microlens array that is configured to output the light
described and shown as being parallel to one another, beam in second lenses in a second plane parallel to the first
however that need not be the case . plane , wherein ones of the second lenses correspond to ones
In the above description , the scan beam projector 204 was of the first lenses but are shifted relative to the first lenses in
described as outputting red , green and blue light correspond a direction parallel to the second plane.
ing to an image , and the waveguides 100 were described as 25 In accordance with certain embodiments described herein ,
transferring the red , green and blue light from the input - an apparatus comprises a scan beam projector configured to
couplers 112 to the output -couplers 116 of the various project a light beam , an optical waveguide, and an exit pupil
waveguides 100 , and more generally, from an entrance pupil expander optically coupled between the scan beam projector
to an exit pupil. However, it is also within the scope of the and the optical waveguide. The exit pupil expander is
present technology that the light output by the scan beam 30 configured to couple the light beam into the optical wave
projector 204 include alternative colours , such as, but not guide. The exit pupil expander comprises a dual microlens
limited to , cyan , magenta and yellow , in which cases the array comprising a first microlens array that is configured to
input-couplers 112 , output- couplers 116 would be designed receive the light beam in first lenses in a first plane and a
for such alternative wavelength ranges . It is also within the second microlens array that is configured to output the light
scope of the present technology that more than three colors 35 beam in second lenses in a second plane parallel to the first
of light be output by the scan beam projector 204 , e . g ., the plane , wherein the first set of lenses is periodic and the
scan beam projector 204 can output red , green , blue and second set of lenses is non -periodic .
yellow light corresponding to an image . In this latter case , an In accordance with certain embodiments described herein ,
additional waveguide can be used to guide the yellow light, an apparatus comprises a scan beam projector configured to
or the yellow light can be guided within one of the wave - 40 project a light beam , an optical waveguide, and an exit pupil
guides that also guides one of the other colors . Other expander optically coupled between the scan beam projector
variations are possible and within the scope of the present and the optical waveguide . The exit pupil expander is
technology configured to couple the light beam into the optical wave
In accordance with certain embodiments described herein , guide . The exit pupil expander comprises a dual microlens
an apparatus comprises a scan beam projector configured to 45 array comprising a firstmicrolens array that is configured to
project a light beam , an optical waveguide and an exit pupil receive the light beam and a second microlens array that is
expander optically coupled between the scan beam projector configured to output the light beam , wherein the second
and the optical waveguide . The optical waveguide includes microlens array has a different optical power than the first
a bulk - substrate, an input -coupler an output-coupler, and a microlens array.
diffractive optical element between the input-coupler and the 50 In accordance with certain embodiments described herein ,
output -coupler. The exit pupil expander is configured to an apparatus comprises a scan beam projector configured to
couple the light beam into the input -coupler. project a light beam , an opticalwaveguide , and an exit pupil
In accordance with certain embodiments described herein expander optically coupled between the scan beam projector
a method comprises scanning a light beam using a scan and the optical waveguide. The exit pupil expander com
beam projector; expanding an exit pupil of the light beam 55 prises a diffuser EPE .
from the scan beam projector using an exit pupil expander, In accordance with certain embodiments described herein ,
optically coupling the light beam from the exit pupil an apparatus comprises a scan beam projector configured to
expander into an input- coupler of an optical waveguide, project a light beam , an optical waveguide, and an exit pupil
diffracting the light beam from the input-coupler to an expander optically coupled between the scan beam projector
intermediate diffractive element in the optical waveguide , 60 and the optical waveguide . The exit pupil expander com
diffracting the light beam from the intermediate diffractive prises a DOE EPE .
element to an output- coupler in the optical waveguide, and In accordance with certain embodiments described herein ,
diffracting the light beam from the output-coupler to outside an apparatus comprises a scan beam projector configured to
of the optical waveguide. project a light beam , an opticalwaveguide, and an exit pupil
In accordance with certain embodiments described herein 65 expander optically coupled between the scan beam projector
a see -through , near eye display system , comprises a light and the optical waveguide. The exit pupil expander com
engine comprising a laser , a scanning mirror, and logic prises a series of refractive optical elements that expand an
US 10 ,025 ,093 B2
23 24
exit pupil of the scan beam projector. The series of refractive 6 . The method of claim 5 , wherein the exit pupil expander
optical elements are aspheric lenses in one embodiment comprises a microlens array , wherein expanding the exit
Although the subject matter has been described in lan - pupil of the light beam from the scan beam projector using
guage specific to structural features and /or methodological the exit pupil expander comprises :
acts, it is to be understood that the subjectmatter defined in 5 refracting the light beam from lenses in the microlens
the appended claims is notnecessarily limited to the specific array at different angles depending on a spatial location
features or acts described above . Rather, the specific features of the lenses in the microlens array .
and acts described above are disclosed as example forms of 7 . The method of claim 5 , wherein expanding the exit
implementing the claims. pupil of the light beam from the scan beam projector using
What is claimed is: the exit pupil expander comprises:
1 . An apparatus, comprising : applying a first optical power to the light beam at an input
a scan beam projector configured to project a light beam ; of the exit pupil expander ; and
an optical waveguide including a bulk - substrate , an input
coupler, an output-coupler, and a diffractive optical applying a second optical power to the light beam at an
element between the input -coupler and the output- 15 output of the exit pupil expander, the second optical
coupler; and power is not equal to the first optical power.
an exit pupil expander optically coupled between the scan 8 . A see - through , near eye display system , comprising:
beam projector and the optical waveguide, the exit a light engine comprising a laser, a scanning mirror, and
pupil expander configured to couple the light beam logic configured to scan a light beam from the laser
sam proiector into the input- coupler. 20 with the scanning mirror ;
the exit pupil expander comprising a dual microlens array a pupil replicator including a bulk - substrate , an input
configured to expand an exit pupil associated with the coupler , an output-coupler , and a diffractive optical
scan beam projector, element between the input-coupler and the output
wherein the dualmicrolens array comprises a firstmicro coupler, the output-coupler configured to deliver the
lens array that is configured to receive the light beam in 25 light beam to an eye of a wearer of the see -through ,
first lenses in a first plane and a second microlens array near eye display system ; and
that is configured to output the light beam in second an exit pupil expander optically coupled between the light
lenses in a second plane parallel to the first plane, engine and the pupil replicator, the exit pupil expander
wherein the first lenses are periodic and the second configured to couple the light beam from the light
lenses are non - periodic . 30
engine into the input-coupler,
2 . The apparatus of claim 1 , wherein the diffractive optical the exit pupil expander comprising a dual microlens array
element further comprises a first diffractive optical element having a first microlens array configured to receive the
and a second diffractive optical element, wherein the input
coupler comprises the first diffractive optical element con light beam in first lenses in a first plane and a second
figured to diffract the light beam to the second diffractive 35 microlens array configured to output the light beam in
optical element, wherein the second diffractive optical ele second lenses in a second plane parallel to the first
ment is configured to diffract the light beam to the output plane, wherein ones of the second lenses have a dif
coupler, wherein at least one of the first diffractive optical ferent numerical aperture from ones of the first lenses.
element or the second diffractive optical element is config 9 . The see -through , near eye display system of claim 8 ,
ured to expand the light beam in at least one direction . 40 wherein the dual microlens array is configured to provide a
3 . The apparatus of claim 1, further comprising an opacity spatially dependent refraction angle .
filter aligned with the optical waveguide, the opacity filter is 10 . The see- through , near eye display system of claim 8 ,
configured to selectively block natural light from passing wherein the dual microlens array comprises a body having
through the optical waveguide . a first side and a second side , the body comprising cells
4 . The apparatus of claim 1 , wherein the first microlens 45 configured to channel light from ones of the first lenses to
array comprises first lenses and the second microlens array corresponding ones of the second lenses , the cells config
comprises second lenses that do not match the first lenses. ured to prevent cross -talk between adjacent cells .
5 . A method comprising: 11 . An apparatus, comprising :
scanning a light beam using a scan beam projector; a scan beam projector configured to project a light beam ;
expanding an exit pupil of the light beam from the scan 50 an optical waveguide including a bulk -substrate , an input
beam projector using an exit pupil expander, compris coupler, an output-coupler, and a diffractive optical
ing channeling portions of the light beam that corre element between the input-coupler and the output
spond to virtual pixels in the light beam through coupler ; and
different physical sections of the exit pupil expander
while preventing cross talk between adjacent virtual 55 an exit pupil expander optically coupled between the scan
pixels ; beam projector and the optical waveguide, the exit
optically coupling the light beam from the exit pupil pupil expander configured to couple the light beam
expander into an input-coupler of an optical wave from the scan beam projector into the input -coupler,
guide ; the exit pupil expander comprising a series of aspherical
diffracting the light beam from the input-coupler to an 60 refractive optical elements configured to expand an exit
intermediate diffractive element in the optical wave pupil of the scan beam projector.
guide ; 12 . An apparatus, comprising:
diffracting the light beam from the intermediate diffrac a scan beam projector configured to project a light beam ;
tive element to an output-coupler in the optical wave an optical waveguide including a bulk - substrate , an input
guide ; and 65 coupler, an output- coupler, and a diffractive optical
diffracting the light beam from the output-coupler to element between the input-coupler and the output
outside of the optical waveguide. coupler ;
US 10 ,025 , 093 B2
25 26
a series of refractive optical elements comprising a first 16 . An apparatus, comprising:
set of lenses and a second set of lenses, the series of a scan beam projector configured to project a light beam ;
refractive optical elements correcting for chromatic an optical waveguide including a bulk -substrate , an input
aberration ; and coupler, an output- coupler, and a diffractive optical
an exit pupil expander optically coupled between the scan 5 element between the input-coupler and the output
beam projector and the optical waveguide , the exit coupler; and
pupil expander optically coupled between the first set an exit pupil expander optically coupled between the scan
and the second set of lenses, the exit pupil expander beam projector and the optical waveguide, the exit
configured to couple the light beam from the scan beam pupil expander configured to couple the light beam
projector into the input-coupler . 10 from the scan beam projector into the input-coupler,
13 . A method comprising: the exit pupil expander comprising a dual microlens array
scanning a light beam using a scan beam projector; configured to expand an exit pupil associated with the
expanding an exit pupil of the light beam from the scan scan beam projector, wherein the dual microlens array
beam projector using an exit pupil expander, compris comprises:
ing: 15
applying a first optical power to the light beam at an a first microlens array that is configured to receive the
input of the exit pupil expander; and light beam in first lenses in a first plane; and
applying a second optical power to the light beam at an a second microlens array that is configured to output
output of the exit pupil expander, the second optical the light beam in second lenses in a second plane
power is not equal to the first optical power; 20 parallel to the first plane, wherein ones of the second
optically coupling the light beam from the exit pupil lenses correspond to ones of the first lenses but are
expander into an input-coupler of an optical wave shifted relative to the first lenses in a direction
guide ; parallel to the second plane .
diffracting the light beam from the input-coupler to an 17 . An apparatus, comprising :
a scan beam projector configured to project a light beam ;
intermediate diffractive element in the optical wave - 25 an optical waveguide
guide; including a bulk - substrate , an input
diffracting the light beam from the intermediate diffrac coupler, an output- coupler, and a diffractive optical
tive element to an output -coupler in the optical wave element between the input-coupler and the output
guide ; and coupler; and
diffracting the light beam from the output-coupler to 30 an exit pupil expander optically coupled between the scan
outside of the optical waveguide . beam projector and the optical waveguide, the exit
14 . The method of claim 13, further comprising: pupil expander configured to couple the light beam
propagating the light beam from the input-coupler from the scan beam projector into the input- coupler,
through the optical waveguide to an output coupler of the exit pupil expander comprising a dual microlens array
the optical waveguide; and 35 configured to expand an exit pupil associated with the
optically coupling the light beam through output coupler scan beam projector, wherein the dual microlens array
to outside of the optical waveguide. comprises:
15 . A see -through , near eye display system , comprising : a first microlens array that is configured to receive the
a light engine comprising a laser, a scanning mirror, and light beam ; and
logic configured to scan a light beam from the laser 40 a second microlens array that is configured to output
with the scanning mirror; the light beam , wherein the second microlens array
a pupil replicator including a bulk -substrate , an input has a different optical power than the first microlens
coupler an output- coupler, and a diffractive optical array .
element between the input- coupler and the output 18 . A see -through , near eye display system , comprising :
he us45
coupler , the output-coupler configured to deliver the a light engine comprising a laser, a scanning mirror, and
light beam to an eye of a wearer of the see -through , logic configured to scan a light beam from the laser
near eye display system ; and with the scanning mirror ;
an exit pupil expander optically coupled between the light a pupil replicator including a bulk - substrate , an input
engine and the pupil replicator, the exit pupil expander coupler an output-coupler, and a diffractive optical
configured to couple the light beam from the light 50 element between the input- coupler and the output
engine into the input -coupler, the exit pupil expander coupler, the output-coupler configured to deliver the
comprising a dual microlens array having: light beam to an eye of a wearer of the see - through ,
a body having a first side and a second side; near eye display system ; and
a first microlens array having first lenses disposed on an exit pupil expander optically coupled between the light
engine and the pupil replicator , the exit pupil expander
the first side ; and 55
configured to couple the light beam from the light
a second microlens array having second lenses dis engine into the input-coupler ;
posed on the second side, the body comprising cells wherein the exit pupil expander comprises a relay of
configured to channel light from ones of the first aspherical lenses that expand an exit pupil of the light
lenses to corresponding ones of the second lenses, engine .
the cells configured to prevent cross - talk between 60
adjacent cells. * * * * *

Waveguide Display with Exit Pupil Expander

Uploaded by

Document Information

Original Description:

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Waveguide Display with Exit Pupil Expander

Uploaded by

Copyright:

Available Formats

MAIMUUTAMAN KOULUTUNNO UNITI US010025093B2

(12) United States Patent (10 ) Patent No.: US 10 ,025 ,093 B2

300 306 .view

204 100B 100G 100R

116B 116G 116R

72212 / 1162) 724(2)

722(3) 17198) 724(3)

722 (5 ) 172637 724 (5)

Scan a lightbeam using a scan beam projector

Diffract the lightbeam from the input- coupler to an 1008

Diffract the lightbeam from the intermediate diffractive 1010

pomies in die transport antanen

You might also like