0% found this document useful (0 votes)
66 views22 pagesUS12322368B2
The document describes a patent application by Meta Platforms Technologies, LLC for an adaptive active noise cancellation (ANC) system that modifies sound cancellation based on environmental triggers. The method involves identifying external sounds that should be made audible to the user and adjusting the ANC accordingly. This innovation aims to enhance user awareness of important external sounds while still providing noise reduction benefits.
Uploaded by
Atul TripathiCopyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF or read online on Scribd
0% found this document useful (0 votes)
66 views22 pagesUS12322368B2
The document describes a patent application by Meta Platforms Technologies, LLC for an adaptive active noise cancellation (ANC) system that modifies sound cancellation based on environmental triggers. The method involves identifying external sounds that should be made audible to the user and adjusting the ANC accordingly. This innovation aims to enhance user awareness of important external sounds while still providing noise reduction benefits.
Uploaded by
Atul TripathiCopyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF or read online on Scribd
2) United States Patent
ay
a
my
oe)
o
(@)
(58)
Lo
et al.
ADAPTIVE ANC BASED ON
ENVIRONMENTAL TRIGGERS
Applicant: Meta Platforms Technologies, LLC
‘Menlo Park, CA (US)
Inventors: Andrew Lovitt, Redmond, WA (U
Antonio John Miller, Woodiaville, WA
(US); Philip Robinson, Seattle, WA,
(US); Seott Phillip Setfon, Kirkland,
Wa (Us)
Assignee: Meta Platforms Technologies, LLC,
Menlo Park, CA (U
Notice: Subject to any disclaimer, the tem ofthis
patent is extended of adjusted under 35
USC. 18446) by 0 days.
Appl. No. 18/530,890
Filed: Dee, 6, 2023
Prior Publication Data
US 2024/0105156.A1 Mar. 28, 2024
Related U.S. Application Data
Continuation of application No, 17/702,738, filed on
Mar. 3, 2022, now Pat. No. 11,869,475, which isa
(Continued)
Int. Cl.
G10K 11178 (2006.01)
HosR 140 (2006.01)
[Link]
CPC. G10K 11717827 (2018.01): GIOK 1117823
(201801); HOAR 1/406 (2013.01),
(Continued)
of Classification Search
GOK H/17S27; G1OK 11/17823: GOK
2210/1081; G10K 22100111
(Continued)
crc
system
USO
1232236882,
(10) Patent No.:
(4s) Date of Patent:
US 12,322,368 B2
jun. 3, 2025
60) References Cited
US. PATENT DOCUMENTS.
S67O1L A * 71997 Garis 03a 3342
eT
(Continsed)
FOREIGN PATENT DOCUMENTS
tn6062746 A 102016
Continved)
(OTHER PUBLICATIONS
tended Furopcan Search Report for Buropean Application No
189376270, mnfed Now 17,2021, 7 pages,
Continved)
Primary Evaminer — Qyesola C Ojo
(74) Attorney, Agent, or Firm — Groenberg Traurig, LLP
on
The disclosed computer-implemented method may inchude
applying, via a sound reproduetion system, sound eaneela
‘ion that reduces an amplitade of various sound signals. The
‘method funher includes identifying, among the sound sig
tals, external sound whose amplitude ist be reduced by
the sound cancellation. The method then includes analyzing
the ienified extemal sound to detemnine whether the
‘dentfed external sound isto be made audible toa user anc,
‘upon determining that the extemal sound is to be made
andilo tothe user, the method includes modifying the sound
‘cancellation so that the idenifed extemal sound is made
andible to tho user. Various other methods, systems, and
‘computer-readable media are also diselosed
ABSTRACT
20 Claims, 8 Drawing Sheets US 12,322,368 B2
Page 2
Related U.S. Application Data
‘continuation of application No. 16I861,948, fled on
Apr. 29, 2020, now Pat. No. 11,315,541, which is a
‘continuation of application No. 16/171,389, filed on
‘Oct. 26, 2018, now Pat. No, 10,679,602
(2) [Link]
CPC soocnnne GIOK 2210/1081 (2013.01); GOK
210/111 (2013.01), GLOK 2210/3084
(2013.01); GIOK 2210/3046 (2013.01); GIOK
10/3056 2013.01)
(58) Fleld of Classification Seareh
CPC... GIOK 221013044; GIOK 2210/3046; GIOK,
221013056; GLOK 11/17837; GIOK,
THATS: HOUR 1/406; HOAR 1/1083:
HOSR 3/002; HOR 246001
Se application file for complete search history.
66) References Cited
USS. PATENT DOCUMENTS,
960113 B2* 62017 GioL 2v088
916939 B2 72017
1oj0793600 B26 2020
2novioodeso4 AL* 11/2001 HAR V1083
3826
20020141599 AL* 10°2002 Trajhovie .. GIOK 17873,
3872
20080015365 AL* 1/2004 Obmexi G10 1923
“ovEIsat
20060083357 AL_ 412006 Emoto
doovn919s9 Al* 122007 Seefeit 036 9025
381104
2008018748 AL* $2008 abasi ..... GOK IUTIRST
381715
20080267416 AL* 102008 Goldstein HOR 300
3856
20180070931 AL_ 32013 Hetherington
BOISOLS6212 AL* 62013 Bjslosevie .. GOK VITESS
3171
2014004269 AL* 22014 Anderon Hoa 11083
3s
20140079235 AL* 32014 Lyons G10K W773
381716
2010126733 AL? $2014 Gauges Je... GLOK ILI
SSI716
20140172426 AL* 62014 Arise GioL 210008
rons
201510294662 AL* 10°2018- Ibrahim... GIOK IITSD3,
381715
201610005122 AL* 2016 Zad ts 03632
704226
201600168336 AL 6/2016 Di Cento ea
dovors792s AL 9.2016 Nomura
2oriosss4os a+ 112017 IK TET
aniwnaeois? AL* ‘92018 Hbaa4 1106,
goiworesses AL 92018 Gish 16.638
aoisurs600 AL* 102018 ict 5020
annwussoo7 AL* 122030 ‘Gtor 210208
ggaunaiogs AL* ‘12022 GtOL 2951
POREIGN PATENT DOCUMENTS
we 42006
» 2 62000
» dooisiarrs A $2004
w 2008095792 42006
w A S307
» 3 12007
w A Lois
aw A ‘o016
» A S216
® A S207
ke 20100120867 11 2010,
KR 01612092 BI 42016
KR aolsnoso47s 8 62016
Kr aovsooe71s9 $2017
wo BOIOIOSHSS AL 62016,
wo aonoossios At 42020,
(OTHER PUBLICATIONS
First ction Interview Otic Aston Summary mie Now 14,2019
for US. Appl. No. 16191389, led Oct. 26, 2018, 8 Pages
Inerontional Preiminary Report on Patel for Iterations
Application No. PCTUS2OISOGG946, mailed May 6. 2021, 7
Pages
International Search Report and Writen Opinion fo
Application No. PCTUSZOISU66946, mailed Jul.
Pages
Notice of Allowance mailed Jan. 29, 2020 for US. App No.
16'171,38, fl Oct 26, 2018 3 Pages,
Notication ofthe Fint Office Action mailed an 6, 2022 for
Chinese Application No, 201880099008 4 filed Dev. 20,2018, 13
pases
(tice Acton mated Ju 26,2023 for European Patent Applisition
No. 189576270, filed on Dee. 20, 2018, 6 pages
Ottce Action mailed May 25,2023 for Korean Application No,
1-2021-7015619, lst Des. 20,2018, 3 pages.
Oc Acton male Jun. 27,2023 for Japanese Patent Application
No. 20216507925, fled om Feb. 16,2021, 10 pages,
(Oc Action mal Sep 27,2022 for apancae Patent Application
No, 2021507035, lon Fe. 16, 2021 18 page,
Olice Action mailed Oct. 28, 2022 for Kotean Application No,
10-2021-701561 filed De. 20,2018, 11 pages
Drsinteriow First Ofce Aston med Ot 1, 2019 for US. App
No. 16171389, Hl Oct 26, 2018, 20 Pages
TEtvopeaa Seach Report for European Patt Application No,
2AIS97HRS dae Feb. 1, 2028, 7 pg.
* cited by examiner U.S. Patent Jun. 3, 2025 Sheet 1 of 8 US 12,322,368 B2
110
FIG. 1 S B2
U.S. Patent Jun. 3, 2025 Sheet 2 of 8 US 12,322,368
System
200
220(F)
- eT
eH
yaseuirniiaii int
AUER
ETT
HeHuRniit
wat!
LETT
205
FIG. 2 U.S. Patent Jun. 3, 2025 Sheet 3 of 8 US 12,322,368 B2
FIG. 3 U.S. Patent Jun. 3, 2025 Sheet 4 of 8 US 12,322,368 B2
400
\ ao
‘Computer System
402: 403
Processor] [Memory
404
Communications Module
405~ 406
Receiver | [Transmitter
407
Tee
cr
‘Sound Reproduction 418
409 Module
Noise Canceling Module Jt
l ato
External Sound Genin
Module oa
ait
External
Sound
ANC Moaificatio
Instructions.
412
‘Sound analyzer
413
Determination’,
418
Crosmanest ana J
Modified Noise TANG Modification Module
\cancaling Sort
420
TANG Policies and Settings
FIG. 4 U.S. Patent Jun. 3, 2025 Sheet 5 of 8 US 12,322,368 B2
500
N 510
‘Apply noise cancellation
Identify external sounds
‘Analyze extemal sounds
‘Woy noise cancelation
FIG. 5
600
601 pos
eee Sound Reproduction System
Speciied 605:
ae "ANG Module
606
Microphone 603 x
cor Phrase
Sound Analyzer [
FIG. 6 U.S. Patent Jun. 3, 2025 Sheet 6 of 8 US 12,322,368 B2
eta
610: 604
‘Sound Reproduction System
605:
oH
Sound
‘ANG Mode
Siren
4
Hi
oe
er
Bear Growl' ae
612.
607
Sound Analyzer
FIG. 7
604
Sound Reproduction
623 ‘stom
“+ 605
Modified
ANC Signal >[ANC Module Sj
601 se ‘Sound
Microphone
607:
[Sound Analyzer]
620:
Direction
Analyzer
e2t
FIG. 8 U.S. Patent Jun. 3, 2025 Sheet 7 of 8 US 12,322,368 B2
co.
Sound Reproduction
Syne i
sas.
Tniaton
Ani Moule siager
st 606
sot
Tcaiea_( wiccoprore) |e
ce &
67 =
Sound Anavzor ea
60 a ed os go?
Brent Anaiaar
FIG. 9
cass
Sound Detection and
Reproduction Systm
cosa
TANG Module oe
A Fistin of
rs |. —___arenh
wicophone
sora
Sound naa
sau.
Sound Detection ana
: Reproavcton Syston
; 088
' OQ et ANG Mode
™ —
irophone
sao P2078
Soind Ana]
FIG.10 U.S. Patent Jun. 3, 2025 Sheet 8 of 8 US 12,322,368 B2
604.
601 650
‘Sound Reproduction
System,
605
‘ANC Module
608
Microphone
07
[Sound Analyzer]
651
FIG. 11 US 12,322,368 B2
1
ADAPTIVE ANC BASED ON
ENVIRONMENTAL TRIGGERS
CROSS REFERENCE TO RELATED
"APPLICATION
‘This application isa continuation of US. application Sex
No, 17/702, 739 filed on 23 Mar, 2022, which isa continu-
ation of US. application Ser. No. 16861,083, filed on 29
Apr. 2020 which is @ continuation of U-S. application Ser
No, 16/171,380, filed on 26 Oct. 2018, the disclosure of
Which is incorporated, in its entirety, by this reference.
BACKGROUND
Active noise cancellation (ANC) is often used in ear
phones and other electronic deviees to cancel the noise
Surrounding @ user, For example, users often sear head-
phones equipped with ANC on agplanes to drown out noise
from the jet engines, as well a remove sounds from nearby
passengers. Active noise cancellation typically operates by
listening to extemal sounds, and then generating a noise
‘cancelation signal tat is 180 degrees out of phase with the
actual background noise. When the ANC signal and the
‘external sounds ae combined, the extemal sounds are muted
‘or atleast areatly mulled.
In typical ANC applications users will turn on the ANC
function, and leave it on until they are done wearing the
headset. For example, if a user js mountain biking or road
biking the user may wear ANC bead phones or earbuds that
allow: the user t0 listen to music, while having outside
rounds muted entirely or greally reduced. In such an
‘example, the user would normally typically leave the ANC
Feature ruaning forthe duration ofthe bike ride. During this
Fide, however, the user may miss some sounds that are
Jmportant forthe user to hear such a @ ear hora oF tain
whistle
SUMMARY,
As will be descr in greater detail below, the instant
disclosure describes modifying. active noise cancelation
based om environmental triggers. In cases where certain
external noises should reach the user, the embodiments
herein may modify active noise cancellation to allow those
‘external sounds through to reach the user. It should be noted
that throughout this document, the terms “noise eancella-
tion,” “active noise cancellation,” or “sound cancellation”
‘may’ each refer to methods of reducing any type of able
noise oF sound,
In one example, a computer-implemented method for
‘modifying active noise cancellation based on environmental
triggers may inelude applying, via a sound reproduction
system, noise cancellation thet reduces an amplitude of
Various sound signals. The method may’ further include
‘identifying, among the sound signals, an extemal sound
whose amplitude isto be reduced by active noise eancella-
tion. The method may then inclnde analyzing the identified
‘extemal sound to determine whether the identified extemal
sound isto be made audible o a user and, upon detemnining
thatthe external sound is o be made sible tothe use, the
‘method may inckade modifying the etive noise cancellation
40 that the identified external sound! is made audible to the
In some examples, modifying the active noise cancelling
signal inchades increasing aadbility ofthe identified exter
nal sound. Increasing avdibility of the identified external
0
o
2
sound may include compressing the modified active noise
cancelling signal, so that the modified active noise cancel-
Ting signal is played back in a shortened timeframe. Add
tionally or alternatively, increasing the audibility of the
identified external sound may include inereasing volume
along a specified frequency band,
‘In some examples, the identified extemal sound may
include various words, ora specific word or phrase In some:
‘examples, the method may funher include detecting which
Grction the identified extemal sound originated fom and
presenting the identified external sound to the user as
‘coming from the detected direction. Ia some examples, dhe
active noise cancelling signal may be further modified to
present subsequently occurring audio from the detected
Section
some examples, policies may be applied when deter-
mining thatthe extemal sound isto be made audible o the
user In some examples, the identified external sound may be
ranked aeconding 1 level of severity. In some examples, the
‘active noise cancelling signal may’ be modified upon deter
ining that the identified extemal sound has «minim
threshold level of severity
‘In some examples, the method for modifying tive noise
cancellation baked on environmental triggers may Torher
include receiving an indiation that an event has occured
\ithin a specified distance of the user and determining that
the event js pertinent 10 the user. Then, based on the
determination that the event is pectinent to the user, the
‘active noise eanceling signal may be modified to allow the
‘user to hear extemal sounds coming from the ste of the
‘vent, In some examples, mictaphones configured t listen
{o the external sounds may be directionally oriented toward
the event
some examples, the method ay further include deter-
mining that another electronic device within = specified
distance of the system has detected an external sound that is
pertinent tothe wser, The method may then inelude deter
‘mining a current postion ofthe other electronic deviee, and
physically or digitally orienting (.c., beamforming) micro-
phones configured to listen othe extemal sounds toward the
Selermined position of the electronie device
In some examples, modifying the active noise cancelling
signal may include continuing to apply active noise cancel-
Ting to external sounds received from multiple locations,
hile disabling active noise cancelling for external sounds
received froma specified location. In some examples, most
‘ving the active noise cancelling signal may include eon-
‘inving to apply active noise cancelling 1 extemal sounds
received fom a specific person, while disabling active noise
cancelling for external sonnds received from athe persons.
Tn some examples, modifying the active noise cancelling
signal may include disabling active noise cancelling for
specific words detected in the extemal sounds, while von-
tinuing to apply active noise eaneelling to other words, For
instance, a listening user may be wearing an augmented
reality (AR) headset and an extemal ser may say “barge in”
‘nd te external users next phrase may be transmitted to the
Tistening user while subsequent phrases from the extemal
‘user are noise cancelled. In some examples, modifying the
active noise cancelling signal may ipelude temporarily paus-
ing active noise canceling, and resuming active noise can-
ecling after a specific amount of time. In some examples,
the sound reproduction system may fther include a mieeo-
phone for playing back the modified active noise cancelling
Signal to the user
Tn adlition, a corresponding system for modifying ative
noise cancellation based on environmental Wiggers may US 12,322,368 B2
3
include several modules stored in memory, including @
sound reproduction system configured to apply noise can-
