You are on page 1of 33
co») United States cz) Patent Application Publication US 202000379561 (a0) Pub, No.: US 2020/0037956 Al KANG et al (ss) Pub, Date: Feb. 6, 2020 (58) MOANFORMATION MEASURING asin S117 (200601) APPARATUS AND hlO-INFORM ATION aaiB somes 0601) MEASURING METHOD. ano foment) (71) Apple SAMSUNG ELECTRONICS CO, on S16 (200501) Ti, Sivonl (&R) (2) usa. . : CH Aen 6843 (2013.01); Gu6K 90002 (72) Inver: Sn Min KANG, Soo (KR), Yon (otk astm 1172 Golson) tb oe Kvn, Yong (KR) Sang 0808 203-4618 S27 CONS ‘ark, Hiwascongesi (KR) AGIB 5/165 (2013.01); A61B 50205 (9) Assan SAMSUNG ELECTRONICS CO, (2130 Eb, Sivona (&R) (21) Appl No. tonnera ansreact (22) ods Feb $2019 Aa apart for messing bonfrmation sh 8 bed (80) Foreign Application Pirity Data pres is provided, Te bo-infomion newt ape Avg. 1,2018 (KR) 10-2018-0089784 pulse wave signal from an object, a fingerprint sensor : Config to chain fingerprint norman oe objet eS ‘and a processor configured fo estimate a contact area of the jp mee objet fom he Inger infra ad oan ‘oi 00 (21ms0n) Sisson bred on te pulse wave sgl ond the ou 9m (0801) Someta Patent Application Publication Feb. 6, 2020 Sheet 1 of 21 US 2020/0037956 AI FIG. 1 SENSOR PART 1 112 PULSE TINGE WAVE PRINT SENSOR, SENSOR. Patent Application Publication Feb. 6, 2020 Sheet 2 of 21. US 2020/0037956 AI FIG. 2A Patent Application Publication —_ Feb. 6, 2020 Sheet 3 of 21 US 2020/0037956 AI FIG. 2B Q LIGHT SOURCE CQ bErEcTOR root I Patent Application Publication Feb. 6, 2020 Sheet 4 of 21 US 2020/0037956 AI FIG. 2C © Ouicur source | O perector FINGERPRINT SOR opoonen are Patent Application Publication —_ Feb. 6, 2020 Sheet 5 of 21 US 2020/0037956 AI FIG. 3 FINGERPRINT SENSOR INFORMATION, PULSE WAVE SIGNAL BIO-INFORMATION Patent Application Publication —_ Feb. 6, 2020 Sheet 6 of 21. US 2020/0037956 AI FIG. 4A FINGER Patent Application Publication Feb. 6, 2020 Sheet 7 of 21 US 2020/0037956 AI FIG. 4B x10° PIXEL INTENSITY 4 2000 4900 6000 8000 10000 12000 14000 TIME AREA 3 1s © 2000 4000 6000 8000 10000 12000 TIME Patent Application Publication —_ Feb. 6, 2020 Sheet 8 of 21 US 2020/0037956 AI FIG. 4C AMPLITUDE, 10000 ini 5 © ind 5000 * ing] 5000 TIME 0 2000 4000 6000 8000 10000 Patent Application Publication —_ Feb. 6, 2020 Sheet 9 of 21. US 2020/0037956 AI FIG. 4D AMPLITUDE, ow CONTACT b 4 PRESSURE, 50 35 60 DP gsMP zy SP 75 80. 85 Patent Application Publication —_ Feb. 6, 2020 Sheet 10 of 21 US 2020/0037956 AI FIG. 5 RECEIVE REQUEST FOR MEASURING ~ 510 BIO-INFORMATION OBTAIN PULSE WAVE. an SIGNAL AND FINGERPRINT SENSOR INFORMATION ESTIMATE CONTACT AREA BASED ON FINGERPRINT FY SENSOR INFORMATION IN CONTACT SURE SIGNAI BASED ON CONTACT_AREA, MEASURE BIO-INFORMATION BASED ON PULSE WAVE SIGNAL AND CONTACT PRESSURE SIGNAL 550 OUTPUT MEASUREMENT RESULT OF BIO-INFORMATION|~ °°? Patent Application Publication Feb. 6, 2020 Sheet 11 of 21 US 2020/0037956 AI FIG. 6 FINGERPRINT SENSOR —7>} INFORMATION SECOND. CONTACT BIO-INFORMATION Patent Application Publication Feb. 6, 2020 Sheet 12 of 21 FIG. 7A 7{7[6 748 | 8 | 247 sfslofololeye 6] 8] 9 fio} io} 8 fiz 7 hs [9 [iofiol es h7 71 Me[9[o[sfo Thal s| sy? ca ia le Ai US 2020/0037956 A1 Patent Application Publication Feb. 6, 2020 Sheet 13 of 21 FIG. 7B 6lolelo 7 Ts [8 ayslololofolsta 6 [8] 9 [10] to] i faro[ 9 | 8 718 fof fiz] isfi2far] o fs 7] 8 [ro] 12] 13] 15] 13] 12] 10] 8 7] 8 [rofi2]13]is]i3]i2[ iol s 6 fs fiofiifi2fis]is[i2[io] s 6 he} 9 frofufi2fi2[ulo]s 7 hs [iofioliofiof iol 9] 8 7hslolofololo[s]7 3 [8] 8 [s [3 h7 US 2020/0037956 A1 -A2 Patent Application Publication Feb. 6, 2020 Sheet 14 of 21. US 2020/0037956 AI FIG. 8 START RECEIVE REOU FOR MEASURING BIQ-INFORMATION T OBTAIN PULSE WAVE SIGNAL AND FINGERPRINT SENSOR INFORMATION ~ $20 (SET THRESHOLD VALUE BASED] ‘ON ALL PIXEL INTENSITIES 830 AT REFERENCE TIME DETERMINE PIXEL AREA HAVING PIXEL INTENSITY. EQUAL TO OR HIGHER THAN THRESHOLD VALUE AT TWO. OR MORE TIME POINTS, 840. CALCULATE FIRST CONTACT "AREA AT EACH TIME POINT ASED ON {NTENSITY OF PIXEL AREA AT EACH TIME 850 ‘OINT ESTIMATE SECOND CONTACT REA BASED ON CHANGE IN FIRST. CONTACT AREA ATEACH TIME POINT 860 OBTAIN CONTACT PRESSURE SIGNAL BASED ON SECOND CONTACT AREA MEASURE BIO-INFORMATION J~ 880 890 ‘OUTPUT MEASUREMENT RESULT OF BIO-INFORMATION Patent Application Publication Feb. 6, 2020 Sheet 15 of 21 US 2020/0037956 AI FIG. 9 PROCESSOR Patent Application Publication Feb. 6, 2020 Sheet 16 of 21. US 2020/0037956 AI FIG. 10 FINGERPRINT CONTACT OR Te) AREA SE . INFORMATION ESTIMATOR FORCE, INFORMA TION ‘OBTAINER 2 WAVE Hl BIO-INFORMATION SIGNAL Patent Application Publication —_ Feb. 6, 2020 Sheet 17 of 21. US 2020/0037956 AI FIG. 11 10. RECEIVE REQUEST FOR MEASURING BIO-INFORMATION SIGNAL AND FINGERPRINT SENSOR INFORMATION 71130 OBTAIN FORCE ESTIMATE CONTACT AREA INFORMATION OF OBIE OBTAIN CONTACT PRESSURE SIGNAL BASED ON CONTACT ‘AREA AND FORCE INFORMATION OUTPUT MEASUREMENT RESULT OF BIO-INFORMA TION} Patent Application Publication —_ Feb. 6, 2020 Sheet 18 of 21 US 2020/0037956 AI FIG. 12 £1200. pl PROCESSOR OUTPUT INTERFAC! Patent Application Publication —_ Feb. 6, 2020 Sheet 19 of 21 US 2020/0037956 AI FIG. 13 r | 1 i_[ CONTACT i ue be TAMINER INFORMATION FINGERPRINT _| | SENS = INFORMATION { 1310 1320 Lif contact CONTACT | AREA PRESSURE ESTIMATOR OBTAINER > BIO PULSE WAVE 1 INFORMATION SIGNAL ae 1 | i i 4 I Ik Patent Application Publication —_ Feb. 6, 2020 Sheet 2 FIG. 14 0 of 21 US 2020/0037956 A1 \ FP2 CP2 Patent Application Publication —_ Feb. 6, 2020 Sheet 21 of 21. US 2020/0037956 AI FIG. 15 ECEIVE REQUES FOR MEASURING BIO-INFORMATION OUTPUT MEASUREMENT RESULT OF BIO-INFORMATION| OBTAIN PULSE WAVT, SIGNAL AND FINGERPRINT SENSOR INFORMATION. ESTIMATE CONTACT AREA 1550 OBTAIN CONTACT PRESSURE SIGNAL 1560 MEASURE BIO-INFORMATION [~ 1570 T ION OUTPUT MEASUREMEN| RESULT OF BIO-INFORMAT US 2020/0037956 Al BIO-INFORMATION MEASURING APPARATUS AND BIO-INFORMATION, MEASURING METHOD. (CROSS-REFERENCE TO RELATED APPLICATIONS) [0001] This application claims priority trom Korean Pat- ‘ent Applicaton No. 10-2018-0089784, filed on Aug. I, 2018, inthe Korean Intellectual Property Ollie, the disclo= sure of which is incomorated herein by reference in its censiety, BACKGROUND, 1. Field 10002] Apparatuses and methods consistent with exem= lary embodiment relate to measuring bio-information, and tore particularly 4 cuflessly measuring blood pressure 2. Description of the Related Art [0003] As a method of measuring blood pressure in a hon-invasive manner without eausing pain or discomfort ‘a human body, there isa cufF-based measurement method for ‘measuring blood pressure using ell pressure measurements tnd a cufless measurement method for estimating blood pressure using pulse wave measurements without @ ull [0004] As the cuff-based measurement method for mea- suring blood pressure, there is @ Korotkol-sound method Which measures blood pressure by winding @enff around an Upper am and hearing the sound of lod vessels through a stethoscope during inflation and deflation ofthe cuff and an oxillometric method which measures blood pressure by ‘winding a cuff around an upper arm and continously measuring cu pressure while inflating and then gradually deflating the euT using an stomated device, and measuring. blood pressure based on a point of maximum pressure signal change, [0005] As the culess measurement method for measuring blood pressure, there is a method of estimating blood prossure by calculating a Pulse Transit Time (PTT), and a Pulse Wave Analysis (PWA) method of estimating blood pressure hy analyzing a pulse wave form, SUMMARY 10006] According to an aspect of an exemplary embot- ment, there is provided a bio-information measuring appa ratus including: a pulse wave sensor configured to measire ® pulse wave signal from an object; a fingerprint sensor ‘configured to obiain fingerprint information of the object, ‘and a processor configured to estimate a contact area between the object and the pulse wave sensor based on the fingerprint information, and obtain bio-information based on the pulse wave signal and the contact are. 10007] The pulse wave sensor may include: a light source ‘configured to emit light onto the objet; and a. detector ‘configured to detect the light that i reflected from the object er being emitted tote object. 10008] ‘The fingerprint sensor may be a eapacitive Finger Print sensor, [0009] The processor may be further configured to caleu- late a statistical value of pixel intensities included in the Feb. 6, 2020 fingerprint information, and estimate the contact area from the statistical value by applying a contat area conversion function. {0010} The processor may be further configured to deter- ‘ine a contact pressure betvoen the pulse wave sensor ad the object based on the contact area. [0011] The processor may be further configured t deter. rine foree exerted from the object to the pulse wave sensor, tnd determine the contact pressure based on the force and the contact ates, {0012} ‘The bio-information measuring apparatus may far ther include a force sensor configured to measure the force exerted to the pulse wave sensor [0013] The pulse wave sensor may measure a plurality of pulse wave signals of multiple wavelengths, and the pro- cessor is further configured to determine the force based on the plurality of pulse wave signals of the multiple wave- engi [0014] The polse wave signal has a frst wavelength, and the pulse wave sensor measures a plurality of pulse signals having two oF more wavelengths diferent ffon the fist wavelength, The processor may be firther configured to obiain a differential signal between the pulse wave signal of the frst wavelength and each ofthe plurality of pulse wave signals having the two or more wavelengis different from the fist wavelength, and determine force exerted Irom the object the pulse wave sensor based on the differential signal and the contact area [0015] The processor may be further configured to deter- ‘ine the contact presure based on the contact area by applying a contact pressure conversion function. [0016] The processor nay be futher configured to obtain ‘an oseillomettic Waveform based oa the plurality of pulse ‘wave signals and the contact pressure, and obtain the bio- information based on the oscillometeie waveform, [0017] The processormay be further configured to provide ‘user with guide information including at least one of @ reference contact postion and s reference contact intensity ‘of the objec. [0018] The processor may be further configured to deter- ‘ine a contact state between the object and the pulse wave sensor during measurement ofthe pulse wave signal based fa fingerprint image inchoded inthe fingerprint inforrna- [0019] The processor may be further configured to extract, 8 fingerprint featre point from the fingerprint image, and ‘determine the contact state based on a distance between the extracted fingerprint feature point and a center position of the fingerprint sensor. [0020] In response 19 determining that the contact state being in an abnormal state, the processor may be further configured to provide guide information for guiding a user to change a contat postion of the object. [0021] The biosinformation may include at least one of blood pressure, vascular aye, deyrwe of arteriosclerosis, onic pressure waveform, vascularcompliance, stress index, and degree of Fatigue. [0022] The processor may be further configured to deter. rine a change in the contact area between the pulse wave sensor and the object while the pulse wave signal is being ‘measured, and obtain the bio-information based on the pulse wave signal and the change in the contact ree [0023] The fingerprint information may inelude pixel Intensities. The processor may be further configured to US 2020/0037956 Al ‘xtmate the contact area by Hinrly combining one or more ‘ofthe pixel intensities which ae equal oF higher than & pretcrmined thesbold vale [0024] "According to an aspoct of another exemplary embosiment there is provides bi-information meastring method inching: obtaining @ pulse wave signal from an ‘object by using & pulse wave sensor: obtaining fingerprint, information of the objet estimating a contact wa between the object and the pulse wave seasor based om the Fingerprint information; and obtaining bioiformaton based on the pulse wave signal and the eontct ae {0025| The estimating the contact area may include cal- ‘ulting statistical value of pixel intensities eluded in the fingerprint information; and eximating the contact area fom the tsi by amin # ent are conversion 10026) The biodformation measuring method may’ far ther inelide determining a contact presse between the ‘objec and the pulse wave senso based en the contac re, {0027| The biosnformation measuring method may fare ther include determining force exerted rom the object the puke wave sensor The determining the contol prestie Muay include determining the contact pressure babel on the force and the cantact area [0028] "The determining the contact pressure signal may ‘include determining the contact pressure signal hased on the oat ares by ping # elt premze cvesion 10029] ‘The obisining the bo-infomation may include ‘obisining an oseilometrc waveform based on the pulse Wave signal and the contact pressure, abd Obtaining the Bioviformation based on the oscillometric naweform [0030] "The biosinformation measuring method may fur therinclad i response to eceving a regent for menor the biosinfomation, providing guide information which includes at lest one of referee contact positon and a felernce contct intensity [001] The biosnformation measuring method may fur ther include determining a coat state between the abject nd the poise wave sensor based on a ngersot image included in he fingerprint information during measuemest of the pulse Wave signal {0032} ‘The biosinfomtion measuring metod may fur therinctude in response to detemining tht the conte tate being i an sbnormal stat, providing guide infoation for _Biding a ster fo change a contact position ofthe object 10033). ‘The biosinfommation meastring method may fur ther ingle: detemining @ change inthe eontaet area between the ple wave seasor and the objet wile blaine ing the pulse wave signal, wherein the obtaining the bio- information may isclude oblsining the bio-information based on the pls wave signal and the change in the contact 10034] ‘The fingerprint information may include a Finger= Print image, and the estimating the contact area may include: determining pixels of the fingerprint image which have iensities equal to or higher than a predetermined threshold value; and estimating the contact arc by linearly combining the intensities of the determined pixels. BRIPF DESCRIPTION OF THE DRAWINGS [0035] The above andlor oer aspects will be more appar ‘ent hy deseribing certain exemplary embodiments, with reference to the accompanying drawings in which Feb. 6, 2020 [0036] FIG. 1s block diagram illustrating a bio-infr. ‘mation measuring apparatus according. 10 an exemplary embodiments [0037] FIGS. 2A, 2B, and 2C are diagrams illastating a Sensor part according (© an exemplary embodiment; [0038] FIG. 3 is @ diggram illustrating an example of a configuration of a processor of FIG. 1; [0039] FIGS. 44, 4B, AC. and 4D are digrams explaining fn example of messuring bio-information according to an exemplary embodiment [0040 - EG. 3 isa Hlowehurt illustrating bio-infornation ‘measuring method according to an exemplary embodiment: [041] FG. 6s diggram ilustrating another example of ‘8 configuration ofthe processor of FIG. 1 [0042] FIGS. 7A and 7B are diagrams explaining an example of estimating ® contact afea acconding t0 the exemplary embodiment of FIG. 6: [0043] "FIG. 8 isa Nowehar illustrating a bio-information ‘measuring method according (0 an exemplary embodiment; [0044] FIG. 9 isa block diagram illustrating a bioinfor- ‘mation measuring apparatus according 10 an exemplary embodiment; [0048] FIG. 10 isa diggram illustrating an example of a configuration of a processor of FIG. 95 [0046] EG. 11 is flowehartillstating a bio-infommation ‘measuring method according wo an exemplary embodiment; [0047] FIG. 12 is a block diagram illustrating a bio {information measuring apparatus according to an exemplary embodiment: [0048] FIG. 13 isa diagram iMlustrating an example of a configuration of a processor of FIG. 12: [0049] “FIG. 14 1s a diagram explaining» method of determining a contact state; and [0080] FIG. 18 isa Nowehur illustrating abio-infomnation ‘measuring metho! according to an exemplary embodiment, DETAILED DESCRIPTION [0051] Exemplary embodiments are described in greater ‘oti! below with reference tothe accompanying deawings [0052] Inthe following description, ike drawing reference fnumerals are used for like elements, even in illrent drawings. The matters defined in the description, such as ‘detailed constrution and elements, are provided to assist in ‘ comprehensive understanding of the exemplary embodi- tens, However, i is apparent tht the exemplary embod iments can be practiced without those specifically defined rtters. Also, Well-koown functions or constructions ae not described in detail since they would obscure the description with unnecessary deta [0053] Ievill be understood that, although the tems fet, Second, ete. may be used herein to deseribe various el ‘ments, these elements should not be limited by these terms “Theso terms are only used to distinguish one element from another Any references (0 singular may include plural unless expressly stated otherwise. In addition, unless explic ily described 0 the contrary. an expression such as “come prising” or “including” will he wnderstood to imply the Inclusion of stated elements but not the exclusion of any bother elements. Also, the tems, such as part or “modal fe, should be understood a aunt that performs atleast one hnetion or operation and that may be embodied as hard- ware, soltware, ora combination thereof, [0054] Expressions such as “at least one of" when pre coding alist of elements, modify the entire list of elements US 2020/0037956 Al and do not modify the individual elements ofthe ist. For ‘example, the expression, “at least one of, b, and." should be understood a including only a, only b, en c, both a and b, both a and c, both b and e, all of a. b, and c, or any Variations of the aforementioned examples. [0055] Various embodiments ofthe bio-information mea suring opparats which will be deseribed below may be ‘embeded in various devices such as a mobile wearable device, smart device, and the like, Examples ofthe various ‘devices may inchide a wearable device of variows types such as a smart watch wom on the wrist, a smart band-iype wearable device, headphone-iype wearable device, a hait- hand-ype wearable device, and the like, # mobile device such as'a smartphone, # tablet PC, and the Hike, but are not Timited thereto. [0056] FIG. 1 is a block diagram illustrating a bio-nfor- ‘mation measuring apparatus according to an exemplary ‘embosliment, FIGS. 2A wo 2C are diagrams illustrating ‘examples of a configuration of a sensor part of the bio information measuring apparatus. 10057) Referring to FIG. 1 the bio-information measuring ‘appacatns 100 includes @ sensor part 10 and 2 processor 120, [0058] The sensor part 110 includes a pulse wave sensor IL anda fingerprint sensor 112. The pulse wave sensor IIL may measure. pulse wave signal, including a photoplethys- mography (PPG) signal, from an object. The pulse wave sensor I1T includes a ight source which emits light onto an ‘Objet, anda detector which detects light emitted bythe light ouroe and scattered or reflected from body tissives sich as skin surface, vessels, andthe like 10059] The light source may include light emiting diode (LED), a laser diode (LD), a fuorescent body: and the ks, but isnot limited thereto, The detector may include 2 photo diode, a photo transistor (PT, an image sensor (e.g, CMOS, image sensor), and the like, ut isnot limited thereto, The pulbe wave sensor £11 may include an array ofa plurality of light sources andlor detectors if necessary In particular, the plurality of fight sourees may emit light of different wave Fengths, and may be space apart at diferent distances from the detector, [0060] The fingerprint sensor 112 may obtain fingerprint seasor information from a user. In paticlar, the fingerprint sensor information may’ inchude information on each pixel intensity of the fingerprint sensor 112 which is measured ‘when the user touches the fingerprint sensor H12 by using hisher finger or another body part. In one exemplary ‘embodiment, the fingerprint sensor 112 may bea capacitive Fingerprint sensor, but is not limited thereto. For conve- nienee of explanation, the following description will be made by using @ capacitive fingerprint sensor as an example [0061] In the case in whieh the fingerprint sensor U12 is a ‘capacitive fingerprint sensor, each pixel intensity may refer to capacitance accumulated on each pixel. For example, when a finger of a user touches the sensor part 110 10 measure bio-informaton, capacitance is aceumulated on ‘each pixel of the fingerprint sensor 112. The capacitance ‘accumulated on each pixel is wenerally changed in response to-a change ina duration and an area of contact between the finger and the fingerprint sensor 112, [0062] FIG. 24 illustrates a rear surface ofa smart device 20 jnchuding @ bio-information measuring apparatus 100, ‘cconling 10 an exemplary embodiment. The bio-informa- tion measuring apparatus 100 may inckude an image sensor Feb. 6, 2020 21 and a sensor par 1 disposed onthe rear surface of the Smart device 20."The image yensor 21 may capture an image fof a user, and the sensor part 20 may include a fingerprint sensor 112, In FIG. 2A, the image sensor 21 and the sensor part 11 including the fingerprint sensor 12 are amounted on the rear surface, but the present exemplary embodiment is ‘not limited thereto. For example, the fingerprint sensor 112 ray’ he mounted at a Trent surface (e.g, al a lower front surlace) of due smart device 20. In particular, the fingerprint sensor 112 may be disposed a te lower front surface, and the pulse wave sensor 111 may be disposed around the fingerprint sensor 112 [0063] FIGS. 2B and 2C illustrate various examples of Sinictire of the sensor part 10. For example, ay illustrated in FIG. 2B, the light source of the pulse wave sensor 11 is Aisposed at one side of the fingerprint sensor 112, and the detector may be disposed on the other side ofthe fingerprint sensor 112 In another example, as illustrated in FIG. 2C, the Tight source and the detector ofthe pulse wave sensor 111 ‘nay be dispose altemately on both sides ofthe fingerprint sensor 112."The fingerprint sensor 112 may be formed in Various shapes such as a circular shape, a triangular shape, fd the like. The pulse wave sensor IIT may be disposed ‘equally on al sides of the fingerprint sensor 112. Alterna tively. in the case in which the ingegprint sensor 112 is made of a ligh-ransmiting material, the pulse wave sensor 111 may be disposed below the fingerprint sensor 112, in which the detector may be disposed atthe center ofthe fingerprint sensor 112, and a plurality of fight sources may be disposed ‘round the detector, [0064] ‘The processor 120 controls the sensor part 110 in response tothe request for measuring bio-information. The processor 110 may be electrically connected with the sensor pert 10. The processor 120 may receive a pulse wave signal ‘nd fingerpriat sensor information feom the sensor pt 120, ‘and may measure bio-nformation based on the received pulse wave signal and fingerprint sensor information, [0065] For example, upon receiving the fingerprint sensor information, the processor 120 may estimate a between an object and the sensor part 110, by using each pixel intensity included in the fingerprint Sensor informa tion. Upon estimating the contact area, the processor 120 ‘may’ measute bio-information based on the received pulse ‘Wave signal and the estimated contact are, In particule, the bio-information may include a heart rate, blood pressure, vascular age, arterial slillnes, aortic pressure waveform, vascular compliance, stress index, degree of fatigue, and the like, but is not limited thereto. [0066] FIG. 3 iso diggram illustrating an example of a configuration of a processor of FIG, 1. FIGS. 4A to 4B are siagrams explaining an example of measuring bio-informa~ tio, [0067] Referring to FIG. 3, the processor 300 acconing to fn exemplary embodiment inclades a contact area estimator 310, a contact pressure obtainer 320, and a measurer 330. [0068] As llustated ia FIG. 4A, once finger touches the Sensor part 110, the fingerprint sensor 112 obtains fingerprint Sensor information and transmits the obtained fingerprint Sensor information to the cont area estimator 310. Upon receiving the finger sensor information from the fingerprint sensor I12, the contact area estimator 310 may estimate a contaet area of the finger by using the fingerprint sensor information US 2020/0037956 Al [0069] FIG. 4B illustrate a relationship between a contact area increase and pixel intensity increase. The contact area ‘estimator 310 may estimate a contact area based on pixel intensity values included in the fingerprint sensor informa- tion For example, the contact area estimator 10-may calculate a statistical value of each pixel intensity. ln par- ticular the statistical value may be various valves such as 8 simple sum, a Weighted sum, an average, a median value, tnd the lke of pixel intensities, but i not limited thereto Upon ealeuatng the statistical va, the contact area esti- ator 310 may caleuate a contaet area using the statistical value by applying predefined contact arca conversion function to the statistical value. In panicular, the contact area ‘conversion fuetion may be defined as a lincan’non-lincar ‘combination function, and the like [0070] Once the contact area is estimated, the contact pressure obtainer 320 may obiain a contact pressure signal berwoen the object and the pulse wave sensor 111 fom the ‘estimated contact ares. For example, when « user's finger touches the fingerprint sensor 112 with gradually increasing foce, to increase contact pressure between the finger and the fingeeprin sensor 112, the contact area becomes wider, sch that it can be seen that there is # eorelation betwaen the ‘contact area and the contact pressure. Accordingly, by applying a contact pressure conversion funetion which rep resents a comelation between the contact ana and the ‘contact pressure, the contact pressure obtainer 320 may’ ‘obiain the contaet pressure from the contact area, The oot ese conven atin may epee a 10071] Further, when a user's finger touches the sensor part 110 to measure bio-information, the pulse wave sensor TIL measures «pulse wave signal from the object. In particular, while the user's finger touches the sensor part M0, the wer may gradually increase the eontact pressure herwaen the finger and the sensor part 110 by touching the sensor part 110 with gradually increasing free during measurement of bic-information, Alternatively, at the begine hing of measurement of bioenformation, when a user's Finger touches the sensor 110 witha pressure intensity qa to or higher than a predetermined threshold, the wser may radually decrease the contact pressure between the finger ‘andthe sensor part 110 by ouehing the sensor part 110 with, tradually decreasing force. 10072] Once the contact pressure signal is obtained, the measurer 330 may measure bio-information based on the pulse wave signal and the contact pressure signal. For ‘example, the messurer 380 may measire blood pressure by Using’ an oscillometric method. The meaeurer 330-may ‘bina an oscillometric waveform by using the pulse wave signal and the contact pressure signal, and may measure bioinformation by using the obtained oscillametric wave- form. [0073] For example, the meusurer 380 may extract & peak-to-peak point at cach measurement point of the pulse ‘wave signa, and may obtain the osillometrie waveform of ‘contact pressure versus pulse wave signal, by plotting the ‘eximicted peak-to-peak point based om a contact pressure Value corresponding #9 each measurement point Referring 1o FIG. 4C, a pulse wave signal is obtained by gradually increasing the contact pressure between the finger and the sensor part 110 or by gradually decreasing the contact pressure therebetween while @ user Touches the sensor part M10 with a pressure intensity equal to or higher than & Feb. 6, 2020 predetermined threshold, The measurer 330 may extract the peak-to-peak point by sublracting an amplitude value in8 of 1 negative (-) point from an amplitude value in of a Positive (+) point of the waveform envelope in! at cach ‘measurement point ofthe obtained pulse wave signal. Then, fs ilusiated in FIG. 4D, the measurer 330 may obtain the ‘sellometrie waveform (OW) by plating the peak-to-peak amplitude at each measurement point based on the cont pressure value. [0074] Upon obtaining the oscilometric waveform, the reasurer 330 may extract one oF more features from the ‘obtained oseillometie waveform. Refering to FIG. 4D, the measures 330 may extract, as features, an amplitude value MA of a maximum peak point andlor a contact pressure value MP of a maximum peak point. Further, the measurer 330 may forther extract, a Feantres, contact pressure values ‘SPand DP located tothe left and right of the contact pressire value MP of the maximum peak point and baving & peede- termined ratio (ex, 0.5 00.7) the contact pressure value MP [0075] The measurer 330 may measure bio-information by ting the extracted features, For example, inthe case of measuring blood pressure, the measurer 330 may determine the contact prestive vale MP ofthe maxiniim peak point, whieh is extracted from the oscillometric waveform, 0 be man arterial pressure (MAP). Further, the measurer 330 ‘may determine, as systolic blood pressure (SBP), a contact pressure valie SP located to the riht othe contact pressire value MP of the maximum peak point within predeter- mined ratio range; and may dtemmine, as diastolic blood pressure (DBP), a contact pressure value DP located to the Tell ofthe contact pressure vale MP of the maxim peak point predetermined ratio range [0076] In another example, upon extracting one or mone {atures from the oscillometic waveform, the meastrer 330 may measure bio-information by using & predefined mes surement mode! as represented by the following Equation 1 ras (egos 1) [0077] Herein, y denotes bio-information to be obisined, such as DBP, SBP, and MAP: x denotes the extracted feature value; and a and b denote values ealeulated in advance through preprocessing, and may be defined differently according to the types of bi-information (eg, DBP. SBP, ‘and MAP). However, the measurement model isnot limited thereto, and may be pregenerated in tble form in which ‘eature values and blood pressure values are mapped teach thee [0078] FIG. 5 isa lowehar illustrating 2 bio-nfomnation ‘measuring method according to an exemplary embodiment, [0079] The bio-information measuring method of FIG. Sis, fn example of a bio-information measuring, method per- formed by the bio-information measuring apparatus 100, Which is desrihed above, such thatthe deseription thereof will be briefly made in order to avoid redundancy. [0080] ‘The bio-information measuring apparatus 100 may receive a request for measuring bio-information in operation S10, The request for measuring bio-information may be input from a user, or may be received fom an external device connected through communication neworks. How- lever, the request for measuring bio-information isnot limn- ited thereto, and it may be determined automatically at predetermined interval that the request for measuring bios information is received. US 2020/0037956 Al {0081} ‘Then, the bio-information messuring apparatus 100 may measure a polse wave signal from an objet during ‘predetermined period of time by using a pulse wave sensor I, andl st the same time, may obtain fingerprint sensor information by using the fingerprint sensor 112 in operation 520, The pulse wave sensor III may include one or more light sources and one or more detectors. The fingerprint sensor 112 may be a capacitive fingerprint sensor. During the measurement, a user may gradually increase or decrease ‘contact pressive between the abject and the sensor. 0082] “Then, the bio-information measuring” apparatus 10 may estimate contact area between the objet ad the sensors based on the fingerprint sensor information in opera= tion $30. For example, the bo-information measuring appa ratus 100 may estimate the contact area base on each pixel intensity of the fingerprint sensor 112. In particular, the biovinformation measuring apparatus 100 may calculate a Statistical value of each pixel intensity, and may caleulate the ‘contact area by substituting the calculated statistical value in ‘contact area conversioa Tunetion In patiular, the contact ‘rea conversion function may be defined in various forms, such a6 ineasinon-lineae combination function, and the Tike, 10083] Subsequently, the bio-information measuring aps Fatus 100 may obtain contact pressure signal between the ‘object and the pulse wave sensor IL basod on the estimated ‘contact area in operation $40. As described above, there is f correlation between the contact area and the contact presse, anda contact pressire conversion function may be predefined, which represents the correlation between the ‘contact area and the contact pressure. Upon estimating the ‘contact are, the bio-information measuring apparatus 100 may calculate contact pressure by substituting the contact area in the contact pressure conversion function. [0084] "Next, the bi-information measuring apparatus 100 may measure bio-information based on the pulse wave signal and the contaet pressure signal in eperation 880, For ‘example, the bio-infermation measuring apparatys 100 may measure bio-information based on te oseillometrie method ‘8 described above, [0085] ‘Then, the bio-information messuring.apparatas may provide & measurement result of bio-information 102 user by using various output devices in operation 860. In particular the output devices may include display module to visually output the resulta speaker module to ouput the result through voice, a haptic module to output the result through vibration or tactile sensation, and the Tike [0086] FIG. 6 is «diagram illustrating another example of configuration ofthe processor of FIG. 1. FIGS. 7A and 7B. ‘re diggrams explaining an example of estimating a contact area according tothe example of FIG. 6 [0087] Referring to FIG. 6, the processor 600 according 10 ‘an exemplary embodiment includes a Mist contact area ‘estimator 610, a Second contact are estimator 620, a contact pressure obtaner 630, and 2 measurer 640, [0088] The frst contact area estimator 610 may calculate 4 first contact area between an object and the fagerprint seasor 112 at to oF more time points based on fingerprint Sensor information, The first contact area estimator 610 may linearly combine pixel intensity values which are equal t oF higher than # presletemnined threshold at frst time point ‘and may determine the result be the fist eontoet area for the first ime point. Further, the fst are estimator 610 may linearly combine pixel intensity values which are equal oF Feb. 6, 2020 higher than a predetermined! threshold at a second time pon, and may determine the result tobe the fst contact Sea fr the avon time point {008} For example, FIGS. 7 and 7B illustrate pisel intensity values of the Fingerprint sensor 112 which are ‘obtained tthe ist time point and atthe second time point ‘shen a user gradly increases cont pressure during Presktcrminel period of time while» wser's objet touches the agerrint Sensor 112. For convenience of explanation, pixel intensity valves of Some portions of the fingerprint Sonor 12 are omit [0090] Referring wo FIG. 7A, the fst ontet aren estima {or 610 may determine an are AL of pixels having intensity ‘ales oil to or higher thin a predetermined threshold {alue (eg. a valve of 8) atthe fipt ie point, and may totimate the fist contact area fr the detent area Al Referring to FIG. 7, the fst contact area estimator 610 may determine an area A2 of pixels having intensity values cual to higher than a pretemained tresbld (ea. ‘ale of 8) atthe second ime point, andl may estimate the Tit contact area forte dtemnned area 2. or example, in the cas in which a contact area is dain to be a vale lvained by adding up the pine intensity values, the eon. ves a the fst time pit 215 andthe ewtac are tthe Second te points 18, {0091} The fist coats azea estimator 610 may preset, 38 a threshold val, a statistical value obtined sing sl pixel Jntensites ofthe fingerprint sensor 112 which ae ob ata reference time point For example, the fist contac re estimator 610 may stan average of all pve intensities {threshold value. However, an example of the satisical ‘ale at limited to an average. Inthe casein which the Tit time point i the referene time pont, the ist contact. aveaestimator 610 nay fist calelatean average fall pixel intensities, may st the caculsted average as threshold ‘alu, snd then may’ caleulate the first enact rea for the first time point by using the set threshold vale {0092} The second contact area estimator 620 may est ‘nate a second contact area based on a change between the first contact areas calculated att or more time points By the frst contact area estimator 610. In particulate second conta area may e an acl contact area Between the objet and the sensor part 110, For example, the second Contact are estimator 620 may estimate the seond eon toa by subsituting the change between the ft contact frets, eg a dilference value fotwoen the fist contact area Of the ist ime point andthe ist contact area ofthe second Sime pont an increasing decreasing rt ofthe Hist com ares and the like, in prdelned contact area conversion Tinetion. The second cont area may represent change in the contrat are hetwoon the pls wave sensor II andthe objet while the pulse wave’ sensor H1Y is measuring the pulse wave sana {0093} Once the second conse area is estimated, the ontet pressure obtange 630 may obtain a contat presse Sana from the second contct are. As described im deta shove, the contac presse oblainee 630 may obi contaet presire fom the second contact area by” Using thee Sefned contact presure conversion function, [0094] “The messurer 640 may measure bio-nfomtion based om the pulse wave signal and the contact presire signal. As Jesetbed above, the measure 640 may obtain the tseillometie waveform by using the pulse Wave signal and the contaet pressure signal, and may mesure bioinfonna US 2020/0037956 Al tion, such as blood pressure, based on the oxilometic method by extrating festres fom the obisined osilomet- fe wavelorm. {0095} FIG. 8 i. whan ilastrating a bio-information measuring method according wo an exemplary embodiment 10096) The bo-infonmation measuring method of FIG. Bis nother example of # bio-nformation measuring mod performed bythe bo-iformation measuring apparatis 100, Which is desribed sve wih reference to FIGS, 1 and 6, och that dealed description thercof il be omitted 10097] Upon eciving request for measuring bio-infor- nation in operaion 810, the biovnformaton meosuring Sppartas 100 may oblsin a pulse wave signal and finger Pint sensor information by Using the pulse Wave sensor IMT fd the ferrin seasor M12 respectively dvi & prede- termined pera of time in operation 820. 10098] Thea, the bio-nformation measuring. apparatus 100 may set theshold value based onal pine intensities at a rolereace time in opertion 830. The biowaformstion tearing apparatos 100 may set, a the threshold val, Statistical vale, eg an averge, ofall pixel iatensites at the reference time. In the cate in which there is prest threshold vale, the operation 830 may’ be omit. 10099] Subsequently, based on the fingerprint sensor infor tation, the biosiaformaton meastrig apparatus 100 may Allerminc 8 cont arca betwcea am object andthe Finger print sonsoe 112 wo oe more ime pat in operation 840 ‘As illustrated in FIGS. 7A and 73, the bio information easing appara 100 may determine the aos AY std ‘AL of pinels having intensities eqal to or higher than a preset thesold value determined foreach meastremest point [0100] Nex the bivintormation measuring apparatus 100 may calculate a fist eonact ate at eae time point based on the pine intensities of ares determined for eich tie pot in operation 880, For example, the bioinformation meonur ing apparatus 100 may determine, asthe fis contact rea for the fst ine pot result abtined by adding up the pixel intensity vases egal to or higher than preset threshold Nalue tthe fist tine pin. Sina. the bio-informaton Imewurig apparatus 100 may determine, a the Gist contact, area for he cond time pont, result obtained by ang up the pixel intensity values equal or higher thn a preset thresbold vale at he second time pot [0101] Thea, the bio-nformation measuring apparatus 100 may estinate a second contact area based on # change between te first contet areas calulstod at each time point in operation 860, For example, he bio-informaton measur ing appartes 100 may estimate the second contact area based on the change between the fst contact ares caleue Inte a two or more die points By applying a predefined ‘contact area conversion funetion. {0102} Subsegucots te bio-nformation measuring appo- rats 100 may obtain a conta pressure signal base onthe Second conc arc in operation 870. For example a conact, prosure conversion function, which presents cmon erween the contact area andthe canter presse, may be predefined, and the bi-infornation measuring apparats 100 ay oblain the contact pressure signal by app the contact pressure conversion Tunction {0103} Next, the bio-nformation measuring appara 100 may measine bio-information Based on the pulse. wave Signal and the contact presse signal in operation 880. In Feb. 6, 2020 particular, the biornformation measuring apparatus 100 ‘may’ measure biosnformation based on the oscillometic sco [0104] Thea, the bio-information measuring apparatus 100 may provide a measurement result of bio-information to ‘user in operation 890, Various output devices may be used to effectively provide the measurement result to 3 user. [0108] FIG. 9 isa block diagram illustrating a bio-infor- ‘mation measuring apparatns according 19 an exemplary embodiment, FIG. 10s a diagram illustrating an example of 1 configuration of a processor of FIG. 9. [0106] Referring to FIG. 9, the bio-information measuring apparatus 900 according, to an exemplary. embodiment includes a sensor part 910 andl a processor 920, [0107] In the exemplary embodiment, te Sensor par 910, ‘nay further include a fore sensor 913, in addition to the pulse wave sensor 911 and the fingerprint sensor 912. The pulse wave sensor 911 and the fingerprint sensor 912 are Ueseribed in detail above with reference to FIG. 1. [0108] The force sensor 913 may be mounted on a rear surface of the pulse wave sensor 91 andor the fingerprint sensor 912, ie, a surface opposite to a surface that comes into contact with the object. When the object touches the pulse wave sensor 91K and the Fingerprint sensoe 912 and fapplies force thereto, the force senscr 913 may measure {ore information such asthe intensity of force [0109] The processor 920 may measure bio-nfomation based on the pulse wave signal, the fingerprint sensor information, and the force information [0110] -Refering to FIG. 10, the processor 1000 includes 1 contact area estimator 1010, a contact pressure obtsiner 1020, 8 measurer 1030, and force information obiainer 1040, Parts withthe same name as those of the aforemen tioned bio-information measuring apparatus 100 perform substantially the same functions, such that detailed deserip. tion thereof will be omitted, [0111] The farce information obtainer 1040 may obtain Information of fore exerted from an abject (eg. 2 finger) {0 the sensor part 910 during measurement of pulse waves, For example, in the ease in which the force sensor 913 is ‘mounted on the sensor part 910 as illustrated in the exen- play embodiment, the ores information obtsiner 1040 my Feceive infomation of force measured by the force sensor on [0112] In another example, in the ease in which the pulse ‘wave sensor 911 measures pulse wave signals of moltiple Wavelengths, the force information obtainer 1040 may obtain force information by using the measured pulse wave signals of multiple wavelengths. Accordingly, the force jnformatioa obtainer 1040 may slso be included in an apparatus, in which the foree sensor 913 is not mounted on the sensor part 110, as in the bio-information measuring ‘apparatus 100 described above, [0113] The force information obtainer 1040 may obtain tlferential signals between a pulse wave signal ofa certain ‘wavelength and pulse wave signals of two or more different wavelengths, and may obtain the force information based on the differential signals, For example, assuming that he pulse ‘wave signals having multiple wavelengths are pulse wave Signals of green, red, and blue wavelengths, the force information obtainer 1040 may pass the pulse wave signal of ‘each wavelength through alow pass filter (LPF), to generate ‘pulse wave direct eurrent (DC) sipnal of each wavelength. Further, the foree infomation obtsiner 1040 may caleulate US 2020/0037956 Al 2 ratio betseen a fist ferential signal, obtained by sub- treting a pulse wave DC signal ofa blue wavelength fom ‘pulse wave DC signal ofa green wavelena and. sound ‘diferent signal, obtained by suhtmcting a pose wane DC sian ofa be wavelength from a pulse wave DC signal of ‘ned wavelength, and may determine the calculate ato st ‘ach time point to be the intensity of foe {0114} The contct pressure obtiner 1020 may obtain a ‘contact presse signal based on the obtained force infor tation and the contact area, For example, the contact presureobtainer 1020 may calculate the contact prssire st sch tae poi by dividing the intensity of foe a each time point hy the contact aa [0113] The measure 1030 may measure bio-nfornation based onthe pulse wave signal and the eotact pressure. As described above, the measurer 1030 may measire bio- information bascd.on the osillomsctrc method. Once the pulse wave semor S11 measures the pulse wave signal having multiple wavelengths, the measure 1030 my select. any one pulse wave signal aceording to various citi, of may obain one pulse wave signal by combining pulse wave anal of multiple wavelengths sing predlined combi nation model. Altematively he measur 1030 sy obtain ‘osvllometie waveforms using eae pulse wave signal and ‘onto presse, ad may obtain one combined osillomet- fie wavefom: by combining the obtained osilomette Svaveforms using predefined combination model [o116} FIG. 11 is owchaetitsrating a bio-inkormation scasuring method scconfins to an exemplary embodiment {0117| The biosnfomation measuring method of FIG. 1 may be an example ofa biorinfomation measuring method peormed hy the bio-nformation measuring apparats 900 OF FIG 9. {0118} Upon receiving request for measuring biorinfor- mation in operation 110, the bio-nformaton measuring 2ppranis 980 may obtain pulse wave signal and finger Pal sensor information by using the pulse Wave sensor 911 Sn the fingerprint sensor 912 respectively dri» prode- termined pera of time in operation 1120 {0119} Then the bio-nformation meesurng appara 900 may obtain fore information, such asthe intensity of force “pplied hy the objet to the force sensor 913, in operation 1130 Ia psticular the bio-nformation measuring appara, ‘300 may obtain foe information by using the force sensor 913 mousted in the biorinformation measuring appara ‘90, in which the operations 1130 and 1120 may be por formed at the same time. In the ease ia which the Force Seasor 913 is aot included therein, pulse wave signal of motile wavelengths may be measured in operation 1120, ‘and then free information may’ be obtained by using the measured pulse wave signals of slip wavelengths [0120 Subsequently, the bo-aformation measring appe- rats 900 muy estimate acon are ofthe objet based on the fingerprint sensor information in operation M40. For ‘example, described above, the bio-nformation measuring ‘ppaatis 900 muy determine © contact area by adding up pine intensity valves ofthe fingerprint sensor 912 at each time point, for each time pois, [0121] Next, the bio-nformation measuring appara 900 may obain the contatpeesre signal bese of the contact fea and the forse information in. operation 1180. For ‘example, the bioinformation measuring apparatus 900 may “aleulate the contact presse at each ime point by dividing the inensty of forse at each time point bythe contact area Feb. 6, 2020 {0122} Then, the biorinformation measuring apparatss 900 may obtain bio-ifoemation based on the pulse wave signal and the contact presure signal in operation 1160, In particular, he bio-nfommation measuring apparates 900 fnay obtin biovnfomaion based on Ihe oscillometic meth. [0123] Subsequently the bio-inermation measuring appa rats 900 may” provide-@ measurement rest of biosinfor Imation 10 a user inoperation 1170. Various outpt devices tay be wc to ectvely provide the measurement esl {0124} FIG. 12 is a block diagram illustrating a bi Jnformation measuring apporaisaeording oan exemplary cnbodimeal. FIG. 138 Gigram listing an cxarsple of 2 coniguation of @ processor of FIG. 12. FIG. 14 is a tiggran explaining a method of detaining a contac sate. [0128]. Referring to FIG. 12, the bo-infrmtion measue ing apparatus 1200 socording to an exemplary embodiment includes a sensor port 1210, a processor 1220, a output Jntrface 1230, a storage 1240, and «communication iter: {ive 120, Dele description of parts with the same nae, hic ate described above, will be omitted [0126] The seasor part 1210 gcldes a pulse wave sensor 1211 anda fngerit sensor 1212 In adion, part 1210 may fer ince a force sensor 913. [0127] The processor 1220 may mesure bo-nfomation based on the pulse wave signal andthe fingerprint sensor {information reccived fom the sensor past 1210 (0128) FIG. 19 illustrates an example of the processor 1220 of FG. 12. Rfeering to FIG. 13, the processor 1300 ineludes contact area estimator 1810, 4 contact presire obainer 1320, a mesure 1330, 2 guide par 1340, and a contact state dstominer 1380. {0129} The contact area estimator 1340 may estimate a coniet area of an object based on the fingerprint sensor {information The contac pressure obtainer 1320 may obtain @ conte pressure signal, corresponding to the ont aes, base on information about the estimated contact area. In particular, the contset pressure obtsiner 1320 may obtain the ontaet pressure sig diet from the contact ares. Alter ‘utvely the contat presse obaine 1320 may obtain the onfat pressure by ting the contact asa slong. with the foree information obtined using. pulse wave signals of sale wavelengths recived from the force seasor 913 (0130) The measure 1389 may measure biorinfornation tesa on the csillomeric method by using the pulse wave signal and the contact pressure sign [0131] Upon receiving a rogues for measuring bi-infoe ‘maton, he guide part 1840 may generate guide information {or guiding#uscr's objeto accurate touch the sensor part 1210, and may output the guide information though the output interface 1230. In prticulr, the gue information ‘nay ialude a coaact posion ofthe objet on the sensor par 1210, and information onthe intensity of preset be "pplied bythe objet 10 the sensor par 1210 during mea {0132} The guide part 1340 may generate eu informa tion appropriate for a tac, by rolerring to various types of information stored in the storage 1240. For example, by Usig various types oF information suchas user's gendee, gc, altho information, measurement history of bo-nformaton, an appropriate contact positon and pres- sue foreach object (2, Finger. wrist, ee) an appropriate Contact intesty foreach measurement ime, and the ike, US 2020/0037956 Al the guide part 1340 may generate guide information suchas an optimal contat position or eonact presse fora current [0133] When a user's object oushes the sensor prt 1210 by refering tthe guide infomation, the cont sate

You might also like