You are on page 1of 98
«2 United States Patent Jain et al. ‘USO11687437B1 (10) Patent No.: (4s) Date of Patent: US 11,687,437 BI *Jun, 27, 2023 oa ow @ Cy wo ay @y (@) oh (2) (58) ASSISTING RESEARCHERS TO MONITOR DIGITAL HEALTH TECHNOLOGY USAGE IN HEALTH RESEARCH STUDIES: Applicant: Vignet Incorporated, Fairfax, VA (US) Inventors: Praduman Jain, Pair x, VA (US): Josh Schilling, Salem, OR (US); Dave Klein, Oakton, VA (US); Mark James Beale, Chicago, IL (US) Assignee: VigNet Incorporated, Fairfax, VA (US) Notice: Subject to any disclaimer, the term ofthis patent is extended or adjusted under 35 USC. 154) by 0 days. This patent is subject to a terminal dis- claims, Appl. No. 17/246,127 Filed: Apr. 30, 2021 Related U.S. Application Data Continuation of application No. 16'877,162, fled on May 18, 2020, Im. cl, Goo 11734 GO6N 20/00 AGIB 5/00 (2006.01) (2019.01), (2006.01), GO6F 11/3466 (2013.01); ABIB 5/7275 (013.01); GOOF 117438 (2013.01): GON 20700 (2019.01) Field of Classification Search CPC... GOGP 11/34; GO6P 11/3466; GO6P 11/3438 Se application file for complete search history. forma cos) aig @s) ome a + oem Ca 66) References Cited US. PATENT DOCUMENTS. SSH7STE A 81996 Kell SSRLATH A L198 Lopresti ot a Gon 184 "22000 Barret eta {551586 8112000 Brown et (Continved) POREIGN PATENT DOCUMENTS oN aovosses7 UW T2019 RR 201101807 A 122011 (Comtinved) (OTHER PUBLICATIONS US. Non-Fiaal Otic Acton in US. App No, 163876.962, dated Sep. 13,2021, 32 pages (Comtinved) Primary Examiner — Kamin B Patel (74) Attorney, Agent, oF Firm — Fish & Richardson PC. on ABSTRACT ‘Methods, systems, and apparatus, including computer pro- srams encoded on a computer storage medium, for moni- foring techaology usage and performance. In some imple- reatations, use of a technology item by one or more individuals assigned to use the technology item is moni- fored. Based on the monitoring, usage data that indicates usgge of the technology item is generated. One or more criteria for evaluating the usage of the technology item by the one oF more individuals is identified. It is determined whether usage data stislies the one or more criteria, A system provides, for display on a user interface, output data indicating whether the usage data satisfies the one or more 23 Claims, 30 Drawing Sheets ici) 5" + ape saysty son Tie eton = US 11,687,437 BI Page 2 (66) References Cited 20040210457 AL 102004 Samen 30040238089 AL 112004 Wane ea USS. PATENT DOCUMENTS, 2aons01ss625 AI 72005 Kart Soustisaset AL £2008 Abrham-Fuche one ede ee doneorsiies AL $2006. Shiinan ea. 594622 BI 62003 Miyabeh ta 2007 0179361 AL 82007 Bown ea 6.663.846 BI 122003 McCombs eal 200700250429 AL Wale al 879970 B2 42005. Shiiman ca 2ooroDoatig At Stim rage etme ee Zonsiporoa4s At Mekenaa et a Finan Bs 93008 laces a aonstozi287 AL Woetlentin eta 09 172007. Mealindon ca 2ooso1on4ss AL Kate Fis? B2 83008 Shimane. 2oog 0114689 AL By a 735308 B2 72010: Sweeney eta. zoos oLsoun At Karka Fs00.601 B2 102010 Sha a aonsnoe44s9 AL ‘gl ta 7306660 B2 10010 Fnctlandr et 2009 0118) AL O'Donoghue eta 7930262 B2 "42011 Fredlande ea 2ovo.or076s ‘At Fecalaner ef a E030505 BS s301L Sein aoiooo72I8 AL Miele Stesiao Boe 1a011. afer Gia o4o 20100088245 A+ 42010 Haman ‘G069 1010 T3738 708317 8157.790 B2 49012 LeBoust ea 2100218132 AL 82010. Soni eta 380.531 B2—23013 aye al 20100318540 AL 122010 Svore aa '8493.605 B2 43013 Huon ta 2otLoes7%6 at Plume eta 527486 BD 9013 Witte era aorzmg76 AL Seats 8338029 B29 2013 Halford et a. 20120065087 At Frog sa. 8585453 B2 112013 Phammer ta 20120310670 At Pru Hiwos es Waola tae sotsioos0s36 At ‘Acheson SSoro2 Bs 4204 Birth a Doisre2t4o AL 102013 Fedandr et S8bo0846 B2 23018 Bane ta 2ovatooe7se6 AL 32014 McGovern et al ieee oi neice aotaoissae7 AL 7301d Abeta et a. Sotene BS Sable Come cea dovanoreiek AI 92014 Mayer etal ase bal ec eanelceete a anianoveir4 AL* 92014 Meclue Giotto 95514655 BI 122016 Nusbaum ta 082 91659954 Bo S017 Achin ea 20140297199 AL 102014 Osten 9383618 BI 92017 Jain ta anansiem At 102014 SSI 2 112017 Igo ta anvanssoasy AL 11014 9848061 BI? 123017 Jain Hosters 2O1S0OTIE0 AL 32015 93858063 212018 Jun et aorsoie4Ts AL 42018, 9528250 BI 32018 Inmet a aoisoireir AL 42015, 9583.775 B2— S3018 Juin et Juisowssss AL T3015, 100029534 92018 Janet aoisvede AL 72018 Taner st Toss.6s8 B1 102018 Janet a 2o1sn226041 AL 82015 Naley eal 32019 Soyeo & aoisnso4o% AL 102015, 3019 nba aoisiossese2 AL 122015, To482816 B2 102019 Kidde a. aor 00805 AI "32016 Hanlon Tolgs8262 B2 102019 Reger eal aovenovss4t AL 43016 Hashela fostoass B 122019 Frater ta So6o12si71 Ale $3016 Faken ocr 16.288 {0'321387 B2 122019 Jain ta "08.2 to's46339 82 "12020 Sno et a 20160140322 AL* 52016 Menon Giett 1020 Toes BL 23020 Tun et a 7052 To'ss051 B2—4.2020 ao et 20160251480 AL 92016 Comish Tols36838 12 42020 Sao et a aore02e26% Al 92016 Mano eta Tojssoara B2 $2020 Sao et a aoien267298 A+ 92016 New Gictt 1060 ToemSi9 BY 62020 Sao et doveosoeo4s AI 102016 ams {0356987 82 $2020 Jain ta O16 0314987 AL 102016 Nolan etal to'7e09%0 BI 92020 Jain et aorronzead At "12017 Lune fooseest 2 33031 Tan et aorTio03¢904 AL 23017 Francois et Mose. Sain 20r7039341 A 22017 ‘Shiai ea {61798 San asin 9727s So170p709R A $2017 Singha a Moss? Saino. aorroonten AL 3017 Neumann 1102304 sain Host 676s 20170255919 AL $2017 Moun ea rsa Manon 20170286622 Al 102017 Cox 1396971 dain aor7os79548 AL 122017 Balun 11398706, Sain ta. dorsnoasi2s AL "T2018 Crane ea i318 Jin ost M38 20180036801 AI 22018. King T3616 Sain el. 2orsoae78) AL 23018 Graver eta i308 MeCloky tl dorsioos6i30 AL 42018 Bian et a iaisais 2018006608) A 32018 Cohen eta 0.080 32018 “Tucker et is20des BL 122022 S018 Alien aooviows70 AL 73003 S2018 Shima ea aopaoranses AL 102002 Soismsrsio Al 82018 Tetbouet etal donzbtasses AL 102002 Frank eta aous0s30s24 AL 112018 they dovoorsiry AL "23003 Wht ea dorspoias AL "12019 Frasier 2003'0068669 AL 42003 Kahn eta 201990122266 AI 42019. Ramer « a dooso1sosmt AL 72003, Rao et a anig0038686 AL $2019 Yang ot aoosoossea7 AL 32004 doivo1ws2 AL $2019 aint al doosoosm7t AL $2004 BOIVOLGADK AL $2019. Zavaro aopuorTaAdT AL 9:3004 aoivmangsst Al* 72019 Walple ‘068 2000 aopwor7stan AL 92004 aoigorarsis AL 72019 Iain a US 11,687,437 BI Page 3 66) References Cited USS. PATENT DOCUMENTS. 201900227528 AL 7/2019 Abbot a 2oro.024si29 AL 82019 “Tach eta a020008K382 AL 22020. Bibs ea zoanooese9 AL 22020 Hhvet a doononeesi> AL 2020, ender eal a0200131881 AL 42020 Jin ta 2o2o02tiesd AL 72020, Sablinsk eta donooa2iiie Al 102020 Neumann’ 3o200299 AL 102020 Neumann ao200y72084 AL 11/2020. Koloboy & a zn200se7s10 AL 122020. Hodgron 2naQ00elae6 Al 20210182878 AL an24oa10170 Al 2020350400 Al 30200076822 AL bn2010s424 Al 12021 Mato ct {62021 Margolin ta. 72021 Garner et H12031 Vilar ea $2022 Livet al 022 Jae a PORFIGN PATENT DOCUMENTS Wo 1995012812 1995 WO 201S0EBS2 AL 62015 WO D1s0sOK AL 62015 Wo 2oi6LI084 32016, WO 2017100609 AL 62017 WO 2020198068 A 102020 (OTHER PUBLICATIONS ‘sporsom [oolae), “How mifeah technology is revolutionizing incl esereh" Sep/Oct. 2018, ravoved on Ap 1, 2022 rowed fom URL Ripe wsewisporor docs deatsore publications ‘ale-utcomes.spotigh september october 2018 sporvosextober 2018-toe mhealth palsfrsn-$8220619 2, 4 pages US. Final Ofice Action in US. Appl. No. 16876962, dad Jn 26,2022, 32 pages US. Non-Fnal Oice Acton in US. App. No, 163876856, dated ‘Oct 6, 2021, 17 pases US. Non-Finsl Ofce Acton in US. App. No. 17173.268, dated Sep. 16,2021, 36 pages. US. Notice of Allawancein US. Appl No. 161576886, dated Mar 30, 2022, 14 pages. US Notice of Allowance in US. Appl No. 16877, 162, dated Mar 1, 2023, 1 pages Cancer go [onlne} "NCI Dictonny of Cancer Terms" Jan 9, 2020, etrieved om Mat. 13, 2020, etivel from URL ps 7 ‘ancer govpublications/dietonaries cancer-termdef rescarch- sty. 1 page. (Cora al "Modernizing and designing evaluation fameworks| for connote Sensor lehpologies in oii”, Digital Maine 3. Mar. 2020 tvcliicalials ong [online], “Clini Trias Transfomation Ini tintve (CTD) Recommendations: Advancing the Use of Mobile “Technologies for Data Capture and Improved Clinical Tals. published in Jl. 2018, roved on Jan 7.2021), euieve fiom URL vor ctiinicalial ngs wuwetlncaltials ‘om fies mobile devise recommendations pal"P p21. a13~, DeAngslis, “Patient Monioring, Big Dat, and the Fuure of ealtheate” Wired.com, Aug. 6, 2014, seoved at URL=hips ‘wri con insight 20 408i oitring-ig ature Iealthare!>, 6 pages. Dias tal, “Weamble Health Devies—Vigtal Sign Monitoring Systems and Technologies” Sensors, ul. 25, 201%, 188)2414, Fatroncom [online “OncoTals” May (4, 2018, revel on Mae 13, 2020, ares fom URL hips atiron com oncog)” lincaral’ $ pages. Fatiron.com [onlibe, "Press Rclas: Fauon Health Announces ‘The Publications Suing 2 Feasible, Reliable, Seable and “Meaning Kea-Woed Progression Enon for Oncology Reseach” ‘Aug. 22,2019, tive on Mar 13,2020. rev om URE 3 pages ‘Michasjox org online), “Fox Til Find” raieved on Mar. 13, 2020, retrieved. train URL “hp wore michasjfox org inde. 4 pages ‘Miksa el, "Small But Might: The Use of Real-Wosld Evidence to Inform Precision Metin,” Clinical Pharmcoloay &© There pets. fl 2019, 10618790, ‘Mixpanel.com [oslins) "What is cohort analysis.” seieved on ‘Marr 13,2020, revel Grom URL tps nixpansl com topic ‘ohortanalysis™ I pages. ‘Murphy eal °Visual Query Tool for Finding Patient Cohort trom ‘Clinical Data Warchoore ofthe Paners Healthcare System,” Presented at Proceedings of AMIA Symposium, 20001174 ‘Niskeled.com lenline, “Chapter 5: Top cohort analysis tool and resources" Dee. 12,2018, erived on Ma. 13.2020, retrieved fiom URL. rapes Pane, Latest Tren in Moat Monitoring Devices and Wen abietalds Technolog" Busioessaside com, Jan 31,2020,raieved ft URL . 4 pape, ‘Wikipedia.org loninel, “Research,” Mat 7, 2020, retrieved on Mar 13, 2020, retieved from URL , 17 pages Otce Action i “Appl No 16876962, date Sep. 28,2022, 51 pages Dice Action in US. App No. 1776.19, dated Dee. 2 pases Oiice Action in US. Appl No. 1732749, dated Dee. 21,2022, 40 2022.34 pages Dice Action in US. App. No. 177207439, dated an 1 peges 2023,36 * cited by examiner US 11,687,437 B1 Sheet 1 of 30 Jun, 27, 2023 U.S. Patent Old 7 ° asus9 vst Toa : syaty onemigpong ong anes | gang - Oamsmadeas omme | mes \vomslensmarg | yams yoru | e008 | 09 | vompeg ee paseo ‘Aboroup ozk Waly} JO. Suoneuquica eh. “njpue aieayos 24] 204 $1008 auILLUa}eq voreumucoen | KO ‘aunssexd poojg uawenow ‘jeneay anseau ie UEMYOS pue seoInep ANUOP) ‘ans oojg pue (uojou pue aes 1weou) dears < payoaen 29901 ep jo sad aune}an ©} e1ep Apnys ezkjeuy a eseqeieg ‘AB6ojouyoo 4, (008S <) BiH 3800 - Z:ai09§ - eu0yd - ZUNE (ones > oss <) wnipayy 3809 pauiguog - | :ev00g~ | aunsseig pooig Quosuag pag | (uowsroypue By s0suag-TUOHIO fey sey) dag FBojouay papuauncoey ff speanens (3) woo Soares weapenuueres JG) & w6oy +] © [a zig dnoig in (slodh, eq © TESS POET | pooja pue deasyeen1 |:spaan Apmis ABOTOUYSET PUT | ‘pnig yoteasey MAN 2819 wes 0 «Xa90b z0b Deo US 11,687,437 B1 Sheet 2 of 30 Jun, 27, 2023 U.S. Patent aseqeiea Awouore | andut Jon Bunasdons pue Sujwen Gwe! suupeu 10) "6 ‘sauobane rep Jo KyauesaiH sasn pue ‘sedAt ep ‘spuowey Buddew eyeq é ‘Old synsar Jeujeyy Busyeoipay pausap enaiyoe ‘saiBoouyoa, ——_ WM Sa,6o}ouy9ey ‘sn 0} saiBojouyoay eros 0 aBesn wo!gup Bupuowwooad yemige Buvowuoy © Jayjeym Bugoipalg « pue Burfyquep} 92. wee Cee Qt cee mee ft ae. t ainpoyy ainpOW, ‘ainpoyy uojepuauuiodey Buono voRDIpeld ‘KBojouyay, e072 105 POA TO_| SES GH |S UES a eseqeiea ‘ABojouyoey, wir ___| aneseig pong | yoosues owen | ene sues so spans | fomdens | sows ‘um seyBojouyoar toouuco : a Tage | Seay . cl aos vay seiGojouuney Burzueyseret ~[Citasooig [ana pamseon | —ABorouyoar . ep jo Asoday Cone US 11,687,437 B1 Sheet 3 of 30 Jun, 27, 2023 U.S. Patent aseqered ‘Auiouoxe eyeodn ‘eseqeied ‘ABojouyo9 | arepdn, ‘SaiBojouNgaL ‘ay 40) $25) parepten Aguep} FerbojoUDe] SAAN ue spionsayaieroy escsoea) (sg >) unpay (dea) (25>) 48H Gaquoy at unpess doa saan ORAS ‘21005 ee yeep Quawa70N 018K eas 9 2080 nea] (ee) vt wawerrseoy de ayaa TORT ‘jewary 99 amnesoij poog (zr) vB p01 doag supose ur Sigunog dag Taare ssdag Aas By uawErOH fudertry Body (40 <) 07 wee aLarseeat uotevcy sbunpe 1 dag saauoreeooy uaweroy ‘doas yy 918609 oystoaid Taree ‘6p parepyen spromoy, ‘ABojouys0) ‘SaIpmg BUF UT PAST) saojouupay au AnuepL Sau pue spiomfay Ayquapy J nn US 11,687,437 B1 Sheet 4 of 30 Jun, 27, 2023 U.S. Patent ‘peppy 20 paren) ay nou suey NaN 2tNaupy GURETIEN—« ssvamnpesuey ou yOld reno eed orewqu) Bunce, eg 285085 FOF bea abesn ‘sepia MBoouey wos pauergo Bea Bus + eq Buco Bus ‘see Sopa 24 Bu F serepdn aseqeied m0 \ "Bia : over | weroway | sincyar | seq aay [unpan wn |e.x9 teas 010 oa Ws soovy | sniw | ww | on [ORL WN vst [aves poow |v esves Pp’ Piospuy si So} wunppayyy Copa sotviy | rea | smovzr | son | (oes ciate PeW | poo :doas | gous ‘eueqrionuy | unnan van] "ee es 09-8 req WIN 88, (ogg >) mo7 uo Aydeipy addy setyiv | ean | wm | sea | ioss>raer no a5 vay ais aT, 5 by Aroyeg | Heved Jsquawesnbay | YOIP%a | PEG posnseeny) AojouyoaL 307 ‘suopeoyjoedg 10 eseqeeq pur syuoweunboy ey LS ABojouyoo, ~ sepmy Sago seunor yorearey, IF eamesoyy US 11,687,437 B1 Sheet 5 of 30 Jun, 27, 2023 U.S. Patent Noy WRN, “AMINONI pueg Josuag res{_ yp seyucssjooy —atoosoukg ———PUUNSSAY Odd 993 youd buna | uonea07 sound 7{ ban waa a RuouoxeL ous (ae 2duaroyuy Bunwesy auygeyy Buoyed 2 sindy 9q2019 OFF eq Buus Buwee ‘euypey aye019 Buuies), Buuies] euupeyy 40} Auouoxey asp) oe ‘sajGojouyoa, 0} sadAy e1eq painseayy deyy = Ve US 11,687,437 B1 in. 27,2023 Sheet 6 of 30 Jun U.S. Patent US 11,687,437 B1 Sheet 7 of 30 Jun, 27, 2023 U.S. Patent a9 ‘Sls uqeyesm, (~.) suoseeg p a ain _saetiidng eqniouny Aaooey ear Old WOOL, Wd yueeH aGoog Sunswes SBUIUM sunt . 1 BY FEM gery unig golle? euoyduews 5, Proupuy ‘© f UME Lroucay 2880) ws 2 A funsueg «Og ezkuewny aus C) , yorem aiddy “eee” | suasx / upsoxey Je|0g US 11,687,437 B1 Sheet 8 of 30 Jun, 27, 2023 U.S. Patent Taewesou 0% oy “geno Bea HeREraH, ond ssazing, vn ssaxng anssaigpoagpaaqieueg | —anyey [9 050g poq ea HARTTONIES ' eee | emmea | wines angauels = _ 1899 hewang CORR, a lee ape TO OB : :eyueonpaegiewen | MES | VK seyneey naegiowen ‘anesaigpoggpaeaiauey | NES | Bo anssaigpongpasqieweg | amey | yaty ‘inne sSuyuey4jsumeszo} uoseey | ysseoong | ABojouyoe, pained 2°Old 0001s - o6png ABoiouyo01 Aoms 18209 50h) 'UoS}201d pOuboR (quowonoy pve 72 veoH) doors ‘unssaig poor ~ ssadh, ejeq painseayt SuOHDIpala ‘ABojouyga arelsuag 202 exec Konig ansooy US 11,687,437 B1 Sheet 9 of 30 Jun, 27, 2023 U.S. Patent ve ‘Sls a) snag aug 927 a Kew] 2 00d (osabe) eg 7a Fang SonnBG eID @ POON ON 8H 1osiag | (G6 068) aon _osuag pag 8 ¥ Josvas asf Aer] e201 81 on BEST | 9 “OSUES PBR i ts By OSE a a 2 28085 Be ” vey, ab esp) J2yBiH ane} & paDIpaid Sg BUOuS EES) igeunel een vi a.osves peeves | oe-t2seby TBoyouaL Suuosee edoruea jd is epuaunuosey | Wreiued/ dneld) soby ily ‘sdnaig aby aiqneduiog - (%G¥ >) wnipeyy ‘uoIsioalg - quediomed/0BES 3809 - 6r90 gauoud "31098 = TONES 09-8} ssdnaig aby aiqyeduiog - (962% >) BiH “uoIsioelg - (winypayy) juedionted/ogig "i809 - 6820 121098 - ‘9 Josuag pag 9 ¥ Josuag - [WORTH ‘SUOPEPUOUNMTOTOY TeTaTEH ‘ABojouysa] papueunwosey 000'01s- seBpng ABojouyoay Apmis 18209 159M ~ ‘uoiBoy Apmis shep gy - :yyBue7 Apmis plo sieak ore} - ssquedionieg jo eBuey oy suedomed 0g - :squedionieg jo saquiny Aepjsinoy ¢-9 ~ wil, aBesf, 2764 veo}) doais - ‘aunssid Pooig ~ :sedA) z)eg painseay OF spaen Apnig SfdC_) eo O “Love U.S. Patent Jun. 27, 2023 Sheet 10 of 30 US 11,687,437 B1 Technology Recommendation Module 242 oy 802 SCORING 108 Stored Data Factors: | Precision | Relablity | Anticipated Usage | Cost Technology ) | Weare] es [aa cap oe oon Data 202) [S00 ieee | tee | topmmme | wr Algorithm Z ts i 7 d 7 806 Taipan Bas | Component | Tacnaloy Foca nk Fodor et acon Score: Weighted Score Score Rank od oan oast ewe a o smo oe [Rey ao w ow oa ‘Sensor Anicipeted Usage orm 0213 cat oa co Fret fo a fala cam oa Pree 8 cee | 2 a aa ca oi oor sen oa we aay cam a ages Seer om | a Tricpinivoan | 35a an Cat oe com ‘anol Threshold Score JX °° Threshold Score = 0.6 om V Recommendations: - Sensor A & Bed Sensor C (Rank 1) ~ Phone B (Rank 2) FIG. 8B US 11,687,437 B1 Sheet 11 of 30 Jun, 27, 2023 U.S. Patent 206 V6 ‘Old "RSV PST BATS (essa) asa go | seats dog eau — , egenfyue0 #848 | tees) oma so | ‘and doag euusaea eae oss peg sted avery) a 55 we) cS a ww vat i = vor ag onuaog sent arenas — | asore, vasa antag , me renew 908) yong apy 1229 se0i0 : asty SpueUINOD Id :aeq saan 09 icon ae _ssaurgsey dasig auuue FB censyvon aimee msg oaeg 7 2MYOS |s2N00 agoyy - 2 opEINB4UOD| wJemig Sot 1 008s | 0 aN vay = ‘sosu0g AH Ue SepeUL ‘eq saauosee00y 39 ho e1 uosian gor : ‘28g Josueg His we |=:490 agoyY - | iogeUNEyUOD| anpon —_ " soads, LA suopeinbyuog 10N0 spuewuog jay ee ABojouy>ay leseaeiea AEojouge4| aoe wm US 11,687,437 B1 Sheet 12 of 30 Jun, 27, 2023 U.S. Patent g6 ‘Sls vieNg Sor (sheng Ssauinsoy desig suNUaIEG Bill] Goalg SUNUIEIEG 06 Ne Bec Jeteuo18=0y 199] spuewuog jay eIgeeay aed yOeg Feng :eauleN WOly ‘SqO JayoWIOIe|@0oy *s10Suag ~ a6 vel So!'so- ‘suoqean6yuog AL aeucug | rnopape ememaaang seas 206 086 { V ddy ROOST] BIDET # doaig ‘Seen ABTS “sainpoy 226 TOFEMBITOT ABOTOUTES] PAIS —S we NOILVINAW31dWi ADOTONHOSL leseqereg ASojouyoa4 SS eee JOE (ea) US 11,687,437 B1 Sheet 13 of 30 Jun, 27, 2023 U.S. Patent ey vest ‘108uag peas annssaig poig = ‘ys08u85 2 osnieg- rowan pve oy pea) dee ‘908u5 pea "L magmas | ae | S| amg a | VS aa voag'toas | eau a eseqeieg [a TT Sopupe. 7a vay Topped Teouway ae dnyoo7 Oc “SP9GH INO, Buoy 0 2 ‘ys0suag "8.9 2050s pag Aiqjouge4| ag 5987 papuauiucosy Sugeorpuy eeq yusueD WOT sesp requajod Aven} o} e160 ABojouyge, ezkeuy FOOT eg ‘ABojouyga4, doo 'ZOOF ABojouyoo, 8 J0 uogeoypuy anizoeyy US 11,687,437 B1 Sheet 14 of 30 Jun, 27, 2023 U.S. Patent bb Old | “sOYUOWY © Apmig yoseesey, Apmig yaieasey 1 1 1 1 I 1 | I I | | 1 1 | | 1 1 I | souapy yo sdnoig eayssesony | wonenn POWso.NL | \ pu san azei0 AeuOHd « | e wojeg 51 uoRE ZI : suonearpuresquog - foencoy | — suedomeg spmg | ' syno7 Ayoxoy- I swaueg ploysayye mojag | | | 1 papedxeun jequatog - 1 sypsoy jo Kaasnooy- | I I 1 ‘axes | Ayano - are | 600.61 \ |, Sewening penodeyyuened sseuanpay - Proyseuyy & mojag St ip Bsn paroatiog yueel 04 uO ainssalg pooig - 10943 apis - are aunyed / sse0ang « sey o Koeirooy~ | paseg saBojouyoay ay, Jene4 jeumeroduay - | Susog - y sluaussinbay aug | ABojouyoes aug jo ejey | 40 A100 8U0 WaIsg | youeasay o} sjaqy Jeu ASojouypa| | any /sSe00ng- | —_salBojouypay yueY « pel 0} SoLtayy | 888051q | oRIpUED LEH - | _S26o1euyp2] a005 « auUua}ag «| 1 I 40 eu Ratu 24 20} uu, ABojouyoa} ut 40.05) au o}UOWY suey eleq auuia}aq 1 i \ ' Gesetd poseug | Taseyd Testud peseug jeuondo, ; | | cots U.S. Patent Jun, 27, 2023 Sheet 15 of 30 US 11,687,437 B1 ram RECEIVE USER INPUT INDICATING CRITERIA FOR TECHNOLOGY SELECTION 4 USE THE TAXONOMY TO INTERPRET THE INPUT 1204 IDENTIFY TECHNOLOGIES THAT SATISFY THE CRITERIA 1206 SCORE AND RANK THE IDENTIFIED TECHNOLOGIES 1208 SELECT TECHNOLOGIES TO RECOMMEND BASED ON THE SCORES AND RANKING 1 PROVIDE OUTPUT INDICATING THE SELECTED TECHNOLOGIES 1202 1210 EVALUATE USAGE AND EFFECTIVENESS OF THE TECHNOLOGIES i214 U.S. Patent Jun, 27, 2023 + Responses ram sy Sotioant for rental betth eg. doresson) sues Coleen meaner data rome partion ‘Steps oe dy {average dorton of seep ovecone week, rintredoy een measurements per inte ‘necator of een avaty ©. veather) indication oFthe avaly oF de race to be reported by pctpants eg, wccuecy, recision, eoueney, ech + Revel of aearecroting ined to ‘bin he expected numberof cree sctie paniinants (eg, 751 + Rourber of active priioants eect to ually sattial response ofa + iathods of date calecton eg appear wanslaton 2 expec renner. experimental rescch ovited) + eration abut rear tai eg, methods. rests, ete) + Choge eyo the selected techaology + Colbration needs ‘Replacement ordering of consumables (Getahes st9e sample depos) Doce for enemas Sampling Frequency + Upload /respende be + Reporting Cxtence + cant Per Uni Batch pricing fabscinion ping shumber of Seats Vicensing + Paria ateibues (eg, ages Orage sisrision, 1) 1 Begurereeon or ust te slated rechnelogy fg, duaton of we, frequency of we, cermpenty of 63, participant edscetion needed) + Participants knowledge of aioe achncogies Sheet 16 of 30 US 11,687,437 B1 *ingletons of which tay parscipent have igh oF low depression survey scores Resul of araling ealetnd data eg + esse eps crrlateso higher depreasion ‘consistent slew duration of bheurs oF greater average per day coraistesto lower ‘epcession «Goad legs incabig rscune nd quo soap morose overall ment heath sate ‘Recomm way proto eer or av itso achieve dese dat gully, a ‘Tota seep duration needed for dye 2 ay pero «Step ots for 9 aye coniguoutin the 7-day eid ‘Estate of pombar of acve partpans needed leg, 901 ‘Estate of fot numberof partipants ede 19 reach the pete participant number fea. 120) Actus numbers of activate participa ithe ey ‘Tinlcaian ofthe hve of ralibity or “valdotion/quaitenton of data calecton techonques for hs tudy fea, the techniques have eer uccestallyased in 100 esearch thes) ‘Vindcnians of equtereny needed or ‘succes ure of elated tecoroloey ee chorge once per dy autsie of eassuceren acti) “Expected or ctl data ansraion requirements (eg. per day datatanster verges per user) Tianeaedcortafnewieced econ | (eentesttonsiope paseo) | wash easel] Pricey tesco] be "Highest participation expected for | ‘ndhicuas between 1B40d 40 | + Selected tecnciogy reves inal eft | + Overall cohort comaliance rede | i US 11,687,437 B1 Sheet 17 of 30 Jun, 27, 2023 U.S. Patent ee peigtent auempsen | Uo shemiy SBA awos o0e seaviy Bis daajs) 3 s0suas pag pauenD Baemyos | Bsr BuO SBA awos s +09 MOT davis addy ee paygend areMYyOS | BN BuO ‘2 wos ¢ Oret Bi | AydesByoy addy payyeno auempieH | ayr auoug on} eda | pepnjsur sayy] winpay | AydeBnoy au0dd peynenD a2 SaRMpIEH Buoy ON}; dar 0s 09-0F «BiH | Aydednoy | ~ewopag zoos payHenD v ‘suempseH uoys on) aidan oe oret| wnipaw | AydeBnoy) eoiseg sum ky v suempseH uoys ON | FRR 07 oe ovat Mor days | aaag sum (28 9's papaan | saipms 3y *y se payouap addy | ayn umeg | oman | qoueesey B09) qwedewieg| vospeig] samseayy| anbiun) 4HO- 2am US 11,687,437 B1 Sheet 18 of 30 Jun, 27, 2023 U.S. Patent OSeS=180) - (pod 1903 431M) #40 QOES=IS09 - (BUOYS HIM) Z OL OL O} F10sueg pag $9180) -1 ovr of 08 addy O0ES=350) - (J08Uas pag yA) Z 06 i 06 2 240g ‘asay OGEG= 3809 - (sosuas pag YIM) » 08 ° 0g} -awopag 1004 o0e$-a809-€ ott ov OL} vane sum 21095 (daei5) Bur {AydesB)y2y) Pepuaunor.y uonrajas} — ansuayesdsa) | 100 g ainseayy} — Buls09s y ainseoyy JH 2 ones U.S. Patent Jun, 27, 2023 Sheet 19 of 30 US 11,687,437 B1 1300 "Tecsany Option [ adotscent [Young Ada aed” cost” | Usabity Anais” | Taored | | [score 2 using Apo 5 ‘edi conte 2 Only | ‘cated regularly | 1 2- Using Bed Sen |X oo or rn sort with Phone ¢ : i | cocsatusebed | | 3 sing ded Sen x is Best -routineiyuses|2 | sor € with Phone © / | bea i | Fr oe a tor with Phone ¢ | [aseeponcouch | | 3 Using Wrist De | eee ste a | | | 3- Using Wrist De | Tr | ee a | | | 3 Using Wrist De- | | | vice | | | 4 Using Foot Pe- | | | meter 8 with | | | Bet Seasort | | | 1 Using Foote x [sss Modi: whenor |@ | ometer wih j [etomestoos | | Bed Sensor E I I {| 4 - Using Foot Pe~ i x [8898S | Medium/Poor- 3 i omer B with i | Lmostivinbome, | | Bed Sensor E | | | | | doesr’t wear shoes: FIG. 16 U.S. Patent Jun. 27, 2023 Sheet 20 of 30 US 11,687,437 B1 car Technology Database 12 Sensors included; data types ‘measured: precision of data Research Literature Database 204 Includes: AIMS. Research Stadies Literary Review Dependent Motries Measurements Data Quatity ‘Total Participants Precision Core participants Likelihood of participant participation Input Operations ‘Availabilty. Licensing terms Picture af Device Dimensions Configurations Battery Life Network connect optons Acceptable down time Transmission Cost Equipment Cost Researcher Feedback COMPUTER SYSTEM 10 Sensor Data / Usage Results 1702 1704 Inchides: des: + Crowdsourved from research, Recommendation statistics community and manufacturers Likes Disikes - what works or + Success/Fail Rates doesn't - Researcher Feedback + Measures Markers Profile associations to participants + Quality Determinations Tailoring feedback trom participants + Usetiiness + Uniqueness FIG. 17 U.S. Patent Jun. 27, 2023 Sheet 21 of 30 US 11,687,437 B1 oes 1810 1812 ( rou Research 1814 informed Selection of DHT taternat ‘Cornmunity a Data - History of DHT Use 1844 External Literature 8 os es) me ‘Community sone FIG. 18 U.S. Patent Jun, 27,2023 Sheet 22 of 30 fe aa 1902 108° ‘Compare Study Data with Technology Data US 11,687,437 B1 U.S. Patent Jun. 27, 2023 Sheet 23 of 30 US 11,687,437 B1 zon tT i farms MOY 2 sy Dam @ Researcher Data Sresieetote Study Findings DHT Findings —_|stenmnmnmmmmnnnn 2010 2026 2024 i 1 Literature: Data DHT ie Recommendation 2032 Participant sae Responses, FIG. 20 US 11,687,437 B1 Sheet 24 of 30 Jun, 27, 2023 U.S. Patent eld euisug uonepuauiuiod3y sayentuy ‘%Or £ ‘payHveP! SLHO %OE “ApNIg 40 sse0onS 000° technology item to collect the type of data; and detemnining composite sore for the technology item based on the data collection scores TInsome implementations, selecting the one or more of the ‘identified technology options includes: ranking the identi- fied technology options based on the suitability scores; and selecting a highest-ranking portion of the identified technol- ‘ogy options. Tn some implementations, selecting the one or more ofthe identified technology options includes: comparing the suite bility seores with threshold; and based on the comparison, seloeting the technology options that have a suitability scare that satisfies the threshold In. some implementations, providing the output dats includes providing an indication of the selected one or more technology options for display in a user interface. In another general aspect, a method! performed by one oF more computers includes: receiving, by the one oF more ‘computes, information indicating one or more of individu. als: secessing, by the one or more computers, attribute data from a database that indicates attibutes of the one or more Individuals; determining, by the one or more computers suitability scores for different technology options based on ‘an assessment of the different technology options and the atibute data forthe one oF more individuals; selecting, hy the one or more computers, one or more technology options for the one or more individuals based on the suitability scores; and providing, by the one or more computers output data that indicates the one or more technology options ‘eleted for the one oF more individuals Tn some implementations, determining the suitability scores includes generating the suitability scores using one or ‘mote machine learning models. ‘In some implementations, the one or more machine lear ing models comprise at least one of a neural network, & support vector machine, a elasiie, a regression model, & ‘clustering model, a decision tee, a random forest model, 3 genetic algorithm, a Bayesian model, or a Gaussian mixtire model In some implementations, the suitability seores are deter- rmined based on (i) usage data indicating usage of technol- ‘ogy items represented by the technology options by other o 8 individuals not in the one or more individuals, and ( atributes ofthe other individuals. In some implementations, the suitability soores ar deter- ‘mined based on rates that other individuals, which are determined to have atwibutes similar o the one oF more individual, have correctly used the technology options In some implementations, the one or more individuals ‘comprise one of more participants in a research stady or one ‘or more candidate participants for the research study. ‘In some implemeatations the one or more individuals are a cohort of participants in a research study or i) a wroup of candidate participants forthe research study Tn some implemeatations, the one of more individuals are a proper subset of a cohort of participants in a research study. of Gi) a proper subset of group of candidate participants for the research study. ‘In some implementations, the one or more individuals are (a single individual in a cohort of parcipants in a research study or (ii) a single individual of group of candidate participants for the research study, Tn some implementations, at Ieast one of the different technology options inclndes a software technology item and at least one ofthe different technology options includes a hardware technology item. In some implementations, at least one of the different technology options includes a single technology item and at least one of the different technology options includes. a ‘combination of multiple technology items. In some implementations, solecting. the one or more technology options includes: ranking the technology options based on the suitability scones: and selecting highest ranking portion of the identified technology options ‘In some implementations, selecting. the one oF more technology options includes: comparing. the suitability soores with a threshold: and based on the comparison, selecting one oF more technology options that have a suit ‘score that satisfies the threshold. In some implementations, providing the output data includes providing an indication of the selected ane or more technology options for display in a user interlace ‘In another general aspect, a method performed by one or ‘more computers includes: monitoring, by the one or more computers, use of a technology item by one or more indi- vidvals assigned to use the technology item; based on the monitoring, generating, by the one or more computes, usage data that indicates usage of the technology item: ‘identifying, by the one or more computers, one oF more criteria for evaluating the usage of the technology item by theoneor more individuals; determining, by the one of more computers, whether usage data satisfies the one of more criteria; ad performing, by the one or more computers, at Jeast one of () evaluating an altemative technology item for the one or more individuals, or Gi) providing. for display on user interface, output data indicating whether the usage ata satisfies the ane oF more eritera Tn some implementations, the technology item includes a software technology item oF a hardware technology item, In some implementations, the one or more computers comprise a server system, and monitoring use of the tech: ‘ology’ item includes: receiving, by the server system and over @ communication network, data transmitted by or generated by the technology item; and storing the oosived {ata in association with metadata that describes a context oF ‘manner in which the collected data is transmitted or gener ated, Tn some implemen ay item includes track Tor each of the one oF more US 11,687,437 BL 9 individuals, at least one of a frequency of use of the technology item, times thatthe technology item is used, or ‘duration of use of the technology ite, In some implementations, monitoring use ofthe technol- ‘gy item includes tracking, for each of the one or more individuals, at leat one of types of data collected oF pro- vided by the technology item, amounts of data collected of provided by the technology item, oF data quality of data provided by the technology item. In some implementations, generating the usage data includes generating data that indicates pattern of usage by the one or more individuals or a series of use intersctions ‘with the technology item by the one or more individuals over In some implementations, identifying the one or more

You might also like