Scribd Logo
Upload

Welcome to Scribd!

  • Edge Computing Management Using Multiple Latency Options

    Uploaded by

    scribbby
    6 views27 pages

    Original Title

    Edge computing management using multiple latency options

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document

    Copyright:

    © All Rights Reserved
    Download as PDF or read online from Scribd
    Flag for inappropriate content
    6 views27 pages

    Edge Computing Management Using Multiple Latency Options

    Uploaded by

    scribbby

    Copyright:

    © All Rights Reserved
    Download as PDF or read online from Scribd
    Flag for inappropriate content
    of 27
    «2 United States Patent Harwani US 11,228,516 BI Jan, 18, 2022 (10) Patent No.: (4s) Date of Patent: (54) EDGE COMPUTING MANAGEMENT USING MULTIPLE LATENCY OPTIONS (71) Applicant: Amazon Technologies, In., Seat, WAS) Robin ws) (2) Inventor ish Harwani, Plano, TX AMAZON TECHNOLOGI Seattle, WA (US) (73) Assignee: INC, (*) Notice: Subject to any disclaimer, the term of this patent is extended or adjusted under 35 USC. 15440) by 158 days, (21) Appl. Now 16/138,729 (22) Filed: Sep. 21, 2018, (51) Incr, GOOF 18/173 Host. 1226 Host. 12911 (2006.01), (006.01) (201301), (2006.01) (2) OSI, 4370852 2013.01; HOS 480876 (2013.01); Madd. 47770 (2013.01); Host 6718, (201301) (58) Fleld of Classitication Search (CPC HOST. 43/0852; HAL 43/08; HOAL. 43/0858: HOST, 43/0864; HOSE 67/18; HOaL 47/70; OSL 43/0876 See application file for complete search history, wey 66) References Cited US. PATENT DOCUMENTS. 8321,862 B2* 112012 Swamy Gar 9455 on 10116.521 B2* 102018 Kokua HOAL 430876 aorsozisoss 1 'S2013 Steiner csr 21402498 ALY 82014 Monash ALY 122014 Sharma 03804 201710295246 AL* 102017 Georgiou 170359272 AL* 122017 Srinivasan * cited by examiner Primary Esaminer — Aah Neuer (74) Attorney, Agent, or Firm — Hogan Lovells US LLP 7 ABSTRACT ‘Technology is described for edge computing management with multiple lateney options. Aa application orchestration service may identily service distribution zones ofa service provider environment that provide a connection between 3 ‘mobile network and computing resources capable of execut- ing portions of distributed applications used by devices connected to the mobile network. The application orehes- twukion service may determine whether a network path Jateney between the devices and the computing resources satisfy lateney consists forthe ponions ofthe distributed applications, The application orchestration service may orchestrate Which computing resources in the service distr- bution zones handle application processing by the portions of the distributed applications for the deviees connected 10 the mobile network 20 Claims, 11 Drawing Sheets U.S. Patent Jan, 18, 2022 Sheet 1 of 11 US 11,228,516 B1 100 service Provider Environment 102 41) Profile latency constraints of different portions of a distributed Distributed Application application Data Store 114 Code Portion(s) 130 Distributed Application I Profile 140 ‘Application Orchestration Service Code Portion | 116 Latency Constraint(s) | 142 | 2) Orchestrate execution of portions of the distributed application for Region(s) 140 clients across service 7 Gaubiion eres en Service Distribution Zone(s) 120 the distributed application Computing profile Resource(s) 1 Code Portion(s) 130 Network Link(s) 124 Network(s) 106 Client Device(s) 104 FIG. 1 U.S. Patent Jan. 18, 2022 200 ~ Sheet 2 of 11 US 11,228,516 B1 Service Distribution Zone Rack 202 Server Computer(s) 220 Application Orchestration Service 222 Processor(s) Moonee — 230 ‘Application Profile Manager Module 240 Application Context Manager Module 242 Mobile Network Integration Module 244 tributed Application 224 Data Store 226 ‘Application Profile(s) 260 ‘Application Context(s) 262 Client Network Information 264, 208 Service Distribution Zone Rack 204 ‘Server Computer(s) 270 Processor(s) eee ald 276 ‘Computing Instance 272 Distributed Application Code Portions) 250 FIG. 2A U.S. Patent Jan, 18, 2022 Sheet 3 of 11 US 11,228,516 B1 200 ~~ Service Distribution Zone Rack 202 Server Computer(s) 220 Wiemory Processor(s) || Module(s) ‘Application Orchestration Service 222 228 Pan Application Context Manager Module = 2 Mobile Network Integration Module ————— 244 ‘App. Profile(s) 260 ‘App. Context(s) 262 Glient Network information 264 Distributed Application 224 Code Portion(s) 250 208 Service Distribution Zone Rack 204 Server Computer(s) 220 | temory Mobile 210 Processor(s) 274 Module(s) 276 Network Computing Instance 272 Code Portion(s) Client 206 ‘App. Orchestration ‘Service 222 Data Store 22% App. Context Profile(s) 260 Manager Module 242 ||| [Context(s) 262 =| | [ Client Net. Info. Mobile Net. Integ, 264 Module 244 —— FIG. 2B US 11,228,516 B1 Sheet 4 of 11 Jan, 18, 2022 U.S. Patent BZZE euoz uoHNqUISsIG B01N9S JUSIID-ILON POZE aus HOMIEN eGo, ZEE euoz uoRNquisiG 20KMag qUal{Q-U} 2o1s9g qUI0d- PIN FFE Airy uoneoojo5 82eE 8uoz UOANGUIsIG 801M9§ JUIID-JEIN BQZE ois YOMAN e1G0/y GCrE eu0z B2TE ou0z uonnqusig eo1eg uoAnqisiq eles FOTE sque9 BIeG BOTE sequen eyeq U.S. Patent Jan. 18,2022 Sheet 5 of 11 US 11,228,516 B1 Sas Computing Service Physical Host_ | oza 492 soay Host Computing) [Trstance| [_@~——_, |Computna) instance L] | testance’| | Manager Instance | | Manager Yow | a | 4080 4080 4020 y Physical ¥ 2 on ompuang] [Trstance Network Aepation rheston instance service LI Fins Manager a “L_ 40h C ¥ 4080 416 4020 fe : Host 418 J) Management Component computing) [instance | Le +| L] | instance | | Manager 422 }{ Deployment Component “L_s04s ‘ 424 Customer Account Info 408 To Wide Area Network cence (WAN) 412 FIG. 4 U.S. Patent Jan, 18, 2022 Sheet 6 of 11 US 11,228,516 B1 500 ao Receive an application profile for a distributed application at an application orchestration service 504 Monitor a device connected to a mobile network 506 Determine a network location in the mobile network of the de\ Identify, using the network location of the device, a service distribution zone at an edge of a service provider environment that provides a connection to the mobile network 508 Determine whether a network path latency between the device and an ‘one or more computing resources in the service distribution zone satisfies a latency constraint in the application profile for a code portion of the application 512 Latency constraint satisfied? Yes Send the code portion of the distributed application to the one or oa more computing resources in the service distribution zone to execute, for the device, the code portion of the distributed application at the service distribution zone FIG. 5 U.S. Patent Jan. 18, 2022 600 Wionitor application processing for a device by a code portion of a distributed application at one or more computing resources in a 602 Sheet 7 of 11 US 11,228,516 B1 first service distribution zone at an edge of a service provider environment, 604 Monitor the device 606 Determine a network location in 608 distribution zone at an edge of t! that provides a connecti [Determine whether a network path ‘dentify, using the network location of the device, a Second service ‘one or more computing resources in the second service in a mobile network the mobile network of the device he service provider environment ion to the mobile network h latency between the device and 610 ~~ istibution zone satisfies a latency constraint for the code portion of the distributed application 612 Latency constraint satisfied? Yes Migrate application processing for the device by the code portion 614 of the distributed application at the one or more computing resources in the first service dist ‘computing resources in the se ribution zone to the one or more scond service distribution zone FIG. 6 U.S. Patent Jan, 18, 2022 Sheet 8 of 11 US 11,228,516 B1 700 Monitor an application context for a code portion of a distributed application at one or more computing resources in a first service distribution zone at an edge of a service provider environment 702 Determine whether to migrate application processing for a device by the code portion of the distributed application to a second service distribution zone of the servic environment 704 Migrate application processing? Transfer application data associated with the device from the first service distribution zone to the second service distribution zone using the application context 708 FIG. 7 U.S. Patent Jan, 18, 2022 Sheet 9 of 11 US 11,228,516 B1 800 ~N Monitor application processing for a device by a code portion of a distributed application at one or more computing resources at a service distribution zone at an edge of a service provider environment 802 Monitor for a change in a network path latency between a device and the one or more computing resources in the service distribution zone at the edge of the service provider environment 804 Change detected? Send instruction to one or more additional computing resources of the service distribution zone to handle, for the device, additional application processing for the code portion of the distributed application Determine that utilization affects Go the network path latency Control a network manager of the [service distribution zone to reduce the| network traffic Determine that network traffic GB affects the network path latency Control the application processing for the device by code portion of the distributed application at one or more service distribution zones in response to the predicted network traffic pattern (Determine that the change in the Inetwork path latency is related to] a predicted network traffic, pattern 816 FIG. 8 U.S. Patent Jan. 18, 2022 Sheet 10 of 11 US 11,228,516 B1 900 902 ~ 904 ~_ 906 ~ 908 ~ 910 ~4 12~4 144 Receive information describing a plurality of code portions of a distributed application Receive a latency constraint for each of the plurality of code portions of the distributed application Generate an application profile for the distributed application using the latency constraint for each of the plurality of code portions of the distributed application Store the application profile for the distributed application in an application profile registry Receive an instruction to execute the distributed application Retrieve the application profile from the application profile registry Orchestrate when and where to execute the plurality of code portions of the distributed application at service distribution zones at edges of a service provider environment using the application profile FIG. 9 U.S. Patent Jan. 18, 2022 Sheet 11 of 11 US 11,228,516 B1 Computing Device(s) 1010 Memory Device(s) Modules Processor(s) Data ‘Application Orchestration Store Manager Module 1026 1012 102 1024 1020 Networking VO Devices paces 1014 1016) I 1018 FIG. 10 US 11,228,516 BL 1 EDGE COMPUTING MANAGEMENT USING “MULTIPLE LATENCY OPTIONS BACKGROUND Electronic devices and computing systems have become ‘ever present in many aspects of society. Electronic devices (ea, Jol devices or embedded devices) may be included in a variety of physical devices or products, such as industrial ‘equipment, farm machinery, home appliances, manufactur- ing devices, industrial printers, automobile, thermostats smart trafic lights, vehicles, buildings, ete. These physical devices may have embeded electronics, sofware, sensors, and network connectivity that enables these physical devices to collec, process and send dats, Blecronie devices (¢. ToT devices, ete.) may be useful for a number of appl tions, sueh ‘as environmental monitoring, farming, infra- structure management, industrial applications, building and home automation, energy management, medical and health- ‘care systems, transport systems, ct. ‘Advancements in communication technologies have allowed even relatively simple electronic devices to com- ‘nnicate with other devices and computing systems over & ‘computer network, For example. Intemet of Things (0) js the interconnection of computing deviees scattered across the globe, for example, using the existing lntemet infra structure. With the advent of highspeed communication technologies, such deviees may be able to capture data, and then the devices may securely communicate the data quickly lover a network to a centralized computing service in & service provider enviroament BRIEF DESCRIPTION OF THE DRAWINGS FIG.1 illustrates a system and related operations for edge ‘computing management using multiple Tsteney opdons soconding to one example of the present technology. FIGS, 2A and 2B ilsiate various example components inched in a system for edge computing management across ‘nutiple service distribution zones according to ane example ‘of the present technology. FIG. 3 illustrates a system and related operations for ‘orchestrating application processing by portions of a dis= tributed application used by a device connected to 4 mobile rework across multiple networked service distabution ‘zones aeconting fo one example ofthe present technology. FIG. 4 is a block diagram that illustrates an example ‘computing service tht includes an application orchestration Service for edge computing management across multiple service distribution zones according to one exaraple of the present technology. FIG. § is a flow diagram that illustrates an example method for orchesiating, using an application orchesition service, the execution of application processing by a code portion of a distributed application located in a service ‘istribusion zone wsing an application profile according t0 ‘one example ofthe present technology. FIG. 6 is a flow diagram that illustates an example method for migrating, using an application orchestration service, the execution of application processing performed by a code portion of a distdbuted application between service distribution zones of a servie provider environment acconting 10 one example of the present technology. FIG. 7 is @ flow diagram that illustrates an example method for monitoring. using an application orchestration service, the exccution of pplication processing performed by acode portion ofa distributed application aa first service 0 o 2 istrbution zone to transfer application data associated with ‘a devioe wo a second service distribution zone aecoeding 10 ‘one example ofthe present technology. FIG. 8 is a flow diagram that illustrates an example ‘method for monitoring, using an application orelestration service, the execution of application processing performed by a code portion of a distsbuted application at a service distribution zone for changes in a network path latency 10 ensure that a lateney constraint for the code portion of the {istributed application is met according to ane example of the present technology PIG. 9 ie a flow ingram that illustmtes an example method for storage and retrieval of an application profile for ‘distributed application having multiple latency consteints aecording to one example of the present technology. FIG. 10 illustrates one oF more computing deviee(s) on whieh modules or code components ofthis technology may DETAILED DESCRIPTION A technology is described for edge computing manage ‘ment with multiple Intency options or configumtions According to one example of the preset technology, edge ‘computing management may be provided in a service pro- vider environment. The service provider environment may include one or more geographically separate regions at the ‘edge of the network that provide ful olerance and stability in terms of location, physical facilities, servers, notworking. power, and other utes, A region may include one or more Isolated service distribution zones that have the ability to host computing resources and data at one or more of edge network loestions. An edge network location may include ‘one or more data center or co-location facilites that provide physical facilites, racks and serves, network infrastructure, power aud cooling, ete, to make computing resources, such as vital computing instances, viral private clouds, stor- age services, application services, et., available to users of the service provider environment over one of more networks at various independent network latencies. A service distri- bution zone at a network location may inchade any number of racks, servers or network connections that are connected to a vatiety of wired and wireless networks which are independent and isolated Irom other service distribution ones Wo provide redundancy and diverse processing ‘As the service provider environment distributes data centers and iilizes co-location facilities to be physically closer to users, the service provider environment may extend the periphery” of a centralized network to be closer in prowimily to the users (eg, near the network edge) and thereby provide reduced network path latencies between the users and the computing resources within a service dist- bution zone. Positioning comping resources atthe network edge in close proximity to telecommunication providers or intemet service providers (ISPs), such as providers of SG mobile networks, may translate into better service for the users of the service provider environment. For example, @ user may experience smoother, faster, and higher quality video transmission given the proximity of content to the user's location, In another example, applications having Jow-lateney constraints for processing data may benefit rom being exectited closer to the users Ioeation at an edge ofthe service provider environment, using a mid-point service Gistbution zone, a nearcustomer oF near-client service ‘stbution zone, oF an in-customer of in-client service Aistrbution zone. According to the present technology, the US 11,228,516 BL 3 service provider environment may provide dynamic latency- based application orchestration across multiple service dise telbution zones using an application orchestration service. ‘According to one example of the present technology, 3 developer may create a distributed application that Uses ‘computing resources of the service provider environment Execution ofthe distributed application may be orchestrated at various service distribution zones ofthe service provider ‘environment usin the application orchestration service. The developer may specify how different code portions of the disteibured application tolerate of handle latency in commu nications to and from the code portions of the distributed application, For example, the developer may create an ‘application profile specifying a latency constraint for code belonging to diferent portions ofthe distributed application. The application profile may provide a latency constraint for ‘one or more diferent code funetions, routines, modules, paris, processes, executables, etc. of the distributed appli ‘ation. A latency constraint for a code portion of the dis ‘euted application may indicate what lateney to tolerate for ‘connections between devices making requests to the distrib- uted application and computing resources of the service provider envirament providing application processing for the code portion ofthe distributed application. Acconding t0 the present technology, the application orchestration service may utilize the application profile associated with the dis- tributed application to orchestrate which computing respurees in pareular service distribution zones may be able to meet the constraints for application processing by the Separate portions of the distributed application, “The application orchestration service may identity sevice

    You might also like