Scribd Logo
Upload

Welcome to Scribd!

  • Pat 20170076504

    Uploaded by

    Buk
    8 views29 pages
    Interesting patent

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    Interesting patent

    Copyright:

    © All Rights Reserved
    Download as PDF or read online from Scribd
    Flag for inappropriate content
    8 views29 pages

    Pat 20170076504

    Uploaded by

    Buk
    Interesting patent

    Copyright:

    © All Rights Reserved
    Download as PDF or read online from Scribd
    Flag for inappropriate content
    of 29
    US 2017007650441 cu») United States 2) Patent Application Publication co) Pub. No.: US 2017/0076504 A1 OAR et al. oy oy fo) ey @y (86) (60) HANDS-FREE AS TIFICATION, LOCATION AND MANAGEMENT SYSTEM Applicants: TYCO E Inventors: Appl. No. PCT Fils PCT No, “TRONICS, CORPORATION, Berwyn, PA (L TYCO ELECTRONICS UK LID, ‘Swindon Wilshire (GB) Michacl Andrew OAR, San Francisco, CA US); Erle Christopher BRADDOM, Plano, TX (US); Min an Prancisco, CA (U Ramya Poojitha PENDYALA. Sunnyvale, CA (US); David THOMAS, Chester (GB); Owen MARS 15/309,136 May 7, 2018 PCT/US2018/029677 $371 (XI), (2) Date Related US. Nov. 4, 2016 Application Data Provisional application No, 61/989.938, filed on May 7.2014, Network Aset (43) Pub. Date Mar. 16, 2017 Publication Classification Int. cl, Gust 1900 (2006.01) Gore 701 (200501), 6096 S00 (2006.01), Hosw snr (200501), Host. 1226 (200601), (2) US.CL cP Go6T 19/006 (2013.01), HOA 4702 (2013.01); Moat 43/0811 (2013.01); G9G ‘5/006 (2013.01); G02B 27/017 (2013.01): 11048 2001/3866 (2013.01) on ABSTRACT A hands-free asset management system and a method of its ‘operation are diselosed. An example system includes asset tracking database storing an asset location and one or ‘more idenilying charicteristics of each of a plurality of networking assets, and an application executable on a Wear able display device communicatively connected tothe asset ‘eocking database, The application is executable to receive a work order associated with at least one asset among the plurality of networking asses, based on a location of the ‘wearable display device and the work oréer, display one or ‘more dictions to the asset for a wearer of the Wearable splay device, and display one or mare work instrctions to be performed on the asset Tracking Engine 1 ace | 1 Network raclty ‘US 2017/0076504 AL Mar. 16, 2017 Sheet 1 of 18 Patent Application Publication ont 4 quawaseuey, sHOMIaN ‘aseqeieg pue aujug Bupped, Yessy OMAN, Ayes y2s5y OMAN, 290T cot YOMIAN OL Patent Application Publication Mar. 16, 2017 Sheet 2 of 18 US 2017/0076504 Al i | Tracking Engine | and Database | seabird Asset Identifier Database Image Analysis Rack Code: 0001 Equipment: [list] Rack 1. Port 1: Location, Connections, Attributes | Network Configuration | 206 | overlay Generation Figure 2 Patent Application Publication Mar. 16, 2017 Sheet 3 of 18 US 2017/0076504 Al Figure 3 Patent Application Publication Mar. 16, 2017 Sheet 4 of 18 US 2017/0076504 AI 304 — Figure 4 Patent Application Publication Mar. 16, 2017 Sheet 5 of 18 US 2017/0076504 AI Figure 5 US 2017/0076504 AI Mar. 16, 2017 Sheet 6 of 18 Patent Application Publication 9 asn3i4 US 2017/0076504 AI Mar. 16, 2017 Sheet 7 of 18 Patent Application Publication Z aun3i4 US 2017/0076504 AI Mar. 16, 2017 Sheet 8 of 18 Patent Application Publication g aun3i4 Patent Application Publication Mar. 16, 2017 Sheet 9 of 18 US 2017/0076504 Al ¥ Capture Image Data | Transmit Image Data to Remote Asset Management | Receive Overlay Data I Display Image with Overlay 4 Receive Technician Feedback | Transmit Technician | 912 Feedback to Remote Asset Management p— 902 p— 904 y— 906 p— 908 y— 910 900 Figure 9 Patent Application Publication Mar. 16, 2017 Sheet 10 of 18 US 2017/0076504 AI | y— 1002 Receive Image Data y y— 1004 Identify Asset By Identifiers 7 Locate Portion of Asset of Interest y— 1006 y Determine Action to be Taken y— 1008 7 Generate Overlay Information y— 1010 y Provide Overlay Information Y Receive Action Confirmation y— 1012 y— 1014 1000 Figure 10 Patent Application Publication Mar. 16,2017 Sheet 11 of 18 US 2017/0076504 AL 1 ' I t t i t 1 1 t L 1 ' I i ' t t noo 1120 Field of View 1150 we Figure 11 102 fo —A } Patent Application Publication Mar. 16,2017 Sheet 12 of 18 US 2017/0076504 AL Nw Figure 12 12044 Patent Application Publication Mar. 16, 2017 Sheet 13 of 18 US 2017/0076504 AI po 1302 Figure 13 as < 1122 — ‘US 2017/0076504 AL Mar. 16, 2017 Sheet 14 of 18 Patent Application Publication oor ~. VT asnsi4 malf J0 pial mow 19303 "491 sMoy 7 ONO Ppp, ing y ‘US 2017/0076504 AL Mar. 16, 2017 Sheet 15 of 18 Patent Application Publication avT aungi4 ‘MAIA $0 Pal US 2017/0076504 AI Mar. 16, 2017 Sheet 16 of 18 Patent Application Publication ST an3l4 49129 €OIL Vy fi US 2017/0076504 AI Mar. 16, 2017 Sheet 17 of 18 Patent Application Publication ToT Ma1A J0 Plats OT auns3i4 Patent Application Publication Mar. 16, 2017 Sheet 18 of 18 US 2017/0076504 AI — 1702 Receive Work Order y Determine Location of |] 1704 Asset Subject to Work Order ¥ Determine Location of ||/— 1706 Wearable Display = /— 1708 Display Directions on HUD ¥ Display Work Instructions |/— 2720 based on Work Order y p—1712 Capture Work Image/Video y 1714 Update Database rr 1700 Figure 17 US 2017/0076504 AI HANDS-FREE ASSET IDENTIFICATION, LOCATION AND MANAGEMENT SYSTEM. CROSS-REFERENCE TO RELATED APPLICATIONS) 10001) This application is being fled on May 7, 2015, as PCT International Patent application and claims priority (0 US. Patent Applicaton Ser. No, 61/989.938 filed on Ma 7, 2014, the disclosure of which is incorporated herein by reference in its entirely. ‘TECHNOLOGICAL FIELD 10002] The present disclosure relates generally to asystem {or determining locations of network assets, such as network ‘connections. In particular, the present disclosure relates 0 3 hands-froe asset identification, location, and management system. BACKGROUND 10003} Large-scale networks and facilities typically Include assets of a variety of types which are placed at @ variety of locations. For example, network that is main- tained by a telecommunications provider o¢ feelity may include networking equipment, such as patch panos, oul- fers, or other networking equipment, in a single rack, in diflerent micks, and. across different rooms, buildings. oF ‘other locations. Bach of these network assets may in tara flso include other assets, such as available or occupied network jacks or other network connections usable to route slgnals among network devices, 0004} "Often, a technician is required to service network assets, for example by configuring network connections ata field location. Olen, hat servicing requires the technician to disconnect and reconnect networking cable, or to otherwise locate, identily and service specific network jack locations fof other network assets. When a technician modifies 9 ‘configuration of equipment (eg. patch panels) in data ‘enters oF spliter nodes in outside envirouments, itis Jmportant to ensure that the technician has located the correct piece of equipment. If the technician identities the ‘wrong asset for configuration, or does aot know how 10 modify the asset as needed, costly mistakes ean happen 10005] Currently, technicians are required to rely on abel- Ing of network assets, and must conelate those networking Jocations to change networking configurations, or to olher- je service network assets, When relying on such labeling, jt not uncommon forthe technician to incomctly contig= tre network acts, for example by inserting a plug into the Incorrect jack ofa patch panel, thereby providing erroneous routing, and resulting in such costly mistakes, 0006] In other types of foclities oF circumstances where Jocations of components of a system are generally constant butofa high number, similar challenges apply: For example, ‘when servicing a vehielo oF ather types of electronic oF 1 equipment having a large number of posible that are required fo be accessed and adjusted, it ‘ean be dificult to determine which components are inter ‘connected, and what electrical components (eg, fises breakers, ee.) are associated with different elevtical and/or mechanical subsystems. 10007] Sill further dificulties exist in assessing and loat- ing assets, in particular because in many eases maps oF networking diagrams are required, which involve eross- Mar. 16, 2017, referencing paper or electronic diagrams to real-world asset locations. This typically compl location and main- tenance process, both because of the cross-referencing reired and the fact that technician's hands are typically ‘ceupied with maintenance services. Sill further, identifi cation and location of such asses, particularly those kept indoors at networking facilities, ean be dilfcult absent sue physical or clectronic diagrams, since typically a lange ‘number of networking or computing assets are housed in & common location (and are dificult to distinguish from one another) [0008] Accordingly, improvements in tracking of assets, including racks, panels, and even networking connections fare desirable. SUMMARY [0009] In accordance with the following disclosure, the hove and other issues are addressed by the following: [0010] In a first aspect, a hands-free asset management system is disclosed. An example system includes an asset ‘tucking database storing an astet location and one or more ‘dentifying characteristics of each ofa plurality of network- ing assets, and an application executable on a wearable display device commnnieatively connected to the asset ‘rocking database. The application is executable to receive a work order associated with at least one asset among the plurality of networking assets, based on @ location of the ‘wearable display device and the work order, display one or ‘more directions to the asset for a wearer of the wearable isplay device, snd display one or more work instructions t0 be performed! on the asset [011] Ina second aspect, a method of tacking netw ng assets includes receiving at an application executing on a wearable display device, a work onder associated with at Jeast one asset among a plurality of networking asets stored in an asset tracking database, each of plurality of records associated with the plraity of networking assets including ‘an asset location and one or more idetilving characteristics ‘of that asset, The method also includes, based ona location fof the wearable display device and the Work order, display fing one oF more directions to the asset for a wearer of the ‘wearable display device. The method further includes dis playing one or more work instructions to be performed on the ast based on the work order [0012] In a third aspect, an application installable on a ‘wearable display devie for execttion to manage networking asses, the application including a plurality of executable fnstnctions sored in 8 memory of the wearable display device. When executed, the instructions cause the wearable display device to perform a method including receiving « Work order associated with at least one asset among a plurality of networking assets stored in an asset tracking Gatabase, each of a plurality of records associated with the plurality of networking assets inckading an asset location ‘and one or more identifying characteristics of that asset based on a location ofthe wearable display device and the work order displaying one or more directions to the aset for ‘wearer ofthe weartble display device, and displaying one ‘ormiore work instructions tobe performed on the asset based fon the work order, [0013] In a. farther aspect, an asset location system includes mobile application componeat executable on ‘mobile device including # camer and a display, the mobile application component configured to receive image data US 2017/0076504 AI from the eamera and display an image on the display based ‘onthe image dats and overlay information identifying one oF more assets identifiable in the image data. The asset locaton system also includes an asset management tracking engine configured 10 receive the image data and generate the ‘overlay information including an identification ofa oeation ‘frat [east one of the one ae more assets within the image, 10014) Ina further aspect, a network asset location system includes 2 mobile application componeat executable on & mobile device including a camera anda display. The mobile pplication component is configured to receive image data fiom the camera aad display an image on the display ‘identifying one or more network assets identifiable in the mage data, The network asset location system includes @ plurality of identifiers associated with the one or more network assets each positioned at a known location relative ‘each ofthe plurality of identifiers. The network asset loca tion system also inchudes an asset management tacking ‘engine configured to receive the image data and generate the ‘overlay information including an identification ofa loeation ‘of at least one of the one or more network assets within the image, [0015] In a further aspect, a method of determining an asset location using an application executing on a mobile device having a camera and a display is disclosed. The method includes capturing image data of @ network asset using the camera of the mobile device, the image data including information regarding a plurality of identifiers associated with the network asset and positioned ata pre- termined location relative w the network asset. The method also includes displaying an image including overlay ‘information identifying the network asset and a location of the network asset within the image 10016] In a further aspect, a method of determining an asset location using a network asset management engine is «disclosed, The method includes receiving image data includ. Jing image data relating to a network asset, the image data ‘ako including information regarding a plurality of identities ‘associated withthe network asset and positioned at a pre dermined location relative w the network asset. The ‘tho also includes determining an identity ofthe network asset basod a least in parton recognition of the plurality of ‘enters and a relative position of the network asset relative tothe plurality of identifiers inthe image daa. The method further includes generating overlay information ‘identifying a location and an identity ofthe network asset in the image data BRIEF DESCRIPTION OF THE DRAWINGS [0017] FIG. 1 itustrtes an example network asset loca- tion system used in conjunction with a distributed network ing system in which aspects of the network astet location system ofthe present disclosure can be implemented: 10018] FIG. 2illusates an example logical block disgram ‘ofa network asset tracking engine usable within a network asset location system, according to a possible embodiment ‘of the present disclosure; [0019] FIG. 3 is a schematic diggram illustrating an ‘example arrangement for tracking network assets, according to a possible embodiment of the present disclosure: [0020] FIG. 4 is a schematic diagram illustrating an ‘example display on a mobile device illustrating the tracked network asset, cording ta 8 possible embodiment of the present disclosure: Mar. 16, 2017, 021] FIG. $ is a schematic diagram illustrating, an ‘example display om a mobile device illustrating the tracked network asset and an overlay provided based on identifica tion of the trucked network asset, acconling to & possible embodiment ofthe present disclosure: [0022] FIG. 6 is a schematic diagram illustrating an ‘example display on a mobile deviee illustrating the tracked fetwork asset and an overly that provides asst idenifea- tion information displayable to a user, secoeding t0 8 pos: sible embodiment ofthe present disclosure [0023]. FIG. 7 is a schematic diagram illustrating an information displayable to a user, according to a possible embodiment of the present disclosure [024] FIG. & is a schematic diagram illuseating an ‘example arrangement for tracking network asses, according to a second possible embodiment ofthe present dislosure: [02S] FIG. 9s a Howehart of methods and systems for ‘tacking network asses using a mobile device, according 10 1 possible embodiment of the present disclosure: [0026] FIG. 10 is flowchart of methods and systems for teucking network assets using a mobile device andor a ‘network assert tricking engine and database remote from the mobile deviee, according 10 a further possible embodiment of the present disclosure: [027]. FIG, 11 is a schematic diagram illustrating an ‘example arrangement for hands-free management of net- work assets using a Wearable display device, according (0 a possible embodiment of the present disclosure; [028]. FIG. 12 is a schematic diagram illustrating an example Joeating process for a wearable display device within a facility, acconting to aspects of the present diselo- [0029], FIG. 13 is a schematic diggram illustrating an example locating process for a wearable display device outside of a faiiy, aecording © aspects of the present disclosure: [0030] FIG. 14. illustrates an example direction service provided by an application executing on a Wearable display device, according to an example embodiment of the present disclosure: [0031] FIG, 148 illustrates an example video chat pro- Vided by an application exccuting on a wearable display evice, according to an example embodiment of the resent disclosure: [0032] FIG. 18 is a schematic diggram illustrating an example asset identification process using a wearable dis play device, according to aspects ofthe present disclosure; [0033] FIG. 16 illustrates an example work instruction included in s work onder recived at a wearable display device acconding to example aspects of the present diselo- sure and (0034) FIG. 17 is a fowchar of an example method of tracking networking assets in a hands-free manner using a wearable display device, according to an example embod iment ofthe present disclosure DETAILED DESCRIPTION [0035] Various embodiments of the present invention will bbe describod in detail with reference 10 the drawings, ‘wherein like reference numerals represent like parts and assemblies throughout the several views. Reference to vari fs embodiments does not limit the scope of the inveation hs limited only by the seope of the elsims atached US 2017/0076504 AI hereto. Additionally, any examples set forth in this specifi ‘cation are not intended to be limiting: and merely set forth some of the many possible embodiments forthe claimed 10036] In genera, the present disclosure relates 10a nel- work asset identification, location, and management system that can be used to identify assets 0 a technician user, and provide direction as to their interconnection, locaton, and ‘maintenance. In certain embodiments, the present disclosure ‘describes an application operating on a mobile device hav~ ing a camera and a display, and can espture image infor mation (eg. video information), and overlay an identifica tion ofa particular asset of interest on that video data when slisplayed on the display. For example, if the asset of interest js a network asset, the overlay information could be used t0 Mdentfy to the technician a comect network asset (C2 @ network jack or ether connectivity element, panel, or portion ‘ofa pane, network switch, subrack, network blade oe rick) to be serviced. In other embodiments, any of a variety of ‘different electical or mechanical systems could be ident fied. In some embodiments, that user can see this overlay ‘information using a realtime, overlay-agmented displ. 10037] In various embodiments discussed herein, the mobile deviee used to present overlay information cam be & mobile computing device or a wearable display deviee. ‘Acconingly, the cverlay'can correspond to ether addition of supplemental information to a display of previously cap- ‘ured information (@.., a8 Would be presented on a display ‘ofa tablet or smartphone) of could altematively correspond to projection of supplemental information onto a semitrans- parent display, such that the projected supplemental infor ‘mation is Viewed ia conjunction with background scenes (ex, via a “heads up display” or other type of display. 10038] | Refering now to FIG. 1, an example network asset location system 100 used in conjunction with a distributed networking system is shown, in whieh aspects of the nel- work asset location system ofthe present disclosure can be Jmplemented. The network asset location system 100 can include, in the embodiment shown @ mobile device 102 oa ‘which a mobile application component resides, and which, ‘can execute the mobile application component. The mobile device 102 can be, in various embodiments, any’ mobile device incloding a camera 103 aad a display 104, such as 3 smartphone or tablet computing system. The mobile appli ‘cation component includes program instructions executable ‘on the mobile device 102, and is configured to receive image ‘data from the camera 103 and display an image on the display 104 ofthe captured image. 10039] In the embodiment shown, the mobile device 102 ean be used at a network asset facility 108, which is tzenerlly a location where networking equipment is stored. Inthe embodiment shown, the network aset facility 10S can bea data center or other outside plant application, and ean include a plurality of pieces of newsorking equipment 106, whieh can, in various applications, include patch panels, data center racks, servers, or oer networking equipment. In, the context ofthe present disclosure, any piece of network- ‘ing equipment or access point provided by such equipment (eg, telecommunications jacks made available on such patch panels or routers, fiber optic connections, oF other physical network access connections) are considered “net- ‘work assets” which ean he configured and provide network data aecess fo subscriber endpoints in data network, Mar. 16, 2017, [040] In the embodiment shown, plurality. of patch pancls 106a-c are shown, cach of which has a plurality of {elecommunications jaeks. In aecordance with the present disclosure, euch of the patch panels 106a-c, or each tele- communications jack, or both, could eorespond to a net- work asset. The pate panels are, i the embodiment shown, included within an overall network 107, which is the net work administered and maintained by the technician using the network asset location system 100 ofthe present diselo- [0041] In certain embodiments, and as discussed in further ‘etal below in connection with FIGS. 3-8, groups of assets (ex, pateh panels within a particular rack or other device) fan be associated with a plurality of identifiers, such that locations of assets that may be difficult to correctly identify (eg, telecommunications jacks) can be located by trangu- Jation o¢ other relative location calculation procedures, In panicular embodiments, the various network assots can include, for example, managed patch panel, such a8 are dsribed in US. Provisional. Patent” Application No. 61/706,460, filed on Sep. 27, 2012, and entitled “Mobile Application for Assisting © Technician in Carrying Out an Electronic Work Order", and U.S. patent application Ser No. 13/775,798, filed on Feb. 25, 2013 and entitled “Over- Jay-Based! Asset Location and Identitication System, the disclosures of both of which are hereby incorporated by reference in theie entireties, [042] The nctwork asset location system 100 also includes, in the embodiment shown, an asset management tracking engine 108. The asset management tricking engine can, in certain embodiments, reside within a memory ofthe ‘mobile device 102; in alternative embodiments, the asset ‘management tracking engine 108 can reside at a remote location from the mobile device 102, such as on a server 110 ata network management facility 12. Insoch embodiments, the mobile device 102 can be configured with a data com nection to the server 110, for example via a network 114 (which can include the Intemct a well a any of a number of different types of wireless data networks, such as GSA, SMS, GPRS, EDGE, CDMA, WiFi, WiMax, LTE net \works), In some embodiments, data and/or analysis compe rents of the asset management tracking engine 108 (as illustrated in the example shown in FIG. 2) an be stored at fone or both locations (Le. either at a Server 110 or on 2 ‘mobile deviee 102), [0043] FIG. 2 lostrates an example logical block diagram of @ network asset tacking engine 108 usable within a fetwork asset location system, according to a possible embodiment of the present disclosure. The engine 108 ‘generally analyzes image data received fom camera, and zenerstes display information that can identify network ‘asses, identi a location of aetwork asets within an image, and generate an overly indicating sueh information 10 3 ‘ser by displaying combined image data and overlay infor ‘mation on the display ofthe mobile device 102 [0044] In the embodiment shown, dhe network asset traek- ing engine 108 includes an asset identifier database 202, as ‘ell as an image analysis module 204, 9 network configu- ration module 206, an overlay generation module 208, and ‘optionally an aetion log 240 and a work order listing 212. [0045] ‘Theasst identifier database 202 stores information regarding cach network asset to he tracked by the network asset location system 100, In the embodiment shown, ‘example records are illustrated in the asset identifier date US 2017/0076504 AI base; specifically, each asset can have associated with it a particular location and properties. The location can be & Jocation relative to an identifier near that asset, as ilustrated in further detail below in connection With FIOS. 3-6, The Jocation eanalso include information sbout a particular asset location at which the asset can be found. The properties ‘associated with the asset ean include, for example: an asset identifier, an asset description (e.g. tlecommunications Jack), associated asses (ea patch panel or rack in which the jek is found), and eurreat connections through that asset (eg. whether 3 particular jack has a plug inserted into that Jack), Although the pareular properties may’ vary By asset fr fype af asset (eg a jack, a panel, a rack, a toate, ete.) enerlly the records inthe database provide a definition of the asset and how to identify it in an image of an overall zroupof one or more assets that may be captured in an image taken by a camera of a mobile device 10046] In certain embodiments, as discussed in further detail below, identification ofthe asset can comrespond to mage recognition process relating w both the asset and (0 8 Tocation identifier associated with group of one oF more assets that uniquely deine those assets. Examples of such an ‘Mentifier are diseusse in further del below ia connection swith FIGS. 348 [0047] The image analysis module 204 analyzes image ‘ata received from a camera ofthe mobile device 102, and socesses information in the asset identifier database 202 to ‘defect identifies in the image data and determine a corre sponding asset identification, The image analysis module 204 can also identify particular related assets that are rexired to be serviced if the asset identifiers are not uniquely associated with the asset to be servieed. For ‘example, asset identifiers may be placed on a particular networking equipment reek, bit specific telecommunica- tions jack of a particular panel within that mack may require service. Accordingly, this related asset tothe asset directly ‘Mentified by the asset identifiers ean be detected by com parison to the asset identifiers, and based on a known Felative location of that asset to the asset klemtifiers ax ‘included in the asset identifier database 202, For example, if three or more identifier are viewable within the image, the image analysis module eould apply one oF more triangula- tion algorithms to determine the location of a particular network asst. In another embodiment, one or more features ‘within an identifier (e., if the identifier includes one oF more images) can be used to determine relative distance, ‘ricntation, and location, using the image analysis module ‘Other location-based algorithms are possible as well, for ‘example using WiFi angulation or GPS echaigues as discussed below, [0048] _ The network configuration modale 206 can option- ally be included in the neswork asset tracking engine 108, ‘nd inthe embodiment shown determines actions required to be performed by'a technician, The overlay generation mod- tle 208 generates overlay information to be displayed with the image data on a display of the mobile deviee, and can include, for example: information identifying 2 particular ‘asset, information identifying related assets; information ‘identifying « paricular setion to be taken by a technician (ea. a8 determined by the network configuration module 206), and other guidance as nesded for the technician to Service the equipment at the network asset feility (eg. ‘instructions for configuring the asst), Such information can include, for example, specific steps t be taken to configure Mar. 16, 2017, particular asset being identified. For example, information fan be generated for delivery to # mobile device 102 instruct @ technician to connect of disconnect a particular plug or wire from a specific socket or connection, oF step-by-step instmetions for programming a programmable panel, replacing a blown Tuse or resetting a tipped circuit breaker, or other options. Embodiments ofthe present dis- closure can, based on generation of such information for lisplay, present toa user very complex steps or installations that would otherwise involve consultation of reference mate- rials. For example, in such embodiments, a multi-step instal lation process may’ be guided by insinictions andar Video demonstrations of proper technique of routing information that may be involved with an installation. [0049] Adkitionally, the overlay infomation can includ. {or example, addtional details eyarding operation of the particular eset In the ease of a network asset such asa ack ‘System or switch, information such a & tlle load, power consumption, intemal temperature, or memory usage could be provided in the overlay information, as well asa display fof memory usage, available services ‘at the device (or a particular por of the device). Adltionaly, a number of ports fr jacks actively in use, oF system utilization, could be splayed. A generalized example of such overlay informa tion is illustrated in FIG. 8 [0050] The action Jog 210 stores received actions as entered by the technician, based, for example, onthe tech- fician following the guidance provided by the overlay information displayed with the image on the mobile device. For example, the action log can store a technician-entered report indicating movement of a telecommunicatons plug {rom a first identified jack to a second idetified jack, based ‘on guidance provided in the overlay. Alleraively, the faction log 210 can store information based on other fesd- back mechanisms, for example based on a confirmation via the nctwork itself that a connectivity change has been made (ea, by transmiting a polting query to the newy-connected port, determining that additional or different endpoints can be reached based on a changed network configuration, or cer mechs). [0081] ‘The work order listing 212 stores open work orders associated with maintenance, repairs oF reconfigurations required of a technician, and includes ‘identifications of particular asserts and operations to be performed on those asses. In example embodiments, the work order listing 212 ‘an iclnde information associated with changes to patiew- Jar configurations, as well ax steps to accomplish such changes in configuration, Such steps ean be, as discussed below, presented to a user on a step-by-step basis, [0052] Referring now to FIGS. 3-8, example schematic illustrations of operation of the network asset location system 100 s shown, from the perspective ofa technician at particular nework asset location (22, location 108 of FIG. », [0053] FIG, 3 is a schematic diagram illustrating an ‘example arrangement for tracking network assets, according {0 a possible embodiment of the present disclosure, while FIG. 4 illustrates an example display 400 of those network assets eaptured as shown in FIG. 3, well sa depiction of triangulation to determine locations and identities of related asses. FIG. $ illustrates the example display 400 including ‘addtional overlay information as determined using the assct panagement tricking engine 108, US 2017/0076504 AI 10054] Refering now to FIGS, 3-4, in the embodiment show the technician ectivates « mobile application on & mobile device 102 to capture imoge data regarding 2 par- ticular network aise. In this example, the teciician is ‘capturing video image data of a telecommunieations rack 300 including «plurality of patch panels 302 and associated telecommunications jacks 304; however, in other embol- ‘nts, other types of telecommunications equipment can be viewed 10085] _As briefly discussed above, a set of identifies 306 ‘are affixed to the telecommunications equipment, and ‘uniquely identify the telecommunications equipment. In the ‘embodiment shown, the set of identifiers are placed at predetermined Ineations on the telecommunications mck; however, in altemative embodiments, separate identifiers ‘could be used for each of the patch panels 302 or other network assets 10056] In various embodiments, the set of identifiers can uniquely identily the telecomminications equipment that they are attached to or otherwise associated with in a number ‘of ways. For example, the identifiers 306 can be light ‘emitting diodes associated with a switching controller such that they are configured to emit ight representing abit code that corresponds to an ID ofthe rack 300, [0087] In alternative embodiments, the identifiers 306 can be bar codes, QR codes, or images that are unique and ‘associated with particular (elecommunications equipment Inother embodiments, NEF, RFID, or other fiducial mark= ings of known size and/or configuration could he used. For ‘example, a particular image may have a known scale and ‘orientation relative to an asset; as such, the recognized size and orientation of the image can be sealed and relative Position determined to derive the relative location of an asset ‘to that image. In stil other embodiments, one or more liquid ‘enystl displays could be used as an identifier, eomesponding targeting arrangements eouk! be wed in that circumstance as wel 10058] It is noted that, in an application associated with telecommunications equipment in data centers, it may be possible tht low-light conditions make such image-based ‘nification more dificult. In such applications, it may be ‘advisable ta use the hove-doseribed flashing LED configu ration, or an LCD display with adjustable brightness levels. Altematively, a constant LED flash light inchuded with 2 ‘camera of a mobile device could be used to illuminate image-based identifiers. [0089] As illustrated in particular in FIG. 4 itis noted that although the identifiers may be associated with one particu larpicce of equipment (eck 300) it may bethe case that ‘technician may need to identify and service @ particule telecommunications jack or other subcomponent of that ‘equipment In such cases, a network asset tracking engine 108 stores information regarding relative locations of the subcomponent to the idemifirs allowing the network asset trucking engine 108, and in particular the image analysis module 204, to tiangulate 1 the subeomponent, thereby ‘dentifying the subcomponent that is thease. 10060] Tn the embodiment shown, the display 400 of the telecommunications rack inclades a plurality of navigation buttons 402a-d, and additionally includes various toueh- sereen functionality usable 1 both view and provide infor- ‘mation about the asset being reviewed. For example, in the ‘embodiment shown, the navigation buttons 4024 include 1 device type button 4024, an alarms button 4026, a web Mar. 16, 2017, ‘used in conjunction with a usee selecting a particulae piece of identified equipment as discussed herein (e22. 4 rack, panel, of a panieular connection on a panel) to identify Specific information regarding that equipment. For example, the device type bution 4020 allows the user to obtain ‘additional details about selected asset, sch a its assct label, the type of equipment, associated assets (eg @ retwork in which the asset is Connected, or routing infor- ‘mation associated withthe asset), capacity, usage, or other information, The alanns button 4028 can be used to either splay alarms associated with the particular asset that is selected, of to view all alarms wihin a network. The web interface huton 402c canbe used to allow the user to log in {o.a web interface that provides a control panel for the selected asset, particularly in the ease of a panel or rack, to allow the wer to view operational parameters (¢.. W Toad, temperature, logs, ee.) ofthe asset [0061] Additionally, the work onders button 402d can be selected to display pending work orders, for example work ‘orders assoctated With one oF more asets recognized in the image captured by the mobile device 102, or generally within a network configured to be tracked by the mobile device, Each electtonic work specifies one or more steps that are to be carried out by a technician a a particular location. For example, an electronic work onder ean indicate that one ‘or more connections implemented on a patch panel (ez. panels 106a-c above). A menu displayed following selection ff the work orders button 402d can also allow the user t0 frwate a Work oper associated with one OF mone assets oF interest and identified on the display 400, In such embodi- the user can, for example, select first and second ports by capturing images ofthe equipment including those ports and lapping on the ports to receive ua iMentlcation {hereof fom server 110, The wser ean then define one or more actions to take with respect to the equipment (@ connecting «cable between specified ports of specifisd panels, or other actions), which is confirmed at the server 110, which can be configured to verify thatthe specified connection has been added, removed, adior changed cor rectly based on communication wih the associated asset. An ‘example work order definition process i illustrated in US. patent application Ser. No 13/683,866, entitled “Ineligent Infratrdcture Management User Devies", filed on Nov. 21, 2012, the disclosure of which is hereby incorporated by relerenee in its enti. 0062] | Now referring to FIGS. §-7, various example user Inerlaces ate shown, presented on display 400, for present- ing aset and associated overlay information associated with ‘ work order or deve identification. As ilustrated in FIG. 5, based on the image captured and analyzed, a display 400 fof @ mobile device 102 can inchide not only the image illustrated in FIG, 4, but also overlay iaformation S00 {dentifying one or more assets visible in the image, 38 well fas information about those asses, such as service to be provided. In the embodiment shown, the overlay informa ‘ion S00 identifies a tlecommunications jack to which a plug is connected, as well asa socond telscommunications jack that is intended to receive that plug, Because the ‘dentfiers 306 are associated with the rack in which the jacks are found, each individual jek is found by triangula- tion to those locations, as discussed above. In the embodi- at shown, the overlay information $00 includes informa US 2017/0076504 AI tion about the asset associated with the identities 306 (i. the rack 300, as shown by “Rack 1D: 0001"), and also Includes identifying « location and a label for one or more sub-assets (ete lelecommunications jacks 304 labeled “Port ID 24° and “Port 1D 36” shown in FIG. 5), These can ‘include, for example, CPID codes for each asset or sub-asset that is tracked In some embodiments, the overlay informa tion 500 includes instrctions for providing service to the network assets, such as by disconnecting and reconnecting network assets, Other types of service or operational infor mation could be desenbed in the overlay information as well, sueh as insertion counts, cable length, cable category (eg, Category 5, Category 6, et.) and other types infor mation such as those listed above, [0063] Preferably, the display of both image data and ‘overlay data is provided in realtime or near realtime with ‘capture of the video image data. This will allow the tech- nician to move the mobile device, allow the locations of network assets to he rocomputed, and the display and ‘overlay information updated a the mobile device changes Position. In altemative embodiments, the overlay informa tion and image data canbe tl image data and static overlay information, Other arrangements are possible as well 10063] Refering to FIG. 6, in this example, the display 4400 presents to the user an interface including overlay information 600 that includes labels for the various types of ‘Mentfied equipment included in the illustration, In this ‘example, an overlay label 602 can be ineluded, ether upon, Selection ofthe device type button 4022, or in response 10 tapping on the display in a location where the device is «displayed, to show the identity of the deviee, including a device type, software version (if applicable, soch as in the ‘ease of a managed panel), manufacturer, manufacture dat, and any’ associated alarms. In addition, in some embodi= ‘mens, olher information associated withthe device can be slisplayed. For example, in FIG. 7, overlay information 700 ‘ean include a detailed information area 702 that displays routing and type information associated with the asset being ‘Mentified. Por example, the detailed information area 702 ‘can display information about routing from a panel, soch as ‘an identifier of another panel to which the current panel is ‘connected, which may not be depicted on the display 400. Additionally, various miseonfigured or eror-siate systems ‘ean be highlighted by accessing error reports stored atthe server 110 when generating the overiay information 702, 10065] In some example embodiments, the additional ‘information associated with the asset in the detailed infor- mation area 702 ean include a textual or graphical desrip- tion of a full routing arangement including the particular asset (@., a connection or panel), from a host to a switeh, from a switch to 8 switch oF router, oF some other type of ‘communicative connection. Such additional information ca {include display of eurent connection of assets or particulae predicted connections hased on a planned result of 3 work ‘onder. In some embodiments, the additional information ean be presented in the form ofa text overlay, or alieraatively @ routing diagram allowing the user to visualize the inteeon- roetions that are toe made, 0066] In accordance withthe display 400 shown in FIGS. 4-7, iL noted that a variety of other types of information ‘ould be presented to a user who laps on an aset or one of the buttons 402ad shown on the display 400, For example, fuiser can tap on a particular asset that isa device to display Warranty information associated with the device, of to get Mar. 16, 2017, {Uurther information about the panel or blade, or port of sueh a device, by tapping on the device itself. Additionally, for technicians who wish to full Work orders, supplemeatal information can be presented to the user af well, such as ‘nstrctional videos or diagrams that ilustrate hap/to accom plish Various routing endor msintenance tasks [0067] Its also noted that, although in the embodiments eseribed herein specific types of information are depicted, ‘user of a mobile device 102 in accordance with the present tisclosure can also provide feedback for storage in database 108, for example work onder or asset identitcaton infor- sation, For example, a user of # mobile device 102 can, in some embodiments, ap on the display to define intereon- rections between equipment that should be made, thercby creating one or more Work orders for other Techaicians 40 ‘execute. Additionally, options can exist fora user to select and reset one or more setings of « particular device via remote control throwgh server 110 atthe networks manoge- ‘meat facility. 0068} Referring now t FIG. 8, an alternative embocl- ‘meat of an atrangement 800 for tracking network asets is shown. The arrangement 800 could be used in place of farangement 300, but includes different types and arrange- ‘ments of identifiers used in eonnection with specific network ‘asses, In particular, inthe embodiment shown, each patch ppancl 302 hasan associated set of identifier 802 placed on ‘Opposing sides of an array of coonectors 404, which ean reduce complexity in triangulating to calculate the position of a particular asset (e.,a jack) when generating overlay information $00. In various embodiments, different images £802 can be used on exch panel 302 (or different images can be used on opposite sides ofthe same panel), to assist in ‘uniquely identifying a nerwork asset. Te is understood that analogous overlay information to that illustrated in FIG. 8 ‘oud he generated for association withthe arrangement 800 fof FIG. 8. sing the images 802 within the serangement 80 to determine relative postions of asses [0060] In sill further embodiments, one or more adali- ‘ional images could be placed on the pane! 302 or other asses, suc that each tracked asset has an associated unique jimage. For example, a separate, unique image could be Jocated on each panel associated with each connector 304, or in combination With an LED or bar code arrangement, 10 identify an asst, such that reduced triangulation calcula- ‘ions would be required (Le, each image could be placed in 1 predetermined or known location relative t the asset) [0070] Referring now co FIGS, 9-10, methods of tacking fand identifying network assets are described, using the structures and inormation described above in connection With FIGS. 1-8. FIG, 96a Mlowehart of a method 900, as may be performed or implemented wsing software systems fof a mobile device, for tricking network assets using. a ‘mobile device, according to a possible embodiment of the present disclosure, The methods and systems illustrated ia FIG. 9 can be perfomned using any of numberof embodi- ‘meats ofa network asset location system as dseussed above. ‘in connection with FIGS. 1-8 [0071] In the embodiment shown, the method 900 begins with capture of image information (e.g, still ot video information) using a camera of a mobile device, such as mobile device 102 (step 902). The captured image data is then transfered to a network asset tricking engine 108, cither at the mobile device such as device 102, or a server 110 ata remote location 112 (step 904). The mobile device US 2017/0076504 AI then receives overlay information, either generated locally ‘on the mobile deviee or remotely atthe server 110, but in ‘ther event generated within the network asset tacking ‘engine 108 (step 906). A display operation generates 8 sisplay of the image including a network asset and overlay information highlighting the location and identity of the network asset, as well as optionally other infomation, sich a identities and locations of other network asses, or actions to be taken by a technician servie the network asset, sich as is shown in FIG. 5 (step 908), {0072} In censin embodiments, the method 900 can ‘nce receiving feedback from the technician, for example to log services or configurations performed by the technic ‘ian In such embodiments, technician may’ iat into the mobile device information regarding the specitic servi provided to the network aset (step 910) In embodiments Which a remote server is used 10 tack such technician ‘activity, the received input from the technvian regarding services performed ean be communicated tothe server to be Ioggcd (ep 912). 10073] FIG. 10 isa flowchart method 1000 for tracking network asses using a mobile device andor network asset tracking engine and database remote fom the mobile device, according toa further posible embodiment of the present disclosure, The methods in FIG. 10 may be performed or implemented using software systems of server, a mobile device, or both systems 10074] Inthe embodiment shown, the network asset track- ing engine 108 receives image iniormation captured by @ mobile device (step 1002}. This can occur, for example Within the mobile device, or based on transmission of that ‘mage data from a mobile devive 1o a server on which the network asset tracking engine resides. The image analysis module 204 of the network asset tracking engine 108 (as shown in FIG. 2) ean analyze the received image data, and ‘enti one or more network assets identifiable within the image data, for example by decoding information comma- nicated by way of the asset identifiers associated with Particular asset (step 1004), This ean include, for example, Aecoding a bar eae or QR ene, or deteting a eode ‘communicated by a steobed LED, 2s well as ocognizing 3 Particular image or images placed in association with the Sst. Other configurations are posible as well 10075] A network asset can then be located within the ‘image data, for example based on tangulation from the ‘demifiers that ore identifi, and based on information regarding relative postions of the asset and identifiers as maintained in database 202 (step 1006). An action to be taken is determined (step 1008) for example based on pre-programmed indication of necessary service to be per formed on a particular network asset. or based on user Aefiniion of new work order that isto be ereated associ- ated with the asset, as received fom the mobile deviee 102. ‘Overlay information is then generated (step 1010) and provided the display of the mobile deviee (sep 1012), to ‘Communicate the identification and lation of the network asset to the technician, or to communicate various other information to the technician as required for interaction with the asset (ee, warranty, err, status, or instructional infor- mation, explained above). 10076] In embodiments such as thse discussed above in ‘which feedback is recived fom a technician reganting service actually performed, the network asset tacking Mar. 16, 2017, engine 108 can reveive feedback information (step 1014), fad ca slore that infomation, for example in action log 210. [0077] As illustrated in bots FIGS. 9-10, i is noted that ‘once overlay information is provided to a mobile deviee, the mobile device may obtain additional image data (e.g. due to capture of video data, or subsequent image). In such an event, the user of the mobile device may have changed the location ofthe mobile device, such as by switching is Toews, moving the device loser to or further from the assets to be {dentifed, or other movements. In such instances, the pees- nl application provides for continual (or periodic) updating of overlay data as image data is received from the mobile ‘device, AS seen in FIG, 9, that method could restart with a subsequent image eapture (step 902) after displaying image and overlay data (step 908). In FIG, 10, additonal image data could be received and processed (step 1002 et seq) following providing overlay data from the server (step 1012), This can include, for example, retamgeting on 2 diferent network asset, oF retargeting on the same network ‘ssc nan image having a dilferent focus (e., with one oF both of the asset or identifiers moving within the image) 0078] Referring now to FIGS, 9-10 generally, in ada- ‘ional emboatiments, other steps, or different orders of steps, can be perlormed by the mobile device andlor server ‘Additionally, other devices could be used as wel, for ‘example multiple technicians can simultaneously access @ server using diferent mobile devices, or multiple servers, ‘ach of Which are configured to provide diferent services (eg, managing a network asset database, calelatng trian- ulated postions of network assets base on received image data, or other features). Furthermore, and as discussed hove, based on various embodiments of the mobile device, the overlay of information ean correspond to either storage of a captured image and addition of supplemental, guidance {information to that image prior o display, o display of sch supplemeatal data on a semi-transparent display associated ‘witha scene in a field of view, for example using a heads-up display or other type of display associated with a wearable sevice, [0079] Now referring to FIGS. 11-17, additional embodt- rents are discussed in which assets can be located and ‘managed, for example using other types of mobile devices In some embodiments discussed herein, the mobile devices used aevording to the embodiments of FIGS, 11-17 represe hands fre, wearable display devices. In example embodi- ‘ments, such devices can include eyewear, sueh as Google Glasses from Google, Inc. of Mountain View, Calif, M100 ‘Smart Glasses from Vuzix Corp. of Rochester, N.Y, or other {pes of overlay-hased eyewear capable of displaying infor mation in a field of view of a wearer. As is recognized, such ‘wearable display devices generally inclade installable appi- cations, resident in memory, that ean utilize video or image capture features of such devices as well as wireless com ‘munication capabilities of such deviees. As discussed in unter del below, these or other types of wearsble display vices could he used as well, to provide for hands-free ‘operation of directions and instructions by 1 technician, thereby simplifying and making more reliable any mainte- nance performed by sueh technicians. [0080] In accordance with the present disclosure, such ‘wearable devices may include other functionality that may be displayed tothe user as well. Far example, in some cases, ‘barometer may be use to detect altitude (ee Wo determine US 2017/0076504 AI ‘current floor ofa buikling where the wearer i located) 2 tpyroscope to determine movement, or oer types of func- ‘ionaltes that ean generate data relevant c© the usee and displayed in the overay 10081] Generally, and as referring to FIG. 11 an arange- ment 1100 is illstated in which @ wearer 1103 has ‘wearable display device 1102, to view a fied of view 1180. Within the fick of view 1150, the wearer 1103 views a scene 1120 that includes a plurality of objects, such as assets 1122 (oa. racks, as shown, or any other types af assets discussed above) [0082] Generally, using the hands-five wearable display ‘device armingement of FIGS. 11-17, the wearer 1103 (ip cally & technician) may be guided in a number of ways to ‘ensure that core actions are taken. For example, and as shown in FIGS, 12-14, the wearer 1108 may be presented

    You might also like