Scribd Logo
Upload

Welcome to Scribd!

  • US7548258

    Uploaded by

    jeerlamallaiah
    4 views10 pages

    Copyright

    © Attribution Non-Commercial (BY-NC)

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    4 views10 pages

    US7548258

    Uploaded by

    jeerlamallaiah

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    of 10
    2) United States Patent 6 0s) 0) o a @ 6s) (6) Kaplinsky |GH RESOLUTION NETWORK VIDEO CAMERA WITH MASSIVELY PARALLEL IMPLEMENTATION OF IMAGE PROCESSING, COMPRESSION AND NETWORK SERVER Assignee: Notice: Subject to any disclaimer, the team ofthis pateat is extended or adjusted under 35 USC. 154(b) by 783 days, Appl. Now 10994,747 Filed: Nov. 22,2004 Prior P US 200510140787 AI ication Duta Jun 30, 2005 Related US. Apy Provisional pplication No. 60V524.490, filed on No 21,2003, provisional application No. 60V524,449, fled on Nov. 21, 2003, provisional application No. (60524.448, filed on Nov. 21, 2003, provisional appli- cation No, 60/524,488, fled on Nov. 21, 2008, ication Data Ch. HOIN 3232 (2006.01) us.cl, s4w/211.99; 725/105, Fleld of Classification Search 348/222.1, 348/211.99, 725/108 See application file for complet search history. ‘USOO7S48258B2 (10) Patent No. 4s) Date of Patent: US 7,548,258 B2 Jun. 16, 2009 (56) References Cited US. PATENT DOCUMENTS: 538459. A + 811992. Roberts a 02316 661,083 B2* 112005 Obsaor el. 2201 Soon707 B2* "12006 Obrador 2201 * cited by examiner Primary Examiner (74) Attorney, gent, or Firm Than V Ho Cristie, Parker & Hale LLP. on ABSTRACT The subject of the present invention is the network video 1 capable of dolivering high-cesolution digital images, ‘comprising over a million of pixels per image at full motion video frame rate. The eamera disclosed in the present iver ‘ion compeises high resolution image sensor capable of oper ating at video frame mic, computer network interface for ‘ransmnission off camera of image data streams originated by sid image sensor and also comprising multistage pipelined ital image processor operating under control of low eost iicroprocessor capable of processing and compression of ‘mage data atthe output rte of said image sensor, wherein said image processor comprises image processing pipeline formed by multiple distinet stages, wherein most of said sages perform distinctly diferent image processing opers- ‘ions and wherein each said stage hasan ouutlatch or butter And accepts its input data fom the output latch or buffer of ‘one oF more af ether sai stages, wherein image data propa- gates from stage to stage and wherein each of said stages performs its operations on image data concurrently and syn tchronously with most of other suid stages performing their espoetve operations 28 Claims, 3 Drawing Sheets [Err act Leen) ae Comenannaes] amen} ‘Dram gh Raton ter Came ih Mandy Par ig Pring ‘Semon Ror hate 20B}I9]UL YOAIIN puke woIssOsdWOD, Suyssov0ag aBeuy ppesvd APassepy YEA wiaute,) YOMIaN UORNIOSTY YBIH Jo wEIBEIC-yoorg “T aun3y, s a 2 & a s aurpadig Sutssav01g adeuy jo[fereq-A]eatssey] payesipaq joeareaaaT mune, yexquend| ‘sue woneoTe —_Geapaannn 1a y dowry, fexnsyoou ‘BOT 7 AuMd Ped ALL AHa pitnsog juvag Seeazz -—>] eur [>] uma eed |—>] 00D > +>} i. | own 3 t m ee —— : en ee 2 ' & leg eel ' a0ssav0ag ‘sng eye q yoxyuO) 1 oT 3 2 ! s 1 $ saat | cor : | ¢ aM 8 av i 3 on fo fo zor ! Suyayng, apo uoD ci ‘tumad.seys 1 a y s09y z e “ y : Seung 1 stony santana] este bl emu k—| ep] oars, ft =| RRS iy ne oes ae ae ee ee ee eee eee 1 Tor g z z r a weg : ues | area 4 = US 7,548,258 B2 Sheet 2 of 3 Jun. 16, 2009 U.S, Patent ALL, PPUION Wo paseg a9R}IO}UE YIOMIIN LOWED WPPHAPUE-YIIH JO WHID-KOLT "Z aInT1 907 esq -aaun i Sala ST ‘a aquNG OK ALL siz ae ‘santa: rar-so0 sa US 7,548,258 B2 Sheet 3 of 3 Jun. 16, 2009 U.S, Patent SUIDUIED IONIAN VON MJOSOY YSIH Uo poseg woyshg oplA Jo urease Yolg “¢ any 2M mopum Buysanboy Zs9sn eowey euoud 1189 10 WOd 40. Oa 190 1M mopur 4 Bunsenbey Lu9sn aowey, ‘O¢ doide7 10 ‘Od doviseq NVI. 40 13NUSIN Jenies oepia ET) 1907 SHOMION onnjosou-u6iH zoe toe US 7,548,258 B2 1 HIGH RESOLUTION NETWORK VIDEO. (CAMERA WITH MASSIVELY PARALLEL, IMPLEMENTATION OF IMAGE. PROCESSING, COMPRESSION AND. NETWORK SERVER (CROSS REFERENCE TO RELATED "APPLICATIONS, ‘This application claims the benefit of U.S. Provisional Application Nos. 60/524.490 filed Nov. 21,2008, 60/524,449 filed Nov. 21, 2008, 60/524,448 filed Nox. 21, 2003, and (60524,488 fled Nov. 21, 2003, the contents of which are Incomporated by relerence herein Also incorporated by reference herein are the following applications which were filed on Jul. 14, 2004: Ser. Nos. 107890,870, 10/890.911, 10°890.912, 10/850,913, 10/890, 914 and 10/890.915. ‘Also incorporated by reference herein are the following applications Med on even date herewith ‘atomey Pray UprosuiwniiANcr SST Amasom wombat BASED ON HGH RESOLUTION NETWORK CAMERAS CAPABLE OF VIDEO RATES NETHODYOR ACCURATE REAL-TIME. AR}5945. ssa VIDEO CAMERAS BACKGROUND OF THE INVENTION ‘Most currently installed vdeo surveillance and monitoring, systemsare based on NTSC/PAL SECAM analog video cam- ‘eras, with camera resolution rigidly fixed by the correspond ing video standard, Thus, 1o inspect fine detail of the scene, NISC surveillance system have wo rely on expensive optical oom and mechanical pan aad ti, However, higher optical ‘0m inevitably corresponds to reduced field of view of the ‘camera, requiring the operator to make a ehoice between, higher level of detail and higher coverage of the area undet surveillance. Furthemiore, the actuators responsible for ‘mechanical pan, it and zoom are typically slow as compared ‘with the camera frame-rte, This makes soming on rapidly moving targets, such as license plates ofthe moving automo- bile, dificult if no impossible Incoatrast to NTSC-based video, network camerss are 201 restricted to the specific resolution ad frame rate and are Primarily limited by the on-camera computational resources fnd available network bandwidih. Network video cements rely on packetoriented digital image transmission are not Jimited o any particularimage esolutionand frame rate. This ‘opens the door for the development of high-resolution video surveillance systems that are overall superior to existing NTSC systems and provide video-ate multisormatfanetion= ty and instantancous pan lt and zoom capa ‘ously unavailable in video surveillance. However, to produce molti-mogapixel imagery at video rates, the netivork camera has to be able to perform image processing, compression and network trnsmission at vasiy higher data bandwidths than are typical for NTSC cameras. 0 2 Conventional approach of implementing image processing, ‘compression ad network protocols in general purpose DSPs ‘and microprocessors significantly Himits overall camera bandwith necessitating the trade-offs between camera rame-rate and resolution, SUMMARY OF THE INVENTION “The subject ofthis invention isthe network video camera capable of delivering high-resolution images, comprising ‘vera milion of pixels per image, at video rte The camera Fined implementation of JPEG compression includes states that perform MCU formation, Forward Diserete Cosine ‘Translorm (FDCT), zigzag sean, quantization and entropy tured to sort the arriving from the camera packets so as to uarantee the ascending onder of TPTP block numbers. nthe prefered embodiment ofthe present invention cam= ‘ea microprocessor is configured (© monitor end of frame (BOE) flag set by image biter access logic. Microprocessor Js conflaured to load an BOF pocket in the next available packet bulfer once EOF flag has heen set. In the preferred ‘embodiment of the present invention, said EOF packet is shorter than other image data packets and contains either no

    You might also like