Super-Resolution Based on Open Source Computer Vision Library EmguCV
Lee Jee Shen
Faculty of Engineering and TechnologyMultimedia UniversityMalacca, Malaysiame@jeeshenlee.com
Authors Name/s per 2nd Affiliation
Dept. name of organization
(Line 1 of Affiliation - optional)
Name of organization - acronyms acceptable
In this paper, we present a simple implementation of Super-Resolution technique using EmguCV computer visionlibrary. Instead of static images, we use real-time video inputsfrom web camera as the input. Each Super-Resolution imageresult are processed based on multiple frames of the video input.The Super-Resolution technique applied our application isimplemented with the following sequence
image acquisition,image registration, sub-pixel image shift calculation, imagetransformation and lastly image interpolation.
Super-Resolution, EmguCV, real-time videoinput image processing
Super-Resolution is an image processing technique thattakes multiple shifted images of a same scene and generate ahigher resolution image copy of the scene by considering lostimage information that are captured at the other frames of thesame scene due to vibration or image shift. The main concept behind Super-Resolution is that CCD camera sensors are finiteand discrete while the light signal is continuous. In one imageframe taken by CCD camera, there are many lost informationof the scene that does not get picked up by the camera sensor grid because some continuous light signal will not hit the CCDsensor grid directly. Figure 1 illustrate the scenario when a fullhit of light signal on CCD camera sensor grid while the secondimage (Fig.2) illustrate the scenario of none full hit(information lost) when the light hit in the might of the sensor grid.EmguCV is an open source computer vision library writtenon .NET platform. It
s a translated copy of OpenCV with someadditional feature specifically written for .NET programmer.EmguCV act as a wrapper of OpenCV to access memory leveldata which was considered as (unsafe) programming in the.NET environment. The library is written using C#.NET programming languages and it can be compiled into Window,Linux, Max OS, Android compatible with the Mono compiler.Mono Mono is a compiler written to compile C# languagestandard into the target platform. On top of EmguCV, we areusing another open source computer vision library AForgespecifically to take web camera input.
Fig. 1. CCD sensor are recording the intensity of the light based on theamount of intensity hit the sensor grid.Fig. 2. Extra information (the tip feature of the object) are better recorded.
There are many Super-Resolution techniques proposed butgenerally it involves the following steps
image acquisition,image registration, sub-pixel shift estimation, and interpolation.In our application, we started by first acquiring the first five