You are on page 1of 38

Color filter array

In digital imaging, a color filter array (CFA),


or color filter mosaic (CFM), is a mosaic of
tiny color filters placed over the pixel
sensors of an image sensor to capture
color information.

The Bayer color filter mosaic. Each


two-by-two submosaic contains 2
green, 1 blue, and 1 red filter, each
filter covering one pixel sensor.
The term is also used in reference to e
paper devices where it means a mosaic of
tiny color filters placed over the grey scale
display panel to reproduce color images.

Image sensor overview


Color filters are needed because the
typical photosensors detect light intensity
with little or no wavelength specificity and
therefore cannot separate color
information.[1] Since sensors are made of
semiconductors, they obey solid-state
physics.

The color filters filter the light by


wavelength range, such that the separate
filtered intensities include information
about the color of light. For example, the
Bayer filter (shown by the image) gives
information about the intensity of light in
red, green, and blue (RGB) wavelength
regions. The raw image data captured by
the image sensor is then converted to a
full-color image (with intensities of all
three primary colors represented at each
pixel) by a demosaicing algorithm which is
tailored for each type of color filter. The
spectral transmittance of the CFA
elements along with the demosaicing
algorithm jointly determine the color
rendition.[2] The sensor's passband
quantum efficiency and span of the CFA's
spectral responses are typically wider than
the visible spectrum, thus all visible colors
can be distinguished. The responses of the
filters do not generally correspond to the
CIE color matching functions,[3] so a color
translation is required to convert the
tristimulus values into a common, absolute
color space.[4]

The Foveon X3 sensor uses a different


structure such that a pixel utilizes
properties of multi-junctions to stack blue,
green, and red sensors on top of each
other. This arrangement does not require a
demosaicing algorithm because each pixel
has information about each color. Dick
Merrill of Foveon distinguishes the
approaches as "vertical color filter" for the
Foveon X3 versus "lateral color filter" for
the CFA.[5][6]
List of color filter arrays
Pattern
Image Name Description size
(pixels)

Bayer
Very common RGB filt er. Wit h one blue, one red, and t wo green. 2×2
filt er

Bayer-like wit h one of t he green filt ers modified t o "emerald";


RGBE filt er 2×2
used in a few Sony cameras.

RYYB filt er One red, t wo yellow, and one blue; 2×2

CYYM One cyan, t wo yellow, and one magent a; used in a few cameras
2×2
filt er of Kodak.

CYGM One cyan, one yellow, one green, and one magent a; used in a
2×2
filt er few cameras.

RGBW
Tradit ional RGBW similar t o Bayer and RGBE pat t erns. 2×2
Bayer

RGBW #1
4×4
Three example RGBW filt ers from Kodak, wit h 50% whit e. (See
RGBW #2
Bayer filter#Modifications )

RGBW #3 2×4

Fujifilm-specific RGB mat rix filt er, wit h a large pat t ern, st udied
X-Trans 6×6
for diminishing Moiré effect .

Similar t o Bayer filt er, however wit h 4x blue, 4x red, and 8x 4×4
green.[7]
Quad
Bayer Used by Sony, also known as Tet racell by Samsung and 4-cell
by OmniVision.[8][9]
Similar t o Quad Bayer filt er, but wit h RYYB inst ead of RGGB. i.e.
RYYB 4x blue, 4x red, and 8x yellow.
Quad
First used in t he Leica camera sensor of t he Huawei P30 series
Bayer
smart phones.[10]

Similar t o Bayer filt er, however wit h 9x blue, 9x red, and 18x
Nonacell 6×6
green.[11]

Used in t he aut omot ive indust ry.[12] A monochrome sensor is


desired for maximum sensit ivit y, wit h t he red channel required
RCCC 2x2
for regions of int erest such as t raffic light s and rear
light s.[13][14][15]

Used in t he aut omot ive indust ry.[12] Similar t o t he Bayer sensor


RCCB except t he green pixels are clear, providing more low-light 2x2
sensit ivit y and less noise.[15]

RGBW sensor
An RGBW matrix (from red, green, blue,
white) is a CFA that includes "white" or
transparent filter elements that allow the
photodiode to respond to all colors of
light; that is, some cells are
"panchromatic", and more of the light is
detected, rather than absorbed, compared
to the Bayer matrix. Sugiyama filed for a
patent on such an arrangement in 2005.[16]
Kodak announced several RGBW CFA
patents in 2007, all of which have the
property that when the panchromatic cells
are ignored, the remaining color filtered
cells are arranged such that their data can
be processed with a standard Bayer
demosaicing algorithm.

CYGM sensor
A CYGM matrix (cyan, yellow, green,
magenta) is a CFA that uses mostly
secondary colors, again to allow more of
the incident light to be detected rather than
absorbed. Other variants include CMY and
CMYW matrices.

Manufacture of the image


sensor CFA
Diazonaphthoquinone (DNQ)-novolac
photoresist is one material used as the
carrier for making color filters from color
dyes or pigments. There is some
interference between the dyes and the
ultraviolet light needed to properly expose
the polymer, though solutions have been
found for this problem.[17] Color
photoresists sometimes used include
those with chemical monikers CMCR101R,
CMCR101G, CMCR101B, CMCR106R,
CMCR106G, and CMCR106B.[18]

A few sources[1][19] discuss other specific


chemical substances, attending optical
properties, and optimal manufacturing
processes of color filter arrays.

For instance, Nakamura said that


materials for on-chip color filter arrays fall
into two categories: pigment and dye.
Pigment based CFAs have become the
dominant option because they offer higher
heat resistance and light resistance
compared to dye based CFAs. In either
case, thicknesses ranging up to 1
micrometre are readily available.[1]

Theuwissen says "Previously, the color


filter was fabricated on a separate glass
plate and glued to the CCD (Ishikawa 81),
but nowadays, all single-chip color
cameras are provided with an imager
which has the color filter on-chip
processed (Dillon 78) and not as a
hybrid."[19] He provides a bibliography
focusing on the number, types, aliasing
effects, moire patterns, and spatial
frequencies of the absorptive filters.
Some sources indicate that the CFA can be
manufactured separately and affixed after
the sensor has been
manufactured,[20][21][22] while other
sensors have the CFA manufactured
directly on the surface of the
imager.[22][23][24] Theuwissen makes no
mention of the materials utilized in CFA
manufacture.

At least one early example of an on-chip


design utilized gelatin filters (Aoki et al.,
1982).[25] The gelatin is sectionalized, via
photolithography, and subsequently dyed.
Aoki reveals that a CYWG arrangement
was used, with the G filter being an overlap
of the Y and C filters.

Filter materials are manufacturer


specific.[26] Adams et al. state "Several
factors influence the CFA's design. First,
the individual CFA filters are usually layers
of transmissive (absorptive) organic or
pigment dyes. Ensuring that the dyes have
the right mechanical properties—such as
ease of application, durability, and
resistance to humidity and other
atmospheric stresses—is a challenging
task. This makes it difficult, at best, to fine-
tune the spectral responsivities.".
Given that the CFAs are deposited on the
image sensor surface at the BEOL (back
end of line, the later stages of the
integrated circuit manufacturing line),
where a low-temperature regime must be
rigidly observed (due to the low melting
temperature of the aluminum metalized
"wires" and the substrate mobility of the
dopants implanted within the bulk silicon),
organics would be preferred over glass. On
the other hand, some CVD silicon oxide
processes are low temperature
processes.[27]

Ocean Optics has indicated that their


patented dichroic filter CFA process
(alternating thin films of ZnS and Cryolite)
can be applied to spectroscopic CCDs.[28]
Gersteltec sells photoresists that
possesses color filter properties.[29]

Some pigment and dye molecules


used in CFAs

In U.S.P.# 4,808,501, Carl Chiulli cites the


use of 5 chemicals, three of which are C.I.
#12715, AKA Solvent Red 8; Solvent Yellow
88; and C.I. # 61551, Solvent Blue 36. In
U.S.P. # 5,096,801 Koya et al., of Fuji Photo
Film company, list some 150-200 chemical
structures, mainly azo dyes and
pyrazolone-diazenyl, but fail to provide
chemical names, CAS Registry numbers, or
Colour Index numbers.

Optically efficient CFA implementation

Nakamura[1] provides a schematic and


bibliographic items illustrating the
importance of microlenses, their f-number,
and the interplay with the CFA and CCD
array.[30] Further, a short discussion of
anti-reflection films is offered,[31] though
Janesick's[32] work appears is more
concerned with photon–silicon interaction.
Early work on microlenses[33] and on the
three-CCD/prism cameras[34] stress the
importance of a fully integrated design
solution for CFAs. The camera system, as
a whole, benefits from careful
consideration of CFA technologies and
their interplay with other sensor properties.

E-paper CFA
There are three primary methods for
reproducing color on e paper displays. One
uses micro spheres in various pigments,
such as the limited color range three
pigment Spectra displays or more faithful
four pigment Advanced Color ePaper, both
by E Ink. This method suffers from often
slow refresh rates as with several
pigments the display must perform
refreshes for each pigment. As with grey
scale units, after the display is updated the
device does not require power to keep the
image on screen.

The second common method uses a


typical grey scale e paper display behind a
transparent color layer. The color layer is a
LCD based CFA. When displaying grey
scale images the device runs at its native
resolution, for instance, 300 pixels per inch
(PPI). However, due to the CFA, the
resolution of the device drops when
displaying color images, say to 100 PPI.[35]
When the image to be displayed consists
of both a colored and a black and white
section, for example when a book page
comprises plain text as well as a color
photo, some e book devices may display
the photo at the reduced resolution while
the text is at the normal resolution. As the
CFA is LCD based, the CFA requires
constant power to run and uses more
energy.

The third method, as in ClearInk, uses a


CFA consisting of a front layer of wells
with hemispherical bottoms above a layer
of fluid containing black charged spheres.
When the spheres are away from the
hemispheres, the hemispheres reflect
brightly due to total internal reflection.
When the black spheres are moved near to
the hemispheres, the amount of reflection
drops. The refresh rate on video versions
of these devices is fast enough for video
playback (33 Hz on the device, compared
to 25 Hz for PAL television or 29.97 Hz for
NTSC television). They require more energy
to operate than a plain E Ink display but
much less than a LCD based display.[36]

References
1. Nakamura, Junichi (2005). Image Sensors
and Signal Processing for Digital Still
Cameras (https://books.google.com/book
s?id=aaTyk2USX1MC&pg=PT80) . CRC
Press. ISBN 978-0-8493-3545-7.
2. "Color Correction for Image Sensors" (htt
p://www.kodak.com/ezpres/business/ccd/
global/plugins/acrobat/en/supportdocs/Co
lorCorrectionforImageSensors.pdf) (PDF).
Image Sensor Solutions: Application Note.
Revision 2.0. Kodak. 27 October 2003.

3. Comparison of the spectral response of a


Nikon D70 vs. Canon 10D (http://www.astro
surf.com/buil/d70v10d/eval.htm) ,
Christian Buil.
4. Soo-Wook Jang; Eun-Su Kim; Sung-Hak
Lee; Kyu-Ik Sohng (2005). Adaptive
Colorimetric Characterization of Digital
Camera with White Balance. Lecture Notes
in Computer Science. Vol. 3656. Springer.
pp. 712–719. doi:10.1007/11559573_87 (h
ttps://doi.org/10.1007%2F11559573_87) .
ISBN 978-3-540-29069-8.

5. "Digital Photography Essentials #003:


"Color Separation" " (http://www.outbackph
oto.com/dp_essentials/dp_essentials_03/e
ssay) . Digital Outback Photo.

6. Thomas Kreis (2006). Handbook of


Holographic Interferometry: Optical and
Digital Methods (https://books.google.co
m/books?id=CNMPLjC0li8C&pg=PA77) .
Wiley-VCH. ISBN 3-527-60492-8.
7. "Sony Releases Stacked CMOS Image
Sensor for Smartphones with Industry's
Highest 48 Effective Megapixels" (http://w
ww.sony.net/SonyInfo/News/Press/20180
7/18-060E/index.html) . Sony Global - Sony
Global Headquarters. Retrieved
2019-08-16.

8. "How Tetracell delivers crystal clear photos


day and night | Samsung Semiconductor
Global Website" (https://www.samsung.co
m/semiconductor/insights/tech-leadershi
p/how-tetracell-delivers-crystal-clear-photo
s-day-and-night/) . www.samsung.com.
Retrieved 2019-08-16.
9. "Product Releases | News & Events |
OmniVision" (https://www.ovt.com/news-ev
ents/product-releases/omnivision-announc
es-its-first-48-megapixel-08-micron-image-s
ensor) . www.ovt.com. Retrieved
2019-08-16.

10. "Part 4: Non-Bayer CFA, Phase Detection


Autofocus (PDAF) | TechInsights" (https://te
chinsights.com/blog/part-4-non-bayer-cfa-p
hase-detection-autofocus-pdaf) .
techinsights.com. Retrieved 2019-08-16.
11. "Samsung's 108Mp ISOCELL Bright HM1
Delivers Brighter Ultra-High-Res Images
with Industry-First Nonacell Technology" (ht
tps://news.samsung.com/global/samsung
s-108mp-isocell-bright-hm1-delivers-brighte
r-ultra-high-res-images-with-industry-first-no
nacell-technology) . news.samsung.com.
Retrieved 2020-02-14.

12. "RAW Files | imatest" (https://www.imatest.


com/docs/raw/) . Retrieved 2021-01-03.

13. "Interfacing Red/Clear Sensors to ADSP-


BF609® Blackfin Processors (EE-358)" (htt
ps://www.analog.com/media/en/technical-
documentation/application-notes/EE358.pd
f) (PDF).
14. "Sensor | imatest" (https://www.imatest.co
m/solutions/sensor/) . Retrieved
2021-01-03.

15. "IISS Image Pipe for Alternate CFA


Formats" (https://www.ti.com/lit/an/spraca
8/spraca8.pdf) (PDF).

16. US Patent Application 20050231618 (http


s://web.archive.org/web/2017022204534
2/http://appft1.uspto.gov/netacgi/nph-Pars
er?Sect1=PTO2&Sect2=HITOFF&p=1&u=%2
Fnetahtml%2FPTO%2Fsearch-bool.html&r=
1&f=G&l=50&co1=AND&d=PG01&s1=2005
0231618&OS=20050231618&RS=2005023
1618)
17. Miller Harris R. (1999). Conley, Will (ed.).
"Color filter array for CCD and CMOS image
sensors using a chemically amplified,
thermally cured, pre-dyed, positive-tone
photoresist for 365 nm lithography" (http://
cat.inist.fr/?aModele=afficheN&cpsidt=173
87091) . Proceedings of SPIE. Advances in
Resist Technology and Processing XVI.
International Society for Optical
Engineering. 3678 (2): 1083–1090.
Bibcode:1999SPIE.3678.1083M (https://ui.
adsabs.harvard.edu/abs/1999SPIE.3678.1
083M) . doi:10.1117/12.350159 (https://do
i.org/10.1117%2F12.350159) . ISSN 0277-
786X (https://www.worldcat.org/issn/0277
-786X) . S2CID 109585024 (https://api.se
manticscholar.org/CorpusID:109585024) .
18. "Microelectronics Fabrication Facility, Hong
Kong University of Science and Technology"
(https://web.archive.org/web/2011072109
4440/http://www.mff.ust.hk/mffdoc/safet
y/msds.htm) . Archived from the original (h
ttp://www.mff.ust.hk/mffdoc/safety/msds.
htm) on 2011-07-21.

19. Theuwissen, Albert (1995). Solid-State


Imaging with charge coupled devices.
Kluwer Academic Publishers. ISBN 978-0-
7923-3456-9.
20. Ishikawa; et al. (1981). "Color Reproduction
of a Single Chip Color Camera with a Frame
Transfer CCD". IEEE Journal of Solid-State
Circuits. 16 (2): 101–103.
Bibcode:1981IJSSC..16..101I (https://ui.ad
sabs.harvard.edu/abs/1981IJSSC..16..101
I) . doi:10.1109/JSSC.1981.1051549 (http
s://doi.org/10.1109%2FJSSC.1981.105154
9) .

21. Takizawa; et al. (1983). "Field Integration


Mode CCD Color Television Camera Using
Frequency Interleaving Method". IEEE
Transactions on Consumer Electronics (3):
358–364. doi:10.1109/TCE.1983.356322
(https://doi.org/10.1109%2FTCE.1983.356
322) . S2CID 29448168 (https://api.semant
icscholar.org/CorpusID:29448168) .
22. Knop and Morf (August 1985). "A New
Class of Mosaic Color Encoding Patterns
for Single-Chip Cameras". IEEE
Transactions on Electron Devices. 32 (8):
1390–1395. Bibcode:1985ITED...32.1390K
(https://ui.adsabs.harvard.edu/abs/1985IT
ED...32.1390K) . doi:10.1109/T-
ED.1985.22134 (https://doi.org/10.1109%2
FT-ED.1985.22134) . S2CID 8503745 (http
s://api.semanticscholar.org/CorpusID:8503
745) .
23. Dillon; et al. (February 1978). "Color
Imaging System Using a Single CCD Area
Array". IEEE Transactions on Electron
Devices. 25 (2): 102–107.
Bibcode:1978ITED...25..102D (https://ui.ad
sabs.harvard.edu/abs/1978ITED...25..102
D) . doi:10.1109/T-ED.1978.19046 (https://
doi.org/10.1109%2FT-ED.1978.19046) .

24. Tanaka; et al. (1990). "HDTV Single-Chip


CCD Color Camera". IEEE Transactions on
Consumer Electronics. 36 (3): 479–485.
doi:10.1109/30.103163 (https://doi.org/10.
1109%2F30.103163) .
25. Aoki; et al. (1982). "2/3-Inch Format MOS
Single-Chip Color Imager". IEEE
Transactions on Electron Devices. 29 (4):
745–750. Bibcode:1982ITED...29..745A (htt
ps://ui.adsabs.harvard.edu/abs/1982ITED...
29..745A) . doi:10.1109/T-ED.1982.20772
(https://doi.org/10.1109%2FT-ED.1982.207
72) . S2CID 47298619 (https://api.semanti
cscholar.org/CorpusID:47298619) .

26. Adams; et al. (1998). "Color Processing in


Digital Cameras" (http://ultra.sdk.free.fr/do
cs/Image-Processing/Demosaic/Color%20
Processing%20in%20Digital%20Camera.pd
f) (PDF). IEEE Micro. 18 (6): 20–31.
doi:10.1109/40.743681 (https://doi.org/10.
1109%2F40.743681) .
27. Xiao (2001). Introduction to Semiconductor
Manufacturing.

28. "Dichroic Filter Array Patented Patterned


Coatings Technology" (https://web.archive.
org/web/20081204134619/http://www.oc
eanoptics.com/Products/thinfilmsdfa.as
p) . Ocean Optics. Archived from the
original (http://www.oceanoptics.com/prod
ucts//thinfilmsdfa.asp) on 2008-12-04.
Retrieved 2008-11-17.

29. "Swiss made SU-8 Photoepoxy Functional


Products" (https://web.archive.org/web/20
101010024326/http://www.gersteltec.ch/s
u-8-Functional/) . Gersteltec Engineering
Solutions. Archived from the original (http://
www.gersteltec.ch/su-8-Functional/) on
2010-10-10. Retrieved 2010-11-01.
30. Agranov; et al. (January 2003). "Crosstalk
and Microlens Study in a Color CMOS
Image Sensor". IEEE Transactions on
Electron Devices. 50 (1): 4–11.
Bibcode:2003ITED...50....4A (https://ui.adsa
bs.harvard.edu/abs/2003ITED...50....4A) .
doi:10.1109/ted.2002.806473 (https://doi.o
rg/10.1109%2Fted.2002.806473) .
ISSN 0018-9383 (https://www.worldcat.or
g/issn/0018-9383) .
31. Murakami; et al. (August 2000).
"Technologies to Improve Photo-Sensitivity
and Reduce VOD Shutter Voltage for CCD
Image Sensors". IEEE Transactions on
Electron Devices. 47 (8): 1566–1572.
Bibcode:2000ITED...47.1566M (https://ui.a
dsabs.harvard.edu/abs/2000ITED...47.156
6M) . doi:10.1109/16.853032 (https://doi.o
rg/10.1109%2F16.853032) .

32. Janesick, James (2001). Scientific Charge


Coupled Devices. SPIE. ISBN 0-8194-3698-
4.
33. Ishihara, Y.; Tanigaki, K. (1983). "A high
photosensitive IL-CCD image sensor with
monolithic resin lens array". 1983
International Electron Devices Meeting.
pp. 497–500.
doi:10.1109/IEDM.1983.190552 (https://do
i.org/10.1109%2FIEDM.1983.190552) .
S2CID 25401214 (https://api.semanticscho
lar.org/CorpusID:25401214) .

34. Murata; et al. (1983). "Development of a 3-


MOS Color Camera". SMPTE Journal. 92
(12): 1270–1273. doi:10.5594/J04214 (htt
ps://doi.org/10.5594%2FJ04214) .
35. "Everything you need to know about e INK
Kaleido 2 and Kaleido Plus" (https://gooder
eader.com/blog/e-paper/everything-you-ne
ed-to-know-about-e-ink-kaleido-2) .
goodereader.com. 21 January 2021.
Retrieved 2021-04-12.

36. "Don't Buy an Ereader Yet: 6 Upcoming


Color Epaper Technologies" (https://www.
makeuseof.com/tag/dont-buy-e-reader-upc
oming-technologies-kill-kindle/) . MUO.
2020-04-06. Retrieved 2021-04-12.

Retrieved from
"https://en.wikipedia.org/w/index.php?
title=Color_filter_array&oldid=1127105444"
This page was last edited on 12 December 2022,
at 22:50 (UTC). •
Content is available under CC BY-SA 4.0 unless
otherwise noted.

You might also like