You are on page 1of 10

Journal of Archaeological Science (2001) 28, 1329–1338

doi:10.1006/jasc.2001.0722, available online at http://www.idealibrary.com on

Automated Analysis of Environmental Degradation of Paint


Residues
Majid Mirmehdi and Alan Chalmers
Department of Computer Science, University of Bristol, Bristol BS8 1UB, U.K.

Lawrence Barham
Department of Archaeology, University of Bristol, Bristol BS8 1UU, U.K.

Louise Griffiths
Department of Computer Science, University of Bristol, Bristol BS8 1UB, U.K.

(Received 20 December 1999, revised manuscript accepted 20 May 2001)

The development of effective conservation strategies for the protection of rock art sites involves the assessment of the
taphonomic risks posed by physical and chemical weathering. This study outlines the methodology used in a pilot study
to monitor and model the deterioration of paint residues in a cave environment. Mineral oxide pigments were mixed
with water and placed on the walls of a cave in the Mendip hills (U.K.). The physical degradation of the paint residues
was simulated visually and modelled mathematically. A training stage learning the characteristics of a reference image
is followed by comparisons with this image as the test paints deteriorate. The study will be extended over three years
and digital image processing will be used to quantify changes in the colour and dimensions of the test paints. The results
will be correlated with micro-climatic variables. This methodology can be used to model taphonomic changes to rock
art and other forms of imagery in differing environments.  2001 Academic Press

Keywords: CAVE ART, TAPHONOMY, DIGITAL IMAGE PROCESSING, MENDIP HILLS.

Introduction Balter, 1999; Ward, Patterson & Watchman, 1999;


Watchman et al., 2000). These are some of the pro-

T
he preservation of parietal art in caves and rock cesses that govern the preservation of art in the short-
shelters depends on a complex interplay of local term perspective of days, seasons and years. The
and regional taphonomic factors operating over element of time complicates the taphonomic history of
time. These include the morphology and geochemistry rock art by increasing the likely degradation of rock
of rock surfaces as absorbent media and the effective surfaces and pigments from exposure to chemical and
adherence of differing paint formulas (Clottes 1993). physical weathering. Global changes in temperature
Micro-climatic variables of temperature and humidity and precipitation during the Pleistocene and Holocene
operate on daily and seasonal cycles in concert with will have had differing effects on the preservation of
variations in surface topography, exposure to light, art depending on latitude and regional variations in
wind and the internal drainage of sites. Seasonal geology and topography (Bednarik, 1994).
changes in humidity and temperature can affect Few taphonomic analyses of rock art have been
the visibility and exfoliation of painted surfaces (e.g. undertaken to date largely because of the inherent
Lorblanchet et al., 1990), and experimental research complexity of weathering processes combined with
has shown that water from precipitation (and human the need for longitudinal observations that can be
application) promotes chemical and physical changes quantified. Rock art as a finite cultural resource
to painted surfaces (e.g. Mawk & Rowe, 1998). demands conservation and, in the context of heritage
Mineral crusts affect the visibility and preservation of management strategies, the taphonomy of paintings
painted and engraved images and form under alternat- and engravings is now of prime concern (Hyman
ing wet and dry conditions combined with micro- et al., 1996; Watchman, 1998; Ward, Patterson &
biological activity (bacteria, algae, fungi, lichen) (e.g. Watchman, 1999). A method of visually monitoring
1329
0305–4403/01/121329+10 $35.00/0  2001 Academic Press
1330 M. Mirmehdi et al.

and mathematically modelling changes to paint International Federation of Rock Art Organizations to
residues is offered here based on the technology of provide a benchmark for calibrating change. Digitally
digital image processing (Clogg & Diaz-Andreu, 2000; recorded images are entered directly for computer
Robson Brown et al., 2001). Test spots of iron oxide, processing.
iron hydroxide and plant charcoal have been placed on Any sequence of images taken over a period of time,
cave walls in the Mendip hills (Somerset, U.K.) and are short or long, is exposed to variation in illumination
the experimental basis of this study. and scale changes from one image to the next. The
entrance to each cave visited is partially exposed to
daylight (and changes in ambient temperature and air
The Experimental Study of Pigment flow) introducing changes in illumination. Further-
more, the camera shutter is not synchronized precisely
Degradation enough with the flash, hence different images are
Conventional photography is an inadequate recording exposed to varying amount of flash. Under cave
medium for digital image processing. The transfer of conditions such variation can be quite marked. The
the image from camera to film and film to computer- camera used could only hold one high resolution image
readable digital pixels introduces distortions that com- at a time and the data needed to be downloaded for the
promise the accuracy and precision of the image. The camera to be ready for the next image. This combined
use of a high resolution digital camera combined with with its automatic zoom setting, introduced scale
a standardized colour calibration chart will enable changes from one image to the next. However, these
precise monitoring of changes to pigments (Bednarik, problems are corrected for in the image processing
1995b). The long-term three-year plan is to carry stage. Such corrections would be unnecessary only if
out monthly recording of pigments. Custom written the conditions were controlled vigorously enough to
software will then be applied to compare images over maintain illumination and scale factors throughout
time and to quantify changes. The problem that is the whole project. This would be impractical given the
addressed here is how to best analyse the image data. irregularity of the cave interiors and the difficult access
Both colour and size analysis are important; colour to the test panel.
analysis to indicate if the spots have faded and basic Figure 1 shows one series of data which we will use
size analysis to indicate the changes caused by the throughout this paper to report on the image process-
colour fading. ing techniques used to process them. The images
A separate pilot-study of the techniques required to attempt to simulate the degradation caused over a long
perform the analysis of the pigments was carried out by period of time.
applying sets of spots to the cave wall at Saye’s Hole in
Cheddar Gorge. Saye’s Hole is closed to the public,
which makes this a suitable site for the long term
observation of pigment degradation. This cave offers
Overview of the Processing
varying exposures to light, water and temperature. Sets Digital image analysis, although used in various
of markings (as circular spots) were applied progres- branches of arts, sciences and engineering, is a complex
sively in increasing amounts and digitally imaged, thus technique and has been most successfully applied in
simulating, in reverse chronological order, the possible medical imaging, product quality control and satellite
degradation of the spots. This provided sets of image imaging (Sonka, Hlavac & Boyle, 1999). The more an
data which show pigment spots in various states, from application is constrained and limited by pre-defined
what would be the original, full circular spots, to what conditions, and benefits from a priori knowledge, the
might be left after degradation, ie, as mere traces of the easier the task of analysis becomes.
original spots. With such images available, an investi- Constraints which assist this study include the use of
gation can be carried out using a data set similar to one a standard colour chart which remains constant and
that will eventually be analysed in three years time on against which reference data can be normalized. The
completion of the project. first image in a series is used as the reference image
For this pilot study, a circular stencil 34 mm in (RI) to which all subsequent analysis is compared.
diameter was used to standardize the size and shape of Real-time analysis is unnecessary thus the most
the pigment spots. The pigments are from local sources efficient and accurate techniques can be used.
and mimic those used in French cave sites (Courard, Figure 2 outlines a schema of the main steps of the
1988; Clottes, 1993): iron oxide (haematite) giving automated processing. Two stages are involved: in
a reddish colour, iron hydroxide (limonite) giving a the first or training stage, the RI is processed and the
yellowish colour, wood charcoal in dry and in wet form indicated information stored. In the second or testing
both producing a blackish colour. Calcium-rich cave stage, similar measurements are made on each image in
water was used as a binder, and the pigments applied the sequence and the results are compared with the
by brush to a thickness of 1–2 mm. A typical set of training data or the RI. We now briefly review our
images is shown in Figure 1. Each image incor- proposed technique and in the next section describe the
porates a standardized colour scale produced by the main steps in more detail.
Automated Analysis of Environmental Degradation of Paint Residues 1331

Figure 1. (a) to (f): One series of data that illustrates the variation in illumination and scale. Original images are of a resolution of 576432.
1332 M. Mirmehdi et al.

Figure 2. A schema of the main tasks in both the training and testing stages of the proposed method.

One major task in the analysis is to normalize each normalization constants, locating the full circular
image to a standard level of illumination, as it can not stencils, making measurements on the coloured area
be assumed that the lighting conditions are consistent within the circular area.
each time an image is taken. A colour chart is dis-
played in each image, and in order to normalize images
Locating the colour chart
to a standard level of illumination, a simple measure is
computed on the colours of the colour chart. To Relatively precise localization of the colour chart is
perform this, the colour chart must first be located needed for the normalization stage. A simple approach
within each image. As the data used in the eventual to finding the colour chart would be to use template-
experiments will have been captured on different matching to locate an image area which resembles the
occasions, the colour chart will not always appear in chart being sought. This would be a practicable ap-
exactly the same position in the image. It is not realistic proach but computationally expensive. To minimize
to locate manually the position of the colour chart in the amount of processing necessary, the template
each image, and as a result the program must be matching process is performed on sparser image data.
designed to automatically detect the boundaries of the The edge information contained in the image is used
chart. The problem of scale also arises as the data are as a mask to control where the template matching
captured over a period of time. The camera cannot be is carried out. Initially, the original colour image is
assumed to always have been at the same distance transformed into a greylevel version F(x,y), where each
away from and in the same relative position, even if its pixel (x,y) in the colour image I, with values R, G, and
lens parameters are reset accurately on each occasion. B, (representing red, green, and blue) is transformed
For the RI, after locating the colour chart, the using:
colour information is recorded. This is used to normal- F(x,y)=0·291R+0·587G+0·114B∀(x,y) I
ize other images. The whole of the RI image is then
searched to locate the circular spots. Spatial infor- Edge detection examines the gradient of the pixel
mation linking the position of the chart and the spots is values of an image and locates all high frequency
stored. This information is used to locate approxi- changes from one position to the next. The method
mately the position of the stencils in the test images in used is described by Canny (1986) and consists of
relation to the position of their colour chart. The filtering the image to maximize three criteria: good
colour information in the circular spots in the RI is signal-to-noise ratio, good spatial locality, and mini-
then recorded for later comparison. mum number of false responses. The result of edge
detection on Figure 1(a) is shown in Figure 3(a).
Conservative parameters are used to ensure the pres-
ence of as much of the colour chart edges in the edge
The Training Stage image at the expense of more noisy edge pixels. In this
This stage is entirely based on the processing of the application, loss of good edge data is more detrimental
reference image RI, e.g. the image I6 as shown than having to post-process some false edges.
in Figure 1(a). The steps involved are: locating Template-matching or correlation, involves the
the position of the colour chart, determining the location of the position in an image at which a
Automated Analysis of Environmental Degradation of Paint Residues 1333

Figure 3. (a) Edge pixels of image I6, (b) the located colour chart in I6, (c) Inexact colour chart boundary in I5, (d) the refined colour chart
boundary in I5.

template gives an optimum match. The match is not better accuracy. The fact that the colour chart is so
exact because of noise or small geometric and scale different from its immediate surroundings is used to
differences. Here the maximum match serves as a good adjust this hypothesized positioning. Consider a side of
approximate position. Given the template is the colour the border found, say the right edge. Pixels on the
chart itself and represented using h, F is the input inside of the edge will have an average value similar to
image in which the template must be found, and I is the pixels on the outside of the edge, since the pixels are
set of all edge pixels in the edge image E of the input very similar. This similarity ends as soon as the
image, then the template matching criterion gives the hypothesized border reaches the real colour chart
optimum match M at position (u,v) as: border. The difference of the average pixel value is
computed iteratively for either side of the edge and the
edge pushed outwards until this average becomes
greater than a threshold. That position is nominated as
the true edge. The same procedure is performed for
By template-matching only at spatial locations indi- each edge of the hypothesized border. The result of
cated as edge pixels, the amount of computation is such a refinement is shown in Figure 3(d).
dramatically reduced.
The position and boundary of the colour chart
obtained via template matching is particularly good for Determining the normalization factor
the reference image since the template comes from Both natural light and irregular flash synchronization
the reference image itself (see Figure 3(b)). Further on the digital camera can lead to grossly varying
processing is sometimes necessary to improve upon the illumination levels in our digital images. To make
accuracy of the result as in the case for the boundary comparisons between each image and the RI, the
obtained for image I5 shown in Figure 3(c). This result former have to be normalized. Figure 4(a) and 4(b)
is adequate but needs further adjustment to ensure show the histograms of the RGB colour bands of
1334 M. Mirmehdi et al.

(a) Image I6 histogram (b) Image I3 histogram

(c) Red channels (d) Green channels


Figure 4. (a) Histogram of the RGB channels in image I6, (b) the same for image I3 pre-normalization, (c) Histogram of just the red channel
for I6, pre-normalization I3, and post-normalization I3, (d) as in (c) but for the green channel.

images I6 and I3 respectively. A general shift of the


pixel values can be observed. The mean R, G, and B
values are computed, in the colour chart area only,
of the RI and the target image that needed to be where TI is the image currently being tested, CRI and
normalized. The difference between these was the CTI are the set of pixels in the colour chart area of the
normalization factor . Hence, RI and the test image TI respectively, and M=/CRI/
Automated Analysis of Environmental Degradation of Paint Residues 1335

Figure 5. (a) Image I6 or the reference image RI, (b) I3 pre-normalization, (c) I3 post-normalization towards I6.

Figure 6. (a) Circles detected in I6, (b) Enlargened circles to ensure maximum coverage.

Figure 7. Hypothesized circles in images I3 and I1 using positioning relationships between the colour chart and the circles from the RI. In each
case, the inner circle is the first estimation and the outer circle is the expanded estimation.

and N=/CTI/. Note this will have to be performed three This value must be clipped to remain within range of
times, once for each colour channel; it will provide a set the appropriate colour channel representation, (usually
of values TI(R,G,B). between 0 and 255). The green and the blue channels
Before processing any test images, the appro- will be obtained in a similar manner using TI(G)
priate normalization factor will be applied to the and TI(B) respectively. In Figure 4(c) and 4(d) we
appropriate colour channel. For example for the red can see the effect of the correction on the red and
channel: green channels of image I3 respectively. Finally,
Figure 5 shows the overall effect on the normalized
TI(x,y)=TI (R)+TI(x,y) ∀x,y TI image I3.
1336 M. Mirmehdi et al.

Table 1. Table showing the size of each spot in each image. The number
of pixels classified as belonging to the spot given the size or area

Spot size (scaled), given by number of pixels


Image 1 (Red) 2 (Yellow) 3 (Black–Wet) 4 (Black–Dry)

I6 (RI) 2906 3341 2881 2982


I5 2888 3185 2743 2648
I4 2581 3000 2710 2220
I3 2086 2477 2449 1962
I2 1453 1411 2086 1339
I1 555 590 832 649

circles. This results in large votes in the parameter


space for specific circles for which supporting edge
pixels exist. The Hough transform may return a
number of circles across the image. A search for four
circles with almost equidistant centres that also lie
along a straight line of almost horizontal direction is
the basis for eliminating any undesirable circles. The
result of the Hough transform on image I6 is shown
in Figure 6(a).
The circle detection technique is not absolutely
perfect. Furthermore, it is highly dependent on the
quality of the input edge data. In Figure 6(a), the
second circle from the right is not quite correctly
positioned due to weak supporting edge information.
The radius size of the detected circles is increased to
ensure that all the coloured areas are incorporated into
the regions signified by the circle circumference.
Figure 6(b) shows this improvement.

Analysing the colour regions


Pattern recognition is the science of classification of
measurements. In the circular regions, simply speaking,
there are two regions, one that consists of the colour
pixels, and one that is the background. In reality,
pixels have varying values but the colour pixels have
chromaticity values much closer to each other than to
the background pixels. A data segmentation technique
called K-means clustering is used as the standard
pattern recognition method (Sonka, Hlavac & Boyle,
1999). It hypothesizes the existence of K classes. In this
application the value of K is 2. In general, K data items
are selected as class centres. Each new data item is
examined to determine its nearest class by Euclidean
Figure 8. Colour spots and their segmentation against the back-
ground for images (a) I6, (b) I3, and (I1). distance to which it will then be joined. The mean of
the class is updated and new data items are compared
against the class mean value. The algorithm can be
Detecting circular stencils iterated until all data items are classified satisfactorily.
In the training stage, the circular spots in the RI are Unfortunately, Euclidean distances make no sense in
expected to be completely round since they are made RGB colour space. The pixels need to be transformed
using almost-perfect circular stencils. The search for into a colour space where the differences between the
the images is carried out using the Hough transform colours are perceptually similar to the distance between
for circles (Duda & Hart, 1973). It operates on edge them. One such space is the CIE-Luv colour space
pixel data and detects circles by accumulating votes (Wyszecki & Stiles, 1982). The transformation of data
in a parametric representation space of all possible from RGB to CIE-Luv is straightforward and the
Automated Analysis of Environmental Degradation of Paint Residues 1337

Table 2. This shows the mean RGB colour values for each spot at each stage of the sequence

Mean spot RGB values


Image 1 (Red) 2 (Yellow) 3 (Black–Wet) 4 (Black–Dry)

I6 (control) R 76 G 10 B 19 R 139 G 73 B 30 R 19 G 7 B 14 R 14 G 5 B 13
I5 R 76 G 13 B 19 R 136 G 72 B 31 R 21 G 11 B 18 R 22 G 12 B 20
I4 R 75 G 17 B 22 R 133 G 72 B 33 R 33 G 20 B 25 R 25 G 16 B 22
I3 R 78 G 32 B 32 R 129 G 77 B 42 R 47 G 34 B 35 R 41 G 32 B 33
I2 R 73 G 18 B 25 R 127 G 70 B 34 R 34 G 21 B 28 R 33 G 22 B 29
I1 R 77 G 36 B 39 R 121 G 77 B 50 R 55 G 42 B 45 R 58 G 45 B 47

results of K-means segmentation in CIE-Luv space are presents zoomed versions of the full segmentation of
more accurate than in RGB when judged subjectively. three images (I6, I3, and I1) next to their original
The number of pixels is counted and the mean to allow close subjective comparison. The pixels are
CIE-Luv value is calculated in each colour cluster divided into background and colour pigment within
of each circle and recorded as the area/size and the circular region examined.
representative colour of the pigments in the RI. The only method of comparison is subjective and the
Segmentation results are shown in Figure 8. results are remarkably good. Table 1 shows the spot
size count for the sequence of images. It can be seen
how the pigment areas decrease in size (with the scale
The Testing Stage taken into account). Results in terms of colour values
As illustrated in the schema of Figure 2, in this stage are given below in mean spot RGB values. These
the knowledge gained from the training stage is used to results are not wholly significant since the images were
examine each new image and record changes in colour taken on the same occasion and any variation is only
and size of the colour spots. Initially, the RI colour due to image acquisition noise and subtle changes not
chart template is used to locate the colour chart in the corrected through normalization. With the final data
test image TI. As shown in Figure 3, this may not on completion of the project, however, the colour
initially be very accurate and a refinement stage follows results should alter more significantly, as over a long
which corrects for any errors arising from colour and period of time it is expected that the pigments will fade.
scale changes. Comparing the size of the colour chart However, they will still be expected to remain suf-
in the RI and the TI, a scaling factor is obtained which ficiently in contrast to the background cave wall and
is incorporated into all subsequent computations in the the segmentation algorithm will still work.
TI. A normalization step is then performed as detailed
above using TI(R,G,B) based on the colour chart area
in TI. Conclusions and Future Plans
One very important step in the testing stage is to
locate the circular region that will contain the fading This paper presents a method to study the deteriora-
colour pigments. Since the pigments are fading and tion of colour pigments painted on cave walls. Digital
non-circular, the Hough transform will not be ap- imaging is used to obtain images of the pigments at
plicable. The assumption is made that the faded re- varying stages of application. A reference image (i.e.
gions are still contained within a circular border along the first in the sequence) is selected against which all
with increasing background pixels. Assuming that the other images could be compared. Using image process-
colour chart is positioned at the same physical place as ing techniques, both greylevel based and in colour,
before, the position of the centre of these circular the area and colour of the cave pigments can be
borders can be located by examining the relationship in monitored.
the positioning of the colour chart and the circles in the The method of image analysis was successful on the
RI. Their locations are already known in RI. Also pilot-study data and should be sufficiently robust to be
known is the position and size of the colour chart in TI. extended to other sites with only minor refinements.
By incorporating the scale differences, the centres of Pigment test spots have now been placed in two
the circular regions can be located in TI. Circle radii additional caves in the Mendips, each with differing
are also increased to compensate for any scaling errors. topography, lighting and exposure to weathering.
Figure 7 demonstrates this for images I3 and I1. Digital images will be recorded monthly over three
The close proximity of the circles can create years at all three sites. Changes in pigment colour and
problems and it is intended that future markings will adherence will be monitored and compared to seasonal
be placed further apart from each other. As in the variations in local climate and cave microclimate. The
training stage, K-means segmentation is applied to the three-year period of observation will provide the data
pixels contained within the circular region. Figure 8 for modelling the effects of weathering during the
1338 M. Mirmehdi et al.

Holocene and perhaps provide an understanding of Duda, R. O. & Hart, P. E. (1973). Pattern Classification and Scene
the absence of cave art in northwestern Europe. Analysis. New York: Wiley.
Delluc, B. & Delluc, G. (1991). L’art parietal archaı̈que en Aquitaine.
Paris: C.N.R.S. 28e Supplément à Gallia Préhistoire.
Dragovich, D. (2000). Rock engraving chronologies and accelerator
Acknowledgements mass spectrometry radiocarbon age of desert varnish. Journal of
Archaeological Science 27, 871–876.
The Maltwood Fund supported the pilot study and Ford, D. & Williams, P. (1994). Karst Geomorphology and
subsequent funding from the Natural Environment Hydrology. London: Chapman & Hall.
Research Council will enable the project to be com- Lorblanchet, M., Labeau, M., Vernet, J., Fitte, P., Valladas, H.,
pleted. We thank the management of Cheddar Gorge Cachier, H. & Arnold, M. (1990). Palaeolithic pigments in the
Show Caves and of Wookey Hole Cave for unhindered Quercy, France. Rock Art Research 7, 4–20.
Mawk, E. J. & Rowe, M. W. (1998). Effect of water on Lower Pecos
access to their sites. River rock paintings in Texas. Rock Art Research 15, 12–16.
Robson Brown, K. A., Chalmers, A., Saigol, T., Green, C. &
D’errico, F. (2001). An automated laser scan survey of the Upper
References Palaeolithic rock shelter of Cap Blanc. Journal of Archaeological
Science 28, 283–289.
Bahn, P. & Vertut, J. (1997). Journey through the Ice Age. London:
Weidenfeld & Nicholson. Sonka, M., Hlavac, V. & Boyle, R. (1999). Image Processing,
Balter, M. (1999). Restorers reveal 28,000-year-old artworks. Science Analysis, and Machine Vision. PWS Publishing.
283, 1835. Waltham, A. C., Simms, M. J., Farrant, A. R. & Goldie, H. S.
Bednarik, R. G. (1994). A taphonomy of palaeoart. Antiquity 68, (1996). Karst and Caves of Great Britain. London: Chapman &
68–74. Hall.
Bednarik, R. G. & Seshadri, K. (1995). Digital colour re-constitution Ward, I., Patterson, C. & Watchman, A. (1999). The environment
in rock art photography. Rock Art Research 12, 42–51. and condition of multi-layered aboriginal paintings at Kennedy-A
Canny, J. (1986). A Computational Approach to Edge Detection. in the wet tropics, North Queensland. Rock Art Research 16,
IEEE Transactions on Pattern Analysis and Machine Intelligence 8, 25–35.
679–698. Watchman, A. (1998). Composition and source of dust on Split
Clogg, P. & Dı́az-Andreu, M. (2000). Digital image processing and Rock paintings, Australia. Rock Art Research 15, 36–40.
the recording of rock art. Journal of Archaeological Science 27, Watchman, A., David, B., McNiven, I. & Flood, J. (2000).
837–843. Micro-archaeology of engraved and painted rock surface crusts
Clottes, J. (1993). Paint analyses from several Magdalenian caves in at Yiwarlay (the Lightning Brothers site), Northern Territory,
the Ariège region of France. Journal of Archaeological Science 20, Australia. Journal of Archaeological Science 27, 315–325.
223–235. Wyszecki, G. & Stiles, W. S. (1982). Colour Science: Concepts
Couraud, C. (1988). Pigments utilisés en préhistoire. L’Anthropologie and Methods, Quantitative Data and Formulas (2nd Edition).
92, 17–28. John Wiley and Sons.

You might also like