You are on page 1of 6

Assuring the Reliability

of Your Sampling Results

David M. Abbott, Jr., CPG-04570

Abstract Introduction the sampling results at least suspect and


potentially as totally unreliable.
Sample analyses constitute one of The purpose of sampling is to obtain
the fundamental data types forming representative portions of a mineral Quality assurance involves those
the basis of our professional work. But deposit for a variety of purposes, par- steps taken to ensure that the sample
do the analytical results actually reflect ticularly mineral content (quantity) and collection, preparation, and analytical
what we think they do? Have the sam- quality (chemistry). Additional proper- protocols are producing reliable, repeat-
pling, sample preparation, and analyti- ties such as geotechnical information, able values. Quality control involves
cal procedures been tested by a quality density, amenability to various types those steps taken to ensure that the
assurance/ quality control program that of processing, etc. can be collected from established sample collection, prepara-
demonstrates the reliability and repeat- at least some types of samples. A wide tion, and analytical protocols continue
ability of the sampling results? Failure variety of sample types (rock, soil, water, to provide reliable and repeatable results
to include appropriate quality assur- and air) are collected in the process of for as long as sampling continues. QA
ance/quality control procedures renders exploring for and delineating the details and QC are lumped together because
the sampling results at least suspect of a mineral deposit and determining the the procedures used for one, say initial
and potentially as totally unreliable. potential environmental impacts result- quality assurance, continue to be valid
The inclusion of randomly selected, ing from exploitation of the deposit. throughout the quality control portion of
non-sequentially numbered duplicate the sampling program.
This is not the place for a detailed
samples is required at a minimum. The discussion of the types of samples that Prior to the Bre-X fraud involving
blind insertion of blank, standard refer- can be collected (see for example Scott the Busang gold deposit in Indonesia
ence, and/or control samples into the and Whateley, 1995). Rather the focus in that was uncovered in 1997, little
sample stream and re-analysis of sample this paper is on the procedures employed formal attention was paid to QA/QC
rejects (pulps and other forms) are com- to ensure that the samples collected programs in the mining industry. For
mon steps of a quality assurance/quality and the analytical results obtained example, Peters, in his generally excel-
control program. The analytical results from those samples provide reliable lent Exploration and Mining Geology,
of quality assurance/quality control are and repeatable data that can be used to 2nd ed. (1987, p. 479) covers the topic
easily analyzed. The duplicate samples model the deposit and estimate mineral in two short paragraphs. Scott and
should yield the same result and stan- resources and mineral reserves within Whateley (1995) provide an excellent
dard samples should return the standard acceptable degrees of assurance.1 This summary discussion of various sampling
result within acceptable analytical lim- is the function of quality assurance and and drilling methods and statistics for
its. Just because a laboratory routinely quality control (QA/QC) programs. QA/ determining sample sizes, etc., but make
runs its own quality assurance/quality QC programs should commence with the no mention of QA/QC programs. Even
control program does not demonstrate first samples taken at the beginning of Pitard’s Pierre Gy’s Sampling Theory
that your sample results are reliable (if exploration and continue throughout the and Sampling Practice (1993) does not
it doesn’t, don’t use the lab). The use of life of the property, including the produc- really address QA/QC procedures of the
independent analytical laboratories can- tion or remediation stage, to assure that type discussed here. Following the Bre-X
not in and of itself, ensure that a reliable the sampling data continues to be reli- fraud, more detailed attention has been
sampling, preparation, and analytical able and repeatable. Failure to include paid to the subject, for example Bloom
process has occurred. You must test the appropriate QA/QC procedures renders and Titaro (1997), Bloom (2000), Roden
process. and Smith (2001), and Sinclair and
Blackwell (2002, section 5.7). The facts of

1. While this paper is based on mining industry practice and thus uses terms like “deposit” and “mineral resources and mineral reserves”
that are not used in the environmental field, the concepts are directly applicable to environmental work. A pollution plume can be
considered a “deposit;” it has a location, X-Y-Z dimensions, and variable concentrations (“grades”) within it, just like an ore body.

www.aipg.org NOVEMBER/DECEMBER 2007 • TPG 33


PEER REVIEWED ARTICLE
the U.S. vs. Jeffus case (2000), described lems, which can be reduced by combin- • insertion of reference (standard) sam-
below, suggest that little attention was ing several grabs that incorporate all ples;
paid to the subject in all too many envi- relevant areas. Eyde and Eyde (1985) • randomization of sample numbers
ronmental sampling programs. address sampling problems for indus- prior to submission to the laboratory;
Roden and Smith (2001) point out trial minerals, which include identifying • comparison of multi-element trends
that, the presence and impacts of even small for elements determined by different
The key message that needs to be amounts of contaminants and the need laboratory procedures;
remembered in the area of field to preserve the character of the in-situ
• comparison of the results for the
sampling is that errors introduced deposit when sampling clays.
same element determined by different
at this stage of the data generation methods; and
process are, in most instances, the Implementing a QA/QC
• analysis of 5 to 10% of the sample
largest errors introduced into a pro- Program pulps at an umpire assay or analytical
gram and that these errors cannot be Implementing a QA/QC program is lab.
rectified in the subsequent process- neither difficult nor does one add sig- Some definitions are in order.
ing of the sample. Errors created nificantly to the sampling program’s
in the field can only be rectified in Blank sample is material that is similar
cost. The precise nature of the QA/QC
the field. to the mineralized field samples and
program will depend on the type and pur-
contains no or negligible amounts of
Roden and Smith (2001) note that the pose of the sampling program. Roden and
the minerals or elements of inter-
two most common problems in field sam- Smith (2001) and, particularly, Bloom
est. They are submitted to check on
pling are sample losses and poor sample (2000) set out several mechanisms that
sample preparation procedures as
splitting techniques. Losses depend on can be used to monitor sample data.
well as the analytical procedures. If
the sampling method involved, but can They include:
the mineral or element of interest is
involve dust, extensive water flows dur- • routine insertion of unprepared, bar- reported in the analysis, attention
ing drilling, poor field handling of sam- ren (blank) samples; must then be directed at why the
ples, and inadequate strength or seals
• routine submission of duplicate field anomalous result occurred; it could
on sample bags or containers. Losses of
samples; come from any step in the process or
fines or “heavies” are the common result
• resubmission of 5 to 10% of sam- from mislabeling of the samples dur-
and will result in biased samples. Riffle
ple preparation duplicates (sample ing the process. If anomalous results
splitters are the preferred type of split-
pulps); in a blank sample occur when pro-
ter but they can be labor intensive. Grab
• insertion of control samples; cessed after a high-grade sample,
sampling presents well-known prob-
cross sample contamination during
sample preparation may be occurring.
Regardless of the source of the error, a
problem within the sampling and ana-
lytical procedures has been identified
and its source can be identified and
corrected through additional testing.
This is particularly true when blank
samples routinely have anomalous
Marketing & Printing Solutions results. Bloom (2000) recommends
514 W. 19th Street that a blank be inserted every 20 to
50 samples.
Cheyenne, Wyoming 82001
Duplicate Field samples are collected
303-829-2092 at the same time, from the same
dnoreen@printbyrequest.com place, and in the same manner as the
www.printbyrequest.com other field samples. Duplicate field
samples, and other types of duplicate
Have you ever had large quantities of marketing samples (e.g., resubmitted sample
materials that became out of date far too soon? PBR’s print pulps), provide information on the
on demand solves that problem. With our $250 minimum, repeatability of the sampling and
you don’t have to order large quantities and hope they are all analytical procedures. The analytical
results from duplicate samples should
used before becoming out of date. be within accepted analytical limits.
Our customers want more control, faster turnaround, bet- If they are not, this may indicate a
ter economics and PBR’s digital presses deliver it all. Digital problem with the collection, prepara-
tion, and/or analytical procedures, or
printing has the ability to make every document unique with they may indicate that there is a sig-
Variable Data Printing (VDP). nificant nugget effect in the deposit.
Bloom (2000) recommends that the
PBR is ready to consult with you on your next numbers for duplicate samples should
marketing project. be at least 20 numbers apart so that
the duplicate samples are analyzed

34 TPG • NOVEMBER/DECEMBER 2007 www.aipg.org


PEER REVIEWED ARTICLE
in different batches in the lab. As Reference or Standard samples are • the ability to submit duplicate, blank,
with blank samples, the number of samples with known quantities of and reference (standard and/or con-
duplicate samples required varies the elements or minerals of interest. trol) samples in a form that con-
with the confidence in the sampling Reference or standard samples have ceals their identity during the sample
and analytical processes. Early in been carefully prepared in large, thor- preparation and analysis steps that
a project, a higher percentage is oughly homogenized batches and the follow the submission of the duplicate,
needed, say 20%. Once the reliability analytically repeatability and analyti- blank, and reference samples; difficul-
of sampling and analytical processes cal error limits have been determined ties include:
has been established, the number of by repeated analysis performed by • duplicate samples may not be
duplicates can drop to 1 in every 20 a number of laboratories. They are available in cases where whole
to 50 samples. available from a variety of sources cores are submitted as part of the
Nugget effect: the nugget effect results including geological surveys and other routine sampling program; and
from inhomogeneities within the sam- independent groups. • reference (standard and/or con-
ple and is common in and was first Control samples are similar to reference trol) samples are already in pulp
named in studies of gold deposits. A or standard samples in that they are (finely ground) form to ensure the
gold nugget or other large particle homogenized samples with known homogenization required to create
may represent the total gold con- quantities of the minerals or elements useful reference standards and
tent of a large volume, for example of interest as determined by repeated when the color of the reference
a cubic meter. But being a single analyses by several laboratories, but sample may not be close to the
particle, it will only be present in one they have been prepared internally pulps of the field samples.
sample of that volume even though to the company or project. Bloom and An important requirement of any
duplicate samples from that volume Titaro (1997) recommended inserting QA/QC program is the regular monitor-
were collected. While gold nuggets a control sample in every 20-field ing of the results. X-Y correlation plots
provide dramatic examples of the sample group. are a common and easily prepared check,
nugget effect (although less of an The particular QA/QC program adopt- although flagging of significant vari-
effect than gem-quality diamonds in ed will depend on a number of factors ances in spreadsheets is another means
a diamond deposit), nugget effect including: of checking results. While anomalous
sampling bias can occur in a variety • whether a particular protocol is values may indicate that a problem has
of deposits. Where a nugget effect is required for the type of sampling cropped up, investigation of the source of
known or suspected, alternative sam- being conducted; this is particularly the problem may isolate it to a particular
pling methods, and perhaps analytical true for some types of environmental sample. Was a piece of core submitted as
methods, must be employed in order sampling; a blank sample taken from an interval
to obtain the repeatable analytical sufficiently close to the ore zone that a
• deposit delineation stage (prelimi-
results required for mineral resource stray anomalous value was indeed pres-
nary exploration, advanced explora-
and reserve estimation. ent? Was there a transcription error in
tion, production);
Randomized sample numbers are a sample numbering? Anomalies should
• type of minerals occurring in the
means of shipping samples to the not be ignored, they should be explained.
deposit and their abundance (precious
preparation and/or analytical steps in Repeated anomalous values provide the
and base metals versus coal versus an
a different sequence than the samples justification for detailed testing of the
industrial mineral);
were collected. Randomization allows procedures in order to identify and cor-
for identification of drift or bias in • whether a significant nugget effect
rect the problem producing the anoma-
the sampling results. The drawback exists (large variance between sam-
lous results.2
of randomization is the increased ples taken at the same location);
Once the anomalous results have been
potential for introducing transcription • the degree to which contamination
resolved, Roden and Smith (2001) point
errors and some increased handling between successive samples is likely
out that the precision of the sampling
procedures. Randomization is also to occur and materially affect the
program is easily determined from the
best performed in large sample lots. analytical results—this successive
duplicate samples; it is the Mean Percent
The field data sheets for recording the sample contamination can occur at
Difference (MPD) approach, which is
information on each sample should the collection stage, e.g. successive
calculated by:
include a column for the laboratory composites lengths in a rotary drill
hole (particularly a problem with MPD = (Σ (absolute (x1 - x2) / ((x1 +
number corresponding to the field
rotary drilling in gold deposits located x2))/2) × 100))/n
sample number. This is particularly
needed when using randomization of below the water table), or during the where x1 and x2 are duplicates of the
sample numbers. sample preparation process; and same sample and n is the number of sam-
ple pairs.3 The individual MPD results

2. One reviewer of this paper provided the following example of an anomalous sample analysis. “Years ago I was involved in water
resources and sediment quality sampling and analysis. We triplicate grabbed sediment with ponar samplers. At one site, two of the
samples read BDL for Chlordane. The third sample analysis was sky high. Repeated sampling resulted in a wide range of values, and
the media had a field day. I had eight of years of data in this particular stream—all good and consistent, both upstream and down-
stream from this particular bridge. I started talking with the neighbors and one told me about a person that had a backyard nursery
and who often dumped stuff into the stream. Aha. Turned out the person had dumped an old bag of powdered Chlordane The point
is that someone must maintain the sampling history, values, COC, etc.”
3. The “× 100” term can be deleted from spreadsheet columns formatted for percent.

www.aipg.org NOVEMBER/DECEMBER 2007 • TPG 35


PEER REVIEWED ARTICLE
are then averaged over the range of simi- tories in order to
lar samples, which provides the expected test the accuracy
variability in analytical value for any and repeatability
similar sample in the database. Roden of the analytical
and Smith (2001, p. 76) state, “Statistical results. Look care-
analysis of this MPD measurement has fully at detection
shown it to be an extremely robust limits (DL) and
measure that closely approximates the the analytical pro-
relative standard deviation. Doubling cedures that are
this number will therefore provide a 95 available from a
per cent confidence interval around the particular labora-
assay value.’ tory. What ana-
Figure 1 shows a correlation plot of lytical procedures
445 duplicate sample pairs. The R2 corre- and detection lim-
lation coefficient for these pairs is 0.9685 its do you require
and the MPD is 16.2%. When one of the and what can a
duplicate pairs reports 0.0 grade units particular labora-
(ppm in this case) and the other reports tory provide. For
some detectable quantity, the mean per- example, many
cent difference between the two samples labs claim to be
can be large. By eliminating those pairs able to test for
reporting less than 1 ppm (well below platinum group Figure 2. Correlation plot of 12 sample pairs analyzed by different labo-

the cut-off grade) in this example, the metals (PGMs) ratories.


MPD of the remaining 379 sample pairs but testing has only must one use reputable laboratories
dropped to 6.8%.4 These sample pairs shown that very few labs can accu- known to be able to provide reliable
were collected from a “nuggety” deposit rately analyze for PGMs (U.S. Bureau results for the types of analyses being
and so some variance in duplicate analy- of Land Management, 2002; Whyte, run, but that these results must be inde-
ses is expected. 2000). In 2000, thirteen people associ- pendently checked and verified as a part
The overall QA/QC program should ated with Intertek Testing Services of a thorough QA/QC program. Bloom
include the use of different labora- Environmental Laboratories, Inc. of and Titaro (1997) recommended that one
Richardson, Texas were indicted for in every 10 sample pulps should be sent
failure to comply to a second lab for reanalysis.6
with standard and Figure 2 is a correlation plot illus-
accepted labora- trating a problematic sample analysis
tory procedures example of 12 pairs of analyses from two
designed to pre- different laboratories. The R2 correlation
vent cross sample coefficient for these pairs is 0.2607 and
contamination the MPD is 43.5%. Clearly, the correla-
and to ensure tion between these 12 sample pairs is
accurate results. very poor.
The indictment
While in this case there was reason
charged that the
to believe that neither laboratory was
soil, water, and
capable of accurately analyzing for the
air samples sub-
elements compared in Figure 2, similar
mitted came from
comparisons of duplicate analyses from
more than 59,000
two laboratories indicate that at least
separate projects
one of the laboratories is providing unre-
and involved as
liable analytical results.
many as 250,000
separate analyses Bloom and Titaro (1997) describe
(U.S. v. Jeffus, some of the difficulties encountered in
2000) . 5 These finding good analytical laboratories out-
examples dem- side Australia and North America. The
Figure 1. Correlation plot of duplicate sample pairs. onstrate that not difficulties encountered included lack of

4. Because only the lower limit sample pairs are eliminated, the R2 value is little affected by elimination of these sample pairs. For these
lower limit sample pairs, the difference between sample pairs on a percentage basis is much higher than the difference between the
sample pairs on an absolute basis.
5. Following a trial that concluded in November 2001, 8 of the 13 defendants were acquitted of the charges against them. Five others
pleaded guilty prior to the trial. The not-guilty verdicts were reached in part because the sample log-in and other procedures were so
lax that the government was unable to prove who was operating which piece of analytical equipment when (Abbott, 2002).
6. I don’t know but suspect that the problems at Intertek were identified by those who actually followed a QA/QC program that included
duplicate, blank, and standard reference samples and who also sent duplicate samples to other laboratories.

36 TPG • NOVEMBER/DECEMBER 2007 www.aipg.org


PEER REVIEWED ARTICLE
infrastructure, poor communications, downhole surveys that determine Professional Ethics & Practices col-
bureaucracy, outdated lab equipment hole deviation)? umn 72: The Professional Geologist,
with high detection limits, poor lab prac- • Was the drill hole spacing ade- March 2002, p. 24.
tices, limited lab capacity, lack of ready quate? How was this determined? Bloom, Lynda, 2000, Implementing
access to high quality consumables, lack Has the spacing been checked? quality assurance programs: Mining
of computers that lead to transcription • How and where were the assays or Millennium 2000, Prospectors and
errors, and political risks. This does other analyses and tests done? Developers Conference CD, 8 p.
not mean that foreign laboratories are
• Why were the analytical methods and Bloom, L., and Titaro, D., 1997, Building
always inferior. Some may be excellent.
tests run selected? confidence in assays: Mining
Likewise, not all Australian or North
American laboratories are reliable.7 This • Did the laboratory perform and report Engineering, July 1997, p. 46-48.
is why you check results from one lab on its internal quality assurance/qual- Eyde, Ted H., and Eyde Dan T., 1985,
with the results of duplicate samples ity control program? Application of geology to problems of
sent to different laboratories. The appropriate answers to these and sampling and grade control unique
Bloom and Titaro (1997) estimated other questions will depend on the type to industrial mineral deposits in
that a QA/QC program would add about of deposit being examined and the pur- Metz, R.E., ed., Applied mining
15% to direct assay costs and 1% to over- pose for which the samples were taken. geology: problems of grade control,
all exploration program costs. The value Reconnaissance geochemical samples p. 85-89 in Erickson, A.J., Jr., Metz,
received from this extra expenditure is may not need to be as carefully located R.E., and Ranta, D.E., 1992, Applied
assurance that the analytical results or analyzed to the same precision as later mining geology: general studies,
from the sampling, on which all mineral deposit delineation samples. Rowe and problems of sampling and grade
resource and reserve estimates depend, Hite (1984) describe the sampling and control, and ore reserve estimation:
are reliable. drilling done to delineate the Crandon, Society for Mining, Metallurgy, and
Wisconsin volcanogenic massive sul- Exploration (SME), Littleton, CO.
Other Sampling Program fide deposit. They note that the global Peters, William C., 1987, Exploration
resource estimate did not significantly
Issues change after 40 holes were drilled. But,
and mining geology, 2nd ed.: John
Wiley & Sons, Inc., 685 p.
When reviewing a sampling pro- they note, the additional drilling done
gram, the following questions should (over 180 holes) considerably improved Pitard, Francis F., 1993, Pierre Gy’s sam-
be asked. the confidence in the knowledge of the pling theory and sampling practice,
deposit’s continuity, distribution, and 2nd ed.: CRC Press, 488 p.
• Who did the work and were the proper
procedures followed?8 variability. The appropriate analyses Roden, S., and Smith, T., 2001, Sampling
• Was there an unbroken “chain of cus- and tests for an industrial mineral and analysis protocols and their
tody”? deposit vary widely depending on the role in mineral exploration and new
industrial mineral being examined and resource development in Edwards,
• How were the samples taken? Were
the potential market(s) for that mineral A.C., ed., Mineral resource and
they:
(Eyde and Eyde, 1985). Regardless of ore reserve estimation—the
• chip samples, the purpose of the sampling program, a AusIMM guide to good practice: the
• channel samples, QA/QC procedure should be part of the Australasian Institute of Mining and
• core samples, sampling program in order to ensure Metallurgy, Melbourne, p. 73-78.
• drill cuttings, or that the results obtained are indeed Rowe, R.G., and Hite, R.G., 1984, Applied
reliable. In those cases where the initial geology: the foundation for mine
• some other type?
results are determined not to be reliable, design at Exxon Minerals Company’s
• How was the location of the samples the reasons for the lack of reliability can
determined? If a GPS receiver was Crandon deposit in Erickson, A.J.,
be examined and different sampling, Jr., ed., Applied mining geology, p.
used, which reference map datum sample preparation, and analytical pro-
(geoid) was used and what are the 9-27 in Erickson, A.J., Jr., Metz,
cedures can be adopted that avoid the R.E., and Ranta, D.E., 1992, Applied
distance errors in location? This infor- problems encountered with the initial
mation should be part of the data mining geology: general studies,
program. problems of sampling and grade
recorded on the sample data sheets.9
control, and ore reserve estimation:
• Drilling: References Society for Mining, Metallurgy, and
• Were drill holes surveyed (both the Abbott, David M., Jr., 2002, Testing Exploration (SME), Littleton, CO.
location of the top of the hole and lab case defendants acquitted in

7. This is particularly true for assays of platinum-group metals (PGMs), which very few labs perform accurately. Many labs in the south-
western US assay for PGMs but don’t do so accurately (U.S. Bureau of Land Management, 2002).
8. A reviewer noted that in the water resources field, field samplers have to go through training / certification programs, e.g., the USGS
Water Resources Water Quality Sampling Training Program. Without that sampling certification, data may not be admissible in
litigation cases.
9. The map datum is based on a mathematical geoid model approximating the true oblate spheroid shape of the Earth. Different map
datum geoid models are used for different maps. Some one wishing to relocate your sample point needs to be using the same map
datum (geoid model) you used when determining the sample’s location. Common map datum geoid models include the North American
Datum 1927 (NAD 27), the North American Datum 1983 (NAD 83), and the World Geodetic System 1984 (WGS 84). Even State Plane
Coordinate (SPC grid) and the Universal Transverse Mercator (UTM) grid depend on a reference geoid model.

www.aipg.org NOVEMBER/DECEMBER 2007 • TPG 37


PEER REVIEWED ARTICLE
Scott, Barry C., and Whateley, Michael
K.G., 1995, Evaluation tech-
niques in Evans, Anthony M., ed.,
Introduction to mineral exploration:
Blackwell Science, p. 161-202.
Sinclair, Alastair J., and Blackwell,
Garston H., 2002, Applied mineral INSURANCE PROGRAMS
inventory estimation: Cambridge
University Press, 381 p.
U.S. Bureau of Land Management,
Available to
2002, Results of analyses of stan- AIPG MEMBERS
dard and blank samples tested at
selected assay laboratories in North GeoCare Benefits Program
American: U.S. Bureau of Land For information:
Management Mineral Report, 34 Life and Health Insurance
p., available in PDF form from the GeoCare Benefits Insurance Plan
BLM National Training Center in
http://www.geocarebenefits.com/
Phoenix, AZ.
Phone: 800-337-3140 or 805-566-9191
U.S. vs. Jeffus, et al, 2000, Indictment,
U.S. District Court for the Northern Auto and Home Insurance
District of Texas, case 300-CR-375- Liberty Mutual Insurance
D, 42 p. http://www.txnd.uscourts. http://www.libertymutual.com/lm/aipg
gov/pdf/Notablecases/300cr375_
Phone: 1-800-524-9400
1.pdf, downloaded March 12, 2007.
Please mention client #111397 when you contact Liberty Mutual.
Whyte, James B., 2000, Black Magic and
white lab coast: pseudoscience in
AFLAC
precious metals exploration: Mining
Millennium 2000, Prospectors and http://www.aflac.com
Developers Conference CD, 7 p. Phone: 303-674-1808
Please identify yourself as an AIPG Member to receive the AIPG
Additional Contributions made
by AIPG National Editor: Gail Gibson,
Association discounted prices. Representative: Carol Streicher
CPG-09993.
Reviewed by AIPG Associate
Editors: Edward M. Baltzer, CPG-
08861, Solomon A. Isiorho, CPG-07788,
and Dale Rezabek, CPG-09285.

AIPG MEMBER APPLICATION

38 TPG • NOVEMBER/DECEMBER 2007 www.aipg.org

You might also like