Professional Documents
Culture Documents
Testing The Reliability
Testing The Reliability
Citations:
Please note: citations are provided as a general guideline. Users should consult their preferred
citation format's style manual for proper citation formatting.
-- Your use of this HeinOnline PDF indicates your acceptance of HeinOnline's Terms and
Conditions of the license agreement available at
https://heinonline.org/HOL/License
-- The search text of this PDF is generated from uncorrected OCR text.
-- To obtain permission to use this article beyond the scope of your license, please use:
Copyright Information
169
Introduction
2 Ibid 42.
3 T B Howell, A Complete Collection of State Trials and Proceedings for High Crimes and
Misdemeanoursfrom the EarliestPeriod to the Year 1783, Vol 6 (T C Hansard 1816), 647.
4 Ibid 697.
5 Ibid 702.
6 Slater v Baker and Stapleton [1767] 2 Wils KB [359], [362].
7 [1782] 3 Dougl KB [157].
8 Ibid [159],
TESTING THE RELIABILITY OF EXPERT EVIDENCE IN INTERNATIONAL ARBITRATION 171
15 Harry Woolf, 'Access to Justice', Final Report to the Lord Chancellor on the Civil Justice
System in England and Wales (2006), Ch 13 para 2.
16 Kim Rosenberg, 'The Use of Experts in Resolving Disputes in Common Law Jurisdictions'
(2015) [7].
17 Ibid [10].
18 [2016] UKSC 6.
19 Ibid [44].
TESTING THE RELIABILITY OF EXPERT EVIDENCE IN INTERNATIONAL ARBITRATION 173
United States
Requirements for the admissibility of expert evidence are not uniform
across the US and are governed by one of the following two standards: the
Frye general admissibility formulated in Frye v United States28 and the Daubert
tests. Federal courts exclusively follow Daubertwhile state courts are split
between both standards, some even applying a combination of both.
Until the early 20th century, there were no particular requirements
regarding the admission of expert witness testimony, discretion being left
entirely to the courts. 29 The 1923 landmark case of Frye v United States30
would set the standard used throughout the US for the following seven
decades until the 1993 Daubertruling.
In the 1923 case, counsel for the defendant appealed an earlier conviction
of second-degree murder on the grounds of expert testimony which had
been, in their opinion, wrongfully excluded. The evidence in question was
a systolic blood pressure deception test developed by Dr William Moulton
Marston, a Harvard graduate in both psychology and law and early pioneer
in the nascent field of applied psychology. 31 The trial judge refused the
admission of the lie detector test as evidence on the basis that the science
had not yet become a 'matter of common knowledge'.32 One year later,
the trial court's conviction, and most importantly its decision to exclude
the expert evidence, was affirmed by the DC Circuit on appeal in a tersely-
worded two-page judgment:
'Just when a scientific principle or discovery crosses the line between the
experimental and demonstrable stages is difficult to define. Somewhere in
this twilight zone the evidential force of the principle must be recognized,
and while courts will go a long way in admitting expert testimony deduced
from a well-recognized scientific principle or discovery, the thing from
which the deduction is made must be sufficiently established to have
gained general acceptance in the particular field in which it belongs.' 33
It is worth noting thatJustice McCoy's refusal to admit the lie detector test may
have had less to do with its lack of common acceptance than with its perceived
flawed scientific methodology.34 Methodology as a factor of reliability would
be taken up by the Daubert ruling 70 years later. Nevertheless, the Frye test
is today known for its simple two-step admissibility review process; the court
first identifies the scientific field of the testimony and then decides whether
the scientific principle presented is generally accepted in that field. The Frye
29 Janusz Puzniak, 'Expert Evidence: The Road from Daubert to Joiner and Kumho Tire'
(2000) 37(3) Court Rev 32, 32.
30 293 F 1013 (DC Cir 1923).
31 Kenneth J Weiss, Clarence Watson and Yan Xuan, 'Frye's Backstory: A Tale of Murder,
a Retracted Confession, and Scientific Hubris' (2014) 42J Am Acad Psychiatry Law 226,
227.
32 Jill Lepore, 'On Evidence: Proving Frye as a Matter of Law, Science, and History' (2015)
124(4) Yale LJ 1092, 1129.
33 Frye (n 30) 1.
34 Lepore (n 32) 1136.
TESTING THE RELIABILITY OF EXPERT EVIDENCE IN INTERNATIONAL ARBITRATION 175
test's advantage is its relative simplicity and the uniformity of the results it
produces; it has, however, been criticised for setting a threshold that is too
high and that would disqualify otherwise sound evidence if the conclusions
drawn are relatively novel in the given field. 5 While Dr Marston's name is not
mentioned in the landmark ruling, he did in the end manage to cement his
legacy by popularising his polygraph in fiction: the 'lasso of truth' held by the
comic book character he later created, Wonder Woman.3 6
The next chapter in the history of the admissibility of expert evidence
in the US will be written in 1975 with the enactment by Congress of the
Federal Rules of Evidence (FRE). The FRE were designed to assist federal
judges in evidentiary matters such as the admissibility of expert testimony;
they failed, however, to clarify whether the Frye test had survived the new
rules. The FRE favour an approach grounded in the admission of evidence
rather than its exclusion, and one which affords judges wide latitude in
7
commenting on the received evidence:
'We could see that allows discretion to be exercised by ajudge is preferable
to hardening a rule of evidence, to etching it in granite. We have always
operated, Mr. Chairman, to afford the US district judges wise discretion
with respect to the admission or exclusion of evidence.'3
Article VII of the FRE deals directly with the admissibility of expert evidence.
Rule 702 of the FRE establishes the three-pronged admission requirement
discussed earlier in the CPR of skill, relevance, and reliability. It does not,
in contrast, require the independence of the expert:
'A witness who is qualified as an expert by knowledge, skill, experience,
training, or education may testify in the form of an opinion or otherwise if:
(a) the expert's scientific, technical, or other specialized knowledge
will help the trier of fact to understand the evidence or to determine
a fact in issue; [Skill]
(b) the testimony is based on sufficient facts or data; [Reliability]
(c) the testimony is the product of reliable principles and methods;
and [Reliability]
(d) the expert has reliably applied the principles and methods to the
facts of the case [Relevance].'>9
Rule 704 allows the expert to opine on the 'ultimate issue' that is to be
35 Puzniak (n 29) 33.
36 Weiss (n 31) 231.
37 Jon R Waltz, 'The New Federal Rules of Evidence: An Overview' (1975) 52(2) Chi-Kent L
Rev 346, 349.
38 Hearings on the Federal Rules of Evidence, 93rd Congress (US Government Printing
Office, 1974), 206.
39 Federal Rules of Evidence, Rule 702, (2021).
176 DISPUTE RESOLUTION INTERNATIONAL Vol 16 No 2 October 2022
decided by the court. Finally, Rule 706 allows the court to appoint their own
experts. This provision is justified by its effect on partisan witnesses, who
may become more circumspect in their opinions if the possibility, however
infrequent, of a court-appointed expert exists.40
The relationship of the FRE to the Frye standard was not clarified until
the 1993 US Supreme Court ruling in Daubertv Merrell Dow Pharmaceuticals
Inc.4 i The ruling held that the Frye general acceptance standard had been
supplanted by Rule 702 and outlined a non-exhaustive list of criteria
determining admissibility. These guidelines have been adopted by US
Federal Courts as well as some state courts and are today referred to as the
Daubert standard of admissibility.
The Supreme Court opinion explicitly cites Rule 702 to exclude the concept
of 'general acceptance' as a requirement for admissibility, affirming that the
two criteria of relevance and reliability supersede the Frye standard in federal
trials.42 The Court confirms the flexible approach envisioned by the FRE as
well as the trial judge's role as a gatekeeper and further directs district courts
to consider the following factors in evaluating reliability of expert evidence:
1. the theory is falsifiable;
2. the evidence has been published and subjected to peer review;
3. the evidence has a known potential error rate; and
4. the underlying methodology is generally accepted in the field (a
remnant of the Frye test)
.
France
While differences arise within the distinct national laws, general evidentiary
concepts across the civil law world are comparable. The civil law judge,
unlike his common law counterpart, is an active investigator and factfinder,
a fundamental difference which affects all other issues in the proceedings,
including evidentiary matters.48 Expert witnesses in France and in the
wider civil law tradition are appointed directly by judges when particular
knowledge is required. 49 This fulfills the requirement of independence
shared with the CPR, without having to engage the question of how experts
can be wholly independent from the parties who engage them. A duty
0
of impartiality is furthermore codified in procedural law and subject to
51
the penalty of recusal. There has been some debate in France around
the question of whether private extra-judicial expertise work, typically on
behalf of insurers, compromises the impartiality required to serve as an
independentjudicial expert.52 In 2008, the Cour de Cassation ruled that both
engagements are not, in fact, automatically incompatible. 53 Nevertheless,
some courts have been reticent to accept individuals who do regular private
expertise work onto their judicial lists, while others have instead opted to
include a voluntary disclosure section onto their application forms. 54
The criterion of skill is codified by the selection of experts based on their
qualification. 55 Though French courts are by no means limited to doing
so, 56 they will often select their expert from lists of pre-qualified individuals.
In France, two lists are in place: a single national list administered by
the office of the Cour de Cassation and multiple lists administered by
the respective lower courts of appeal.5 7 Experts are initially added to the
appeals courts' lists for a probationary period of three years, which may
be renewed for another five years. 58 Higher standards are required to be
admitted on the national list, such as one's inscription on a lower list for
Arbitration
Arbitration rules
In alignment with the principles of party autonomy and the desire to
cross jurisdictional lines, the requirements for the admissibility of party-
appointed expert evidence in international arbitration rules generally make
no reference to any rules of evidence and leave all discretion entirely to the
tribunal. The UN Commission on International Trade Law (UNCITRAL)
model rules illustrate this principle:
'The arbitral tribunal shall determine the admissibility, relevance,
materiality and weight of the evidence offered.' 64
The model rules include provisions for both party and tribunal-appointed
experts aswell the parties' right to object to any chosen expert's qualifications,
impartiality or independence.6 5 Similar admissibility provisions apply across
arbitration rules with only minor variances, such as the LCIA rules' explicit
59 Ibid.
60 D no 2004-1463, JUSC0420950D, Art 2.
61 C pr civ, s 263.
62 C pr civ, s 265.
63 Joseph Richani, 'Les Preuves dans l'arbitrage international' (Universit6 de Cergy
Pontoise, 2013), [575].
64 UNCITRAL Arbitration Rules ('UNCITRAL') (2013), Art 27(4).
65 Ibid Art 29.
TESTING THE RELIABILITY OF EXPERT EVIDENCE IN INTERNATIONAL ARBITRATION 179
73
presume that the valuation tool was used to confirm an a priori conclusion.
The tribunal agreed that the DCF model had been influenced by a biased
outlook.74 The other valuation methods were also not deemed to be suitable
independent bases,75 barring the comparable companies method which
eventually became the starting point for the tribunal's assessment.7 6
Compare the Yukos case to that of Kipperman v Onex Corp," held in a
Georgia federal court and where the admissibility of none other than a DCF
valuation was challenged. The district court judge in this case held that
while the DCF was a widely-used and accepted model, 78 the expert's lack of
transparency and unjustified assumptions had rendered the methodology
in this case unreliable. 79 It therefore did not meet the standards of Rule
702, that is, the Daubert test, and was deemed inadmissible. 80
It is a feature of international arbitration that there is essentially no
system for the early dismissal of 'junkscience'; current rules and guidelines
focus on the experts' independence, with very little being said regarding
the quality of the testimony, which should in principle be the basis of
credibility.81 It is up to the opposing party to discredit the expert through,
for example, cross-examination or for the arbitrators to assign weight to the
evidence in their award. Combined with procedural mechanisms such as
joint expert statements, where opposing witnesses are invited pre-hearing
to draft a statement outlining their agreements and divergences, or witness
conferencing, where opposing experts are questioned simultaneously, this
is likely to be adequate for most arbitrations. In some cases, it may however
be more efficient for the tribunal to make an objective evaluation of the
reliability of the expert evidence before the testimony is considered. 82 A
defined framework for this evaluation that is agreed with the parties, such
as a modified form of Rule 702 /Daubert test, would moreover empower
tribunals to exclude evidence without the fear of due process challenges.
The additional time required in pre-arbitral admissibility hearings would
likely be too onerous for most arbitrations but could be a sensible option
on larger cases.
73 Ibid [1745].
74 Ibid [1785].
75 Ibid [1786].
76 Ibid [1787].
77 411 BR 805 (2009).
78 Ibid s II.A.3.iii (c) para 1.
79 Ibid s II.A.3.iii (c) para 10.
80 Ibid.
81 Hodgson (n 14) 458.
82 Ibid.
TESTING THE RELIABILITY OF EXPERT EVIDENCE IN INTERNATIONAL ARBITRATION 181
Arbitration institutions
There is generally very little guidance to be found directly with arbitration
institutions besides the International Chamber of Commerce (ICC),
which stands out from others by offering services directly aimed at the
procurement and management of expert witnesses. A party or the tribunal
may turn to the ICC's Expert Witness Centre to propose the name of one
or more experts active in the chosen field. Any proposal is contingent upon
the expert signing a statement of independence and neutrality in the eyes of
the party requesting the expert; 83 it does not, however, automatically address
the credibility of the expert in the eyes of the tribunal. Once the expert has
been proposed, the terms of engagement are negotiated directly between
the party and the expert without involvement of the ICC. Unless otherwise
agreed, the statement of independence is therefore limited to conflicts of
interest between both parties, not to the proceedings themselves. 84
If, on the other hand, the ICC is retained to administer the expert
proceedings, then the expert must remain impartial and independent during
the proceedings pursuant to the ICC's Expert Rules, unless the parties agree
otherwise. 85 The rules also grant the ICC the power to replace an expert if a
credible claim against his impartiality is made by one of the parties. 86
83 ICC Rules for the Proposal of Experts and Neutrals ('ICC Expert Proposal Rules') (2015),
Art 2, para 3.
84 Mark Kantor, 'A Code of Conduct for Party-Appointed Experts in International
Arbitration - Can One be Found?' (2010) 26(3) Arb Intl 323, 373-374.
85 ICC Rules for the Administration of Expert Proceedings, ('ICC Expert Administration
Rules') (2015), Art 4, para 1.
86 Ibid Art 4, para 5.
182 DISPUTE RESOLUTION INTERNATIONAL Vol 16 No 2 October 2022
Censure by professionalassociations
Since theynecessarily start as complaints against members for their testimony,
policing efforts by professional associations are inherently retrospective
devices. A complaint filed against a member with their professional
association over their conduct in arbitration proceedings would have to be
much more limited in fact unless the parties to the arbitration were to waive
confidentiality. Nevertheless, the ability to hold professionals accountable
to the ethical standards of their associations, however unlikely, is essential
in ensuring the effectiveness of association oversight.
While courts generally avoid interfering in the administrative matters
of associations, the effectiveness of professional sanctioning nonetheless
depends on a successful relationship with the local legal environment; that
is, whether punitive action by professional associations for expert witness
work is tolerated in the first place. In the US, the limits of this relationship
were tested in 2001 by Austin v American Association of Neurological Surgeons
(AANS). 91 Neurosurgeon Donald Austin was suspended for six months
by the AANS, a voluntary medical organisation, for testimony deemed
87 Kantor (n 84) 324.
88 AANS Code of Ethics (2016), available atwww.aans.org.
89 B Sonny Bal, 'The Expert Witness in Medical Malpractice Litigation' (2009) 467(2)
Clinical Orthopaedics and Related Research 383, 385.
90 Paul S Appelbaum, 'Policing Expert Testimony: The Role of Professional Organizations'
(2002) 53(4) Law & Psychiatry 389, 390.
91 F3d 967 (7th Cir 2001).
TESTING THE RELIABILITY OF EXPERT EVIDENCE IN INTERNATIONAL ARBITRATION 183
registered after 1 January 2020.100 This was done in the interest of greater
transparency and without harming the privacy of arbitration by allowing
parties to opt-out of the disclosure. A similar system disclosing the names
of experts could conceivably be useful in offering some form of database
for pre-qualified, or at least tested, experts operating in international
arbitration. Once the experts are identified, the second issue, that of the
evaluation of expert witnesses' performance, could be tackled through
ongoing efforts to increase transparency in international arbitration. One
such initiative is the UNCITRAL Rules on Transparency in Treaty-based
Investor-State Arbitration (the 'Mauritius Convention'), which entered
into force on 18 October 2017, and provides public access to information
regarding treaty-based investor-state arbitration proceedings. 10 1
Another
is the recent partnership between the ICC and Jus Mundis, a Paris-based
legal tech start-up, to create a comprehensive search engine for all
publishable ICC awards.102 While the awards are anonymised to ensure no
personal data is published, neither the details of the arbitrators nor those
of the parties' counsel are redacted.
Increased transparency could likewise tie into a proposal by Howard
Rosen that arbitrators explicitly report in their awards on the role played
by experts and the helpfulness of their conduct. 1 3 Of course, such a
requirement to 'grade' experts is only meaningful if it is published for
prospective clients to see. Tracking arbitrators' review of experts' conduct,
particularly any instances of censure, in voluntary databases managed by
arbitral institutions would allow for such a feedback loop to be created
without compromising the privacy of arbitration. The success of such
initiatives is however reliant on the existence of a large enough pool of
willing participants. At the time of writing, the Mauritius Convention has
only been ratified by nine member states.104 Similarly and as of 1 April 2021,
ICC awards made in the first quarter of 2019 that would be eligible for
publication are all either confidential or subject to an objection by a party. 105
100ICC Note to Parties and Arbitral Tribunals on the Conduct of the Arbitration under the
ICC Rules of Arbitration, (2021) s IV(B).
101 United Nations Convention on Transparency in Treaty-based Investor-State Arbitration (New
York, 2014) (the 'Mauritius Convention on Transparency') (UNCITRAL) https://uncitral.
un.org/en/texts/arbitration/conventions/transparency [accessed 22 August 2022].
102 'ICC andJus Mundi launch partnership to publish ICC arbitral awards' (ICC, 1 April 2021),
https://iccwbo.org/media-wall/news-speeches/icc-and-jus-mundi-launch-partnership-to-
publish-icc-arbitral-awards/ [accessed 22 August 2022].
103 Rosen (n 97) 6.
104Status: United Nations Convention on Transparency in Treaty-based Investor-State
Arbitration (New York, 2014) (UNCITRAL) https://uncitral.un.org/en/texts/
arbitration/conventions/transparency/status [accessed 22 August 2022].
105ICC online (n 101).
186 DISPUTE RESOLUTION INTERNATIONAL Vol 16 No 2 October 2022
Judging from the publicity garnered by Drs Austin and Meadow, it is easy
to understand how reputational damage can act as a strong motivator for
professionals acting as expert witnesses. Yet one of arbitration's primary
appeals means that tribunals can currently make little use of this powerful
dissuasion tool.