2008 Galois, Inc. All rights reserved.
 
Modern Benchmarking
Don Stewart
|
Galois Tech Talk
|
Feb 2010
 
2008 Galois, Inc. All rights reserved.
Measuring Performance
•Easy, right?
 –Time the computation –Record the time –Compare it against other programs
•Too many variables
 –Noise on the machine... –(See Matt S. talk on eliminating noise)
•Need a statistically sound approach
 
2008 Galois, Inc. All rights reserved.
Making it easy
•A good benchmarking lib should
 –Make it easy to code up benchmarks –Plot / print it in a variety of formats –Tell you when you're doing it wrong
Compared to most other benchmarking frameworks (for any programming language,not just Haskell), criterion focuses on being easy to use, informative, and robust.
View on Scribd
Back to document