Professional Documents
Culture Documents
by Herbert L. Anderson
I
n 1942 Nick Metropolis was work- using the Monte Carlo method (so named In September 1985 more than one hun-
ing with Edward Teller on the reac- by Metropolis) on the new computers. dred researchers from around the world
tor project at the University of Chi- The Monte Carlo method is an applica- met in Los Alamos for a four-day con-
cago when J. Robert Oppenheimer tion of the laws ofprobability and statistics ference, in honor ofNick Metropolis, on the
invited the young physicist to continue his to the natural sciences. The essence of the frontiers of quantum Monte Carlo. One of
collaboration with Teller, but at Los Ala- method is to use various distributions of the speakers was Herb Anderson, from the
mos. There Metropolis joined the Manhat- random numbers, each distribution reflect- Laboratory's Physics Division. Anderson 3
tan Project as a member of the Theoretical ing a particular process in a sequence of presentation was a fascinating remi-
Division, having been encouraged by Teller processes such as the diffusion of neutrons niscence about thefirst modern calculating
to move from experimental to theoretical in various materials, to calculate samples machines and the scientists who used
physics. His first assignment was to de- that approximate the real diffusion history. them, about the intellectualferment in the
velop equations of state for materials at Statistical sampling had been known for physics community that began early in this
high temperatures, pressures, and densi- some time, but without computers theproc- century and still continues, and about Nick
ties. ess of making the calculations was so la- Metropolis and the MANIAC. This article
Over the years Metropolis turned in- borious that the method was seldom used is adaptedfrom Anderson 3 presentation.
creasingly to mathematics and computer unless the need was compelling. The com-
design, and by 1948 he was leader of a Los puter made the approach extremely useful
Alamos team that designed and built the for many physics problems.
MANIAC, one of thefirst electronic digital Metropolis was also involved in the de-
computers. Many of the country'sforemost velopment of an importance-sampling
scientists were eager to try their experi- scheme, called the Metropolis algorithm,
ments on the wonderful new machine and that improves the effectivenessof the Monte
came to the Laboratory to work with Carlo method. In the past twenty years his
Metropolis. A few years later, together with work has included nonlinear problems and
Teller, John von Neumann, Stanislaw combinatorial theory as well as Monte
Ulam, and Robert Richtmyer, Metropolis Carlo calculations. He was named a
developed techniques and algorithms for Senior Fellow of the Laboratory in 1980.
Metropolis
This story is about the MANIAC and the beginning of World War 11. Nick was name. I don't know whether he was the
about Nick Metropolis, who conceived the twenty-five years old. In those days we had very first, but the story comes from Emilio
MANIAC, built it, and saw how to use it no computers as we now know them. We SegrG, who told me that Fermi used that
for a wide variety of problems. In the used slide rules and adding ma- statistical sampling technique as early as
period just after World War 11, other com- chines-hand-operated machines. Ma- 1934, when he was working on neutron
puters were being built, many of them, like chines with electric motors were the excep- diffusion in Rome.
the MANIAC, modeled on the von Neu- tion rather than the rule. In 1933 Fredkric Joliot and Irene Curie
mann principle, the principle of the stored I remember particularly the hand-oper- had discovered the radioactivity induced
program. Von Neumann organized a ated machine that Fermi used with re- in light elements by bombardment with
group at the Institute for Advanced Study markable deftness. It was made by alpha particles. The neutron had been dis-
and started building a computer based on Brunsviga, a German firm in the town of covered just one year before. These two
that principle. Other institutions got into the same name, famous as the place where facts gave Fermi the idea that neutrons,
the act, too, because they all realized the Gauss was born. This machine had a crank having no charge at all, would be much
importance of building computers. There that you rotated by hand. To multiply, for more effective than alpha particles in
was one at Argonne called the AVIDAC example, you set the machine and then producing nuclear transformations. They
and one at Oak Ridge called the ORACLE. rotated the crank the number of times would not be repelled by the Coulomb
Then there were the SEAC at the National called for by each digit of the multiplier, barrier and could therefore penetrate the
Bureau of Standards and the ILLIAC at shifting the carriage for each successive nuclei of all atoms, whatever their charge,
the University of Illinois. But the digit and turning the crank again. Fermi whereas the alpha particles could only get
MANIAC at Los Alamos was special. had one of those machines when he was into the nuclei of light elements.
You see, the circumstances in postwar working in Rome and brought it along It was an exciting idea. He got a radon-
Los Alamos were special. The war had with him when he came to Columbia Uni- beryllium neutron source and began a
brought together there an exceptional versity in 1939. He was using it when I series of experiments with some of his
group of scientists, with whom Nick had started working with him on the chain young and enthusiastic collaborators:
established a close relationship. John von reaction, soon after his arrival. Whenever Amaldi, Segr6, Pontecorvo, d'Augostino,
Neumann, Enrico Fermi, Hans Bethe, Ed- I used my slide rule to make a calculation, and Rasetti. Early in the course of their
ward Teller, Stan Ulam, Dick Feynman, he started cranking his machine. By the work, they found they were getting some
George Gamow, Tony Turkevich, and time I announced my result, he was wait- very peculiar effects. The radioactivity
Robert Richtmyer, among others, were ing-and grinning. He could beat me they obtained depended a whole lot on
drawn to Nick because they enjoyed work- every time. But that situation changed where the irradiation was carried out. In
ing with him. When you went to Nick with when I got myself a Marchant. When it particular, the activity induced in silver
a problem, he took a deep interest in it and became clear that he couldn't even keep was much greater when they did the ir-
worked hard on it with you, invariably up with me, let alone beat me, he gave up radiation on a wooden table than when
making some essential contribution. It the Brunsviga and got a Marchant of his they did it on a table with a marble top.
was a treat to work with Nick, and, if you own. Ferrni could never resist the op- That was a great puzzle. They couldn't
understand that, you will understand a lot portunity to calculate faster. explain it. Then Fermi began to tell them
about how this story evolved. It seemed to me that Fermi was always that they didn't know how to experiment
Those who returned to Los Alamos calculating something. It was Fermi's view very well and that they didn't really do
after the war were drawn irresistibly to that Nature revealed itself through the things properly. Of course this didn't
Nick and his MANIAC, to what this won- experiments you devised to test it. You make them very happy. To clear up the
derful electronic computer could do for can construct a theory to explain what is puzzle, Fermi decided to try filtering the
them. They went away enriched by their going on, but unless the numbers come out neutrons through various substances. His
new experience and rewarded by new right, you can't be sure the theory is right. first idea was to use lead, but then at the
scientific results in their fields of interest. So you have to do a lot of calculations. last minute, for no apparent reason, he
This is a happy tale of how one of the first substituted paraffin instead. The increase
of the modem computers got its start and Fermi Monte Carlo in the activity of the silver was
what it was able to do in its early years. phenomenal. Everyone went home mys-
You might be interested to know that tified.
Fermi's Brunsviga Fermi was one of the first to use the Monte Now, one of Fermi's characteristicswas
Carlo method-in a rather simple form that he liked to come into the lab early in
Let's go back about forty-five years to and hand-calculated-long before it had a the morning and surprise his colleagues
The ENIAC
The great step forward in computing
was the introduction of electronics, and
now the ENIAC entered the scene. The
ENIAC was the first electronic, digital,
general-purpose, scientific computer. It
was designed and built for the Aberdeen
Proving Grounds by a group of engineers
under the direction of Pres Eckert and
John Mauchly. It had 18,000 vacuum Fig. I.Programming panels and cables of the ENIAC.
tubes and computed 1000 times as fast as
its closest electromechanical competitor. computer that would have a stored pro- learned that a new panel had been con-
The machine was built during wartime on gram. The ENIAC was programmed by structed to augment one of the logical
the promise that it would calculate connecting cables and wires and setting operations. It was a one-input, one-hun-
ballistic trajectories at least ten times switches on a huge plugboard that was dred-output matrix, and it occurred to
faster than the mechanical differential distributed over the entire machine. Fig- Nick that this matrix could be used in-
analyzers then in use. As things frequently ure 1 is a photograph showing young stead to interpret the instruction pairs in
turn out, the machine was now working as women programming the ENIAC by inter- the control mode proposed by Clippinger.
promised-but the war was over, and sud- connecting the electron tube registers with Such a panel would greatly simplifi the
denly no one cared that much about calcu- cables inserted in plugboards. It was an implementation of a background control.
lating ballistic trajectories. awkward and tedious way to tell the ma- He told von Neumann about it and was
The connecting link between the chine what to calculate and what to do encouraged to go ahead and try-and so
ENIAC and Los Alamos was Johnny von with the results. When von Neumann was he did. The scheme was implemented on
Neumann, who was a consultant both at in Los Alamos, in about 1947, he de- the ENIAC forthwith, and Nick's set of
the Aberdeen Proving Grounds and at the scribed a suggestion made by Richard problems-the first computerized Monte
Lab. He was tremendously excited about Clippinger of the Ballistic Research Labo- Car10 calculations-were run in the new
the ENIAC. He took a deep interest in its ratory on how the ENIAC might be con- mode.
design and thought a good deal about what verted to a limited stored-program mode.
could be done with it. When he came to The idea was to rearrange the so-called The MANIAC
Los Alamos early in 1945, he told Nick, hnction tables, normally used to store 300
Edward Teller, and Stan Frankel about twelve-decimal-digit numbers set by man- M e r the war Nick joined the faculty of
what the Eckert and Mauchly team was ual switches, to store up to 1800 two- the University of Chicago, to help set up a
doing. They were enchanted. You know decimal-digit numbers, each pair of major computing facility. When that
how things sometimes work out if you are numbers corresponding to an instruction. didn't materialize as quickly as he had
in the right place at the right time-and A particular problem would correspond to hoped, he began to think of other
prepared for the opportunity. Well, von a sequence of such instructions. This se- possibilities, and about that time he got a
Neumann suggested that perhaps Los Ala- quence would be set on the function call fiom Carson Mark, head of the Theo-
mos had a problem that could be worked tables. A background control would inter- retical Division at Los Alamos, suggesting
out on the ENIAC and invited Nick and rogate these instructions sequentially, that he set up a computing facility here.
Stan to try the new machine. It was a great including so-called loops of instructions. Nick was ready, willing, and able. The
opportunity, and they seized it eagerly. Changing fiom one problem to another moral of my story is that fortune favors
And so it turned out that the first serious would be achieved by resetting the the prepared mind. Nick was right there,
problem the ENIAC solved was the one switches of the function tables to cor- well prepared to do just what he was asked
Metropolis and Frankel put to it regarding respond to the new sequence of instruc- to do, and that's how the MANIAC was
the "super," the thermonuclear bomb. tions. Figure 2 shows the fimction tables of born.
By this time the idea of the stored pro- the ENIAC. The Mathematical and Numerical Inte-
gram had already been conceived, prin- This suggestion made a deep im- grator and Computer-the MANIAC-
cipally by John von Neumann and his pression on Nick, but there was a missing was designed according to von Neumann's
collaborators on the ENIAC. They had element-the background control. On a principles, which had been set forth in a
already begun to design the EDVAC, a visit to the ENIAC in early 1948, Nick remarkable publication by Arthur Burks,
Herman Goldstine, and Johnny von Neu- language and compiler. This was a critical Nick must have been pleased by the
mann. The MANIAC borrowed heavily developmentbecause it provided a conve- praise and interest shown by so many of
fiom the IAS, the computer being built at nient way to communicate with the the illustrious scientists he had worked
the Institute for Advanced Study under MANIAC. with in wartime Las Alamos, but the
von Neumann's direction. But because the supreme accolade came from Enrico
MANIAC came later, Nick was able to Fermi and Metropolis Fermi. When you build something, what
avoid many pitfalls that delayed the MS. could be more satisfiing than to have one
As I have mentioned, many computers Enrico Fermi had been at Los Alamos of the world's greatest physicists tell you
were built in this outburst of activity afier during the war and liked it so much that he not only that it's a great machine but that
the end of the war. The ENIAC had started claimed he would not have left if only the he wants to use it. Moreover, Fermi had a
a revolution that continues to this day, Lab were a university. Since it wasn't a problem that was ideally suited to the
with no end yet in sight. But the unusual university, he made the best possible com- machine. He wanted to analyze the pion-
success of the MANIAC was due primarily promise by accepting a position at the proton s c a t t e ~ experiments
g he had been
to the personality and motivation of Nick University of Chicago and spending his carrying on in Chicago with his col-
Metropolis and to the group of highly summers at Los Alamos. laborators at the new 450-MeV synchro-
capable engineers and programmers he as- When he came to Los Alamos in the cyclotron.
sembled at Los Alamos to help him build summer of 1952, the MANIAC was up My connection with this story is
the machine and make it run. The original and running, and it would have been very analogousto Nick's except that in this case
engineers were Dick Merwin, Howard hard to keep Enrico from that machine. I had built the cyclotron. I also helped
Parsons, Jim Richardson, Bud Demuth, He though the MANIAC was just wonder- build the apparatus and carry out the
Walter Qrvedahl, and Ed Klein. The im- hl. He could hardly wait to get his hands measurements. The other collaborators
portance of programming aids was rec- on it. I've told you how he loved to calcu- were Darragh Nagle and Earl Long, on the
ognized early on. About 1953 John Jack- late, the faster the better, and here was his faculty, and my graduate students, Ronald
son led a study of assembly languages, and good fi-iend Nick Metropolis with the Martin, Gaurang Yodh, and Maurice
an assembler was produced. Mark Wells fastest machine in the world, offering to Glicksman.
and others launched the development of introduce him to its mysteries and let him The results of our pion-proton scatter-
the MADCAP9a high-level programming run it himself ing experiments had been as striking as
they were surprising. The large scattering
cross section at a specific energy indicated
the presence of a resonance.It was a major
discovery, an excited state of the proton.
We had uncovered a new particle now
known as the delta, and it attracted the
attention of the entire high-energy physics
community. In order to extract the ap-
propriate quantum numbers of the delta,
Fermi wanted to do what he called phase-
shift analysis, which tells you which quan-
tum states have the biggest scattering
amplitudes and which have the smallest.
I should mention that Fermi had a
knack of coming up with problems whose
computation matched the means avail-
able. Some years before, when the
punched-card machines were the principal
means for computing, Fermi posed the
problem of calculating a table of atomic
masses using a semiempirical mass for-
mula he had devised on the von
Wehacker model. Nick organized the cal-
Fig. 2. Function tables of the ENIAC- culation and the preparation of the tables.
to the problem. By using graphical meth- Two-dimensional hydrodynamics (Metropolis, von Neumann; 1954)
ods with simplified but plausible assump-
tions, they came up with the resonant Universalities of iterative functions (Metropolis, Stein, Stein; 1973)
solution that turned out to be the correct
Nuclear cascades using Monte Carlo (Metropolis, Turkevich; 1954)
one. It was a lesson in the use of computers
that should be a caution to us all. Anti-clerical chess (Wells; 1956)
Finally, I must mention some interest- Death of MANIAC from Chicago, but by this time the com-
ing work in number theory in which Stan puting needs of the Laboratory had in-
Ulam and others introduced the notion of Before closing, let me make clear how creased dramatically and were being sup-
"lucky numbers," a generalization of the the MANIAC evolved over the years. plied by commercial machines. Unfor-
ordinary prime numbers with many MANIAC I1 succeeded MANIAC I in Los tunately, in this climate the decision was
similar properties. That was an attractive Alamos in 1956. The second MANIAC eventually made to abandon the kind of
piece of work. was more powerful than the first and, be- original research that was special to the
This list of ten is just a small sample of cause it included floating-point arithme- computer project, and in 1977 MANIAC
the many scientific uses of the MANIAC, tic, was easier to use. MANIAC 111, with 11was turned off.
and it includes only the most prominent the latest in solid-state circuitry, was de- To conclude this story on a happier
names associated with Nick on those proj- veloped at the University of Chicago when note, I remind you that it's Nick's birth-
ects. These I think were the most impor- Nick returned there to head the newly day. I've always had the idea that when
tant works-or at any rate the most inter- formed Institute for Computer Research. there is a birthday there ought to be a
esting. In 1965 Nick returned to Los Alamos poem. Here is my own modest offering.
Further Reading
Metropolis, N., Howlett, J., and Rota, Gian-Carlo, eds. 1980. History of Computing in the Twentieth
Century. New York:Academic Press.
Burks, Arthur W.,Goldstine, Herman H., and von Neumann, John. 1946. Preliminary Discussion of
the Logical Design of an Electronic Computing Instrument. Princet0n:Institute for Advanced Study.
Seg6, E., ed. 1965. The Collected Works ofEnrico Fermi. Chicago:The University of Chicago Press.
Metropolis, Nicholas, Rosenbluth, Arianna W., Rosenbluth, Marshall N., Teller, Augusta H., and
Teller, Edward. 1953. "Equation of State Calculations by Fast Computing Machines." Journal of
Chemical Physics 2 1 : 1087.
Metropolis, Nicholas, and Ulam, S. 1949. "The Monte Carlo Method." Journal of the American
Statistical Association 44335.