Professional Documents
Culture Documents
Adrian Thompson
Centre for Computational Neuroscience & Robotics, and Centre for the Study of Evolution,
School of Cognitive & Computing Sciences, University of Sussex, UK.
adrianth@cogs.susx.ac.uk
http://www.cogs.susx.ac.uk/users/adrianth/
Christoph Wasshuber
4106 Springhill Estates Drive, Parker, TX 75002.
wasshub@parallelcomputers.com
111
000
000
111
Output
111
000 111
000 111
000
-0.2 In1 C3
J7
-0.25 coupling load
model 111
000 111
000 111
000 111
000 C10 model
J8 J9 J10 C4
-0.3
C9 C5 C7
111
000
000
111 111
000
000
111 111
000
000
111 111
000
000
111
-0.35
1 10 100 1000 10000
Generations (logarithmic scale) In2 J13
C6
111
000
000
111
J11
111
000
000
111
J12
111
000
000
111 111
000
000
111
Figure 2. Evolution at 0K: Fitness of the best C12
C11
individual in the population.
11
00 111
000 111
000 111
000
0V 0V 0V 0V
were valid. In the case of resistances and capacitances, Figure 3. The circuit evolved at 0K, in the rep-
which both range over many orders of magnitude, the log resentation manipulated by the evolutionary
of the variable (and its range) was taken, the BGA muta- algorithm. The large dots are nodes, and the
tion applied, and then the antilog of the result became the ‘preferred output’ node is shown circled.
variable’s new value.
Starting from a population of identical copies of the best
circuit found through random search (Phase 0), the GA’s
The way forward is suggested by noticing that the loss
operation consisted of many iterations of the generational
of behaviour with increasing temperature seen in Fig. 6 is
cycle of fitness evaluations, selection of parents, offspring
gradual, although rapid.
formation, and replacement of all but the currently fittest in-
dividual by the new offspring. Fig. 2 shows how the fitness
rapidly increased at first, and then was slowly fine-tuned 2.3 Phase 2
over a much longer period.
The GA was stopped after 8000 generations, and the best Taking the final population of Phase 1, evolution was
individual at that time is shown in Figs. 3 and 4. The be- continued, still with only first-order tunnelling simulated.
haviour shown in Fig. 5 is very close to the ideal, but it is Whenever the fitness of the best individual reached a thresh-
also seen to be completely destroyed if we now enable the old of -0.25, the temperature was increased by 10mK. It
simulation of higher-order tunnelling events. If the temper- can be seen in Fig. 7 that although these small temperature
ature is increased (Fig. 6), the behaviour is completely lost increases usually caused some loss in fitness, the popula-
at only 30mK. tion had enough residual performance for the evolutionary
In a similar earlier experiment at zero temperature [20] process to work on, in adapting the individuals to the new
it was found that if evolution was continued from this point, conditions. The fact that co-tunnelling and increased tem-
but now with second-order tunnelling enabled, it took many perature both smear out the Coulomb blockade in a very
generations to regain the original fitness. If third-order tun- similar way further supports the soundness of this approach.
nelling was then enabled in the simulation, then again much Higher-order tunnel events are thus lumped into a larger ef-
more evolution was needed. Given that simulation of higher fective temperature.
order tunnelling is extremely computationally expensive, Due to time constraints, the temperature was held con-
the approach of gradually increasing the order of simulated stant once it reached 340mK, to allow a recognisable NOR-
tunnelling events, at zero temperature, does not appear fruit- gate to be formed. When the experiment was terminated,
ful. Attempts to conduct the experiment at a temperature the best circuit (Fig. 8) certainly would not work in a com-
of 500mK, even simulating only first order tunnelling, met putational circuit, but can be seen to be roughly approxi-
with total failure: no initial circuits could be found (either mating the target NOR response 5.
through random search, or by the GA) that were above base- The circuit has some interesting properties. Its response
line fitness. deteriorates only slightly if second-order tunnelling events
0
Fixed Values:
C8 3.333e-13 F -2e-05
C9 3.333e-13 F
C10 1.000e-12 F
Voltage (V)
-4e-05
Evolved Values:
C1 6.416e-19 F
C2 4.001e-19 F -6e-05
C3 5.387e-19 F
C4 4.645e-17 F
C5 9.597e-16 F -8e-05
C6 4.638e-18 F
C7 1.000e-13 F
J2 9.462e-16 F 2.756e+05 Ω -0.0001
J3 2.466e-16 F 3.114e+05 Ω 0 2e-07 4e-07 6e-07 8e-07 1e-06 1.2e-06
J5 8.867e-14 F 2.900e+08 Ω Time (s)
J7 9.861e-18 F 9.571e+08 Ω
J8 1.472e-15 F 2.668e+08 Ω
J10 3.946e-18 F 5.000e+04 Ω Figure 5. The input/output relationship of the
J11 4.000e-19 F 5.000e+04 Ω
J12 4.000e-19 F 5.024e+04 Ω
circuit evolved at 0K (see Fig. 4). The dark
J13 4.000e-19 F 8.902e+07 Ω solid line is the output considering only first
Vb -1.000e-04 V order tunnelling events, as used in the sim-
Vf alse -1.538e-05 V ulations to evaluate fitness during evolution.
Vtrue -9.923e-05 V
The gray solid line is the output when second-
order (or second and third-order) events are
Vb also simulated.
111
000
C1
J2
111
000
J3 C2 J5
C8
111
000 Output
000
111 111
000
In1 C3
J7
coupling load 0
model 111
000 C10 model
J8 C4 -0.1
J10
C9 C5 C7
111
000 111
000 111
000 -0.2
000
111 000
111 000
111
-0.3
In2
Fitness
-0.5
-0.6
111
000 -0.7
0V
-0.8
-0.2 0.7
-0.22 0.6
Temperature (K)
-0.24 0.5
Fitness
-0.26
0.4
-0.28
0.3
-0.3 Fixed Values:
0.2 C2 1.000e-12 F
-0.32 C8 3.333e-13 F
0.1 C9 3.333e-13 F
-0.34
0 Evolved Values:
8000 9000 10000 11000 12000 C1 4.858e-19 F
Generations (linear scale) C3 9.969e-14 F
C4 2.052e-16 F
C5 1.000e-13 F
Figure 7. Continued evolution, at increasing C6 3.393e-16 F
temperature. The solid upper line is best C7 2.975e-15 F
J1 4.000e-19 F 4.950e+06 Ω
fitness (left axis), and the lower dotted line J2 4.000e-19 F 5.766e+05 Ω
is temperature (right axis). The temperature J3 4.059e-19 F 9.024e+04 Ω
was increased by 10mK whenever the fitness J4 4.237e-19 F 5.854e+04 Ω
reached -0.25, then was held constant upon J5 3.632e-16 F 2.886e+07 Ω
J6 4.857e-19 F 5.000e+04 Ω
reaching 340mK. Vb -1.000e-04 V
Vf alse -8.368e-05 V
Vtrue -8.488e-06 V
-0.3
0
-1e-05 -0.35
-2e-05
-0.4
Fitness
-3e-05
Voltage (V)
-0.45
-4e-05
-5e-05 -0.5
-6e-05 -0.55
-7e-05
-0.6
-8e-05 0 100 200 300 400 500 600 700
Temperature (mK)
-9e-05
0 2e-07 4e-07 6e-07 8e-07 1e-06 1.2e-06
Time (s) Figure 10. The thermal response of the circuit
0
evolved for 340mK (see Fig. 8).
-1e-05
-2e-05
-4e-05
evolutionary techniques to navigate into intriguing unchar-
-5e-05 tered territories of design.
-6e-05 Some important issues were not part of this first study.
-7e-05
Perhaps the possibility of signal representation schemes
other than voltage levels would be fruitful (e.g. [15]), and
-8e-05
the issues surrounding the composition of evolved primi-
-9e-05 tives into larger systems are worth closer attention. We ig-
0 2e-07 4e-07 6e-07 8e-07 1e-06 1.2e-06
Time (s)
nored the effects of background charge and component tol-
erances, drift, and control, although parallel work has ad-
dressed the challenge of robustness in evolutionary micro-
Figure 9. The input/output relationship of electronics design [22].
the circuit evolved at 340mK (see Fig. 8). It may be that a better NOR gate was not obtained be-
Top: Simulation only of first-order tunnelling cause the fitness evaluations were quite noisy (visible in
events. Middle: Simulation including second- Fig. 7). In common with many of the future demands
order tunnelling. Bottom: Simulation includ- mentioned above, perhaps more computationally expensive
ing third-order tunnelling. fitness evaluations will be required. The set of experi-
ments reported here took about 3 weeks on a dual-processor
466MHz PC. The computational demands are not neces-
sarily terminal, as evolutionary algorithms parallelize very
well to loosely-coupled MIMD parallel machines, such as [11] K. K. Likharev and T. Claeson. Single electronics. Scientific
cost-effective Beowulf-style clusters [4]. American, 266(6):50–55, 1992.
Nanoelectronics design seeks to employ subtle physics [12] M. Sipper and D. Mange (Guest Editors). Special issue on
to do useful work. Natural evolution has done this in biol- biology to hardware and back. IEEE Trans. Evolutionary
Computation, 3(3), Sept. 1999.
ogy, and so can evolutionary algorithms in artificial media.
[13] J. Miller, A. Thompson, T. Fogarty, and P. Thomson, edi-
Our experiments tentatively suggest that evolutionary meth- tors. Proc. 3rd Int. Conf. on Evolvable Systems (ICES2000):
ods may be a useful exploratory tool into novel kinds of de- From Biology to Hardware, volume tba of LNCS. Springer-
sign that may help to make such new technologies viable. Verlag, 2000. In Press.
[14] H. Mühlenbein and D. Schlierkamp-Voosen. The science of
breeding and its application to the breeder genetic algorithm
Acknowledgements BGA. Evolutionary Computation, 1(4):335–360, 1994.
[15] R. W. Rendell. Adaptive control of single-electron circuit
Thompson’s work is funded by the EPSRC, with sup- signatures for computation. In M. Cahay, D. J. Lockwood,
port from Xilinx, British Telecommunications, Hewlett- J.-P. Leburton, and S. Bandyopadhyay, editors, Proc. of the
Packard, and Zetex. Personal thanks to Paul Layzell, Phil ECS 98-19 Quantum Confinement V: Nanostructures, pages
Husbands, Inman Harvey, Ricardo Salem Zebulum, Ron 574–581. Electrochemical Society, 1999.
Rendell and Mario Ancona for useful discussions and help. [16] R. W. Rendell and M. G. Ancona. Adaptive computation by
interacting quantum dots. Superlattices and microstructures,
20(4):479–491, 1996.
References [17] E. Sanchez and M. Tomassini, editors. Towards Evolvable
Hardware: The evolutionary engineering approach, volume
1062 of LNCS. Springer-Verlag, 1996.
[1] The Single-Electron Repository.
[18] M. Sipper, D. Mange, and A. Pérez-Uribe, editors. Proc. 2nd
http://home1.gte.net/kittypaw/
Int. Conf. on Evolvable Systems (ICES98), volume 1478 of
[2] M. G. Ancona. Design of computationally useful single-
LNCS. Springer-Verlag, 1998.
electron digital circuits. J. Appl. Phys, 79(1):526–539, 1996.
[19] A. Stoica, D. Keymeulen, and J. Lohn, editors. Proc. 1st
[3] J. E. Baker. Reducing bias and inefficiency in the selec-
NASA/DoD workshop on Evolvable Hardware. IEEE Com-
tion algorithm. In J. J. Grefenstette, editor, Genetic Algo- puter Society, 1999.
rithms and their Applications: Proc. 2nd Int. Conf. on Ge- [20] A. Thompson. Evolutionary design for novel technolo-
netic Algorithms (ICGA), pages 14–21. Lawrence Erlbaum gies. In IEE Colloquium on Evolutionary Hardware Sys-
Associates, 1987. tems, page 4/1, Savoy Place, London, June 1999.
[4] F. H. Bennett III, J. R. Koza, J. Shipman, and O. Stiffelman. [21] A. Thompson and P. Layzell. Analysis of unconventional
Building a parallel computer system for $18,000 that per- evolved electronics. Communications of the ACM, 42(4):71–
forms a half-petaflop per day. In W. Banzhaf, J. Daida, A. E. 79, Apr. 1999.
Eiben, et al., editors, Proc. Genetic and Evolutionary Com- [22] A. Thompson and P. Layzell. Evolution of robustness in an
putation conference (GECCO-99), pages 1484–1490. Mor- electronics design. In J. Miller, A. Thompson, T. Fogarty,
gan Kaufmann, 1999. and P. Thomson, editors, Proc. 3rd Int. Conf. on Evolvable
[5] R. Chen, A. Korotkov, and K. Likharev. Single-electron Systems: From biology to hardware (ICES2000), volume tba
transistor logic. Appl. Phys. Lett., 68(14):1954–1956, 1996. of LNCS. Springer-Verlag, 2000. In press.
[6] D. E. Goldberg. Genetic Algorithms in Search, Optimization [23] A. Thompson, P. Layzell, and R. S. Zebulum. Explorations
& Machine Learning. Addison Wesley, 1989. in design space: Unconventional electronics design through
[7] T. Higuchi, M. Iwata, and L. Weixin, editors. Proc. 1st Int. artificial evolution. IEEE Trans. Evol. Comp., 3(3):167–196,
Conf. on Evolvable Systems: From Biology to Hardware, 1999.
volume 1259 of LNCS. Springer-Verlag, 1997. [24] C. Wasshuber. About Single-Electron Devices and Circuits.
[8] G. Klimeck, C. H. Salazar-Lazaro, A. Stoica, and T. Cwik. PhD thesis, Technical University of Wien, Österreichischer
“genetically engineered” nanoelectronics. In A. Stoica, Kunst- und Kulturverlag, 1997.
D. Keymeulen, and J. Lohn, editors, Proc. 1st NASA/DoD [25] C. Wasshuber, H. Kosina, and S. Selberherr. SIMON –
Workshop on Evolvable Hardware, pages 247–248. IEEE a simulator for single-electron tunnel devices and circuits.
Computer Society, 1999. IEEE Transactions on Computer-Aided Design, 16:937–
[9] A. N. Korotkov, R. H. Chen, and K. K. Likharev. Pos- 944, Sept. 1997.
sible performance of capacitively-coupled single-electron [26] X. Yao (Guest Editor). Special section on evolvable hard-
transistors in digital circuits. Journal of Applied Physics, ware. Communications of the ACM, 42(4):47–79, Apr. 1999.
78(4):2520–2530, 1995.
[10] J. R. Koza, F. H. B. III, M. A. Keane, et al. Searching for
the impossible using genetic programming. In W. Banzhaf,
J. Daida, A. E. Eiben, et al., editors, Proc. Genetic and
Evolutionary Computation conference (GECCO-99), pages
1083–1091. Morgan Kaufmann, 1999.