Page iii

Foundations of Neural Networks, Fuzzy Systems, andKnowledge Engineering

Nikola K. Kasabov

A Bradford Book The MIT PressCambridge, MassachusettsLondon, England

Page iv

Second printing, 1998© 1996 Massachusetts Institute of TechnologyAll rights reserved. No part of this book may be reproduced in any form by any electronic or mechanicalmeans (including photocopying, recording, or information storage and retrieval) without permission inwriting from the publisher.This book was set in Times Roman by Asco Trade Typesetting Ltd., Hong Kong and was printed andbound in the United States of America.Library of Congress Cataloging-in-Publication DataKasabov, Nikola K.Foundations of neural networks, fuzzy systems, and knowledgeengineering/ Nikola K. Kasabov.p. cm."A Bradford book."Includes bibliographical references and index.ISBN 0-262-11212-4 (hc: alk. paper)1. Expert systems (Computer science) 2. Neural networks (Computerscience) 3. Fuzzy systems. 4. Artificial intelligence. I. Title.QA76.76.E95K375 1996006.3—dc2095-50054CIP

Page v

To my mother and the memory of my father

and to my family

Diana

Kapka

and Assia

Page vii

Contents

Foreword by Shun-ichi AmarixiPrefacexiii1 The Faculty of Knowledge Engineering and Problem Solving11.1 Introduction to AI paradigms11.2 Heuristic problem solving; genetic algorithms31.3 Why expert systems, fuzzy systems, neural networks, and hybrid systemsfor knowledge engineering and problem solving?141.4 Generic and specific AI problems: Pattern recognition and classification191.5 Speech and language processing281.6 Prediction421.7 Planning, monitoring, diagnosis, and control491.8 Optimization, decision making, and games playing571.9 A general approach to knowledge engineering651.10 Problems and exercises681.11 Conclusion721.12 Suggested reading73