Skip to main content

An Introduction to Optimization, 3rd Edition

An Introduction to Optimization, 3rd Edition

Edwin K. P. Chong, Stanislaw H. Zak

ISBN: 978-1-118-21160-1

Sep 2011

608 pages



Praise from the Second Edition

" excellent introduction to optimization theory..." (Journal of Mathematical Psychology, 2002)

"A textbook for a one-semester course on optimization theory and methods at the senior undergraduate or beginning graduate level." (SciTech Book News, Vol. 26, No. 2, June 2002)

Explore the latest applications of optimization theory and methods

Optimization is central to any problem involving decision making in many disciplines, such as engineering, mathematics, statistics, economics, and computer science. Now, more than ever, it is increasingly vital to have a firm grasp of the topic due to the rapid progress in computer technology, including the development and availability of user-friendly software, high-speed and parallel processors, and networks. Fully updated to reflect modern developments in the field, An Introduction to Optimization, Third Edition fills the need for an accessible, yet rigorous, introduction to optimization theory and methods.

The book begins with a review of basic definitions and notations and also provides the related fundamental background of linear algebra, geometry, and calculus. With this foundation, the authors explore the essential topics of unconstrained optimization problems, linear programming problems, and nonlinear constrained optimization. An optimization perspective on global search methods is featured and includes discussions on genetic algorithms, particle swarm optimization, and the simulated annealing algorithm. In addition, the book includes an elementary introduction to artificial neural networks, convex optimization, and multi-objective optimization, all of which are of tremendous interest to students, researchers, and practitioners.

Additional features of the Third Edition include:

  • New discussions of semidefinite programming and Lagrangian algorithms

  • A new chapter on global search methods

  • A new chapter on multipleobjective optimization

  • New and modified examples and exercises in each chapter as well as an updated bibliography containing new references

  • An updated Instructor's Manual with fully worked-out solutions to the exercises

Numerous diagrams and figures found throughout the text complement the written presentation of key concepts, and each chapter is followed by MATLAB exercises and drill problems that reinforce the discussed theory and algorithms. With innovative coverage and a straightforward approach, An Introduction to Optimization, Third Edition is an excellent book for courses in optimization theory and methods at the upper-undergraduate and graduate levels. It also serves as a useful, self-contained reference for researchers and professionals in a wide array of fields.


Part I: Mathematical Review.

1. Methods of Proof and Some Notation.

2. Vector Spaces and Matrices.

3. Transformations.

4. Concepts from geometry.

5. Elements of Calculus.

Part II: Unconstrained Optimization.

6. Basics of Set-Constrained and Unconstrained Optimization.

7. One-Dimensional Search Methods.

8. Gradient Methods.

9. Newton's Method.

10. Conjugate Direction Methods.

11. Quasi-Newton Methods.

12. Solving Linear Equations.

13. Unconstrained Optimization and Neural Networks.

14. Global Search Algorithms.

Part III: Linear Programming.

15. Introduction to Linear Programming.

16. Simplex Method.

17. Duality.

18. Nonsimplex Methods.

Part IV: Nonlinear Constrained Optimization

19. Problems with Equality Constraints.

20. Problems with Inequality Constraints.

21. Convex Optimization Problems.

22. Algorithms for Constrained Optimization.

23. Multiobjective Optimization.



  • Major topics, including the Nelder-Mead algorithm and the simulated annealing algorithm, have been added to the new edition.
  • A new chapter on multi-objective optimization discusses problems with multiple-objective functions and how they are treated; Pareto solutions; and algorithms for multi-objective problems, i.e., genetic algorithms.
  • Additional, class-tested exercises are included in almost every chapter and some examples use  MATLAB.
  • The bibliography includes new references.
  • The Instructor's Manual has been updated to include fully worked-out solutions to each of the new exercises.
"Examples are stated very clearly and the results are presented with attention to detail." (MAA Reviews, 2008)
  • This book provides an up-to-date, accessible introduction to optimization theory and methods with an emphasis on engineering design
  • A review of the required mathematical background is provided.
  • The book reviews basic definitions, notations and relations from linear algebra, geometry and calculus, followed by unconstrained optimization problems.
  • Existing topics were modified to include improve to the organization of the book and to promote classroom discussion.