Skip to main content

Data Mining Methods and Models

Data Mining Methods and Models

Daniel T. Larose

ISBN: 978-0-471-75648-4

Feb 2006

385 pages

Select type: Online Book


Apply powerful Data Mining Methods and Models to Leverage your Data for Actionable Results

Data Mining Methods and Models provides:
* The latest techniques for uncovering hidden nuggets of information
* The insight into how the data mining algorithms actually work
* The hands-on experience of performing data mining on large data sets

Data Mining Methods and Models:
* Applies a ""white box"" methodology, emphasizing an understanding of the model structures underlying the softwareWalks the reader through the various algorithms and provides examples of the operation of the algorithms on actual large data sets, including a detailed case study, ""Modeling Response to Direct-Mail Marketing""
* Tests the reader's level of understanding of the concepts and methodologies, with over 110 chapter exercises
* Demonstrates the Clementine data mining software suite, WEKA open source data mining software, SPSS statistical software, and Minitab statistical software
* Includes a companion Web site,, where the data sets used in the book may be downloaded, along with a comprehensive set of data mining resources. Faculty adopters of the book have access to an array of helpful resources, including solutions to all exercises, a PowerPoint(r) presentation of each chapter, sample data mining course projects and accompanying data sets, and multiple-choice chapter quizzes.

With its emphasis on learning by doing, this is an excellent textbook for students in business, computer science, and statistics, as well as a problem-solving reference for data analysts and professionals in the field.

An Instructor's Manual presenting detailed solutions to all the problems in the book is available onlne.

1. Dimension Reduction Methods.

Need for Dimension Reduction in Data Mining.

Principal Components Analysis.

Factor Analysis.

User-Defined Composites.

2. Regression Modeling.

Example of Simple Linear Regression.

Least-Squares Estimates.

Coefficient or Determination.

Correlation Coefficient.

The ANOVA Table.

Outliers, High Leverage Points, and Influential Observations.

The Regression Model.

Inference in Regression.

Verifying the Regression Assumptions.

An Example: The Baseball Data Set.

An Example: The California Data Set.

Transformations to Achieve Linearity.

3. Multiple Regression and Model Building.

An Example of Multiple Regression.

The Multiple Regression Model.

Inference in Multiple Regression.

Regression with Categorical Predictors.


Variable Selection Methods.

An Application of Variable Selection Methods.

Mallows’ C p Statistic.

Variable Selection Criteria.

Using the Principal Components as Predictors in Multiple Regression.

4. Logistic Regression.

A Simple Example of Logistic Regression.

Maximum Likelihood Estimation.

Interpreting Logistic Regression Output.

Inference: Are the Predictors Significant?

Interpreting the Logistic Regression Model.

Interpreting a Logistic Regression Model for a Dichotomous Predictor.

Interpreting a Logistic Regression Model for a Polychotomous Predictor.

Interpreting a Logistic Regression Model for a Continuous Predictor.

The Assumption of Linearity.

The Zero-Cell Problem.

Multiple Logistic Regression.

Introducing Higher Order terms to Handle Non-Linearity.

Validating the Logistic Regression Model.

WEKA: Hands-On Analysis Using Logistic Regression.

5. Naïve Bayes and Bayesian Networks.

The Bayesian Approach.

The Maximum a Posteriori (MAP) Classification.

The Posterior Odds Ratio.

Balancing the Data.

Naïve Bayes Classification.

Numeric Predictors for Naïve Bayes Classification.

WEKA: Hands-On Analysis Using Naïve Bayes.

Bayesian Belief Networks.

Using the Bayesian Network to Find Probabilities.

WEKA: Hands-On Analysis Using Bayes Net.

6. Genetic Algorithms.

Introduction to Genetic Algorithms.

The Basic Framework of a Genetic Algorithm.

A Simple Example of Genetic Algorithms at Work.

Modifications and Enhancements: Selection.

Modifications and enhancements: Crossover.

Genetic Algorithms for Real-Valued Variables.

Using Genetic Algorithms to Train a Neural Network.

WEKA: Hands-On Analysis Using Genetic Algorithms.

7. Case Study: Modeling Response to Direct-Mail Marketing.

The Cross-Industry Standard Process for Data Mining: CRISP-DM.

Business Understanding Phase.

Data Understanding and Data Preparation Phases.

The Modeling Phase and the Evaluation Phase.


""..the book is interesting to read, and the methods will be useful for data mining researchers…"" (Computing, August 17, 2007)

""…an excellent problem-solving resource..."" (CHOICE, June 2007)

""…the latest techniques…insight into how data mining algorithms work…"" (Materials World, April 2007)

  • Presents data mining as a process for solving business or research problems, not simply an unconnected and isolated set of tools
  •   “White box” approach -- internal workings of each algorithm are explored, using small data sets, so that the underlying mathematical structure may be made clear to the reader
  • Logical structure flows naturally from the CRISP-DM standard process, and is categorized by the set of data mining tasks
  • Emphasis on exploratory data analysis, which encourages students to “feel their way” through the large data sets
  • Application of the algorithms to real-world large data sets
  • Chapter exercises allow both the student and instructor to assess the student’s level of understanding
  • Graphical approach, with 110 computer screen shots and many other figures
  • Companion website for adopters of the book, containing: solutions to all the exercises, including the hands-on analyses; Powerpoint® presentations of each chapter; easily adaptable sample data mining course projects, written by the author for use in his own courses; real-world data sets for use with the course projects; multiple-choice chapter quizzes; and a chapter-by-chapter web resource