Making Sense of Data: A Practical Guide to Exploratory Data Analysis and Data Mining
Making Sense of Data educates readers on the steps and issues that need to be considered in order to successfully complete a data analysis or data mining project. The author provides clear explanations that guide the reader to make timely and accurate decisions from data in almost every field of study. A step-by-step approach aids professionals in carefully analyzing data and implementing results, leading to the development of smarter business decisions. With a comprehensive collection of methods from both data analysis and data mining disciplines, this book successfully describes the issues that need to be considered, the steps that need to be taken, and appropriately treats technical topics to accomplish effective decision making from data.
Readers are given a solid foundation in the procedures associated with complex data analysis or data mining projects and are provided with concrete discussions of the most universal tasks and technical solutions related to the analysis of data, including:
* Problem definitions
* Data preparation
* Data visualization
* Data mining
* Grouping methods
* Predictive modeling
* Deployment issues and applications
Throughout the book, the author examines why these multiple approaches are needed and how these methods will solve different problems. Processes, along with methods, are carefully and meticulously outlined for use in any data analysis or data mining project.
From summarizing and interpreting data, to identifying non-trivial facts, patterns, and relationships in the data, to making predictions from the data, Making Sense of Data addresses the many issues that need to be considered as well as the steps that need to be taken to master data analysis and mining.
1.2 Problem definition.
1.3 Data preparation.
1.4 Implementation of the analysis.
1.5 Deployment of the results.
1.6 Book outline.
1.8 Further reading.
2.4 Roles and responsibilities.
2.5 Project plan.
2.6 Case study.
2.6.4 Roles and responsibilities.
2.6.5 Current situation.
2.6.6 Timetable and budget.
2.6.7 Cost/benefit analysis.
2.8 Further reading.
3.2 Data sources.
3.3 Data understanding.
3.3.1 Data tables.
3.3.2 Continuous and discrete variables.
3.3.3 Scales of measurement.
3.3.4 Roles in analysis.
3.3.5 Frequency distribution.
3.4 Data preparation.
3.4.2 Cleaning the data.
3.4.3 Removing variables.
3.4.4 Data transformations.
3.7 Further reading.
4. Tables and graphs.
4.2.1 Data tables.
4.2.2 Contingency tables.
4.2.3 Summary tables.
4.3.2 Frequency polygrams and histograms.
4.3.4 Box plots.
4.3.5 Multiple graphs.
4.6 Further reading.
5.2 Descriptive statistics.
5.2.2 Central tendency.
5.3 Inferential statistics.
5.3.2 Confidence intervals.
5.3.3 Hypothesis tests.
5.3.5 One-way analysis of variance.
5.4 Comparative statistics.
5.4.2 Visualizing relationships.
5.4.3 Correlation coefficient (r).
5.4.4 Correlation analysis for more than two variables.
5.7 Further reading.
6.1.2 Grouping by values or ranges.
6.1.3 Similarity measures.
6.1.4 Grouping approaches.
6.2.2 Hierarchical agglomerative clustering.
6.2.3 K-means clustering.
6.3 Associative rules.
6.3.2 Grouping by value combinations.
6.3.3 Extracting rules from groups.
6.4 Decision trees.
6.4.2 Tree generation.
6.4.3 Splitting criteria.
6.7 Further reading.
7.1.4 Building a prediction model.
7.1.5 Applying a prediction model.
7.2 Simple regression models.
7.2.2 Simple linear regression.
7.2.3 Simple nonlinear regression.
7.3 K-nearest neighbors.
7.4 Classification and regression trees.
7.4.2 Predicting using decision trees.
7.5 Neural networks.
7.5.2 Neural network layers.
7.5.3 Node calculations.
7.5.4 Neural network predictions.
7.5.5 Learning process.
7.5.7 Using neural networks.
7.6 Other methods.
7.9 Further reading.
8.4 Deployment scenarios.
8.6 Further reading.
9.1 Summary of process.
9.2.1 Problem overview.
9.2.2 Problem definition.
9.2.3 Data preparation.
9.2.4 Implementation of the analysis.
9.2.5 Deployment of the results.
9.3 Advanced data mining.
9.3.2 Text data mining.
9.3.3 Time series data mining.
9.3.4 Sequence data mining.
9.4 Further reading.
Appendix A Statistical tables.
A.1 Normal distribution.
A.2 Student’s t-distribution.
A.3 Chi-square distribution.
Appendix B Answers to exercises.
This hands-on book fills a current gap in the market. It is intended for non-specialists and describes the issues that need to be considered as well as the steps that need to be taken to master the topic.
This book is based on the author's experience in implementing data analysis and data mining in the field and therefore provides a practical background for methods in making decisions from data.
Processes, along with methods, are carefully and meticulously outlined throughout the book for use in any data analysis and data mining project.
A related website (www.makingsenseofdata.com) provides a hands-on data analysis and data mining experience.
The book is easy-to-read and provides an appropriate level of detail to assist the vast majority of professions who wish to use the methods in decision making.
“This book is written in plain language and is useful to you who wants to learn about the business of gathering and analyzing data and accomplishing the objectives you set beforehand. Its most important message I think is that you define the problem so that the data gathered will be tailored to solving it.” (Biz India, 22 December 2012)
"…a well-written book on data analysis and data mining that provides an excellent foundation…" (CHOICE, May 2007)
"This is a must-read book for learning practical statistics and data analysis" (Computing Reviews.com, May 22, 2007)
"…the book should be accessible to all its intended readers." (MAA Reviews, December 28, 2006)