The Microsoft Data Warehouse Toolkit: With SQL Server 2005 and the Microsoft Business Intelligence Toolset
Building a data warehousing and business intelligence system is a complex business and engineering effort. While there are significant technical challenges to overcome in successfully deploying a data warehouse, the authors find that the most common reason for data warehouse project failure is insufficient focus on the business users and business problems. In an effort to help people gain success, this book takes the proven Business Dimensional Lifecycle approach first described in best selling The Data Warehouse Lifecycle Toolkit and applies it to the Microsoft SQL Server 2005 tool set.
Beginning with a thorough description of how to gather business requirements, the book then works through the details of creating the target dimensional model, setting up the data warehouse infrastructure, creating the relational atomic database, creating the analysis services databases, designing and building the standard report set, implementing security, dealing with metadata, managing ongoing maintenance and growing the DW/BI system. All of these steps tie back to the business requirements. Each chapter describes the practical steps in the context of the SQL Server 2005 platform.
The target audience for this book is the IT department or service provider (consultant) who is:
- Planning a small to mid-range data warehouse project;
- Evaluating or planning to use Microsoft technologies as the primary or exclusive data warehouse server technology;
- Familiar with the general concepts of data warehousing and business intelligence.
The book will be directed primarily at the project leader and the warehouse developers, although everyone involved with a data warehouse project will find the book useful. Some of the book’s content will be more technical than the typical project leader will need; other chapters and sections will focus on business issues that are interesting to a database administrator or programmer as guiding information.
The book is focused on the mass market, where the volume of data in a single application or data mart is less than 500 GB of raw data. While the book does discuss issues around handling larger warehouses in the Microsoft environment, it is not exclusively, or even primarily, concerned with the unusual challenges of extremely large datasets.
About the Authors
JOY MUNDY has focused on data warehousing and business intelligence since the early 1990s, specializing in business requirements analysis, dimensional modeling, and business intelligence systems architecture. Joy co-founded InfoDynamics LLC, a data warehouse consulting firm, then joined Microsoft WebTV to develop closed-loop analytic applications and a packaged data warehouse.
Before returning to consulting with the Kimball Group in 2004, Joy worked in Microsoft SQL Server product development, managing a team that developed the best practices for building business intelligence systems on the Microsoft platform. Joy began her career as a business analyst in banking and finance. She graduated from Tufts University with a BA in Economics, and from Stanford with an MS in Engineering Economic Systems.
WARREN THORNTHWAITE has been building data warehousing and business intelligence systems since 1980. Warren worked at Metaphor for eight years, where he managed the consulting organization and implemented many major data warehouse systems. After Metaphor, Warren managed the enterprise-wide data warehouse development at Stanford University. He then co-founded InfoDynamics LLC, a data warehouse consulting firm, with his co-author, Joy Mundy. Warren joined up with WebTV to help build a world class, multi-terabyte customer focused data warehouse before returning to consulting with the Kimball Group. In addition to designing data warehouses for a range of industries, Warren speaks at major industry conferences and for leading vendors, and is a long-time instructor for Kimball University. Warren holds an MBA in Decision Sciences from the University of Pennsylvania's Wharton School, and a BA in Communications Studies from the University of Michigan.
RALPH KIMBALL, PH.D., has been a leading visionary in the data warehouse industry since 1982 and is one of today's most internationally well-known authors, speakers, consultants, and teachers on data warehousing. He writes the "Data Warehouse Architect" column for Intelligent Enterprise (formerly DBMS) magazine.
Part One Requirements, Realities, and Architecture.
Chapter 1 Defining Business Requirements.
Chapter 2 Designing the Business Process Dimensional Model.
Chapter 3 The Toolset.
Part Two Developing and Populating the Databases.
Chapter 4 Setup and Physical Design.
Chapter 5 Designing the ETL System.
Chapter 6 Developing the ETL System.
Chapter 7 Designing the Analysis Services OLAP Database.
Part Three Developing the BI Applications.
Chapter 8 Business Intelligence Applications.
Chapter 9 Building the BI Application in Reporting Services.
Chapter 10 Incorporating Data Mining.
Part Four Deploying and Managing the DW/BI System.
Chapter 11 Working with an Existing Data Warehouse.
Chapter 12 Security.
Chapter 13 Metadata Plan.
Chapter 14 Deployment.
Chapter 15 Operations and Maintenance.
Part Five Extending the DW/BI System.
Chapter 16 ManagingGrowth.
Chapter 17 Real-Time Business Intelligence.
Chapter 18 Present Imperatives and Future Outlook.
Warren Thornthwaite, a member of the Kimball Group, has
been building decision support and data warehousing systems since
1980. Warren co-authored the best-selling Data Warehouse
Lifecycle Toolkit (Wiley, 1998). Warren worked at Metaphor
Computer Systems for eight years starting in 1983, where he managed
the consulting organization and implemented many major data
warehouse systems. After Metaphor, Warren managed the
enterprise-wide data warehouse development at Stanford University.
He then cofounded InfoDynamics LLC, a data warehouse consulting
firm. Warren joined up with WebTV to help build a world-class,
multi-terabyte customer-focused data warehouse before returning to
In addition to designing data warehouses for a range of industries, Warren has extensive experience helping clients develop scalable, practical information access architectures. Warren holds an MBA in Decision Sciences from the University of Pennsylvania’s Wharton School, and a BA in Communications Studies from the University of Michigan.
Ralph Kimball, Ph.D., founder of the Kimball Group, has been designing information systems and data warehouses since 1972. Ralph wrote his Ph.D. dissertation in the Electrical Engineering department at Stanford University on the design of a man–machine system for tutoring mathematics students. In 1972 he joined the Xerox Palo Alto Research Center as a research scientist. Over the following ten years at Xerox, he became a development manager and the product marketing manager for the Xerox Star workstation, the first commercial product that used windows, icons, and the mouse. For this work at Xerox, he received the Alexander Williams Award from the IEEE Human Factors Society for user interface design. Following his years at Xerox, Ralph was a vice president and member of the founding team at Metaphor Computer Systems, the first data warehousing company. Between 1982 and 1986, Metaphor installed many client-server data warehouse systems. In 1986 Ralph founded Red Brick Systems, which developed the first high-performance relational database for decision support. Since 1993, Ralph has designed data warehouse systems, written bestselling data warehouse books, and taught data warehousing skills to more than 10,000 IT professionals.