Author Archive

Geoflow Preview for Excel 2013

Tuesday, April 16th, 2013

Last week at the PASS Business Analytics Conference in Chicago, Microsoft disclosed a public preview of GeoFlow for Excel (download).  GeoFlow” is a 3D visualization tool for mapping, exploring and interacting with both geographic and chronological data, providing users with a new way to discover and share insights that might be difficult to identify in traditional 2D tables and charts.  GeoFlow integrates with tools such as Excel and PowerPivot, enabling users of all levels to do self-service BI directly in Excel with a set of familiar tools for data modeling, exploration and visualization of data, all powered by xVelocity, the in-memory analytics engine.

More info:

Microsoft Talks Analytics, Introduces New Preview of BI Technology

Public preview of project codename “GeoFlow” for Excel delivers 3D data visualization and storytelling

Geoflow? Is that it, Microsoft?

Download GeoFlow Preview for Excel 2013

Public Preview GeoFlow for Excel 2013

GeoFlow Released for Public Preview

Exploring Excel 2013 for BI Tip #6: GeoFlow–The Latest Excel Visualization

GeoFlow Public Preview Available

Day 2: PASS Business Analytics Conference, New 3D Mapping Analytics Tool for Excel

Telling Even Better Stories with Microsoft BI and GeoFlow

Public Preview GeoFlow for Excel 2013

Analyze a Twitter feed with Excel 2013, DataExplorer and GeoFlow

From Data to Insight: Getting Public Data with Data Explorer & Building a Power View & GeoFlow

PASS SQL Saturday in Chicago Presentation Slides

Monday, April 15th, 2013

Thanks to everyone who attended my sessions “What exactly is Business Intelligence?” and “Building an Effective Data Warehouse Architecture” at the PASS SQL Saturday in Chicago.

Here are the PowerPoint presentation: What exactly is Business Intelligence? and Building an Effective Data Warehouse Architecture.

What exactly is Business Intelligence?

BI is the “Gathering of data from multiple sources to present it in a way that allows executives to make better business decisions”. I will describe in more detail exactly what BI is, what encompasses the Microsoft BI stack, why it is so popular, and why a BI career pays so much. I will review specific examples from previous projects of mine that show the benefits of BI and its huge return-on-investment. I’ll go into detail on the components of a BI solution, and I will discuss key concepts for successfully implementing BI in your organization.

Building an Effective Data Warehouse Architecture

You’re a DBA and your boss asks you to determine if a data warehouse would help the company. So many questions pop into your head: Why use a data warehouse? What is the best methodology to use when creating a data warehouse? Should I use a normalized or dimensional approach? What is the difference between the Kimball and Inmon methodologies? Does the new Tabular model in SQL Server 2012 change things? What is the difference between a data warehouse and a data mart? Is there any hardware I can purchase that is optimized for a data warehouse? What if I have a ton of data? During this session James will help you to answer these questions so your response to your boss will provoke amazement and lead to a big raise. Or at least help to lead you down the correct path!

PASS Business Analytics Conference Presentation Slides

Monday, April 15th, 2013

Thanks to everyone who attended my sessions “Overview of Microsoft Appliances” and “Building an Effective Data Warehouse Architecture” at the PASS Business Analytics Conference.

Here are the PowerPoint presentations:  Overview of Microsoft Appliances and Building an Effective Data Warehouse Architecture.

Overview of Microsoft Appliances

Learn how SQL Server 2008 can scale to hundreds of terabytes for BI/DW solutions. This session will focus on Fast Track solutions and appliances, reference architectures, and Parallel Data Warehousing (PDW). It will also cover performance numbers and lessons learned from one of the very first production PDW deployments in the world and how a successful BI solution was built on top of it using SSAS.

Explore all the different appliances – HP Business Decision Appliance (BDA), HP Business Data Warehouse appliance (BDW), HP Enterprise Data Warehouse Appliance (EDW), and HP Database Consolidation Appliance (DBC) – and how they can save you significant time and money instead of building on your own. If you’re involved in the decision making for purchasing one or more servers for SQL Server, this session will show you options to ordering a server and internally installing the hardware, OS, and SQL Server.

Building an Effective Data Warehouse Architecture

You’re a DBA and your boss asks you to determine if a data warehouse would help the company. So many questions pop into your head: Why use a data warehouse? What is the best methodology to use when creating a data warehouse? Should I use a normalized or dimensional approach? What is the difference between the Kimball and Inmon methodologies? Does the new Tabular model in SQL Server 2012 change things? What is the difference between a data warehouse and a data mart? Is there any hardware I can purchase that is optimized for a data warehouse? What if I have a ton of data? During this session James will help you to answer these questions so your response to your boss will provoke amazement and lead to a big raise. Or at least help to lead you down the correct path!

PASS Business Analytics Conference Live Blog

Thursday, April 11th, 2013

Apologies if you went to my site this morning to see my blog from the bloggers table at PASS Business Analytics Conference.  Turns out a firewall issue blocked me from getting to my site (and many others).  So I wound up tweeting updates at http://twitter.com/jamesserra.  You can review my tweets from today, and then check back tomorrow from 8:00am CST and 9:15am as I will tweet all the goings on, when the presenter will be award-winning economist and Freakonomics author Dr. Steven Levitt.

PASS Business Analytics Conference

Monday, April 8th, 2013

The PASS Business Analytics Conference is almost here!  Check out the sessions to be presented at the conference and you will see there are a ton of great sessions and great speakers.  I feel fortunate to be able to speak alongside many of the experts in the industry and to meet many of them for the first time.

I will be arriving Tuesday night in Chicago and attending a pre-conference session on Wednesday.  Thursday and Friday are the conference sessions, and I will be presenting on Friday at 11:15am in the Sheraton 2.  My topic is “Building an Effective Data Warehouse Architecture“.  I also have an alternate presentation ready to go in case a speaker has to cancel at the last-minute.  That presentation is “Overview of Microsoft Appliances“.

I was fortunate enough to be asked to sit at the bloggers table during the keynote speeches, so make sure to check my blog during the times below for updates:

  • Thursday, 8:00-9:15am CST: Microsoft Director of Program Management for BI Kamal Hathi and Technical Fellow Amir Netz
  • Friday, 8:00-9:15am CST: Award-winning economist and Freakonomics author Dr. Steven Levitt

Also, I am staying an extra day in Chicago to present at SQLSaturday.  I will again present “Building an Effective Data Warehouse Architecture” at 4pm EST, as well as a just added “What exactly is Business Intelligence?” at 10:30am EST.

Please shoot me an email if you will be attending and would like to meet up.  Hope to see you there!

Microsoft BI tools: How they use data sources

Tuesday, April 2nd, 2013

A quick list of how each of these Microsoft BI tools handles the two data sources “SQL Server” (relational-based) and “Analysis Services” (multidimensional-based):

  • Report Builder – Using “SQL Server”, auto-detects joins if source system has foreign-key relationships (by selected “Auto Detect” relationships on the “Design a query” screen).  Otherwise will have to create your own joins.  If use “Analysis Services”, will get a different query designer, and has the benefit of not needing to create joins as a cube has them built-in
  • PowerPivot –  Using “SQL Server”, auto-detects joins if source system has foreign-key relationships (via “Select Related Tables” button on the “Table Import Wizard” screen).  Otherwise will have to create your own joins.  If use “Analysis Services”, will get a different Table Import Wizard, very similar to one in Report Builder, and has the benefit of not needing to create joins as a cube has them built-in, but the result returns just one flattened table.  I like to think of PowerPivot as essentially a way of making an analysis services cube from a relational source using Excel as the design tool
  • PerformancePoint – If use “Analysis Services” has the benefit of not needing to create joins as a cube has them built-in.  “SQL Server” can only be used to represent tables as KPIs on scorecards or have them appear as data values within filters (see http://www.jamesserra.com/archive/2012/10/using-performancepoint-against-tabular-data/)
  • Excel Pivot Tables – If use “Analysis Services” has the benefit of not needing to create joins as a cube has them built-in.  If use “SQL Server”, can only use one table
  • Power View – Can only connect to the Tabular model and the multidimensional model (which is in CTP, see Microsoft SQL Server 2012 With Power View For Multidimensional Models CTP)
  • Visual Studio Reporting Services (SSRS) - Using “SQL Server”, auto-detects joins if source system has foreign-key relationships (when adding tables on the “Query Designer” screen).  Otherwise will have to create your own joins.  If use “Analysis Services”, will get a different query designer, very similar to one in Report Builder, and has the benefit of not needing to create joins as a cube has them built-in

SQL Server 2012 Business Intelligence Enhancements

Thursday, March 28th, 2013

My first article in SQL Server Pro magazine has been published.  It is entitled “SQL Server 2012 Business Intelligence Enhancements” and can be found here.  I hope you enjoy it!

TFS vs SSIS project versioning

Tuesday, March 26th, 2013

I had someone ask me the other day if they are using SSIS 2012 Project Versions, is there any benefit to using TFS?  The answer is Yes!  While Project Versions is a new feature that keeps prior versions of SSIS projects as they are deployed to the server and allows you to rollback to any prior version, it is not a replacement for source control.  Here are some of the limitations of using Project Versions as compared to using TFS:

The bottom line is the best use for Project Versions is to quickly revert to a prior project version if a new version causes issues (a quick rollback).  It is not really a source control solution.

Benefits of using views in a BI solution

Tuesday, March 19th, 2013

Using SQL Server views throughout a Business Intelligence (BI) solution can provide a tremendous amount of benefits.  Here is a list of such benefits, taken in large part from the excellent video SQLBI Methodology by Marco Russo and Alberto Ferrari:

Benefit of views

  • Can be modified by anyone, even outside of BIDS/SSDT
  • Can provide default values when needed
  • Simple computation can be carried out by views
  • Renaming fields leads to better understanding of the flow
  • Can present a star schema, even if the underlying structure is much more complex
  • Can be analyzed by third-party tools to get dependency tracking
  • Can be optimized without ever opening BIDS/SSDT
  • For security reasons, to limit the rows retrieved by joining with a security table

Benefit of views in SQL Server Integration Services (SSIS):

  • Simpler code inside SSIS packages
  • No need to open the package to understand what it is reading
  • Easily query the database for debugging purposes
  • Query optimizations can be carried out separately

Benefit of views in SQL Server Analysis Services (SSAS):

  • Renaming database columns to SSAS attributes
  • Clearly exposing all the transformations to DBA
  • Simplifying handling of fast variations
  • Full control on JOINs sent to SQL Server
  • Exposing a start schema, even if the underlying structure is not a simple star schema

Why you need Business Intelligence

Thursday, March 14th, 2013

First lets define what Business Intelligence (BI) is.  My favorite definitions:

Forrester Research: “Business Intelligence is a set of methodologies, processes, architectures, and technologies that transform raw data into meaningful and useful information used to enable more effective strategic, tactical, and operational insights and decision-making.”

Gartner: “A broad category of applications and technologies for gathering, storing, analyzing, sharing and providing access to data to help enterprise users make better business decisions.”

Me: “Gathering of data from multiple sources to present it in a way that allows executives to make better business decisions”.

“Get the right data at the right time to make the right decision for the organization”.

“It is the application of knowledge derived from analyzing an organization’s data to effect a more positive outcome”.

“It transforms data into knowledge”.

So why use BI?

  • Understand the health of the organization
  • Collaborate on a shared view of business drivers
  • Reduce the time to decision
  • Opportunity to save costs
  • Reduce maintenance and usage cost due to multiple reporting systems and silos of information
  • Reduce costs (losses) associated with decisions made on basis of inaccurate information
  • Be able to compete in the market with today’s pace and stay ahead of competition due to use of right business intelligence

Tangible Benefits:

  • Enable critical data and analysis tools as identified for multiple business groups
  • Provide data integrity, simplification and standardization for the business areas
  • Provide dynamic and interactive reporting
  • Allow for data mining and predictive analytics
  • Reports create simplicity and reduce Business Technology dependence for report creation and updates
  • Cost savings by reducing the business users effort to create these reports
  • Rapid access to data from all sources
  • Standard KPI and dashboard reports

Intangible Benefits:

  • Improve efficiency and accuracy of decision support system for management and executive decision-making
  • Reduce manual consolidation efforts thereby improving productivity
  • Provide transparency

The bottom line is BI is no longer a luxury afforded by a few large companies.  It is now considered an essential part of the IT portfolio.

Examples of common business questions that BI can answer:

  • How are the sales territories performing?
  • How are the sales people performing?
  • Which customers are likely to buy from us?
  • What products do our customers buy together?

Many companies have a ton of data, but don’t know what to do with it.  They have business analysts who spend days or weeks pulling together data from different sources to create reports, many times in Excel.  These analysts would like clean data that is more accurate and more timely so they can spend more of their time analyzing data instead of building reports.  They often have many of these problems with their current reporting solution:

  • Are using reports from 3rd-party app that is hitting production data
  • Need to integrate data from a variety of data systems, often in different formats
  • Reports are slow, getting timeouts, and inflexible
  • Need to combine, cut and paste reports together to form other reports
  • Data systems are not optimized for analytical queries, don’t contain all the data needed, and are not available all the time
  • The systems do not have universal definitions (no “single version of the truth”)
  • Does not manage historical context
  • Employees may not the sufficient skills, tools, or permissions to query data systems
  • Want to use data in other front-end tools to do ad-hoc querying and data mining 

So decision makers need:

  • Reliable, secure access to data to do their job effectively
  • Flexibility in the ways they access data
  • Tools to browse and analyze data and view reports
  • Low time-to-impact; low latency query results

So what is the best solution?  There is no single solution scenario to describe what a BI Solution looks like.  There are however some broad categories of solutions that describe common approaches to BI solutions.  In order of increasing complexity and time investment:

  1. Operational Reporting: Provides improved access to existing data from operational systems.  Usually involves the building of an Operational Data Store (ODS)
  2. Business Process / Activity Management: Provides improved analysis and reporting capabilities for specific business processes or activities.  See BPM and BAM and Business Activity Monitoring and Business Intelligence.  Usually involves a real-time summary of business activities from multiple transactional data sources to operations managers and upper management (“Operational Intelligence”)
  3. Data Mart / Integrated Reporting and Analytics: Provides improved tools and access to business users of an application to enhance its value by improving decision-making.  This is the most common solution.  Usually involves the Kimball methodology when building the data warehouse
  4. Enterprise Data Warehousing / Information Management: Provides comprehensive integration of critical information across the enterprise.  Also breaks down the barriers between applications.  Usually involves the Inmon methodology when building the data warehouse

By understanding all of the solution scenarios, you can decide how to approach building your first BI solution.  Some developers may elect to start small by simply providing improved access to operational data as described in the Operational Reporting scenario.  Other developers may decide to tackle the larger problem of providing comprehensive integrated reporting and analytics capabilities to their application as described in the Data Mart scenario.  Truly adventurous developers may decide to tackle the larger problem of Enterprise Data Warehousing, and attempt to provide their customer with an Enterprise Information Management solution which solves the larger problem of providing an integrated view of enterprise information across application boundaries.

More info:

DBA’s, want to earn the big bucks? Learn BI

Business discovery: the next step in business intelligence?

Importance of Data Management for Business People

Microsoft Business Intelligence at a Glance Poster

Putting BI to Work for Your Organization

Three Mistakes to Avoid in your Business Intelligence Project

Why Corporate BI and Self-Service BI Are Both Necessary

Video How to Start Microsoft BI

Five Pillars for Creating a Business Intelligence Culture in an Organization