“Gartner sees a big discrepancy between BI expectations and realities” – Intelligent Enterprise

Doug Henschen
 
Doug Henschen at Intelligent Enterprise reports from the Gartner Business Intelligence Summit in Washington D.C., explaining that Gartner analysts John Van Decker and Kurt Schlegel cited five reasons why BI projects do not live up to expectations (article link here):
 

  1. No IT-Business Partnership – “We have to get away from thinking of it as a vendor-customer relationship,” said Schlegel.
  2. No Link to Corporate Strategy – BI team have to listen to the executives and develop metrics and measures that are aligned with their goals.
  3. No connection to the Process – “BI has been overtly disconnected for too long,” Schlegel proclaimed. It’s not enough to deliver the right information to the right users. You have to insert those insights into the processes and interfaces that business users live in every day.”
  4. No Governance or Too Much – It has to be just the right amount of governance. BI grew up departmentally, so it’s all too common to have many silos of BI. At the other extreme, some companies are so uptight about data standards that companies can’t get their data into the warehouse.
  5. No Skills – Business users often lack skills, chimed in Van Decker, citing the one area where the business side was said to be falling short. “Most companies have very sophisticated capabilities available that folks just aren’t taking advantage of,” he said, pointing to corporate performance management (CPM) software as a leading example.

 
I come close to the situation of words failing me when I read a list like this (though not close enough to prevent me penning an article of course). I appreciate that maybe a public seminar is not the easiest place to provide deep insights (I present a lot myself), but the commentary against each of the problem areas seems odd to me. I’m not sure that these are really the five reasons for BI continuing to disappoint in some organisations, while it continues to delight in others, but here are my thoughts on each headline.
 

  1. No IT-Business Partnership – We have to stop talking about IT and Business as if they were two parties trying to negotiate a cease-fire. IT is a business department, it carries out business projects. It would be ridiculous to say that there needs to be a Sales-Business Partnership, it should be equally so with IT. I expand on this theme in the very first article on this blog.
  2. No Link to Corporate Strategy – There should not be a link to Corporate Strategy, BI does not exist as a separate entity that requires linkage. Instead BI work should be an expression of Corporate Strategy (as should any IT project), what else is it an expression of? This is not about listening to executives (though that is important) it is about IT being part of the senior management team of an organisation and not some semi-detached entity, focussed only on the beauty of its own navel. I give some indication of how to go about ensuring that this is the case in two articles, one focussed on a European environment and one spanning four continents.
  3. No connection to the Process – I agree that embedding good BI in a coporoate culture requires effort (indeed I have written a series of articles on the subject, starting with this one), however I struggle to see how any BI team could fail to realise this and pay the area due attention. If this is truly a reason for failure, then it is because of a lack of basic project and change management skills in BI teams.
  4. No Governance or Too Much – I’m not sure that achieving the Goldilocks approach to Governance is the issue here. BI’s impact on an organisation is directly proportional to how pervasive it is. This means that silos of BI reduce value and the walls need to be knocked in. Does this have to be all in one go? of course not, there are always benefits in a balance between incremental progress and paradigm shifts. Any organisation who has gatekeepers who refuse access to the warehouse because of and overly rigid approach to data standards is going to have problems. Equally where systems are developed with little thought to the information that they provide and data is simply thrown over the wall to the BI team, this is going to destroy value. As ever, there needs to be a sensible balance struck, one that yields the greatest business benefit for the lowest cost.
  5. No Skills – “Business users often lack skills”, this seems both incredibly patronising (are only IT people smart enough to get it?) and also a poor excuse for BI teams not paying enough attention to education (see point 3. above). If business people truly lack the skills to use good BI, then they are probably unfit to be in business as the tools are pretty intuitive (if not over-engineered by an approach that is too technology-focussed). More likely, training has been poor, or the BI deliveries have failed to be tailored to answering questions that the business wants to ask.

 
In summary, I don’t have five reasons for BI failing to live up to expectations, I have one. I firmly believe that BI done well is both the easiest of IT systems to sell to people and has one of the highest paybacks of any IT initiative. BI done badly (at the design, development, implementation or follow-up stages) will fail.

The issue is basically a simple one: just how good is your BI team? If a BI implementation fails to deliver significant business value, then instead of looking for scape-goats, the BI team should purchase a mirror and start using it.
 


 
Continue reading about this area in: Some reasons why IT projects fail
 
 
Doug Henschen joined Intelligent Enterprise as Editor in 2004 and was named Editor-in-Chief in January 2007. He has specialized in covering the intersection of business intelligence, performance management, business process management and rules management technologies within enterprise applications and architectures. He previously served as Editor-in-Chief of Transform Magazine, which covered content management and business process management challenges.

I comment on another Intelligent Enterprise article, this one by Cindi Howson, here.
 

Education and cultural transformation

Back in September of this year, Obis Omni were kind enough to invite me to speak at their Forum 2008, which took place on the outskirts of London and had the theme of “Realising Business Intelligence & Corporate Performance Management Success”.

The strap-line of my presentation was “EMIR – A case study in cultural change”. I have written about some of the themes that I discussed at this seminar elsewhere on this blog (e.g. about the importance of promoting your project in Marketing Change and the strong role to be played by extended business teams in Scaling-up Performance Management). In this article I am going to talk about some aspects of the pivotal area of education.
 
Obis Omni
 
Background on The EMIR Project can be found elsewhere on this site. Briefly it was a business intelligence / data-warehousing project aimed at improving the profitability of the European operations of a multinational insurance organisation.

More importantly, EMIR was always seen as primarily a cultural transformation initiative. The explicit aim of the system was to transform the culture of the organisation into one in which the use of credible, timely and easy-to-use information became as much second nature as picking up the telephone. Of course one initial learning here is that if you are in the business of cultural transformation, it helps an awful lot to tell people that this is the case. Having this element as a public goal was of great assistance.
 
 
Making a good first impression

Having already established a strong extended business team (see the links in the first paragraph above) the project team also realised that there was another important group to win over; our first set of 20 or so training delegates. We felt that if they went back to their offices singing the praises of EMIR then this, supported by the voices of the extended team would give us the necessary momentum to carry us through the first training phase and make a great start to our cultural change work.

It is often said (perhaps sometimes glibly) that as much attention should be paid to the deployment of IT systems as to their development. Many IT managers may not truly believe this in their heart-of-hearts, perhaps an “if I build it, they will come” attitude is sometimes more prevalent. However, with the EMIR project we took the educational aspect extremely seriously.

To start with this we made EMIR training a 3-day event, something that was unprecedented in IT training in the organisation. Second, we insisted that all delegates (the senior managers of the European organisation) travel to London to attend the course*. One reason for the duration was that we wanted to cover a lot of ground, but also we wanted to send a message that this was an important event and merited the devotion of an appropriate amount of time.

A lot of effort and thought went into the presentations that would be made, the different styles of training (some lecture style, more hands-on), the quality of the supporting training materials, the arrangement of the rooms and so on. I assigned one of my senior managers to oversee the training and we also employed an external training consultant to help us design the courses and user guides and achieve the professional look that we were going for.
 
 
The importance of real-life examples

Sometimes training simply explains how to use the technical features of a system, but, again, we were in the business of cultural transformation and so this shifted opur emphasis. Because of this, and also because the system was pretty intuitive and easy to use, in training we focussed on using the system to address real-life business problems. One example of this would be estimating the future profitability of a book of business based on historical trends.

This approach meant that the business value inherent in the system was clearly demonstrated. This was not an IT system, it was a business system. A key first step in changing the behaviour of managers was establishing that there was something in it for them; namely that they could get at information that was previously unavailable, that access to information was quick and easy and that their decision-making would be enhanced. Ticking these boxes through our real-life exercises helped to engage the enthusiasm of delegates and made them more receptive to our other proposals for how to build use of the system into their day-to-day lives.

This business-focussed training was initially carried out by our actuaries, however as demand for training soared in later weeks, I also ran many of these workshops. It was potentially a major challenge for an IT person to be telling insurance underwriters how to run their business, but something that I actually enjoyed very much. While discussing training personnel, we always had at least two people present in the classes as well as the lead trainer. The role of these other people was to check that delegates were keeping up and help anyone who was struggling with an exercise. We did not want anyone to fall so far behind that they became disengaged from the programme.
 
 
Breaking the back of cultural change

Our approach worked and our first twenty delegates became converts to the EMIR cause. Before the first training session, delegates has (understandably) been somewhat reluctant to commit so significant a period of time to the training process. After it an example of the type of message that attendees took back with them to their offices was: –

“This is the best management information I have seen, it represents a big leap forward”

It was not all down-hill from this point and a further article will deal with how we sustained cultural change over the latter stages of this project. However, after this initial success, some things became easier and we had safely negotiated what was probably the largest hurdle in the project.

Given this, I was quite happy to release some project funds for champagne at the end of our first three days, but should stress that the project was brought in under budget nevertheless.
 


 
Continue reading about this area in: Sustaining Cultural Change.
 
 
Note: –

* In latter training phases – having succeeded in making our point – training was often carried out in each European country, something I will cover in the future.