1 of 11

Slide Notes

Here I highlight for you some of the common mistakes I see with metrics and their management.

This is based on an extract from our full article
http://www.jamsovaluesmarter.com/blog/common-mistakes-using-metrics
DownloadGo Live

Common Mistakes Using Metrics and a check list to find them

Published on Oct 11, 2016

Based on the main content from our full article http://www.jamsovaluesmarter.com/blog/common-mistakes-using-metrics

Here we highlight for you the most common mistakes we see in business use with metrics, KPI's and analytics. We include for you a check list to find and fix the errors. Review our notes with each slide for a deeper understanding and information set to implement and help educate your business management.

For more information contact us directly www.jamsovaluesmarter.com

PRESENTATION OUTLINE

Common Mistakes Using Metrics

And a check list to find them
Here I highlight for you some of the common mistakes I see with metrics and their management.

This is based on an extract from our full article
http://www.jamsovaluesmarter.com/blog/common-mistakes-using-metrics

Vanity Metrics

Measuring only positive outcomes
Our number one candidate for mistakes with metrics is the prevalent use of vanity metrics. These are the metrics, used and showered around the organization that sound and look great but mean little. One clear example within JAMSO is the number of followers we have on Twitter, we prefer instead to measure the amount of engagement with our followers.
Looking blind
Example: A marketing department may show and declare 20,000 likes on their sales campaign for a given Facebook page, but unless this turns into actual sales enquiries then there is little point in declaring it a success.
Photo by longhorndave

Messy Metrics

Random collection of measures not linked to strategy
A business seeking to maximize it’s profit and effectiveness should avoid an unorganized collection of metrics. These are a wide pool of metrics not linked to strategic goals or objectives.

The culture is often developed and observed through any of the following scenarios:

The leadership has a broad or vague vision, mission for the company, i.e. “We will be the best at ……”
Performance reviews are rushed events.
The management structure is encouraged to operate tactically and not strategically, this is often reinforced through lack of autonomy for roles.
Rewards are provided for “hitting the number”.

Top Tip: Consider the use of gamification within metric design to help provide an overall strategy, story and improvement across the business.
Photo by trilanes

Focus on only numbers

Do not consider trends 
Setting targets and agreeing to targets can become the key to a persons career and status within a business. This often defines their measure of failure or success.

The high emphasis on attaining an absolute number can create a culture of corruption, deceit, jealousy, anxiety and stress if the metrics number has been created incorrectly. To reinforce this dilemma, more staff are today encouraged to create their own performance numbers and targets. These numbers are gladly accepted by their leaders with little thought to the level of quality information, consequences and purpose of these metrics.

Managing a team based on metric performance can be limiting and counter productive to the overall business objective and goals. For instance a sales team may have their expenses budget radically reduced to support a cash-flow metric for a specific quarter but their ability to hit sales in the coming quarter will be impacted.

A solution for this situation is to measure the trajectory and speed of progress rather than an actual specific number. Being strategic and goal orientated should be a higher priority than an actual number for a specific metric.
Photo by kirstyhall

Lagging Indicators Bias

Focus mostly on historical data
LAGGING INDICATORS BIAS

A business or department that has a skewed bias recording of lagging metric indicators will always be in a reactionary position. These are the metrics that look backwards in time over performance levels as opposed to direct current/future behaviors that can affect such outcomes.

Using Benchmark Data Only

Ignoring internal differences 
USING ONLY BENCHMARKED METRICS

Industry benchmarks are a convenient and perceived as a lower cost method to create standards and expectations within a business. Your own organizations reality is often more complex than comparisons to a standard industry model. Read more here.

Top Tip: Never forget the lessons learned from Kodak. They led many industry benchmarks for film and imaging processing however their business model was rendered unsustainable due to the surge and popularity of digital image technology against their unwillingness to engage with it.
Photo by yonsterz

Not understanding basic statistics

Lack of skills to generate valid data sets
NOT UNDERSTANDING BASIC STATISTICS

When using a mathematical method to represent information, it requires at least basic levels of statistical skills to ensure it is represented and understood in the correct context.

An example is a manager showing the average number of widgets packed in the warehouse per day as opposed to the range and variance of widgets packed. This could then provide deeper insights to the required man power levels required, sales process feeding the orders to the warehouse and identify any peak/low demand trends.
Photo by kevin dooley

Only focusing on numbers

Not asking questions and using critical thinking
NOT ASKING QUESTIONS BUT FOLLOWING THE NUMBERS

I have attended too many meetings where metrics are reported and the numbers remain the sole purpose and point of decision making. The use of traffic light systems (red – take urgent action, yellow – review and manage, green – all is well) or reporting by exception also have their weaknesses. These approaches to management through metrics address the numbers only, they do not question the trends and other contributing factors that could bring business objectives and strategic goals faster and better.

Frequency/Scale of measurement

Incorrect use of scale and frequency of measures
FREQUENCY/SCALE OF MEASUREMENT

Frequency
Example: Within procurement/purchasing departments we notice many companies bundling their price negotiations at the end of the year, so they have “savings” implemented from the start of the following month and calendar year. This often highlights a weakness in the overall strategic thinking.

With negotiations spread across the full calendar year it strengthens the skill base of the negotiators, offers more time to negotiate the best deals and improves time management planning of tasks.

So, by selecting appropriate frequency and scales of measurement in metrics, alternative outcomes can be achieved.
Photo by FeatheredTar

Check List

  • How are your metrics linked to business goals, objectives, vision and mission?
  • How do you track trends within metrics?
  • What is the frequency intervals of measurement and what benefits can be made from adjusting them or their scale of measurement?
  • What impact will the metric have on the business this week, quarter, year?
Check List to avoid common metric mistakes:

We have highlighted some of the most common mistakes using metrics. Use this short check list to review your current metrics so see if your own business metrics fall into these error classification identified.

How are your metrics linked directly to the goals, objectives, vision and mission of your business?
How do you identify and track trends of performance and measures within your existing metrics?
What is the frequency intervals of measurement and what benefits can be made from adjusting them or their scale of measurement?
What impact will the metric have on the business this week, month, quarter, year, 36 month period?

How many mistakes did you find?

HOW TO MOVE FORWARD

The lessons from these common mistakes with metrics will help improve business performance. There are very few companies that do not fall into these mistake traps to some degree or another. The challenge for managers and leaders is to identify to what degree these mistakes are being made.

A business organization needs metrics to gain insight, understanding so decisions can be made aligned to strategic goals.

There is a time and place for many small minor metric measurements but their influence and impact on the business should be understood in full context.
Drawing
The need for critical thinking to replace accepted numbers reporting is important to retain a competitive edge for any business.

There are many cases of incorrect metric measurement reasons. I see examples of metric choice due to correlation and not causation of critical elements. The use of critical thinking helps clarify the validity of such decisions.

The insights gained by companies through tracking trends and selecting appropriate scales and frequencies is a better and more effective use of the organizations talents and resources.

Once specific metrics have been managed and robust systems introduced to produce the correct results, a forward thinking business should reflect on the future value of continual measurement of this specific parameter. If the risk of impact is low enough, consider moving to another metric area to address improvement and help speed the business to the future it seeks.

TOP TIP:

Take action every day to improve your metrics. The results will not just improve by themselves (unless random chance occurs), so take control of your business and put your metrics to hard work and positive use.

How many of these mistakes do you see at your business?