1 of 16
Slide Notes
Industry leaders will spend just shy of $117 billion on data initiatives in 2016.
Most will fail.
Despite deep investment in talent, PMO's and vendor procurement programs meant to wring every drop of efficiency from initiatives, organizations are failing in their data and development projects at increasingly higher rates.
Three powerful forces are combining to fuel the appetite for data, and drive leaders into initiatives that their organizations aren't fully prepared for.
Most will fail.
Despite deep investment in talent, PMO's and vendor procurement programs meant to wring every drop of efficiency from initiatives, organizations are failing in their data and development projects at increasingly higher rates.
Three powerful forces are combining to fuel the appetite for data, and drive leaders into initiatives that their organizations aren't fully prepared for.
Epic Fails and the Rise of the Data 1%
Published on Nov 23, 2015
Company leaders will spend $118 billion on data initiatives in 2016.
It's no secret that most will fail.
But why will they fail?
Even after a decade of investment in talent-acquisition, PMO, and vendor-procurement frameworks meant to wring every drop of efficiency from internal initiatives, most will still fail.
Three powerful forces are already working to destroy next year's data projects, and the best efforts of their leaders.
MORE DECKS TO EXPLORE
PRESENTATION OUTLINE
Most data projects fail. Don't do what they do.
Industry leaders will spend just shy of $117 billion on data initiatives in 2016.
Most will fail.
Despite deep investment in talent, PMO's and vendor procurement programs meant to wring every drop of efficiency from initiatives, organizations are failing in their data and development projects at increasingly higher rates.
Three powerful forces are combining to fuel the appetite for data, and drive leaders into initiatives that their organizations aren't fully prepared for.
Most will fail.
Despite deep investment in talent, PMO's and vendor procurement programs meant to wring every drop of efficiency from initiatives, organizations are failing in their data and development projects at increasingly higher rates.
Three powerful forces are combining to fuel the appetite for data, and drive leaders into initiatives that their organizations aren't fully prepared for.
Photo by Marcus Teshainer
People want data?
Data they shall have.
In spring 2014, leaders from 300 companies - a mix of health, BFSI, tech, manufacturing and service organizations - were evaluating how best to meet the rising data demands of their internal and external audiences.
Projects got approved, budgets got allocated, and each company set off on their journey.
They later shared what they encountered.
Projects got approved, budgets got allocated, and each company set off on their journey.
They later shared what they encountered.
Photo by Stuck in Customs
Lots and lots of data.
Customer data. Enterprise data. Health data. Social data. Location data. Operational data. Sensor data. Biometric data. Mobile data.
Structured / Semi-structured / Unstructured data.
Data Data Data
Three factors - the rise of the data economy, the fist of regulatory compliance, and the allure of emerging platforms - combined to fuel the stakeholder's desire for data projects, and the insights and riches they could bring.
On average, the enterprise organizations each spent $13.8 million on their data initiatives.
The SMB's averaged $1.6 million each.
Most funding was focused on internally-managed headcount, tasked with delivering project results.
On average, the enterprise organizations each spent $13.8 million on their data initiatives.
The SMB's averaged $1.6 million each.
Most funding was focused on internally-managed headcount, tasked with delivering project results.
Photo by arbyreed
As milestones came and went, 58% observed "inaccurate scope."
While each company was expert in their respective field and was competent across development and IT, few had experienced such data initiatives.
Some later said they had made some wrong choices along the way, including that they "didn’t apply the needed expertise to properly plan and execute."
Some later said they had made some wrong choices along the way, including that they "didn’t apply the needed expertise to properly plan and execute."
Photo by Jameson42
41% met with "technical roadblocks."
"The technology is complex, the tools immature, and there’s a whole lot to know."
As projects progressed, some leaders recorded that they "didn’t know as much as they should have" about their projects.
Specifics cited included: "The business problem, the data, what data sources were required to answer the business problem, and the proper types of analytics and development to apply."
Specifics cited included: "The business problem, the data, what data sources were required to answer the business problem, and the proper types of analytics and development to apply."
Photo by code poet
The 300 found the going "rougher than planned."
39% encountered “siloed data, with lots of politics wrapped around them.”
For many, the oldest problem in the history of IT reared its head.
Project stakeholders and executive sponsors found themselves wrestling with entrenched powers who controlled the data sets
For this reason, many Hadoop clusters remain empty today.
Project stakeholders and executive sponsors found themselves wrestling with entrenched powers who controlled the data sets
For this reason, many Hadoop clusters remain empty today.
Photo by SSAVE w/ over 2 Million views THX
The Net:
99% of the companies couldn't deliver on the promises of their data initiatives.
Of the original 300 companies, 297 said their data project went “over schedule."
288 said their data project went “over budget.”
157 said their data project “Failed."
The failures delivered shock waves through the organizations and for many, their bottom lines.
288 said their data project went “over budget.”
157 said their data project “Failed."
The failures delivered shock waves through the organizations and for many, their bottom lines.
Photo by quinn.anya
Beyond overcoming the forces of technical roadblocks, inaccurate scope, and siloed data wrapped in politics, what takeaways can we find?
What did the 1% know that enabled them to succeed?
Photo by m1ke_pearce
Big Takeway:
The1% start the party only when two special guests arrive.
Despite the inherent obstacles faced by all, the 1% who succeeded focused their energy on the controllable elements that determined data project success.
And their secret is really no secret at all.
The 1% discovered that the selection of the right people, empowered to do the right things, and equipped with the right processes, were consistently the main determiners of project outcomes.
And their secret is really no secret at all.
The 1% discovered that the selection of the right people, empowered to do the right things, and equipped with the right processes, were consistently the main determiners of project outcomes.
Photo by Here's Kate
Empowered exec sponsor
Enlightened data expertise
Project success.
Specifically, a repeatable pattern of data project success emerged for the 1%.
(1) An enlightened and empowered Executive Sponsor
(2) paired with the right Expertise, internal or external
(3) who've all demonstrated the ability to deliver on like projects, despite obstacles
(4) consistently provide the environment for data project success.
(1) An enlightened and empowered Executive Sponsor
(2) paired with the right Expertise, internal or external
(3) who've all demonstrated the ability to deliver on like projects, despite obstacles
(4) consistently provide the environment for data project success.
Photo by greenwise art
CyByte engages with the leaders who equip their projects for success.
For leaders who won't tolerate failure in their data initiatives, CyByte is a full-stack, special forces data practice.
Purpose-built in Pittsburgh and with global reach, CyByte equips organizations to understand and execute on their data and development projects, end-to-end.
And unlike other external or internal talent sources, CyByte's on-demand expertise is highly scalable, costs are moderated, and outcomes are predictable.
Purpose-built in Pittsburgh and with global reach, CyByte equips organizations to understand and execute on their data and development projects, end-to-end.
And unlike other external or internal talent sources, CyByte's on-demand expertise is highly scalable, costs are moderated, and outcomes are predictable.
Photo by CubanoConFlickr
CyByte Big Data Client
U.S. based funded startup:
"Build a social sentiment analysis crowdfund decision platform for global investors."
Alrighty then. CyByte results: Success metrics achieved. Solution delivered on time, below budget.
Profile: Big Data Client
U.S. based funded startup.
Scenario: Great ideas are springing up like wildflowers all over the world. Investors with an appetite for early-stage risk wanted to help the brightest ones grow. How best to connect everyone?
Our client had a vision to develop a “Kayak.com” for crowdfunding.
They needed to to consolidate data across 200+ global crowdfund sites.
They needed to gather social data from top seven social networks (Facebook, Twitter, LinkedIn, Google+, Instagram, Youtube, Reddit).
They needed to provide useful and meaningful analytics to investors, so they could make educated investments in suitable startups around the world.
CyByte Solution:
Big Data solution using Hadoop, Talend and LAMP stack to efficiently process huge volumes of structured and unstructured data.
Custom API (as a low-cost alternative to GNIP.com) to extract data from Social networks
NoSQL database to store and process unstructured data
Semantria API to perform Sentiment analysis on social data
Automated investor-startup matchmaking based on the profile settings.
A Custom CRM module.
A Custom Advertisements module.
CyByte Results: Project completed on time and below budget. 80% savings through non-GNIP social media integration module creation. 115% savings through integration tool selection.
CyByte Stack:
Hadoop
Talend
MongoDB
LAMP
HTML5
Bootstrap
Facebook, Twitter, Google, Reddit, Instagram & LinkedIn SDK’s
FusionCharts – Data visualization
Searchbug – Investigation API
Semantria – Sentiment Analysis Engine
CometChat – Audio/Video chat platform
U.S. based funded startup.
Scenario: Great ideas are springing up like wildflowers all over the world. Investors with an appetite for early-stage risk wanted to help the brightest ones grow. How best to connect everyone?
Our client had a vision to develop a “Kayak.com” for crowdfunding.
They needed to to consolidate data across 200+ global crowdfund sites.
They needed to gather social data from top seven social networks (Facebook, Twitter, LinkedIn, Google+, Instagram, Youtube, Reddit).
They needed to provide useful and meaningful analytics to investors, so they could make educated investments in suitable startups around the world.
CyByte Solution:
Big Data solution using Hadoop, Talend and LAMP stack to efficiently process huge volumes of structured and unstructured data.
Custom API (as a low-cost alternative to GNIP.com) to extract data from Social networks
NoSQL database to store and process unstructured data
Semantria API to perform Sentiment analysis on social data
Automated investor-startup matchmaking based on the profile settings.
A Custom CRM module.
A Custom Advertisements module.
CyByte Results: Project completed on time and below budget. 80% savings through non-GNIP social media integration module creation. 115% savings through integration tool selection.
CyByte Stack:
Hadoop
Talend
MongoDB
LAMP
HTML5
Bootstrap
Facebook, Twitter, Google, Reddit, Instagram & LinkedIn SDK’s
FusionCharts – Data visualization
Searchbug – Investigation API
Semantria – Sentiment Analysis Engine
CometChat – Audio/Video chat platform
Photo by benleto
CyByte Mobile Data Client
Atlanta-based provider of B2B insurance products:
"Help our execs use their devices to acesss all our data sources, especially Tableau...it's killing us."
CyByte results: Responsive mobile-data solution delivered on time, below budget. Adoption increased 200% in three months.
Profile - Mobile Data Client:
Atlanta-based provider of B2B insurance products.
Scenario: The work to satisfy global-automaker customers wasn't confined to four walls and 9-to-5.
Executives desperately needed access to key data to perform analysis on their own devices, wherever they were.
Things got tricky and pricey when they first tried.
Three underlying issues soon emerged:
1) The current data strategy was not working. Employees were trying to work with - and around- disparate and siloed reporting platforms: SSRS, Tableau, and local data bases and spreadsheets based on different data sources were the standard. A typical example was that Data Analysts were generating reports using local databases on their work stations.
2) With web licensing throttled by number of of users, it was cost prohibitive to grant access to the Tableau web interface to the rapidly growing mobile user base.
3) Data security was a critical obstacle. The Tableau web interface lacked the ability for desired customization and role-based security needed for user to access the data.
CyByte Solution:
Looking across options for Big Data or traditional solutions, a single enterprise data warehouse and reporting platform was designed and implemented. Importantly, it featured a responsive web / mobile user interface that enabled downstream functionality.
A cost-saving custom wrapper was developed to fully utilize Tableau’s baked-in data visualization components.
An Enterprise Security module was developed to implement role-based security across the user base, to securely accommodate mobile and BYOD users.
CyByte Results: Security, usability and license abatement metrics were achieved. User Adoption increased 200% in three months. Project was completed on time and below budget. 100% savings through non-commercial data and development tool selection.
CyByte Stack:
LAMP
HTML5
Twitter Bootstrap
Tableau SDK
SSRS SDK
Atlanta-based provider of B2B insurance products.
Scenario: The work to satisfy global-automaker customers wasn't confined to four walls and 9-to-5.
Executives desperately needed access to key data to perform analysis on their own devices, wherever they were.
Things got tricky and pricey when they first tried.
Three underlying issues soon emerged:
1) The current data strategy was not working. Employees were trying to work with - and around- disparate and siloed reporting platforms: SSRS, Tableau, and local data bases and spreadsheets based on different data sources were the standard. A typical example was that Data Analysts were generating reports using local databases on their work stations.
2) With web licensing throttled by number of of users, it was cost prohibitive to grant access to the Tableau web interface to the rapidly growing mobile user base.
3) Data security was a critical obstacle. The Tableau web interface lacked the ability for desired customization and role-based security needed for user to access the data.
CyByte Solution:
Looking across options for Big Data or traditional solutions, a single enterprise data warehouse and reporting platform was designed and implemented. Importantly, it featured a responsive web / mobile user interface that enabled downstream functionality.
A cost-saving custom wrapper was developed to fully utilize Tableau’s baked-in data visualization components.
An Enterprise Security module was developed to implement role-based security across the user base, to securely accommodate mobile and BYOD users.
CyByte Results: Security, usability and license abatement metrics were achieved. User Adoption increased 200% in three months. Project was completed on time and below budget. 100% savings through non-commercial data and development tool selection.
CyByte Stack:
LAMP
HTML5
Twitter Bootstrap
Tableau SDK
SSRS SDK
CyByte Health Data Client
Chicago-based leader in medically-integrated fitness centers:
"We're struggling with manual rework, HL7 compliance cliffs, disparate data silos and BPM spaghetti."
CyByte results: Referral conversion rate up 150% in three months. Project completed on time and below budget.
Profile: Health Data Client:
Chicago-based market leader in medically-integrated fitness centers.
Scenario: A woman carrying her toddler falls down a flight of icy steps. Her physician says she requires months of grueling physical therapy to perhaps be healed.
Our client, who runs medically-integrated health centers throughout the US, receives a post-surgery rehab fax referral form from the physician's hospital.
Referral data is then hand-entered into a CRM system.
Customer service follows up with the patient, to "convert" the referral, so the patient can make use of the of the fitness center.
If the patient chooses to becomes a member, Customer Service hand enters detailed patient information into a "Management system".
In the initial patient rehabilitation visit, an initial physical assessment is made, which is managed by different software, and again the patient information is re-entered by the staff in "Assessment software."
During recurring health center visits, all performance data is hand entered into disparate systems.
Before, during and after the treatment, the patient's physician has no clear visibility to monitor or evaluate the patient progress, due to multiple systems used to manage the referral conversion and member management cycles.
Conversion cycles are long, conversion rate is low, and the staff spends much time in data entry rather than on customer service. But most importantly, does the mother get healed?
Usable analytics are scarce due to data silos.
CyByte Solution:
Automated workflow management, utilizing an HL7 interface with EMR to automate the flow of referrals into the CRM, funneling the converted member’s data into Assessment software and Member management system.
Secure HL7 messages back to the referring physician to update on the progress of Patient’s rehab.
Develop enterprise data warehouse to:
Integrate data from CRM, Assessment Software, Member management system, Customer portals and payment platforms
Facilitate Analytics platform for our client’s administration staff, Referring physicians and Patients
Develop a web/mobile responsive enterprise portal to provide a single secure gateway for employees of our client - to eliminate the need to open multiple software applications to serve a customer
CyByte Results: Physicians now have visibility into their patients progress, resulting in improved outcome metrics. Referral Conversion Rate increased by 150% in 6 months. 115% savings through data integration tool selection.
Project completed on time and below budget.
CyByte Stack:
Talend
Mirth
HL7
Java
LAMP
MS SQL Server
HTML5
Twitter Bootstrap
Chicago-based market leader in medically-integrated fitness centers.
Scenario: A woman carrying her toddler falls down a flight of icy steps. Her physician says she requires months of grueling physical therapy to perhaps be healed.
Our client, who runs medically-integrated health centers throughout the US, receives a post-surgery rehab fax referral form from the physician's hospital.
Referral data is then hand-entered into a CRM system.
Customer service follows up with the patient, to "convert" the referral, so the patient can make use of the of the fitness center.
If the patient chooses to becomes a member, Customer Service hand enters detailed patient information into a "Management system".
In the initial patient rehabilitation visit, an initial physical assessment is made, which is managed by different software, and again the patient information is re-entered by the staff in "Assessment software."
During recurring health center visits, all performance data is hand entered into disparate systems.
Before, during and after the treatment, the patient's physician has no clear visibility to monitor or evaluate the patient progress, due to multiple systems used to manage the referral conversion and member management cycles.
Conversion cycles are long, conversion rate is low, and the staff spends much time in data entry rather than on customer service. But most importantly, does the mother get healed?
Usable analytics are scarce due to data silos.
CyByte Solution:
Automated workflow management, utilizing an HL7 interface with EMR to automate the flow of referrals into the CRM, funneling the converted member’s data into Assessment software and Member management system.
Secure HL7 messages back to the referring physician to update on the progress of Patient’s rehab.
Develop enterprise data warehouse to:
Integrate data from CRM, Assessment Software, Member management system, Customer portals and payment platforms
Facilitate Analytics platform for our client’s administration staff, Referring physicians and Patients
Develop a web/mobile responsive enterprise portal to provide a single secure gateway for employees of our client - to eliminate the need to open multiple software applications to serve a customer
CyByte Results: Physicians now have visibility into their patients progress, resulting in improved outcome metrics. Referral Conversion Rate increased by 150% in 6 months. 115% savings through data integration tool selection.
Project completed on time and below budget.
CyByte Stack:
Talend
Mirth
HL7
Java
LAMP
MS SQL Server
HTML5
Twitter Bootstrap
Photo by Rafael Peñaloza
