From Big Data to Smart Information

Mike Small, Senior Analyst, Kuppinger Cole

Transcript

1. From Big Data to Smart Information IT Tinget 2013 Mike Small CEng, FBCS, CITP Senior Analyst Kuppinger Cole Mike.Small@kuppingercole.com
2. • There is now an enormous quantity of data which exists in a wide variety of forms and is being generated very quickly. Big Data in itself has no meaning and no value. Smart Information is Big Data analyzed to make it useful to transform products, improve planning and optimize operations. This presentation will describe the opportunities from Big Data and how to safely benefit from these. Abstract 10/8/2013 © KuppingerCole 2
3. Agenda © KuppingerCole 3 • Big is Relative • Smart Information • Case Studies • Challenges • Summary 10/8/2013
4. BIG IS RELATIVE! We will not be able to make any money selling the 30Mb disk drives. Customers will only need one! Computer salesman circa 1969
5. •Manual collection and analysis of mortality data. 19th Century •Moon mission planned and managed using computers with 64Kb memory. 1960’s •Database tables with millions of rows. 1990’s •According to IDC, 2.8ExaBytes (1018) of data will have been created and replicated in 2012 2012 Big Data is a Relative Term 10/8/2013 © KuppingerCole
6. SMART INFORMATION Smart Information is Big Data analyzed to make it useful - for example to transform products, improve planning and optimize operations.
7. Big Data vs. Smart Information 10/8/2013 © KuppingerCole Big Data Symbols without context processed or stored by a computer Millions of events in log files Smart Information Big Data with interpretation and context that provides answers to questions A pattern of events indicating fraudulent activity
8. • “Companies that use ‘data driven decision making’ actually show higher performance… I analyzed 179 large publicly-traded firms and found that the ones that adopted this method are about 5% more productive and profitable than their competitors. “ Getting Competitive Advantage from Big Data © KuppingerCole 8 10/8/2013 Transforming the Product Changing the nature of competition Improving the competitive edge Michael E Porter and Victor E Millar, Harvard Business Review Jul-Aug 1985 http://mitsloanexperts.mit.edu/erik-brynjolfsson-on-big- data-a-revolution-in-decision-making-improves- productivity/
9. SMART INFORMATION IN ACTION Transforming the product, Changing the nature of competition, Improving the competitive edge.
10. Can big data help fight fires and save lives? BBC News 26 March 2013 http://www.bbc.co.uk/news/business-21902070 Amsterdam’s fire service is using Big Data to decide where the risk of fire and other incidents is highest, and how resources should be deployed to greatest effect. They have built a data warehouse based on government open-source data on buildings, streets, roads, waterways and transport links in the region combined with fire service incident reports. This data is processed, analysed and displayed on a map. Better Risk Management 10/8/2013 © KuppingerCole
11. “300 hours lost production time from a single piece of equipment” http://www.catminestarsystem.com/articles/health-technologies-reducing- unscheduled-downtime Choosing the best time to replace expensive parts is important. Replacing a part too early leads to unnecessary cost but allowing a part to fail can have catastrophic results. By using on board monitoring Caterpillar makes it possible to choose the ideal moment to perform the replacement on their equipment. Improving Equipment Availability 10/8/2013 © KuppingerCole
12. Minimizing Attacker Free Time • 150 Million attacks per day detected by one MSSP • One user act generates multiple system logs and network events. • The challenge is to identify abnormal patterns amongst millions of events. • Before the attacker can do damage • Then to learn from that example to predict similar anomalies Reducing Operational Risk 10/8/2013 © KuppingerCole http://www.nerc.com/files/HILF.pdf
13. NPV Costs Avoided between £0.5B and £10B • Low Carbon Technologies mean unpredictable changes to energy demand. • Smart Meters provide instrumentation to monitor and manage that demand. • Early detection of local outages & customer notifications • 28 million electricity smart meters generating 6.72 billion measurements per day. http://www.energynetworks.org/electricity/futures/smart-meters.html Better Planning to Reduce Costs 10/8/2013 © KuppingerCole
14. More data means more accurate models for placement of wind turbines • Current library of 2.8 petabytes of data includes more than 178 parameters. • Big data techniques allow 10 fold expansion of data. • Time to get answers reduced from 3 week to 15 minutes. http://www.ibmbigdatahub.com/sites/default/files/document/IMC14702USEN.P DF Better Planning Improves Efficiency 10/8/2013 © KuppingerCole
15. CHALLENGES Will Big Data really make a difference? What are the security challenges from Big Data?
16. Will Big Data Really Make a Difference? 10/8/2013 © KuppingerCole 16 • Is the small improvement worth the costs? Benefit vs. Cost • Wrongly anticipating the customer’s needs can be worse than doing nothing Accuracy vs. Annoyance • Misplaced certainty can lead to disaster. Hubris
17. Security Challenges 10/8/2013 © KuppingerCole 17 Insecure Infrastructure Secure distributed computing framework Secure non SQL stores Control access to multi level stores and logs Improper Analysis Data provenance Granular access control Detect misuse and unauthorized access Assuring Compliance Trust in data sources Scalable Privacy Auditing https://downloads.cloudsecurityalliance.org/initiatives/bdwg/Big_Data_Top_Ten_v1.pdf
18. The Bad Guys can also Use Big Data 10/8/2013 © KuppingerCole 18 •Big Data will provide attackers with information to place more successful malware attack Malware •Big Data will provide attackers with additional intelligence about exploits and methods to better utilize exploit kits Exploits •Big Data will provide with insights towards data breaches Data Breaches •Discovery of information within Big Data will facilitate identity theft Identity Theft http://www.enisa.europa.eu/activities/risk-management/evolving-threat-environment/ENISA_Threat_Landscape/at_download/fullReport
19. SUMMARY Smart Information is Big Data analyzed to make it useful to transform products, improve planning and optimize operations.
20. Summary 10/8/2013 © KuppingerCole 20 • Volume, Velocity and Variety Big Data • Provides useful answers to questions Smart Information • Detecting anomalies, Better Planning, Optimizing Operations Example Benefits • Cost, Compliance and Security New Challenges
21. QUESTIONS
22. The Future of Information Security – Today. KuppingerCole supports IT professionals with outstanding expertise in defining IT strategies and in relevant decision making processes. As a leading analyst company KuppingerCole provides first-hand vendor-neutral information. Our services allow you to feel comfortable and secure in taking decisions essential to your business. Kuppinger Cole Ltd. Am Schloßpark 129 65203 Wiesbaden | Germany Tel +49 (211) 23 70 77 – 0 Fax +49 (211) 23 70 77 – 0 www.kuppingercole.com
23. No. Type Title L. 70744 Executive View Big Data and Information Stewardship 70750 Advisory Note From Big Data to Smart Information Related Research 10/8/2013 © KuppingerCole 23