Connected Teams, Connected Code, and the Connected Device: The Complexities of IoT Development

Presented at IEEE Software Technology Conference in Long Beach, CA, October, 2015

Developing software for the Internet of Things (IoT) comes with its own set of challenges. Security, privacy and unified standards are a few of the key issues. In addition, each IoT product is comprised of (at least) three separate application components: the software embedded in the device, the back-end service, and the mobile application for the end user’s controls.

Wallgren’s presentation will cover how to coordinate the diverse moving parts that must come together when developing an IoT product or updating each of its components.

Transcript

1. © Electric Cloud | electric-cloud.com | @electriccloud Connected Teams, Connected Code, and the Connected Device: The Challenges of IoT Software Delivery Anders Wallgren CTO, Electric Cloud
2. © Electric Cloud | electric-cloud.com | @electriccloud Every Business is a Software Business Embedded/IoT Mobile Enterprise, Web/IT “Software is eating the world” Marc Andreessen, Aug 2011
3. © Electric Cloud | electric-cloud.com | @electriccloud Software is now the primary driver of innovation & disruption.
4. © Electric Cloud | electric-cloud.com | @electriccloud
5. © Electric Cloud | electric-cloud.com | @electriccloud
6. © Electric Cloud | electric-cloud.com | @electriccloud IoT is Everywhere. How does that change our world? 1.Accessible from anywhere 2.Automatically optimizes for cost/comfort 3.Automatically adjusts based on “presence” 4.Provides individual and aggregate reporting 5.Updates delivered continuously OTA
7. © Electric Cloud | electric-cloud.com | @electriccloud What are People Working On? Types of connected devices respondents say will have the largest market opportunity in five years. HP online survey of 610 developers and IT, 2015
8. © Electric Cloud | electric-cloud.com | @electriccloud What do Developers think? Respondents who classify the IoT as "transformative", "important” HP online survey of 610 developers and IT, 2015
9. © Electric Cloud | electric-cloud.com | @electriccloud 26B by 2020 Gartner Prediction on the Internet of Things (excluding PCs, tablets, phones)
10. © Electric Cloud | electric-cloud.com | @electriccloud Today’s cars have over 300m lines of code
11. © Electric Cloud | electric-cloud.com | @electriccloud A Complex Delivery Pipeline
12. © Electric Cloud | electric-cloud.com | @electriccloud IoT: A Complex Environment Systems Driven Product Development Multi- Domain Continuous Delivery Cloud Industry 4.0 Dev Ops
13. © Electric Cloud | electric-cloud.com | @electriccloud Three Applications, one user experience Embedded Software in the Device Big-data backend app Mobile app for end-user controls • Different Teams • Different Tools • Different Development Practices • Different Deployment Targets / Stacks
14. © Electric Cloud | electric-cloud.com | @electriccloud Connecting it All
15. © Electric Cloud | electric-cloud.com | @electriccloud Connected Car: Example of IoT Service’s Components Data exchange Embedded Software (OTA) Mobile App Cloud based software Data Exchange
16. © Electric Cloud | electric-cloud.com | @electriccloud Challenges
17. © Electric Cloud | electric-cloud.com | @electriccloud Demand for More Frequent, OTA Updates
18. © Electric Cloud | electric-cloud.com | @electriccloud Logistics and Coordination of Different Engineering teams (+Minimizing Friction)
19. © Electric Cloud | electric-cloud.com | @electriccloud Long and Challenging Integration Test Cycle
20. © Electric Cloud | electric-cloud.com | @electriccloud Skyrocketing Infrastructure Costs
21. © Electric Cloud | electric-cloud.com | @electriccloud Continued Focus on Reducing Development Costs and Cost Overruns
22. © Electric Cloud | electric-cloud.com | @electriccloud Visibility and Compliance Concerns
23. © Electric Cloud | electric-cloud.com | @electriccloud Quality Issues
24. © Electric Cloud | electric-cloud.com | @electriccloud Customers Want Value. Quickly. In the age of the consumer, empowered buyers demand a new level of customer obsession Amy DeMartine, Forrester
25. © Electric Cloud | electric-cloud.com | @electriccloud Are we there yet? “Are you able to deliver new software to production as fast as the business demands?” Based on a 2015 survey of 90+ IT Managers, Directors, Sr. Directors and VPs, Electric Cloud and Forrester Research Survey No Yes ?
26. © Electric Cloud | electric-cloud.com | @electriccloud Continuous Delivery of IoT Services Data exchange Embedded Software (OTA) Mobile App Cloud based software Data Exchange Multi Domain Continuous Delivery Platform
27. © Electric Cloud | electric-cloud.com | @electriccloud How Do Others Do It?
28. © Electric Cloud | electric-cloud.com | @electriccloud Shared Goals Measure-ability Self-Awareness Expectations Can-Do-Culture Technology
29. © Electric Cloud | electric-cloud.com | @electriccloud Automate! Shrink Cycle Times Done Means Done It Worked in Dev… Build Quality In Keep Improving
30. © Electric Cloud | electric-cloud.com | @electriccloud Best Practices: • End-to-End Visibility and Traceability: • Connect and orchestrate PLM, ALM, CD, OTA workflows • Integrate data of all product components into single EBOM • Global team visibility • Accelerated Delivery: • Remove error-prone, labor intensive manual tasks and transitions or hand off among hardware, software, and delivery teams • Reducing Design-to-Deliver cycles across hardware and software teams • Parallelize and accelerate various tasks in elastic private / semi-private cloud • Predictable Quality: • Test integrated systems earlier and more often • Consistent build, test, release environment to prevent environmental bugs • Accelerated compliance verification and on-demand compliance report
31. © Electric Cloud | electric-cloud.com | @electriccloud Who Does DevOps? Our Customers Networking Other Systems ISV, Internet & Entertainment Heavy Industry Financial Services Automotive Medical Devices Semiconductor Aerospace / Defense Mobile Devices
32. © Electric Cloud | electric-cloud.com | @electriccloud The Value of DevOps and Continuous Delivery 10X faster TTM 90% higher quality 100% cross-team visibility 74% reduced costs 75% improved utilization
33. © Electric Cloud | electric-cloud.com | @electriccloud Cisco Transformative Benefits Challenges • Long delays between releases • Lack of test automation leading to high number of escaped bugs • Poor resource utilization, maintenance overhead Solution • Centralized CD approach • Dynamic creation of workflows 74% better infrastructure utilization Accelerated time to market, with better quality 10X faster software development
34. © Electric Cloud | electric-cloud.com | @electriccloud Qualcomm Transformative Benefits Challenges • Velocity:  2500+ Developers  WW distribution  100,000 jobs/day  Complex workflows Solution  Customized dashboards  Global rollout Automated Linux/Android environments Accelerated Chip design and test ELIMINATED Manual error prone processes
35. © Electric Cloud | electric-cloud.com | @electriccloud GE Energy Transformative Benefits Challenges • 13 global dev locations, 10-15 teams; 800+ developers • Moving from Waterfall to Agile • Long build times (10-15 hours)  1 build per month  Broken builds  Manual tests took weeks Solution • Build Acceleration • CI as A Service with integrated Preflights Accelerated builds from 11 hours to 20 min Eliminated 650k hours of lost productivity per year Improved Dev Productivity 32X
36. © Electric Cloud | electric-cloud.com | @electriccloud Ericsson Transformative Benefits Challenges • Hyper-competitive markets and diverse product lines • Over 2500 developers • Poor developer productivity, time to market, unreliable builds, difficult to maintain • Poor resource utilization, maintenance overhead Solution • Centralized CD infrastructure • Deployment as a service Shared “private cloud” hub for builds Better quality, vitibility, resource utilization, productivity time to market 6X Faster Builds
37. © Electric Cloud | electric-cloud.com | @electriccloud EMC Transformative Benefits Challenges • Multi-site (US/China) Multiple OS • 1400 Devs, supported by US Build and Release Team • Consolidating 3 business units • Adopting Agile • Scheduling slips, lower quality, higher cost of administration Solution • Centralized CD infrastructure • Build acceleration MORE Visibility into consolidated business unit operations Accelerated time to market, with better quality ELIMINATED Jenkins sprawl with centralized control and more visibility
38. © Electric Cloud | electric-cloud.com | @electriccloud Huawei Case Study: An Agile approach to Continuous Delivery Transformation
39. © Electric Cloud | electric-cloud.com | @electriccloud Agile and Beyond
40. © Electric Cloud | electric-cloud.com | @electriccloud Get your ticket now at devopsenterprise.io
41. © Electric Cloud | electric-cloud.com | @electriccloud Continuous Discussions (#c9d9) An open forum to discuss Agile, DevOps and Continuous Delivery. Join us at electric-cloud.com/c9d9 / @electriccloud - #c9d9
42. © Electric Cloud | electric-cloud.com | @electriccloud Thank You
43. © Electric Cloud | electric-cloud.com | @electriccloud EXTRAS
44. © Electric Cloud | electric-cloud.com | @electriccloud BAD UX DESTROYS VALUE
45. © Electric Cloud | electric-cloud.com | @electriccloud Continuous Delivery for Mobile Ship.io Build Deploy 1 4 Test 2 3
46. © Electric Cloud | electric-cloud.com | @electriccloud Continuous Delivery for Embedded Devices PLM Enterprise Application Change Request ALM Enterprise Application Impact Analysis Project Plan Technical Spec Test Plan ElectricFlow Code Build/CI Software-in-loop Hardware-in-loop Compliance Release 1 2 3 3 Binary & Manifest
47. © Electric Cloud | electric-cloud.com | @electriccloud OTA Distribution PLM Enterprise Application Change Request ElectricFlow Extract binary and target list 1 3 Binary & Manifest 2 Initiate OTA process Update meta data Upload package Wait for Success status
48. © Electric Cloud | electric-cloud.com | @electriccloud Continuous Delivery to Data Center ALM Enterprise Application Change Request Project Plan Technical Spec Test Plan ElectricFlow CI Deploy 1 2 3 4
49. © Electric Cloud | electric-cloud.com | @electriccloud Continuous Delivery for IoT Teamcenter PLM Change Request Arynga OTA ElectricFlow Code Build/CI Software-in-loop Hardware-in-loop Compliance Release 1 2 Binary & Manifest Change Request ElectricFlow Process payload and target information Invoke Arynga Get Confirmation 3 8 OTA Successful Create Release Pkg OTA Successful Binary & Manifest Approve Release Pkg 4 7 5 6
50. © Electric Cloud | electric-cloud.com | @electriccloud Techniques • End-to-End Visibility and Traceability: • Connect and orchestrate PLM, ALM, CD, OTA workflows • Integrate data of all product components into single EBOM • Global team visibility • Accelerated Delivery: • Remove error-prone, labor intensive manual tasks and transitions or hand off among hardware, software, and delivery teams • Reducing Design-to-Deliver cycles across hardware and software teams • Parallelize and accelerate various tasks in elastic private / semi-private cloud • Predictable Quality: • Test integrated systems earlier and more often • Consistent build, test, release environment to prevent environmental bugs • Accelerated compliance verification and on-demand compliance report
51. © Electric Cloud | electric-cloud.com | @electriccloud Integrated Hardware and Software Development, Test, and Release Processes
52. © Electric Cloud | electric-cloud.com | @electriccloud Integrated Software OTA Update
53. © Electric Cloud | electric-cloud.com | @electriccloud Arynga CarSync Architecture CarSync™: End-End, OTA vehicle software, firmware, and data management solution. Features: • Highly scalable Backend architecture based on the Erlang technology, • BackOffice with advanced and user intuitive GUI, • Easily portable Embedded Client (both open source and proprietary versions available) • A-Diff Tool for file based OS and direct FLASH memory updates. • As benchmarked by the industry – the A-Diff tool affords the fastest client update time and smallest memory footprint. • Modular architecture for scalability and easy integration with 3rd party SW and systems. OEM Data Analytics CarSync™ In-Vehicle Gateway ECUs Infotainment & Telematics Chassis Power Train Safety & Security Body & Comfort CarSync™ Management System Arynga Differential Tool Tier 1 (Update) CarSync™ BackOffice Arynga Differential Tool
54. © Electric Cloud | electric-cloud.com | @electriccloud PLM + ALM + CD = Multi Domain Continuous Delivery
55. © Electric Cloud | electric-cloud.com | @electriccloud Global Team Coordination Before: • Redundant low utilization infrastructure for each team • Multiple admins • Inconsistent infrastructure • No one can see the whole system • Very hard to troubleshoot issues • Lack of visibility to many different projects and groups Users in region A Users in region B Users in region C Users in region D High available, horizontal scalable cloud resource manager Consolidated dashboards for All projects from different regions Computing resources as private cloud accessible from all regions After: • Less hardware BUT much higher utilization • Consistent tool chain, configuration, and environment • Centralized views to all projects in different regions • Drill down views to accelerate troubleshooting • Fast issues detection and resolution • Divert human resources from managing manual process to R&D • Authentication and Authorization for global Intellectual Property protection