SOFTWARE 2.0 SIMPLE CARS WITH COMPLEX SOFTWARE JOSH FRIEDMAN 2018/09/20 

OVERVIEW ROUGH CONTENTS ▸ What is Software 2.0? ▸ Deep Learning for the Masses ▸ Disruption in the Automotive Industry ▸ Future Implications ▸ What to Remember… 

WHAT IS SOFTWARE 2.0? 

WHAT IS SOFTWARE 2.0? SOFTWARE 1.0 ▸ Programmer decides desired behaviour ▸ Explicit instructions to the computer by the programmer ▸ Written in known languages - Python, Java, C++ 

WHAT IS SOFTWARE 2.0? SOFTWARE 2.0 ▸ Abstract ▸ Human unfriendly language ▸ Programmers instead specify the behaviour with a rough skeleton of the search space and optimise 

1.0 Programmers ▸ Maintain surroundings ▸ Tooling ▸ Analytics ▸ Visualizations ▸ Infrastructure 2.0 Programmers ▸ Maintain data for training ▸ Maintains ▸ Massage ▸ Clean ▸ Label WHAT IS SOFTWARE 2.0? SOFTWARE 2.0 

▸ What is the stack for Software 2.0? ▸ ____________________ ▸ What will be the VCS for Software 2.0? ▸ ____________________ WHAT IS SOFTWARE 2.0? SOFTWARE 2.0 

DEEP LEARNING FOR THE MASSES 

DEEP LEARNING FOR THE MASSES DEEP LEARNING AS A COMMODITY ▸ Training a deep neural network requires little to no understanding of numerical stability, cross entropy, etc… ▸ Open source and have enabled anyone to train and/or deploy a model ▸ … ▸ Which simplifies the picture to how to build the most effective training dataset? 

DEEP LEARNING FOR THE MASSES DON’T DO TRY THIS AT HOME ▸ Connected RPi3 with camera pointed at the street ▸ Minimal effort to build a scheduled inference workflow ▸ Goal is to identify free parking spots* 

DEEP LEARNING FOR THE MASSES DON’T DO TRY THIS AT HOME ▸ Connected RPi3 with camera pointed at the street ▸ Minimal effort to build a scheduled inference workflow ▸ Goal is to identify free parking spots* 

DATA IS THE NEW OIL. IT’S VALUABLE, BUT IF UNREFINED IT CANNOT REALLY BE USED. IT HAS TO BE CHANGED INTO GAS, PLASTIC, CHEMICALS, ETC TO CREATE A VALUABLE ENTITY THAT DRIVES PROFITABLE ACTIVITY. Clive Humby (2006) DEEP LEARNING FOR THE MASSES 

DEEP LEARNING FOR THE MASSES LABELS ARE INVALUABLE 

TESLA AUTOMATIC WINDSHIELD WIPERS ▸ Dashboard cameras from the entire Tesla fleet results in a massive collection of data ▸ Essentially driving data streams ▸ Labelling is complex with real-world conditions DEEP LEARNING FOR THE MASSES 

REAL WORLD TESTING DEEP LEARNING FOR THE MASSES 

DISRUPTION IN THE AUTOMOTIVE INDUSTRY 

DISRUPTION DISRUPTION IN THE AUTOMOTIVE INDUSTRY 

STATUS QUO DISRUPTION IN THE AUTOMOTIVE INDUSTRY ▸ Standard car companies fight for “dashboard” space ▸ Steering wheel team hates the entertainment team ▸ Electric and electronics are separate and independent ▸ This results in a complex car with simple firmware ▸ Tesla flipped this “equation” on its head ▸ Simple cars with complex software 

WHAT IS TESLA DOING? DISRUPTION IN THE AUTOMOTIVE INDUSTRY 

REAL DISRUPTION DISRUPTION IN THE AUTOMOTIVE INDUSTRY ▸ The first reaction - “Let’s just hire some developers!” ▸ [internal mess] ▸ The next solution - “Let’s just buy it” 

SOFTWARE 2.0 IN ACTION DISRUPTION IN THE AUTOMOTIVE INDUSTRY ▸ Tesla is not competing with Detroit ▸ Tesla is now battling with Silicon Valley for automation ▸ Its vast fleet equipped with sensors is their New New Oil ▸ Sell cars with sensors ▸ Collect more sensor data ▸ Train better model ▸ Push OTA autonomy upgrades ▸ Sell more cars with sensors 

FUTURE IMPLICATIONS 

FUTURE IMPLICATIONS THE PATH TO AUTONOMY Tesla’s Conceptual Software “Divide” over Time 

FUTURE IMPLICATIONS PRIVACY ▸ Autonomous cars powered by Software 2.0 will enable mass amounts of continuous, high definition 360° video 

FUTURE IMPLICATIONS PRIVACY Prepare yourself for even more targeted advertisements, and good luck “opting” out! 

FUTURE IMPLICATIONS MANDATORY BLACK MIRROR REFERENCE 

WHAT TO REMEMBER 

CONCLUSION A FEW POINTS ▸ Software divide exists for ML applications ▸ Maintain surroundings vs. maintain data for training ▸ Deep Learning is now a commodity ▸ Training data >>>>>> understanding model architecture ▸ Tesla ships simple cars with complex software ▸ Automotive training data is invaluable for success ▸ Don’t forget about future privacy issues! 

No content

REFERENCES LIST OF SOURCES ▸ Building the Software 2.0 Stack ▸ Labeled Data ▸ Software Disruption in the Automotive Industry ▸ Tesla’s Model 3 UI ▸ Move Fast and Break Things ▸ Autonomous Vehicles and Privacy