Upgrade to Pro — share decks privately, control downloads, hide ads and more …

IBM Emerging Technology - Internet of Things

IBM Emerging Technology - Internet of Things

An introduction to IBM Emerging Technology team and some of the work we've done around the Internet of Things.
Covers:
- Conversational IoT
- Node-RED

Nick O'Leary

February 22, 2016
Tweet

More Decks by Nick O'Leary

Other Decks in Technology

Transcript

  1. IBM Emerging Technologies
 - Internet of Things
 
 Nick O’Leary

    – IBM Emerging Technology Services
 @knolleary
  2. Today 2 1. Introduce IBM Emerging Technology
 2. A Conversational

    Internet of Things
 3. Wiring the Internet of Things
  3. 4 We touch on 22 (out of 37) of these

    today More details from Gartner: gtnr.it/1SsEIZl
  4. Emerging Technology 5 • It’s not just about the technology

    • Impact on people, business and society • We ask “so what?” rather than just “what is it?” • We don’t (usually) invent this stuff, but we do try to make it work • A big focus on the
 “edge of the network” • Standards are very important • Open innovation is core • Working with others is critical
  5. 6 • IBM Hursley, ~ 40 people • We work

    with: • Clients, partners, research collaborators, other IBMers • We work on: • Emerging Technology • Innovation • Research • Design and delivery • We worry about: • Keeping our edge, fostering innovation,
 growing our team, staying “open” • Cost recovery • Managing innovation
  6. Our client-funded research work 7 The International Technology Alliance (ITA)

    10 year US/UK fundamental research programme See: bit.ly/1vEueFv
  7. The International Technology Alliance 8 Hybrid Networks
 Network tomography, performance

    & metrics, multicast Security/Network Management & Control
 Clouds, data streaming, secure protocol design Security for Distributed Services
 Secure information flows, security-aware querying, outsourced computation Human-Information Interaction
 Collective cognition, controlled natural language for info extraction & mission matching Distributed Coalition Services Collective Sense-making Under Uncertainty
 Information fusion, querying over distributed networks Distributed Coalition Information Processing for Decision Making: Enable exploitation of agile networks of data & information sources for effective decision making across coalitions Coalition Interoperable Secure & Hybrid Networks: Enable adaptable & interoperable communication- information services for dynamic military coalition environments
  8. 9 • The basic deal: We cost IBM no money

    • …but we must also show impact: • Influence product development • Generate good publicity • Build relationships (client/collaborator etc) • Act as a conduit (e.g. to IBM research) • Deliver first-of-a-kind projects • Win new business (or help others to do so) • Media & analyst relations Making an impact
  9. Gaian Database - biologically-inspired self organisation 10 • Exploit adaptation

    in natural systems to build better networks • Development of robust self-organizing network architectures • Development of frameworks and algorithms for robust fault-tolerant information dissemination • Achievement of robust communications with minimal complexity or human control
 • Building and maintaining a “Social network” of Gaian databases GaianDB Derby Engine: Parsing, Compilation, Execution GaianPStmtNode VTI: Executes queries on physical leaf nodes + Propagates the original SQL (+ queryID & steps state info) to linked Gaian nodes Instantiates Invokes costing methods Pushes columns and ‘where’ clause in a structure MQ(tt) Stream Data Original SQL DB2 Oracle MS SQLServer Sybase MySQL Flat files In-memory tables Derby GaianDB GaianDB GaianDB propagate Text Index Derby tables N0 N3 N11 N4 N5 N1 N2 N6 N7 N8 N10 N9 SQL Query N0 N3 N11 N4 N5 N1 N2 N6 N7 N8 N10 N9 SQL Query Expanded Node
  10. New security & encryption 12 Fully Homomorphic Encryption Enables computation

    on encrypted data e.g. Genome comparison
 Secure Multi Party Computation Garbled Circuits, Super folding Circuits
 Crypto in Smartcards New generation of cards based on java VM – June 2015
 Crypto for Internet of Things Use of RFID security protocols
  11. Oblivious Transfer 13 Can A ask a question of B

    without revealing the question?
 
 Can B can give the correct answer without knowing what answer was given?
  12. Today 14 1. Introduce IBM Emerging Technology
 2. A Conversational

    Internet of Things
 3. Wiring the Internet of Things
  13. 19 Traffic systems Water management Energy grids Healthcare Food systems

    Supply chains Cities Retail A journey that started with visions of a Smarter Planet ….anticipating a world that was instrumented, interconnected, & intelligent before the “Internet of Things” was coined
  14. Now, we are on the threshold of a massive explosion

    of connected things 20 10 billion devices around the world are currently connected to the Internet, including computers and smartphones The number is expected to increase dramatically within the next decade, with estimates ranging from 50 billion devices to reaching 1 trillion The Internet of Things has the potential to create economic impact of $2.7 trillion to $6.2 trillion annually by 2025
  15. 21

  16. 22

  17. 23

  18. 24 Ubiquitous computing names the third wave in computing, just

    now beginning. First were mainframes, each shared by lots of people. Now we are in the personal computing era, person and machine staring uneasily at each other across the desktop. Next comes ubiquitous computing, or the age of calm technology, when technology recedes into the background of our lives. Mark Weiser, Xerox PARC, 1988
  19. 26

  20. 27

  21. 31 Spot Report • Eyewitness reporting of an event •

    Prompt for missing details Information Fusion • Combine information in a report with data from other sources • Confirm inferences with the eyewitness Sensor Tasking • Identify missing information for corroboration or expansion • Obtain human authority to deploy ask/tell confirm why gist/expand
  22. Controlled English 32 there is a person named p1 that

    is known as ‘John Smith’ and is a suspect.
  23. Controlled English 33 “Suspicious  vehicle  heading  south:  black  saloon  with

     license  plate  DEF456”   there is a vehicle named v48 that has DEF456 as registration and has the colour black as colour and has the vehicle body type saloon as body type and is a moving thing. there is a moving thing named v48 that has the direction south as direction of travel.
  24. 34 there is a suspect sighting named SS_v48 that has

    the vehicle v48 as target vehicle and has the person p1 as suspect candidate. because there is a person named p1 that is known as ‘John Smith’ and is a suspect and the person p1 has DEF456 as linked vehicle registration and there is a vehicle named v48 that has DEF456 as registration.
  25. 35 there is a task named TS_SS_v48 that requires the

    intelligence capability localize and is looking for the detectable thing car and is seeking instance the vehicle v48 and operates in the spatial area ‘North Road’ and is ranked with the task priority High. A TRAFFIC OFFICER with EO camera has been tasked to localize a black saloon car (DEF456) with possible suspect John Smith in the North Road area. Be on the lookout for a black saloon car (DEF456) with possible suspect in the North Road area.
  26. 37 the thermometer t1 can measure the environment variable temperature

    and is located in the room r1 the radiator valve v1 can control the environment variable temperature and is located in the room r1 the room r1 has the environment variable temperature that can be measured and that can be controlled
  27. 38

  28. 39

  29. Conversational Homes Nick O’Leary, Dave Braines Emerging Technology Services, IBM

    United Kingdom Ltd, Hursley Park, Winchester, UK Alun Preece, Will Webberley School of Computer Science and Informatics, Cardiff University, Cardiff, UK Abstract—As devices proliferate, the ability for everyday people to interact with them in an intuitive and meaningful way becomes increasingly challenging. In this paper we take the typical home as an experimental environment in which we can investigate the challenges and potential solutions arising from ever-increasing device proliferation and complexity. We show a potential solution based on conversational interactions between “things” in the environment where those things can be either machine devices or human users. The key innovation in our approach is the use of a Controlled Natural Language technology as the single underpinning information representation language for both machine and human agents, enabling both humans and machines to trivially “read” the information being exchanged. This single language that is core to the communication between devices and people is further augmented with a conversational protocol enabling different speech acts to be exchanged within the system. This conversational layer enables key contextual information to be conveyed as well as providing a mechanism for translation from the core CNL language to other forms such as device specific API requests, or more easily consumable human representations. Our goal is to show that a single, uniform language can support machine-machine, machine-human, human-machine and human-human interaction in a dynamic environment that is able to rapidly evolve to accommodate new devices and capabilities as they are encountered. Keywords—IoT, Controlled Natural Language, Conversational Interaction I. INTRODUCTION From an individual agent’s perspective, the Internet of Things (IoT) can be seen as an increasingly large and diverse world of other agents to communicate with. Humans are agents too in this world, so we can observe four kinds of communication: (i) human-machine, (ii) machine-human, (iii) machine-machine, and (iv) human-human. There is a tendency to consider human-oriented (i, iv) and machine-oriented (ii, iii) interactions as naturally requiring different kinds of communication language; humans prefer natural languages, while machines operate most readily on formal languages. In this paper, however, we consider what the IoT world might look like where humans and machines largely use a common, uniform language to communicate. Our design goal is to support communication activities such as: the discovery of other agents and their capabilities, querying other agents and receiving understandable information from them, and obtaining rationale for an agent’s actions. Of key importance in the IoT context is that the proposed approach must be able to cope with rapid evolution of an environment that needs to accommodate new devices, capabilities, and agent types. In Section II, we consider why human users might find such an environment more appealing when machines communicate using an accessible and human-friendly language, than when machines use a tradition machine-to-machine formalism. Section III substantiates our proposed approach using a series of vignettes, while Section IV provides some initial experimental evidence that human-machine and machine- machine interactions can be facilitated via a Controlled Natural Language communication mechanism. Section V concludes the paper. II. BACKGROUND AND RELATED WORK A key part of our approach is to consider the way in which humans “want” to interact with machines in the world. To help us gain insights into these latent human requirements we look towards existing trends and events occurring in the world and use these as inspiration to help us form our hypotheses about what a conversational environment for human-machine agents might entail. The remainder of this section covers this perspective1. A. Social Things The advent of Twitter as a means of social communication has enabled a large number of otherwise inanimate objects to have an online presence. For example Andy Stanford-Clark created accounts for the Red Funnel ferries that service the Isle of Wight in the UK. The accounts2 relay real-time information about the ferry arrivals and departures allowing a subscriber of the account to see if they are running on time. Another example of this was an unofficial account for London’s Tower Bridge3. Its creator, Tom Armitage, created a system that took the published scheduled of bridge opening 1 This section develops ideas first presented in the talk “Conversational IoT” given by Nick O’Leary at ThingMonk 2014, http://bit.ly/conviot 2 https://twitter.com/redjets 3 https://twitter.com/twrbrdg_itself
  30. Today 44 1. Introduce IBM Emerging Technology
 2. A Conversational

    Internet of Things
 3. Wiring the Internet of Things
  31. 48

  32. 49

  33. The Internet of Things does not have a one-size-fits-all solution

    Solutions often require pulling together different device APIs and online services in new and meaningful ways Time spent figuring out how to access a serial port, or to complete an OAuth flow against Twitter is not time spent creating the real value of a solution
  34. We need tools that make it easier for developers at

    all levels to bring together the different streams of events, both physical and digital, that make up the Internet of Things
  35. Wouldn’t it be neat if, when it sends me kicks

    off the or just goes ping! happens, business process an alert that
  36. 56

  37. 57

  38. 58

  39. 59

  40. 60

  41. 61

  42. 62

  43. Today 63 1. Introduce IBM Emerging Technology
 2. A Conversational

    Internet of Things
 3. Wiring the Internet of Things
  44. 64 IBM Emerging Technologies
 - Internet of Things
 
 Nick

    O’Leary – IBM Emerging Technology Services @knolleary http://nodered.org @nodered http://ibm.biz/try_iot @IBMIoT http://bluemix.net @IBMBluemix @IBMETS