Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Data in Motion - Data Engineering Meetup by RecDoTec

5648ef74e40ec5c26fd0b33f2f961038?s=47 Autoletics
February 08, 2018

Data in Motion - Data Engineering Meetup by RecDoTec

A short talk and demo on the benefits of simulation, driven by streamed event data, over traditional big data processing techniques, and how event streams can be used to reconstruct actual behavior a scientist or data engineer wishes to observe, inspect, filter, and transform.

5648ef74e40ec5c26fd0b33f2f961038?s=128

Autoletics

February 08, 2018
Tweet

Transcript

  1. DATA IN MOTION WILLIAM LOUTH

  2. THE OBSERVABLE UNIVERSE ACTIVITY STATE OBSERVABLE RECORD RETRIEVE COLLECTOR SELECT

    ASSESS OBSERVER OBSERVATIONS QUERIES DATASET AGENTS RESOURCES ENVIRONMENT SENSORS INSTRUMENTS ACCURACY PRECISION STORAGE MODELS PATTERNS PREDICTIONS SIMULATIONS
  3. THE MOVEMENTS STATES SENSORS DATA DELTA TIME CHANGE COGNITION CONTROL

    ACTION MEASUREMENT EVENT FLOWS / PIPES PAST / PRESENT
  4. CASE STUDY - IOT METERS READINGS THERMOSTAT TABLES RECORDS CLUSTER

    CODE CONFIG SCHEDULER CHANGE TASK HEATING / ENERGY DEVICES / SAMPLES MAP / REDUCE DATASET
  5. FLATLINERS SAMPLES Δ METER 1 METER 2 Δ Δ Δ

    Δ Δ Δ Δ Δ Δ Δ Δ Δ Δ TIME LAST LAST FIRST FIRST
  6. RESURRECTION SPARSE DATA DENSE DATA SIMULATE / INFLATE

  7. CASE STUDY - APM EXECUTIONS STATES SERVICE RECORDS CHANGES MONITOR

    CONSOLES CHARTS OPERATOR METRIC QUERY ACTION / EFFECT EVENT / SIGNAL SENSE / REACT DATASET
  8. LOST IN TRANSLATION GRAPH METRIC CHART CALLER / CALLEE STACKS

    / FRAMES SEQUENCES / PATHS THREADS / REQUESTS SCOPES / BOUNDARIES ENTRY / EXIT OBJECT / CODE STATE / CONTEXT DELTA / TIME AGENT ATTITUDE ACT AGENCY PURPOSE SCENE MOTIVE / PRESCRIBED GOAL / PLANNED CONDITION / PROVISION
  9. MOTION PICTURE FILM FRAME CLIP ACT SCENE SETTING STATE BEHAVIOR

    CHANGE RECORDING SNAPSHOT SEGMENT PHASE TIME ENVIRONMENT ACTOR ACTIVITY EVENT
  10. AUTOLETICS A SIMULATED UNIVERSE

  11. TIME MACHINE IMMERSIVE EXPERIENCES [ SOFTWARE MEMORIES & SIMULATED WORLDS]

    MAN-MACHINE COOPERATION [ CONVERSATIONAL DIALOGS ] BEHAVIORAL MODELING & MANIPULATION [ SYSTEM DYNAMICS & ADAPTIVE CONTROL] FICTION TO FUTURE
  12. None