Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Car brand recognition using SAP Data Hub

8c99732998590e4643b8616748adf2a1?s=47 PhilMAD3
October 11, 2019

Car brand recognition using SAP Data Hub

This slide deck showed our use case for doing image recognition via Tensorflow in a dataflow managed by SAP Data Hub.

8c99732998590e4643b8616748adf2a1?s=128

PhilMAD3

October 11, 2019
Tweet

Transcript

  1. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 1 INTEGRATING WITH

    SAP DATA HUB EXAMPLE: CAR BRAND RECOGNITION *pron. [z ʊ l ts ə r] * jorge.plaza@sulzer.de philipp.nell@sulzer.de
  2. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 2 Looking back

    to sitBCN 2018 What is SAP Data Hub all about Building pipelines for transforming data Today’s show case “Car brand recognition” (again ) Demo More ideas INTEGRATING WITH SAP DATA HUB AGENDA
  3. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 3 LOOKING BACK

    TO SITBCN 2018 https://www.youtube.com/watch?v=YXCU6ZaQLkQ
  4. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 4 LOOKING BACK

    TO SITBCN 2018
  5. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 5 Data Hub

    is a complex utility for data orchestration and metadata management across heterogeneous data sources Its development has been favored by the arrival of Big Data to the business world: WHY DATAHUB Source: https://www.sap.com
  6. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 6 Many distributed

    file systems in the business scope give, as a result, very complex system ecosystems WHY DATAHUB Source: https://www.sap.com
  7. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 7 SAP Data

    Hub uses a modern open architecture All necessary components are fully containerized and delivered as a Docker image ARCHITECTURE *Kubernetes is an open-source system for automating deployment, scaling, and management of containerized applications SAP Data Hub decouples data processing (in Kubernetes*) and data storages (any supported cloud store) Source: https://www.sap.com
  8. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 8 ARCHITECTURE What

    do you need? Where to deploy it? You need to take care of It has been taken care of
  9. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 9 FUNCTIONAL OVERVIEW

    OF SAP DATA HUB
  10. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 10 CONNECTION MANAGEMENT

    Allowed system types definitions can be found in the Connection Types tab within this tool. https://help.sap.com/viewer/1246f58c6a74412580877af1f484f41a/2.6.latest/en-US/c68bcf2d960547879d7fcc6ab7a2bfa5.html
  11. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 11 Manage data

    across different systems, get data previews, make data more accessible to other users, prepare and validate the data… https://help.sap.com/viewer/bd9aff2447b24109bccbd7618cfd542e/2.6.latest/en-US METADATA EXPLORER
  12. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 12 METADATA EXPLORER

    Metadata preview and filtering, monitor the status of the Metadata Explorer tasks…
  13. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 14 SYSTEM MANAGEMENT

    Manage user’s workspace, share files to tenant workspace, change user password, manage user applications https://help.sap.com/viewer/1246f58c6a74412580877af1f484f41a/2.6.latest/en-US/76e7a1faa64f408e9e72dc2fa4071964.html
  14. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 15 PIPELINE MODELER

    (1/5)
  15. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 16 PIPELINE MODELER

    (2/5)
  16. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 17 PIPELINE MODELER

    (3/5)
  17. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 18 PIPELINE MODELER

    (4/5)
  18. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 19 PIPELINE MODELER

    (5/5) PIPELINES OUT OF THE BOX Import ABAP operators Basic Validation Rule Load into SAP Vora Sentiment Analisis S3
  19. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 20 1. Retrieve

    files from source • Cold storage • Streaming • … 2. Send images to TF server 3. Save (real-time) results to HANA TODAY’S SHOWCASE STEPS
  20. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 21 • This

    operator is used to read a file or periodically poll a directory for its contents in a storage service • The JavaScript operator allows you to execute JavaScript snippets within a graph • An HTTP client operator capable of sending arbitrary HTTP requests, polling a URL and POSTing JSON data • This operator executes SQL statements and inserts CSV or JSON data into an SAP HANA instance TODAY’S SHOWCASE OUR OPERATORS
  21. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 22 TODAY’S SHOWCASE

    RESULT
  22. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 23 SHOWTIME

  23. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 24 Any question

    Suggestion, Feedback