Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Car brand recognition using SAP Data Hub

PhilMAD3
October 11, 2019

Car brand recognition using SAP Data Hub

This slide deck showed our use case for doing image recognition via Tensorflow in a dataflow managed by SAP Data Hub.

PhilMAD3

October 11, 2019
Tweet

More Decks by PhilMAD3

Other Decks in Technology

Transcript

  1. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 1 INTEGRATING WITH

    SAP DATA HUB EXAMPLE: CAR BRAND RECOGNITION *pron. [z ʊ l ts ə r] * [email protected] [email protected]
  2. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 2 Looking back

    to sitBCN 2018 What is SAP Data Hub all about Building pipelines for transforming data Today’s show case “Car brand recognition” (again ) Demo More ideas INTEGRATING WITH SAP DATA HUB AGENDA
  3. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 3 LOOKING BACK

    TO SITBCN 2018 https://www.youtube.com/watch?v=YXCU6ZaQLkQ
  4. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 5 Data Hub

    is a complex utility for data orchestration and metadata management across heterogeneous data sources Its development has been favored by the arrival of Big Data to the business world: WHY DATAHUB Source: https://www.sap.com
  5. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 6 Many distributed

    file systems in the business scope give, as a result, very complex system ecosystems WHY DATAHUB Source: https://www.sap.com
  6. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 7 SAP Data

    Hub uses a modern open architecture All necessary components are fully containerized and delivered as a Docker image ARCHITECTURE *Kubernetes is an open-source system for automating deployment, scaling, and management of containerized applications SAP Data Hub decouples data processing (in Kubernetes*) and data storages (any supported cloud store) Source: https://www.sap.com
  7. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 8 ARCHITECTURE What

    do you need? Where to deploy it? You need to take care of It has been taken care of
  8. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 10 CONNECTION MANAGEMENT

    Allowed system types definitions can be found in the Connection Types tab within this tool. https://help.sap.com/viewer/1246f58c6a74412580877af1f484f41a/2.6.latest/en-US/c68bcf2d960547879d7fcc6ab7a2bfa5.html
  9. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 11 Manage data

    across different systems, get data previews, make data more accessible to other users, prepare and validate the data… https://help.sap.com/viewer/bd9aff2447b24109bccbd7618cfd542e/2.6.latest/en-US METADATA EXPLORER
  10. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 12 METADATA EXPLORER

    Metadata preview and filtering, monitor the status of the Metadata Explorer tasks…
  11. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 14 SYSTEM MANAGEMENT

    Manage user’s workspace, share files to tenant workspace, change user password, manage user applications https://help.sap.com/viewer/1246f58c6a74412580877af1f484f41a/2.6.latest/en-US/76e7a1faa64f408e9e72dc2fa4071964.html
  12. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 19 PIPELINE MODELER

    (5/5) PIPELINES OUT OF THE BOX Import ABAP operators Basic Validation Rule Load into SAP Vora Sentiment Analisis S3
  13. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 20 1. Retrieve

    files from source • Cold storage • Streaming • … 2. Send images to TF server 3. Save (real-time) results to HANA TODAY’S SHOWCASE STEPS
  14. Status 14.02.2017 Sulzer España, S.L.U.– sitBCN 2019 21 • This

    operator is used to read a file or periodically poll a directory for its contents in a storage service • The JavaScript operator allows you to execute JavaScript snippets within a graph • An HTTP client operator capable of sending arbitrary HTTP requests, polling a URL and POSTing JSON data • This operator executes SQL statements and inserts CSV or JSON data into an SAP HANA instance TODAY’S SHOWCASE OUR OPERATORS