Octember - Social Graph Based People Recommender with Amazon Neptune and Textract

Slide 1

Slide 1 text

Sungmin Kim Solutions Architect, AWS OctemberTM on AWS

Slide 2

Slide 2 text

What to be expected • Understanding Customers • Legacy Architecture • To-Be Architecture • Amazon Textract - Easily extract text and data from Biz. cards • Amazon Elasticsearch Service – Search Biz. cards • Amazon Neptune – Find and connect People You May Know • Demo

Slide 3

Slide 3 text

OctemberTM Mission Your People Are Your Most Important Asset!

Slide 4

Slide 4 text

OctemberTM Competitor Trend

Slide 5

Slide 5 text

As-Is Pain Points ① 명함 이미지의 문자 인식 자동화 ② 이미지 처리/검색/인맥 추천 서비스의 독립적인 운영 및 배포 ③ 소셜네트워크 데이터 분석 시스템 구축 upload a biz card image search store a biz card image Image Store (Files) Text Store (RDS) Typists extract text data from biz card images return search results store text data

Slide 6

Slide 6 text

Whiteboard Architecture

Slide 7

Slide 7 text

/search To-Be /pymk Bizcard Image S3 Object Creation Event S3 Object Path API Gateway S3 API Gateway API Gateway S3 S3 JSON Kinesis Data Streams Lambda function Elasticsearch Service ElastiCache ElastiCache Lambda function Kinesis Data Firehose Lambda function Lambda function Neptune DynamoDB Textract

Slide 8

Slide 8 text

Amazon Textract 거의 모든 문서에서 텍스트와 데이터를 손쉽게 추출 Extract data quickly & accurately No code or templates to maintain { Start Date: 1/15/2009 End Date: 6/30/2013 Employer Name: Any Company Position Held: Head Baker Reason for leaving: Family relocated} Full Name: First: John Middle: X Last: Doe Date of Birth: MM: 01 DD: 01 YYYY: 1971 Gender: Male: True Female: False Form Table Text Output

Slide 9

Slide 9 text

API Gateway S3 Lambda function Textract DynamoDB Kinesis Data Streams S3 To-Be: 명함 이미지 자동 인식 { name: “OOO”, jobtitle: “OOO”, mobile: ’ooo-xxx-xxx” email: “xyz@xxx”, address: “OOO” } S3 Object Creation S3 Object Path Bizcard Image json

Slide 10

Slide 10 text

Amazon Elasticsearch Service 완전 관리, 확장 가능 및 보안형 Elasticsearch 서비스

Slide 11

Slide 11 text

API Gateway S3 Lambda function Textract Kinesis Data Streams S3 Kinesis Data Streams Kinesis Data Firehose Elasticsearch Service Lambda function API Gateway ElastiCache S3 To-Be: 명함 검색 서비스 DynamoDB /search

Slide 12

Slide 12 text

Amazon Neptune 클라우드용으로 구축된 빠르고 안정적인 그래프 데이터베이스 Social Networking Recommendation Engines Fraud Detection Knowledge Graphs

Slide 13

Slide 13 text

Lambda function Neptune API Gateway S3 Lambda function Textract Kinesis Data Streams S3 Kinesis Data Streams Lambda function API Gateway ElastiCache To-Be: 인맥 추천 서비스 DynamoDB /pymk

Slide 14

Slide 14 text

How To Solve Pain Point (1) /pymk Bizcard Image API Gateway S3 API Gateway API Gateway S3 S3 Kinesis Data Streams Lambda function Elasticsearch Service ElastiCache ElastiCache Lambda function Kinesis Data Firehose Lambda function Lambda function Neptune DynamoDB Textract 명함 이미지의 문자 인식 자동화 /search

Slide 15

Slide 15 text

How To Solve Pain Point (2) /search /pymk Bizcard Image API Gateway S3 API Gateway API Gateway S3 S3 Kinesis Data Streams Lambda function Elasticsearch Service ElastiCache ElastiCache Lambda function Kinesis Data Firehose Lambda function Lambda function Neptune DynamoDB Textract 명함 이미지 처리 검색 서비스 인맥 추천 서비스

Slide 16

Slide 16 text

How To Solve Pain Point (3) /search /pymk Bizcard Image API Gateway S3 API Gateway API Gateway S3 S3 Kinesis Data Streams Lambda function Elasticsearch Service ElastiCache ElastiCache Lambda function Kinesis Data Firehose Lambda function Lambda function Neptune DynamoDB Textract 소셜네트워크 데이터 분석 시스템 구축

Slide 17

Slide 17 text

AWS Well-Architecture Framework Performance efficiency Cost optimization Security Reliability Operational excellence Set of questions you can use to evaluate how well an architecture is aligned to AWS best practices https://wa.aws.amazon.com/wat.map.en.html

Slide 18

Slide 18 text

/search Is Well-Architected? /pymk Bizcard Image S3 Object Creation Event S3 Object Path API Gateway S3 API Gateway API Gateway S3 S3 JSON Kinesis Data Streams Lambda function Elasticsearch Service ElastiCache ElastiCache Lambda function Kinesis Data Firehose Lambda function Lambda function Neptune DynamoDB Textract

Slide 19

Slide 19 text

DEMO

Slide 20

Slide 20 text

Demo: 명함 이미지 이름 직함 주소 전화번호 e-mail

Slide 21

Slide 21 text

Demo: 시나리오 https://github.com/aws-samples/social-graph-based-people-recommender-using-amazon-neptune-and-textract Edy Kim (edy) Poby Kim (poby) Rody Park (rody) Harry Jang (harry) Crong Lee (crong) Pororo Kim (pororo)

Slide 22

Slide 22 text

Demo: PYMK(People You May Know) Edy Kim (edy) Poby Kim (poby) Rody Park (rody) Harry Jang (harry) Crong Lee (crong) Pororo Kim (pororo) https://github.com/aws-samples/social-graph-based-people-recommender-using-amazon-neptune-and-textract

Slide 23

Slide 23 text

AWS의 다양하고 폭넓은 서비스

Slide 24

Slide 24 text

Learn More • Automatically extract text and structured data from documents with Amazon Textract • https://tinyurl.com/yyz6b7qb • Let Me Graph That For You – Part 1 – Air Routes • https://tinyurl.com/yxwh2yl7 • Building an NLP-powered search index with Amazon Textract and Amazon Comprehend • https://tinyurl.com/y4jomub2