What anML-ful worldBritt Barak
View Slide
Once upon a time@BrittBarak
beta@BrittBarak
ML Capability ?!@BrittBarak
Who is afraid ofMachine Learning?& First Steps With ML-Kit@BrittBarak
Britt BarakDeveloper Experience, NexmoGoogle Developer ExpertBritt Barak @brittBarak
@BrittBarak
=@BrittBarak
§What’s the difference?@BrittBarak
…and classify?@BrittBarak
This is a strawberry@BrittBarak
This is a strawberryRed SeedspatternNarrowtopleaves@BrittBarakPointyat thebottomRoundat the top
Strawberry NotNotNotStrawberryStrawberryNotNotNot@BrittBarak
~*~ images ~*~@BrittBarak
@BrittBarakVision library
Text Recognition@BrittBarak
Face Detection@BrittBarak
Barcode Scanning@BrittBarak
Image Labelling@BrittBarak
Landmark Recognition@BrittBarak
Custom Models@BrittBarak
Example@BrittBarak
Detectordetector.execute(image)Result:@BrittBarak“Ben & Jerry’spistachioice cream”
1. Setup Detector@BrittBarak
Local or cloud?@BrittBarak
Local•Realtime•Offline support•Security / Privacy•Bandwith•…@BrittBarak
Cloud•More accuracy & features•But more latency•Pricing@BrittBarak
Text DetectortextDetector =FirebaseVision.getInstance()@BrittBarak
Text DetectortextDetector =FirebaseVision.getInstance().onDeviceTextRecognizer@BrittBarak
Text DetectortextDetector =FirebaseVision.getInstance().cloudTextRecognizer@BrittBarak
2. Process input@BrittBarak
FirebaseVisionImage•Bitmap•image Uri•Media Image•byteArray•byteBuffer@BrittBarak
image = FirebaseVisionImage.fromBitmap(bitmap)@BrittBarakText Detector
3. Execute the model@BrittBarak
Text DetectortextDetector.processImage(image)@BrittBarak
Text DetectortextDetector.processImage(image).addOnSuccessListener {}@BrittBarak
Text DetectortextDetector.processImage(image).addOnSuccessListener {firebaseVisionTexts ->processOutput(fbVisionTexts)}@BrittBarak
4. Process output@BrittBarak
firebaseVisionTexts.text@BrittBarak
someTextView.text =firebaseVisionTexts.text@BrittBarakUI
Result@BrittBarak
(another) Example : Labelling@BrittBarak
Detectordetector.execute(image)Result:@BrittBarakice cream pint
VegetablesDesertsVegetables
Image ClassifierimageDetector =FirebaseVision.getInstance()@BrittBarak
Image ClassifierimageDetector =FirebaseVision.getInstance().visionLabelDetector@BrittBarak
Image ClassifierimageDetector =FirebaseVision.getInstance.visionCloudLabelDetector@BrittBarak
image = FirebaseVisionImage.fromBitmap(bitmap)@BrittBarakImage Classifier
Image ClassifierimageDetector.detectInImage(image)@BrittBarak
Image ClassifierimageDetector.detectInImage(image).addOnSuccessListener{}@BrittBarak
Image ClassifierimageDetector.detectInImage(image).addOnSuccessListener{ fBLabels ->processOutput(fBLabels)}@BrittBarak
fbLabel.labelfbLabel.confidencefbLabel.entityId@BrittBarak
UIfor (fbLabel in labels) {s ="${fbLabel.label} : ${fbLabel.confidence}"}@BrittBarak
Result
It is an ML-ful worldEnjoy!
Thank you!Keep in touch!