CoreMLͰ͸͡ΊΔػցֶश Neural Networks on Keras ( TensorFlow backends ) Timers inc. / Github: naru-jpn / Twitter: @naruchigi

CoreMLͰ͸͡ΊΔػցֶश Timers inc. / Github: naru-jpn / Twitter: @naruchigi Neural Networks on Keras ( TensorFlow backends )

What is Neural Networks?

One of machine learning models. - Neural networks - Tree ensembles - Support vector machines - Generalized linear models - … https://developer.apple.com/documentation/coreml/converting_trained_models_to_core_ml

What is Keras?

Theano TensorFlow Keras Keras is a high-level neural networks API, written in Python and capable of running on top of either TensorFlow, CNTK or Theano. https://keras.io

What is CoreML?

Accelerate and BNNS Metal Performance Shaders CoreML BNNS : Basic Neural Network Subroutines https://developer.apple.com/documentation/coreml With Core ML, you can integrate trained machine learning models into your app. Core ML requires the Core ML model format.

CoreML Trained Model Application Keras Train coremltools

What is coremltools?

Convert existing models to .mlmodel format from popular machine learning tools including Keras, Caffe, scikit-learn, libsvm, and XGBoost. https://pypi.python.org/pypi/coremltools coremltools

CoreML Trained Model Application Keras Train coremltools

(Demo App)

Environment - Tensorflow 1.1.0 (virtualenv) - Keras 1.2.2 - coremltools 0.3.0 - Xcode 9.0 beta ※ Tensorflow, Keras ͸ coremltools ͷରԠόʔδϣϯͰ͋Δඞཁ͕͋ΔͷͰগ͠ݹ͍Ͱ͢ɻ

Programs to train neural networks - mnist_mlp.py - mnist_cnn.py ※ Keras ͷ࠷৽όʔδϣϯ΁ͷϦϯΫʹͳ͍ͬͯ·͕͢ɺ࣮ࡍ͸όʔδϣϯ 1.2.2 Λࢀর͠·͢ɻ https://github.com/fchollet/keras/tree/master/examples

Convert model with coremltools 1. Import coremltools import coremltools model = Sequential() …
 coreml_model = coremltools.converters.keras.convert(model) coreml_model.save("keras_mnist_mlp.mlmodel") 2. Convert model

Import model into Xcode project // 入力データ class keras_mnist_mlpInput : MLFeatureProvider { var input1: MLMultiArray // … } // 出力データ class keras_mnist_mlpOutput : MLFeatureProvider { var output1: MLMultiArray // … } // モデル @objc class keras_mnist_mlp:NSObject { var model: MLModel init(contentsOf url: URL) throws { self.model = try MLModel(contentsOf: url) } // … func prediction(input: keras_mnist_mlpInput) throws -> keras_mnist_mlpOutput { // … keras_mnist_mlp.mlmodel Λѻ͏ҝͷίʔυ͕ࣗಈੜ੒͞ΕΔ

Prepare model and input in code // モデルの作成 let model = keras_mnist_mlp() // 入力データの格納用変数 (入力は28*28の画像) let input = keras_mnist_mlpInput( input1: try! MLMultiArray(shape: [784], dataType: .double) )

Modify input value // 入力データの 0 番目の要素に 1.0 を代入 input.input1[0] = NSNumber(value: 1.0)

Make a prediction // モデルに入力データを渡して計算 let output = try model.prediction( input: self.input )

CoreML Trained Model Application Keras Train coremltools Recap

Demo App on Github https://github.com/naru-jpn/MLModelSample

͝ਗ਼ௌ͋Γ͕ͱ͏͍͟͝·ͨ͠