Vuzix Developer Conference 20171201

2017年12月1日に開催されたVuzix Developer Conferenceでの発表資料です。

「M300で　　　　アプリ開発」

Transcript

1. C-LIS CO., LTD.
   

   View Slide

2. C-LIS CO., LTD.
   
   ༗ࢁܓೋʢ,FJKJ"3*:"."ʣ
   $-*4$0 -5%
   "OESPJEΞϓϦ։ൃνϣοτσΩϧ
   Photo by Koji MORIGUCHI (MORIGCHOWDER)
   

   View Slide

3. 76;*9%FWFMPQFS$POGFSFODF
   
   
   .ͰɹɹɹɹΞϓϦ։ൃ
   

   View Slide

4. .
   
   

   View Slide

5. 6*ʢग़ྗʣ
   
   nHD - 640x360
   (16:9)
   

   View Slide

6. 6*ʢೖྗʣ
   
   Χϝϥ
   

   View Slide

7. 6*ʢೖྗʣ
   
   KEYCODE_DPAD_LEFT
   KEYCODE_DPAD_RIGHT
   KEYCODE_ENTER
   

   View Slide

8. 6*ʢೖྗʣʔϘλϯΛ௕ԡ͠
   
   ϗʔϜϘλϯ
   KEYCODE_BACK
   KEYCODE_MENU
   

   View Slide

9. 6*ʢೖྗʣ
   
   λονύου
   

   View Slide

10. .ΞϓϦ։ൃߟྀ͢΂͖఺
    3VOUJNF1FSNJTTJPO
    Χϝϥͷ্Լ
    λονύωϧʹґଘ͠ͳ͍ը໘ઃܭ
    
    

    View Slide

11. "OESPJE.BSTINBMMPX
    
    

    View Slide

12. 3VOUJNF1FSNJTTJPO
    
    

    View Slide

13. Χϝϥͷ্Լ
    
    

    View Slide

14. CameraManager manager = (CameraManager) activity.getSystemService(Context.CAMERA_SERVICE);
    CameraCharacteristics characteristics
    = manager.getCameraCharacteristics(cameraId);
    mSensorOrientation = characteristics.get(CameraCharacteristics.SENSOR_ORIENTATION);
    // Orientation
    int rotation = activity.getWindowManager().getDefaultDisplay().getRotation();
    int orientation = (ORIENTATIONS.get(rotation) + mSensorOrientation + 270) % 360;
    captureBuilder.set(CaptureRequest.JPEG_ORIENTATION, orientation);
    
    ݱࡏͷը໘ํ޲ɾΧϝϥͷํ޲Λߟྀ
    https://github.com/googlesamples/android-Camera2Basic
    

    View Slide

15. λονύωϧʹґଘ͠ͳ͍ը໘ઃܭ
    
    

    View Slide

16. 
    ࣄྫ̍
    ϑΥʔΧεͷҠಈ
    

    View Slide

17. ϑΥʔΧεͷॱ൪͕௚ײతͰͳ͍
    
    

    View Slide

18. 
    
    android:id="@+id/button1"
    android:layout_width="0dp"
    android:layout_height="wrap_content"
    android:layout_weight="1"
    android:text="Button 1"
    />
    android:id="@+id/button2"
    android:layout_width="0dp"
    android:layout_height="wrap_content"
    android:layout_weight="1"
    android:text="Button 2"
    />
    
    
    ϑΥʔΧεҠಈ
    
    android:id="@+id/button3"
    android:layout_width="0dp"
    android:layout_height="wrap_content"
    android:layout_weight="1"
    android:text="Button 3"
    />
    android:id="@+id/button4"
    android:layout_width="0dp"
    android:layout_height="wrap_content"
    android:layout_weight="1"
    android:text="Button 4"
    />
    
    
    

    View Slide

19. 
    
    android:id="@+id/button1"
    android:layout_width="0dp"
    android:layout_height="wrap_content"
    android:layout_weight="1"
    android:text="Button 1"
    android:nextFocusRight="@+id/button4"
    android:nextFocusLeft="@+id/button2"
    />
    android:id="@+id/button2"
    android:layout_width="0dp"
    android:layout_height="wrap_content"
    android:layout_weight="1"
    android:text="Button 2"
    android:nextFocusRight="@+id/button1"
    android:nextFocusLeft="@+id/button3"
    />
    
    
    OFYU'PDVT-FGU3JHIU
    
    android:id="@+id/button3"
    android:layout_width="0dp"
    android:layout_height="wrap_content"
    android:layout_weight="1"
    android:text="Button 3"
    android:nextFocusRight="@+id/button2"
    android:nextFocusLeft="@+id/button4"
    />
    android:id="@+id/button4"
    android:layout_width="0dp"
    android:layout_height="wrap_content"
    android:layout_weight="1"
    android:text="Button 4"
    android:nextFocusRight="@+id/button3"
    android:nextFocusLeft="@+id/button1"
    />
    
    
    

    View Slide

20. ϑΥʔΧεҠಈઃఆޙ
    
    

    View Slide

21. 
    ࣄྫ̎
    λον͕࢖͑ͳ͍৔߹ͷ6*
    

    View Slide

22. ΞΫγϣϯόʔͷεΠονʹΞΫηεͰ͖ͳ͍
    
    https://github.com/DeviceConnect/DeviceConnect-Android
    

    View Slide

23. 
    xmlns:app="http://schemas.android.com/apk/res-auto">
    android:id="@+id/activity_service_manager_power"
    app:actionViewClass="android.widget.Switch"
    app:showAsAction="always"
    android:title="@string/app_name"/>
    android:id="@+id/activity_service_menu_item_settings"
    app:showAsAction="never"
    android:title="@string/activity_service_menu_settings"/>
    android:id="@+id/activity_service_menu_item_help"
    app:showAsAction="never"
    android:title="@string/activity_service_menu_help"/>
    
    
    SFTNFOVBDUJWJUZ@TFSWJDF@MJTUYNM
    

    View Slide

24. 
    xmlns:app="http://schemas.android.com/apk/res-auto">
    android:id="@+id/activity_service_menu_item_settings"
    app:showAsAction="never"
    android:title="@string/activity_service_menu_settings" />
    android:id="@+id/activity_service_menu_item_help"
    app:showAsAction="never"
    android:title="@string/activity_service_menu_help" />
    
    
    SFTNFOVOPUPVDIBDUJWJUZ@TFSWJDF@MJTUYNM
    

    View Slide

25. android:id="@+id/activity_service_list_buttons_container"
    android:layout_width="match_parent"
    android:layout_height="wrap_content"
    android:layout_alignParentBottom="true">
    android:id="@+id/activity_service_list_manager_switch"
    android:layout_width="0dp"
    android:layout_height="wrap_content"
    android:layout_margin="8dp"
    android:layout_weight="1"
    android:text="@string/app_name" />
    android:id="@+id/activity_service_list_search_button"
    android:layout_width="0dp"
    android:layout_height="wrap_content"
    android:layout_margin="8dp"
    android:layout_weight="1"
    android:text="@string/activity_service_list_search" />
    
    
    SFTMBZPVUOPUPVDIBDUJWJUZ@TFSWJDF@MJTUYNM
    

    View Slide

26. λονύωϧ͕࢖͑ͳ͍6*ʹରԠ
    
    

    View Slide

27. 76;*9%FWFMPQFS$POGFSFODF
    
    
    .ͰɹɹɹɹΞϓϦ։ൃ
    

    View Slide

28. 76;*9%FWFMPQFS$POGFSFODF
    
    
    .ͰػցֶशΞϓϦ։ൃ
    

    View Slide

29. 5FOTPS'MPXͱ͸
    
    ೥݄ɺถ(PPHMF͕ࣾΦʔϓϯιʔεԽͨ͠
    ػց஌ೳ޲͚ͷܭࢉϑϨʔϜϫʔΫ
    

    View Slide

30. 5FOTPS'MPXͷಛ௃
    
    ࣄલʹܭࢉάϥϑΛߏஙɺ࣮ߦ͢ΔύϥμΠϜ
    େن໛ͳฒྻɾ෼ࢄܭࢉʹରԠ
    1$ʢαʔόʔʣʹՃ͑ͯɺ

    ϞόΠϧɺϘʔυίϯϐϡʔλʔͳͲ

    ෳ਺ͷϓϥοτϑΥʔϜ্Ͱಈ࡞ʢ˞ʣ
    ※ ݱࡏ͸inferenceʢਪ࿦ʣݶఆ
    

    View Slide

31. "OESPJEʹରԠ
    
    ୺຤ͷηϯαʔ৘ใΛ࢖ͬͯδΣενϟʔΛ
    ൑ผ͢Δ"OESPJEΞϓϦͷ࡞੒
    5FOTPS'MPXͷֶशࡁΈϞσϧΛ"OESPJE

    ΞϓϦ͔ΒಡΈࠐΜͰར༻͢Δ
    

    View Slide

32. ࡞Δ΋ͷ
    .Λ૷ணͯ͠टΛৼΔδΣενϟͰɺ
    :&4ɾ/0
    Λ൑ఆ͢Δ
    
    

    View Slide

33. Ϟσϧ
    
    conv
    1x5

    64
    max_pool
    1x3
    fully connected
    192
    ʢdropout 0.5ʣ
    output

    2
    size = 256
    

    View Slide

34. ֶश৚݅
    ܇࿅σʔλ:FT /P
    ֶशΞϧΰϦζϜ"EBN
    ֶश཰
    όοναΠζ
    ֶशεςοϓ਺
    
    

    View Slide

35. ग़ྗϞσϧͷߏ଄
    
    model.pb
    input_accel
    input_gyro
    softmax_logits
    

    View Slide

36. dependencies {

    compile fileTree(dir: 'libs', include: ['*.jar'])

    androidTestCompile('com.android.support.test.espresso:espresso-core:2.2.2', {

    exclude group: 'com.android.support', module: 'support-annotations'

    })

    compile 'com.android.support:appcompat-v7:25.3.1'

    compile 'com.android.support.constraint:constraint-layout:1.0.2'

    testCompile 'junit:junit:4.12'

    

    compile 'org.tensorflow:tensorflow-android:1.4.0'

    }

    
    CVJMEHSBEMF
    

    View Slide

37. ֶशࡁΈϞσϧͷ഑ஔ
    
    

    View Slide

38. private static final String MODEL_FILEPATH = "model.pb";

    private final TensorFlowInferenceInterface mTfInference;

    GestureDetector(AssetManager am) {

    mTfInference = new TensorFlowInferenceInterface(am, MODEL_FILEPATH);

    }

    
    ϞσϧͷಡΈࠐΈ
    

    View Slide

39. GestureType recognizeGesture(float[] accelData, float[] gyroData) {

    

    mTfInference.feed("input_accel", accelData, accelData.length);

    mTfInference.feed("input_gyro", gyroData, gyroData.length);

    

    mTfInference.run(new String[]{"softmax_logits"});

    

    mTfInference.fetch("softmax_logits", mRecognizeGestureResult);

    

    for (int index = 0; index < mRecognizeGestureResult.length; index++) {

    
    (FTUVSF%FUFDUPSͷ࣮૷ʢGFFEʣ
    

    View Slide

40. GestureType recognizeGesture(float[] accelData, float[] gyroData) {

    

    mTfInference.feed("input_accel", accelData, accelData.length);

    mTfInference.feed("input_gyro", gyroData, gyroData.length);

    

    mTfInference.run(new String[]{"softmax_logits"});

    

    mTfInference.fetch("softmax_logits", mRecognizeGestureResult);

    

    for (int index = 0; index < mRecognizeGestureResult.length; index++) {

    
    (FTUVSF%FUFDUPSͷ࣮૷ʢSVOʣ
    

    View Slide

41. GestureType recognizeGesture(float[] accelData, float[] gyroData) {

    

    mTfInference.feed("input_accel", accelData, accelData.length);

    mTfInference.feed("input_gyro", gyroData, gyroData.length);

    

    mTfInference.run(new String[]{"softmax_logits"});

    

    mTfInference.fetch("softmax_logits", mRecognizeGestureResult);

    

    for (int index = 0; index < mRecognizeGestureResult.length; index++) {

    
    (FTUVSF%FUFDUPSͷ࣮૷ʢGFUDIʣ
    

    View Slide

42. 
    σϞ
    

    View Slide

43. C-LIS CO., LTD.
    ຊࢿྉ͸ɺ༗ݶձࣾγʔϦεͷஶ࡞෺Ͱ͢ɻຊࢿྉͷશ෦ɺ·ͨ͸Ұ෦ʹ͍ͭͯɺஶ࡞ऀ͔ΒจॻʹΑΔڐ୚Λಘͣʹෳ੡͢Δ͜ͱ͸ې͡ΒΕ͍ͯ·͢ɻ
    5IF"OESPJE4UVEJPJDPOJTSFQSPEVDFEPSNPEJpFEGSPNXPSLDSFBUFEBOETIBSFECZ(PPHMFBOEVTFEBDDPSEJOHUPUFSNTEFTDSJCFEJOUIF$SFBUJWF$PNNPOT"UUSJCVUJPO-JDFOTF
    ֤੡඼໊ɾϒϥϯυ໊ɺձ໊ࣾͳͲ͸ɺҰൠʹ֤ࣾͷ঎ඪ·ͨ͸ొ࿥঎ඪͰ͢ɻຊࢿྉதͰ͸ɺ˜ɺšɺäΛׂѪ͍ͯ͠·͢ɻ
    5IF"OESPJESPCPUJTSFQSPEVDFEPSNPEJpFEGSPNXPSLDSFBUFEBOETIBSFECZ(PPHMFBOEVTFEBDDPSEJOHUPUFSNTEFTDSJCFEJOUIF$SFBUJWF$PNNPOT"UUSJCVUJPO-JDFOTF
    

    View Slide