Wantedly Peopleのスキャン画面の裏側 / Wantedly People Scanning Screen

Transcript

1. 1.

   Wantedly Peopleͷ εΩϟϯը໘ͷཪଆ ɹ 2017/05/31 Wantedlyٕज़ݟֶձ iOSฤ shingt (Shinichi Goto)

   @ Wantedly, Inc.
2. 2.

   shingt (Shinichi Goto) GitHub: @shingt Twi5er: @_shingt

3. 3.

   None
4. 4.

   None
5. 5.

   Outline • εΩϟϯը໘ͷॲཧͷྲྀΕ • ٕज़ཁૉ / ߏ੒ • ෆ҆ఆͳݕग़݁Ռ΁ͷରॲ •

   σόοά൛ͷ࿩
6. 6.

   εΩϟϯը໘ͷॲཧͷྲྀΕ

7. 7.

   None
8. 8.

   None
9. 9.

   None
10. 10.

    None
11. 11.

    None
12. 12.

    None
13. 13.

    None
14. 14.

    None
15. 15.

    None
16. 16.

    None
17. 17.

    ٕज़ཁૉ / ߏ੒

18. 18.

    • AVFounda*on • OpenCV • ίϯϐϡʔλϏδϣϯ༻ͷϥΠϒϥϦ • ໊ࢗྖҬͷݕग़ɺͦͷଞը૾ॲཧʹར༻ • ಛผͳ΋ͷ͸࢖͍ͬͯͳ͍

19. 19.

    ໊ࢗݕग़ͷOpenCVҎ֎ͷબ୒ࢶ • CoreImage • Accerelate (BNNS) • Metal (CNN) •

    TensorFlow
20. 20.

    ݕग़ϩδοΫ͸Androidͱڞ௨Խ͍ͨ͠ ʢগͳ͘ͱ΋ॳظϦϦʔεͰ͸ʣ

21. 21.

    => Accerelate / Metal / CoreImage ͸ݟૹΓ ʢલऀ2ͭ͸iOS9Ͱར༻Ͱ͖ͳ͍໰୊΋ʣ

22. 22.

    TensorFlow • ΞϓϦʹ૊ΈࠐΈɺผ్ֶशࡁͷϞσϧΛద༻ɺͱ͍͏ͱ͜Ζ ·Ͱ͸ࢼͨ͠ • ໊ࢗݕग़෦෼΁ͷ࣮ࡍͷ׆༻ʹ͸ࢸΒͣ • ։ൃظؒɺσʔληοτɺਫ਼౓ͷ໰୊

23. 23.

    ༨ஊ: Google I/O '17 pod 'TensorFlow-experimental' ɹ • Android Meets

    TensorFlow: How to Accelerate Your App with AI • "experimental" Ͱͳ͍ํ͸ "Coming soon" ͱͳͬͯΔ • h?ps:/ /cocoapods.org/pods/TensorFlow
24. 24.

    ߏ੒

25. 25.

    ɹ • OpenCV • C++Ͱهड़͞ΕͨΠϯλʔϑΣΠεΛར༻ • => Swi/͔Βͷ௚઀ͷݺͼग़͠͸ෆՄ • ʢඞવతʹʣݕग़ؔ࿈ͷϩδοΫ͸Objec3ve-C++ଆʹدͤΔ

26. 26.

    None
27. 27.

    // CardDetector.mm - (NSArray<CardFeature *> *)cardFeaturesInMat:(const cv::Mat &)mat { std::vector<dtct::Card>

    cards = ... // Detect cards on C++ layer NSMutableArray<CardFeature *> *cardFeatures = [NSMutableArray array]; for (const auto& card : cards) { if (!card.is_namecard) continue; CardFeature *cardFeature = [[CardFeature alloc] initWithDTCTCard:card]; [cardFeatures addObject:cardFeature]; } return cardFeatures; }
28. 28.

    CardDetector • C++ͷϨΠϠ΁ͷProxyʹ͍ۙҐஔ • ࣮ࡍʹ͸͋Δఔ౓ը૾ॲཧϩδοΫ΋ؚΉ • ࠲ඪิਖ਼ɺಁࢹม׵ɺetc. • σόΠεଆͰಈ͔ͯ͠ΈͯॳΊͯݟ͔ͭΔɺͱ͍͏໰୊΋͋ͬ ͨͨΊ

29. 29.

    C++ͷϨΠϠ • ੾Γग़ͯ͠։ൃ & ୯ಠͰϏϧυ • ΞϓϦશମΛϏϧυ͢Δͷʹൺ΂ͯѹ౗తʹ଎͍ͨΊ • ݕग़෦෼ͷϩδοΫΛվળ͠΍͍͢ʢ΋ͬͱجຊతͳ෦෼͸ PythonͰ࣮ݧʣ

    • దٓiOSϓϩδΣΫτ΁औΓࠐΈ
30. 30.

    ෆ҆ఆͳݕग़݁Ռ΁ͷରॲ

31. 31.

    ໊ࢗྖҬͷݕग़

32. 32.

    AVCaptureStillImageOutput ʢ੩ࢭը༻ʣ OR AVCaptureVideoDataOutputʢಈը༻ʣ

33. 33.

    ໊ࢗεΩϟϯʹγϟολʔԻ͸໐Βͨ͘͠ͳ͍ => AVCaptureVideoDataOutput

34. 34.

    ໰୊: iPhone͸༳ΕΔ

35. 35.

    => ϒϨΔ

36. 36.

    None
37. 37.

    ղܾࡦ: γʔέϯεͱͯ͠ѻ͏

38. 38.

    None
39. 39.

    None
40. 40.

    None
41. 41.

    None
42. 42.

    ݕग़݁Ռͷ౤ථ • ϑϨʔϜͷ઱໌౓ʢͲΕ͚ͩϒϨ͍ͯͳ͍͔ʣ • ϥϓϥγΞϯϑΟϧλΛ͔͚ͨ݁Ռͷ෼ࢄʢͰ͋Δఔ౓ݟΕ Δʣ • ݕग़໊ࢗຕ਺ • ͲΕ͚ͩ௚ۙͷϑϨʔϜ͔

43. 43.

    ࢀߟ: ઱໌౓ͷԋࢉ @implementation UIImage (CVExtension) - (double)sharpness { cv::Mat mat,

    gray, laplacian; UIImageToMat(self, mat); cv::cvtColor(mat, gray, CV_BGR2GRAY); cv::Laplacian(gray, laplacian, CV_64F); cv::Scalar mean, stddev; cv::meanStdDev(laplacian, mean, stddev, cv::Mat()); return stddev.val[0] * stddev.val[0]; } @end
44. 44.

    None
45. 45.

    None
46. 46.

    τϥοΩϯά࣌

47. 47.

    None
48. 48.

    None
49. 49.

    None
50. 50.

    ɹ • ݁ߏ҆௚ͳղܾࡦͰ͸͋Δ • ͱ͸͍͑ܶతʹମݧ͸޲্ !

51. 51.

    σόοά൛ͷ࿩

52. 52.

    ϦΞϧλΠϜͳը૾ॲཧΞϓϦͷ։ൃͰࠔΔ͜ͱ • ໰୊ൃੜ࣌ɺݱঢ়೺Ѳʹ͕͔͔࣌ؒΓ΍͍͢ • ϓϩηεͷͲͷ෦෼͕ѱ͍ͷ͔ • ઢ෼ݕग़ʁ࠲ඪม׵ʁ઱໌౓ͷԋࢉʁ

53. 53.

    Debug, QAͰ͸ • ԋࢉঢ়گɺϦιʔεঢ়گΛදࣔ • ઱໌౓, γʔέϯεॲཧ, CPU, etc. •

    ը૾ॲཧͷաఔΛදࣔ
54. 54.

    None
55. 55.

    None
56. 56.

    None
57. 57.

    ɹ • ࢹ֮తʹ෼͔Γ΍͍ͨ͢Ί໰୊Λݟ͚ͭ΍͍͢ • ͍͚ͦ͏ײ͕CEOʹ఻ΘΔ

58. 58.

    ·ͱΊ • εΩϟϯը໘ͷॲཧͷྲྀΕ / ٕज़ཁૉ / ߏ੒ Λ঺հ • ෆ҆ఆͳݕग़݁Ռ΁ͷରॲ

    => γʔέϯεຖʹॲཧ • "ΊͪΌͪ͘ΌεϚʔτʂ" ͳ͜ͱ͸ͯ͠ͳ͍ʢݱঢ়͸ʣ • Debug/QA൛ͰॲཧաఔɺϦιʔεঢ়گΛग़͓ͯ͘͠ • ࢒Γ͸ޙ೔BlogͰެ։ʢ͢Δ͔΋ʣ
59. 59.

    Thanks!