TensorflowでYOLOv3を写経した話

https://tfug-okinawa.connpass.com/event/109390/
で、LTしてきた内容

Transcript

1. TFUG Okinawa val.2 ΞΠύʔୂ௕@ླྀٿେֶ
2. औΓʹདྷͨ
3. ຊ೔͓࿩͢Δ͜ͱ
4. ຊ೔͓࿩͔ͨͬͨ͜͠ͱ • YOLOͱ͸ • TensorflowͰ૊ΜͰΈͨ • ૊ΜͰΈͨYOLOΛֶशͤͯ͞Έͨ
5. ຊ೔͓࿩͔ͨͬͨ͢͠Δ͜ͱ • YOLOͱ͸ • TensorflowͰ૊ΜͰΈͨ • ૊ΜͰΈͨYOLOΛֶशͤͯ͞Έͨ
6. ࣗݾ঺հ
7. ࣗݾ঺հ • ΞΠύʔୂ௕ • ͪΎΒσʔλגࣜձࣾ • PyData.OkinawaڞಉΦʔΨφΠβʔ • Pythonͱո्ͱΫιΈ͍ͨͳөը͕޷͖Ͱ͢
8. ๻ͷϨϕϧ • ਺ֶΘ͔ΒΜ • TensorflowΘ͔ΒΜ • σΟʔϓϥʔχϯάઙ͍ཧղ • ͭ·Γॳ৺ऀ
9. (YOLOΛબ୒ͨ͠) ܦҢ
10. ܦҢ Ϙεʣը૾ೝࣝͷҊ݅͘ΔΑʂ ๻ʣ͓ɺ͕Μ͹Δ͍ͧ Ϙεʣ·ͩΘ͔ΒΜ͚ͲObject DetectionͬΆ͍Αʂʂ ๻ʣ;͊ʔʔʔ
11. ษڧͤͶ͹ʢਅإʣ
12. YOLO(v3)
13. YOLOͱ͸ • ϦΞϧλΠϜΦϒδΣΫτݕग़ΞϧΰϦζϜ • YOLO(You Look Only Onse) • darknetͱ͍͏ϑϨʔϜϫʔΫͰಈ͔ͤΔ • σϞ͕͋Δ • ʢݕग़͕ʣ଎͍
14. darknet https://pjreddie.com/darknet/
15. YOLOͱ͸ • ը૾ೖྗ͢ΔͱӈԼͷΑ͏ͳ݁ՌʹͳΔ • ʮ΋ͷʯͷݕग़͢Δ͚ͩ
 Ͱͳ͘ɺΫϥε΋෼ྨ
 ͢Δɻ͠Ύ͍͝
16. YOLOͱ͸
17. YOLOͷ࢓૊Έ
18. YOLOͷ࢓૊Έ • ʢ·ʹ͋Θͳ͔ͬͨ͝ΊΜʣ • ͕ͬͪ͜Θ͔Γ΍͍͢ͷͰ֬ೝ͍ͯͩ͘͠͞ • https://github.com/leetenki/YOLOv2/blob/ master/YOLOv2.md
19. YOLOͷ࢓૊Έ • ʢ·ʹ͋Θͳ͔ͬͨ͝ΊΜʣ • ͕ͬͪ͜Θ͔Γ΍͍͢ͷͰ֬ೝ͍ͯͩ͘͠͞ • https://github.com/leetenki/YOLOv2/blob/ master/YOLOv2.md
21. ֶͼͷಓΛ੾Γସ͑Δ
22. पΓͷ໠ऀͷֶͼํ 1. ࿦จಡΉ 2. هࣄΛړΔ 3. ཧղͨ͠ɻΑ࣮͠૷͠Α͏
23. ΅͘ʢLv.1ʣ 1. ਆ༷ʢ࣮૷͍ͯ͠ΔਓɾίʔυʣΛݟ͚ͭΔ 2. ࣸܦ͢Δ 3. ͬ͘͟Γཧղͨ͠ -> هࣄړΔ
24. ਆ༷ʢ࣮૷ʣΛ୳͢
25. ਆ͸͍ͨ
26. ਆͷهࣄ https://itnext.io/implementing-yolo-v3-in-tensorflow-tf-slim-c3c55ff59dbe
27. ࣸܦ͢Δ
28. ͦͷલʹ؀ڥͷ࿩ • Ubuntu 16.04(Docker) • Python 3.7(Anaconda) • Tensorflow 1.12
29. Tensorflow Πϯετʔϧ $ pip3 install --upgrade tensorflow Collecting tensorflow Could not find a version that satisfies the requirement tensorflow (from versions: ) No matching distribution found for tensorflow ݟ͔ͭΒͳ͍ͱ͸ɾɾɾɾʁ
30. ఘΊͳ͍ؾ࣋ͪ $ pip3 install —upgrade https://storage.googleapis.com/tensorflow/ mac/cpu/tensorflow-1.10.1-py3-none-any.whl https://qiita.com/nahshi/items/fcf4898f7c45f11a5c63
31. ʗ(^o^)ʘ Traceback (most recent call last): File "YOLO_small_tf.py", line 3, in <module> import tensorflow as tf File "/opt/conda/lib/python3.7/site-packages/tensorflow/__init__.py", line 22, in <module> from tensorflow.python import pywrap_tensorflow # pylint: disable=unused-import File "/opt/conda/lib/python3.7/site-packages/tensorflow/python/ __init__.py", line 49, in <module> from tensorflow.python import pywrap_tensorflow File "/opt/conda/lib/python3.7/site-packages/tensorflow/python/ pywrap_tensorflow.py", line 58, in <module> from tensorflow.python.pywrap_tensorflow_internal import * File "/opt/conda/lib/python3.7/site-packages/tensorflow/python/ pywrap_tensorflow_internal.py", line 114 def TFE_ContextOptionsSetAsync(arg1, async): ^ SyntaxError: invalid syntax
32. པΜͩGoogle͞Μ
33. ఘΊͨ • Ubuntu 16.04(Docker) • Python 3.7 3.6(Anaconda) • Tensorflow 1.12
34. ʢվΊͯʣ ࣸܦ͢Δ
35. ΍ͬͨ͜ͱ • YOLOv3ͷϞσϧͷఆٛ • yolov3ͷॏΈΛtensorfowͰಡΈࠐΊΔ༻ɺ convert͢Δॲཧ • σϞεΫϦϓτ
36. ࡶͳίϝϯτΛ࢒ͭͭ͠΋ ࣸܦͰ͖ͨ
37. ࣮ߦͨ݁͠Ռ
38. ࣮ߦͨ݁͠Ռ
39. ʢͱΓ͋͑ͣ͸ʣ ͓k
40. ͜ͷޙɺࣗ෼Ͱֶशͤͨ͞Γɺ FineTuningͱ͔֎Εσʔλͷ ߟ࡯ͱ͔΍ͬͯΈ͔͚ͨͬͨͲ ཧղ͕ؒʹ߹Θͳ͔ͬͨͷͰ Tensorflowͷ࣮૷ͷ࿩Λ͠·͢
41. ࣮૷ͷ࿩
42. • ௚ײతʹɺKerasΈ͍ͨʹॻ͚Δ • tf.contrib.keras͸ɾɾɾʁ • tf.contrib͸tensorflowνʔϜ͸αϙʔτ͠ ͍ͯͳ͍͚Ͳɺςετऴ͍͑ͯͣΕ͸Ϛʔδ ͍ͨ͠ΑͶతͳύοέʔδΒ͍͠ ࣮૷ͷ࿩ tf.contrib.slim
43. ࣮૷ͷ࿩ tf.contrib.slim with slim.arg_scope([slim.max_pool2d], padding=‘SAME’): # Layer01 h_conv1 = slim.conv2d(x_image, 32, [5, 5]) h_pool1 = slim.max_pool2d(h_conv1, [2, 2]) # Layer02 h_conv2 = slim.conv2d(h_pool1, 64, [5, 5]) h_pool2 = slim.max_pool2d(h_conv2, [2, 2]) # Layer03 h_pool2_flat = slim.flatten(h_pool2) h_fc1 = slim.fully_connected(h_pool2_flat, 1024)
44. • with۟ͰϒϩοΫΛ࡞ΓɺϒϩοΫ಺ͷؔ਺ ͷσϑΥϧτҾ਺Λ·ͱΊͯఆٛͰ͖Δ • ͨͩͨͩศར ࣮૷ͷ࿩ slim.arg_scope()
45. ࣮૷ͷ࿩ slim.arg_scope() h_conv1 = slim.conv2d(x_image, 32, [5, 5], activation_fn=tf.nn.relu, weights_initializer=tf.truncated_normal_initializer(stddev=0.1), biases_initializer=tf.constant_initializer(0.1)) with slim.arg_scope([slim.conv2d], activation_fn=tf.nn.relu, weight_initializer=tf.truncated_normal_initializer(stddev=0.1), biases_initializer=tf.constant_initializer(0.1): h_conv1 = slim.conv2d(x_image, 32, [5, 5])
46. • ఆֶٛͨ͠शάϥϑΛඳըͯ͘͠ΕͨΓɺॏ ΈΛάϥϑԽͨ͠ΓͱԿ͔ͱศརͳ΍ͭ Tensorboard
47. Tensorboard ࢖͏ͨΊͷ࣮૷ (ఆٛͨ͠άϥϑඳըͷΈ) with tf.Session() as sess: # tensorboard file_writer = tf.summary.FileWriter('./logs/', sess.graph)
48. Tensorboard
49. ஫ҙ͍ͨ͜͠ͱ with tf.variable_scope(‘darknet-53'): route_1, route_2, inputs = darknet53(inputs) with tf.variable_scope('yolo-v3'): with tf.variable_scope('detect_1'): route, inputs = _yolo_block(inputs, 512) • ఆ͚ٛͨͩ͠Ͱ͸
 άϥϑ͸ݟͮΒ͍ • είʔϓΛ
 ༻ҙ͠·͠ΐ͏ είʔϓແ είʔϓ༗
50. ཧղ͢ΔͨΊʹࢼߦͨ͠࿩
51. • ίʔυΛཧղ͠Α͏ͱͨ͠ͱ͖ɺೖྗͱग़ྗ ΍Βɺม਺ͷத਎Λ֬ೝ͠ͳ͕Β΍Γ·ͤΜ ͔ʁ • ๻͸΍Γ·͢ • ͱ͍͏͜ͱͰɺ࠷ڧͷprintσόοάΛࢼͦ͏ ͱ͠·ͨ͠ Tensorflowͷσόοά
52. • ʗ(^o^)ʘ • Tensorflow͸άϥϑΛߏ੒ͨ͋͠ͱʹσʔλ Λྲྀͯ͠ॲཧ͢ΔͷͰɺఆ͍ٛͯ͠Δͱ͜Ζ Λεςοϓͯ͠printͯ͠΋Θ͔Βͳ͍ ࠷ڧͷprintσόοά Tensor("xxx:0", shape=TensorShape([Dimension(1), Dimension(1)]), dtype=float32)
53. tf.print • ೖྗ͞ΕͨTensorͷ݁ՌΛɺ
 stdout΍ΒɺϩάϨϕϧͰग़ྗͯ͘͠ΕΔ • ਆ • ͪͳΈʹ΍΍͍͚͜͠Ͳɺtf.Print͸Ҿ਺΋ҧ͏͠ඇਪ঑Ͱ͢ • ͔͠͠ɺSessionฦ͞ͳ͍ͱ͍͚ͳ͍ͷͰɺϞσϧΛఆٛ͢Δͱ͜Ζʹ૊ΈࠐΉ࡞ۀ ʹϋϚͬͨ • ·ͨɺTensorflowͰఆٛͨ͠ม਺ͷத਎͸ݟΕ͕ͨɺ࣍ݩΛ֬ೝ͢ΔͨΊʹtf.shape ͱ͔ڬΉͱ݁Ռ͕ฦͬͯ͜ͳ͘ͳΔɻͳͥ • ʢ͕࣌ؒͳ͍ͷͰʣఘΊͨ tensor = tf.range(10) print_op = tf.print(tensor)
54. tfdebug • Tensorflow༻ͷPythonͷpdbΈ͍ͨͳ΍ͭ • https://www.tensorflow.org/guide/debugger • λʔϛφϧͰṖͷςΫϊϩδʔUI • ࢖͍΍͍͢ʢ࢖͍ͮΒ͍ʣ • ݟํ͕Θ͔Βͳ͍ͷͰΠϥΠϥͭͭ͠΋υΩϡϝϯτ
 ಡΈͳ͕Β֬ೝதʢ࿝֐ʣ • vimϥΠΫ͡Όͳ͍ͱݏ
55. ࡶʢͳʣ ײʢ૝ʣ
56. ࡶײ • Θ͔ΒΜͱ͜Ζ͕Θ͔ͬͨ • ͍͍࿩ͩͧʂʢܾͯ͠ෛ͚੯͠ΈͰ͸ͳ͍ʣ • ࿦จಡ΋͏ • Tensorflow΋਺ֶ΋ɺ΋ͬͱ͕Μ͹Γ·͠ΐ͏