TensorFlow-20160622 - Speaker Deck

TensorFlow-20160622

by ARIYAMA Keiji

Slide 1

Slide 1 text

C-LIS CO., LTD.

Slide 2

Slide 2 text

5FOTPS'MPXͰ  झຯͷը૾ऩूαʔόʔΛ࡞Δ ݄̒߸ #dltfb

Slide 3

Slide 3 text

C-LIS CO., LTD. ༗ࢁܓೋʢ,FJKJ"3*:"."ʣ C-LIS CO., LTD. AndroidΞϓϦ։ൃऀ ػցֶशॳ৺ऀ ΍ͬͯ·ͤΜ Photo : Koji MORIGUCHI (AUN CREATIVE FIRM) ͱɺݴ͍ͳ͕Βૣ൒೥……

Slide 4

Slide 4 text

޷Έͷ؟ڸ່ͬը૾ΛࣗಈͰऩू͍ͨ͠

Slide 5

Slide 5 text

4PGUXBSF%FTJHO೥݄߸ʰ"OESPJE4UVEJPͷελΠϧͰޮ཰ΞοϓʱΑΓ © ࠜઇΕ͍ ؟ ڸ ͬ ່

Slide 6

Slide 6 text

C-LIS CO., LTD. ̎Ϋϥε෼ྨ 1 0

Slide 7

Slide 7 text

C-LIS CO., LTD. ࡞੒σʔλ಺༁ ؟ڸ່ͬը૾ຕ  ඇ؟ڸ່ͬը૾ຕ ؟ڸ່ͬ ඇ؟ڸ່ͬ

Slide 8

Slide 8 text

5FOTPS'MPXͰ  झຯͷը૾ऩूαʔόʔΛ࡞Δ ݄̐߸ #dltfb https://goo.gl/MX72Bc

Slide 9

Slide 9 text

C-LIS CO., LTD. ໰୊ൃੜ ΦϑΟεͷαʔόʔϚγϯͷ(16͕࢖͑ͳ͘ͳΔ $ python3 megane_co/cifar10_train.py I tensorflow/stream_executor/dso_loader.cc:105] successfully opened CUDA library libcublas.so locally I tensorflow/stream_executor/dso_loader.cc:105] successfully opened CUDA library libcudnn.so locally I tensorflow/stream_executor/dso_loader.cc:105] successfully opened CUDA library libcufft.so locally I tensorflow/stream_executor/dso_loader.cc:105] successfully opened CUDA library libcuda.so.1 locally I tensorflow/stream_executor/dso_loader.cc:105] successfully opened CUDA library libcurand.so locally Filling queue with 400 CIFAR images before starting to train. This will take a few minutes. E tensorflow/stream_executor/cuda/cuda_driver.cc:481] failed call to cuInit: CUDA_ERROR_NO_DEVICE

Slide 10

Slide 10 text

C-LIS CO., LTD. 5FOTPS'MPXͰ(16͕࢖͑ͳ͍ https://blog.keiji.io/2016/05/cuda_error_no_device.html ֓ཁ ɹGPUϚγϯͰTensorFlowΛ࣮ߦ͢ΔࡍɺCUDA΋cuDNN΋ਖ਼ৗʹηοτΞοϓͰ͖͍ͯ ΔͷʹɺTensorFlow͕GPUΛೝࣝ͠ͳ͍ʢCUDA_ERROR_NO_DEVICE΍No GPU devices available on machine.͕දࣔ͞ΕΔʣ৔߹ɺਖ਼͍͠σΟεϓϨΠΧʔυɾυϥΠό͕Πϯε τʔϧ͞Ε͍ͯͳ͍Մೳੑ͕͋Γ·͢ɻ ɹචऀͷ؀ڥͰ͸ɺطଘͷυϥΠόʔΛΞϯΠϯετʔϧʢsudo apt-get remove --purge nvidia*ʣͯ͠ɺNVIDIAͷαΠτ͔ΒυϥΠόʔΛμ΢ϯϩʔυɾΠϯετʔϧ͢Δ͜ͱͰ GPUΛೝࣝ͢ΔΑ͏ʹͳΓ·ͨ͠ɻ

Slide 11

Slide 11 text

C-LIS CO., LTD. ซͤͯಡΈ͍ͨ 5FOTPS'MPXPO%PDLFSͰ(16Λ࢖͑ΔΑ͏ʹ͢Δํ๏]גࣜձࣾΧϒΫ  IUUQXXXLBCVLVDPKQEFWFMPQFSTFSSPSTXJUIUFOTPSqPXPOHQV /7*%*"%PDLFSͰ؆୯ʹ(16ରԠͷ5FOTPS'MPXೖΓίϯςφΛ࡞Δํ๏ ]NVPOPUFT  IUUQXXXNVPKQOWJEJBEPDLFSUFOTPSqPXIUNM

Slide 12

Slide 12 text

ಉਓࢽΛॻͩ͘

Slide 13

Slide 13 text

ݸਓαʔΫϧʰΊ͕ͶΛ͔͚ΔΜͩʱ

Slide 14

Slide 14 text

Slide 15

Slide 15 text

https://techbookfest.org/#A-28

Slide 16

Slide 16 text

Slide 17

Slide 17 text

ࣥච্ͷ՝୊

Slide 18

Slide 18 text

C-LIS CO., LTD. ը૾ͷݖརؔ܎ ͦΕͧΕͷΠϥετʹஶ࡞ݖ͕ଘࡏ ࢿྉͰ࢖͏ʹ͸ڐ୚ΛऔΔඞཁ͕͋Δ D ࠜઇΕ͍ ʢ˞ݸਓͷݟղͰ͢ʣ

Slide 19

Slide 19 text

Slide 20

Slide 20 text

4PGUXBSF%FTJHO೥݄߸ʰ"OESPJE4UVEJPͷελΠϧͰޮ཰ΞοϓʱΑΓ © ࠜઇΕ͍ ؟ ڸ ͬ ່

Slide 21

Slide 21 text

Slide 22

Slide 22 text

$*'"3ʹؐΔ

Slide 23

Slide 23 text

C-LIS CO., LTD. $*'"3 Ϋϥε෼ྨ ֶशσʔλ   ςετσʔλ IUUQTXXXDTUPSPOUPFEV_LSJ[DJGBSIUNM

Slide 24

Slide 24 text

5FOTPS'MPX5VUPSJBM$*'"3

Slide 25

Slide 25 text

C-LIS CO., LTD. νϡʔτϦΞϧʁ Ϟσϧ͸DVEBDPOWOFUϕʔε  ৞ΈࠐΈɾϓʔϦϯά̎૚  ہॴԠ౴ਖ਼نԽ૚  શ݁߹૚̎૚ %BUB"VHNFOUBUJPOʢΫϦοϓɾࠨӈ൓సɾً౓ɾίϯτϥετʣ  ന৭Խʢ8IJUFOJOHʣ ֶश཰ͱڞ༗ॏΈͷݮਰ ϛχόονֶशʢόοναΠζ γϟοϑϧόονʣ

Slide 26

Slide 26 text

͔̍Β࡞ͬͯΈΑ͏ʂ

Slide 27

Slide 27 text

Slide 28

Slide 28 text

C-LIS CO., LTD. ͞·͟·ͳࢪࡦͰ্͕Δೝࣝਫ਼౓ ہॴԠ౴ਖ਼نԽʢ-3/ʣ૚ͷ௥Ճ %BUBBVHNFOUBUJPOɾന৭Խʢ8IJUFOJOHʣ υϩοϓΞ΢τΛઃఆ͢Δ ϞσϧΛଟ૚ʹ͢Δ

Slide 29

Slide 29 text

C-LIS CO., LTD. ࣮ࡍʹ͸ʜʜ 0.10 0.10 0.10 0.10 0.10 0.10 0.10 0.10 0.10 0.74 0.41

Slide 30

Slide 30 text

C-LIS CO., LTD.

Slide 31

Slide 31 text

C-LIS CO., LTD.

Slide 32

Slide 32 text

C-LIS CO., LTD.

Slide 33

Slide 33 text

C-LIS CO., LTD.

Slide 34

Slide 34 text

C-LIS CO., LTD. def _export_graph(sess, epoch): constant_graph_def = graph_util.convert_variables_to_constants( sess, sess.graph_def, ["output/logits"]) file_path = os.path.join(FLAGS.graph_dir, 'graph_%02d_epoch.pb' % epoch) with gfile.FastGFile(file_path, 'wb') as f: f.write(constant_graph_def.SerializeToString()) άϥϑʴύϥϝʔλʔ with tf.gfile.FastGFile(graph_file, 'rb') as f: graph_def = tf.GraphDef() graph_def.ParseFromString(f.read()) _ = tf.import_graph_def(graph_def, name='')

Slide 35

Slide 35 text

ॳߘͷ׬੒

Slide 36

Slide 36 text

C-LIS CO., LTD. ϨϏϡΞʔͷօ͞ΜͷࢦఠΛ΋ͱʹ௚͢ ʮ5FOTPS'MPXͷಛ௃ʹฒྻ෼ࢄॲཧΛؚΊΔͷ͕ྑ͍ͱࢥ͍·͢ʯ ʮ͜ͷຊΛಡΉʹ౰ͨͬͯɺಡऀ͕஌͓͔ͬͯͳ͚Ε͹ͳΒͳ͍͜ͱ͸ͳΜͰ͠ΐ͏ ͔ʯ ʮ1ZUIPOܥͱޓ׵ੑΛอͭͨΊʹɺ͜ͷهड़Λ଍ͨ͠ํ͕ʜʜʯ ʮষͷऴ൫ͷҾ͖ͱɺ࣍ͷষͰ࿩୊͕ܨ͕ͬͯͳ͍Ͱ͢ʯ ʮ͕Μ͹Εʂ͕Μ͹Εʂͱ੠͕͚͢ΔͱɺԹ͔Έͷ͋ΔωοτϫʔΫʹͳΔ͸ͣ Ͱ͢ʯ FUDʜ

Slide 37

Slide 37 text

C-LIS CO., LTD.

Slide 38

Slide 38 text

C-LIS CO., LTD.

Slide 39

Slide 39 text

C-LIS CO., LTD.

Slide 40

Slide 40 text

C-LIS CO., LTD.

Slide 41

Slide 41 text

C-LIS CO., LTD. 3$͕Ͱͨ https://github.com/tensorﬂow/tensorﬂow/releases/tag/v0.9.0rc0

Slide 42

Slide 42 text

C-LIS CO., LTD. ೝࣝਫ਼౓͸޲্͠ͳ͔͚ͬͨͲࢼͨ͜͠ͱ ࠷దԽΞϧΰϦζϜΛมߋ  ʢ(SBEJFOU%FDFOU͔Β"EBN΁ʣ όοναΠζΛมߋ

Slide 43

Slide 43 text

C-LIS CO., LTD. ਂࠁͳܭࢉ࣌ؒͷ૿Ճ

Slide 44

Slide 44 text

ϛχόονֶश

Slide 45

Slide 45 text

C-LIS CO., LTD. ܭࢉ͕࣌ؒେ෯ʹ୹ॖ

Slide 46

Slide 46 text

C-LIS CO., LTD. όοναΠζ Every 2.0s: nvidia-smi -l Thu Jun 16 17:23:25 2016 Thu Jun 16 17:23:25 2016 +------------------------------------------------------+ | NVIDIA-SMI 361.42 Driver Version: 361.42 | |-------------------------------+----------------------+----------------------+ | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | |===============================+======================+======================| | 0 GeForce GTX 960 Off | 0000:01:00.0 On | N/A | | 38% 57C P2 34W / 120W | 1916MiB / 2044MiB | 21% Default | +-------------------------------+----------------------+----------------------+ +-----------------------------------------------------------------------------+ | Processes: GPU Memory | | GPU PID Type Process name Usage | |=============================================================================| | 0 832 G /usr/bin/X 34MiB | | 0 18183 C python3 1867MiB | +-----------------------------------------------------------------------------+ Thu Jun 16 17:23:30 2016 +------------------------------------------------------+ | NVIDIA-SMI 361.42 Driver Version: 361.42 | |-------------------------------+----------------------+----------------------+

Slide 47

Slide 47 text

C-LIS CO., LTD. όοναΠζ Every 2.0s: nvidia-smi -l Fri Jun 17 20:40:45 2016 Fri Jun 17 20:40:45 2016 +------------------------------------------------------+ | NVIDIA-SMI 361.42 Driver Version: 361.42 | |-------------------------------+----------------------+----------------------+ | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | |===============================+======================+======================| | 0 GeForce GTX 960 Off | 0000:01:00.0 On | N/A | | 45% 73C P2 103W / 120W | 1917MiB / 2044MiB | 93% Default | +-------------------------------+----------------------+----------------------+ +-----------------------------------------------------------------------------+ | Processes: GPU Memory | | GPU PID Type Process name Usage | |=============================================================================| | 0 832 G /usr/bin/X 34MiB | | 0 24204 C python3 1867MiB | +-----------------------------------------------------------------------------+ Fri Jun 17 20:40:50 2016 +------------------------------------------------------+ | NVIDIA-SMI 361.42 Driver Version: 361.42 | |-------------------------------+----------------------+----------------------+

Slide 48

Slide 48 text

(16ɺ࢓ࣄͯ͠ͳ͔ͬͨ

Slide 49

Slide 49 text

݄̒25೔ʢ౔ʣ ळ༿ݪ ௨ӡձؗ ʰٕज़ॻయʱʹͯ൦෍༧ఆʂ ຊจ64p / ൦෍Ձ֨1,000ԁ https://techbookfest.org/#A-28 TensorFlowͷجૅ TensorFlowͱ͸ σʔλϑϩʔάϥϑ ม਺ͱϓϨʔεϗϧμʔ Tensorʢςϯιϧʣ TensorBoardʹΑΔάϥϑͷՄࢹԽ CIFAR-10ͷֶशͱධՁ σʔλͷಡΈࠐΈ ਪ࿦ʢinferenceʣ ֶशʢlearnʣ ධՁʢevaluateʣ σʔλอଘͱϑΟϧλʔͷՄࢹԽ ֶशσʔλͷอଘ ϑΟϧλʔͷՄࢹԽ CIFAR-10ฃಆه ਖ਼نԽ૚Λ௥Ճ͢Δ ܇࿅σʔλΛՃ޻͢Δ υϩοϓΞ΢τΛઃఆ͢Δ VGGNetͷϞσϧΛ࢖͏ ࠷దԽΞϧΰϦζϜΛมߋ͢Δ όοναΠζΛ૿΍͢ TensorFlow͸͡Ί·ͨ͠  CIFAR-10 ฃಆه

Slide 50

Slide 50 text

C-LIS CO., LTD. 5FOTPS'MPXΛ࢖ͬͨػցֶश͜ͱ͸͡ΊCZ5PSV6&/0:"."  IUUQXXXTMJEFTIBSFOFU5PSV6FOPZBNBUFOTPSqPXHEH σΟʔϓϥʔχϯάͰ͓ͦদ͞Μͷ࿡ͭࢠ͸ݟ෼͚ΒΕΔͷ͔ʁɹʙ४උฤʙ  IUUQCPIFNJBIBUFOBCMPHDPNFOUSZ ͗͢ΌʔΜϝϞ  IUUQNFNPTVHZBODPN  5FOTPS'MPX  IUUQTHJUIVCDPNUFOTPSqPXUFOTPSqPX ࢀߟ

Slide 51

Slide 51 text

C-LIS CO., LTD. C-LIS CO., LTD.

Slide 52

Slide 52 text

ຊࢿྉ͸ɺ༗ݶձࣾγʔϦεͷஶ࡞෺Ͱ͢ɻܝࡌ͞Ε͍ͯΔΠϥετ͸ɺಛʹهࡌ͕ͳ͍৔߹͸ࠜઇΕ͍ͷஶ࡞෺Ͱ͢ɻ ຊࢿྉͷશ෦ɺ·ͨ͸Ұ෦ʹ͍ͭͯɺஶ࡞ऀ͔ΒจॻʹΑΔڐ୚Λಘͣʹෳ੡͢Δ͜ͱ͸ې͡ΒΕ͍ͯ·͢ɻ 5IF"OESPJE4UVEJPJDPOJTSFQSPEVDFEPSNPEJpFEGSPNXPSLDSFBUFEBOETIBSFECZ(PPHMFBOEVTFE BDDPSEJOHUPUFSNTEFTDSJCFEJOUIF$SFBUJWF$PNNPOT"UUSJCVUJPO-JDFOTF ֤੡඼໊ɾϒϥϯυ໊ɺձ໊ࣾͳͲ͸ɺҰൠʹ֤ࣾͷ঎ඪ·ͨ͸ొ࿥঎ඪͰ͢ɻຊࢿྉதͰ͸ɺɺɺäΛׂѪͯ͠ ͍·͢ɻ 5IF"OESPJESPCPUJTSFQSPEVDFEPSNPEJpFEGSPNXPSLDSFBUFEBOETIBSFECZ(PPHMFBOEVTFEBDDPSEJOH UPUFSNTEFTDSJCFEJOUIF$SFBUJWF$PNNPOT"UUSJCVUJPO-JDFOTF