Performance Tuning Tips of TensorFlow Inference

https://m3-engineer.connpass.com/event/111354/
2018/12/20 Cookpad×merpay×m3 機械学習 Nightの登壇資料です。

Transcript

1. View Slide

2. ) (
   • s W ei Vi h
   • F PRP RS X c J
   • m 2E 12G7C: 1 4G :D :BCn
   • a .+ + 2 .44 o l
   • A:) D: C ( 08 : 8E r
   

   View Slide

3. 
   
   • %*+5 !#
   • .6+5 !#
   +51/$"#4'$
   • %*)+5/2 &3,0.6 +5/2
   &
   -(
   

   View Slide

4. 
   
   F Tae P eU
   e p C 2 s
   • e t
   • Fnw C i I
   Tae
   • c 13 1
   • + 25 1 5+
   • lo V U
   • e h
   • r C
   

   View Slide

5. 
   
   
   • / .. / . / . /
   :
   

   View Slide

6. 
   
   J ca C F
   •
   • / Ie
   • P Ih SU S e
   • l
   J C ca C F
   • P _
   • / / . / / . Ifi
   J C F
   • _ _ T I d
   

   View Slide

7. 
   
   041 /16 l l 8 : T
   o :
   • 041 /16 : T (
   : T F e p
   . 0
   o g n ( n
   a ) 2 7/ .
   n
   

   View Slide

8. 
   
   • ) :
   :
   () )
   ) )
   ) 1
   ()
   ) )
   ) 1
   )
   ) )
   () ) )
   ) 1
   () )
   ) 1
   S
   ) . )
   =
   

   View Slide

9. 
   
   • 5 .10 8 7
   :
   
   
   2 6/ 3
   S
   

   View Slide

10. 
    
    • /1423 025 . F6 l TU
    6on . C
    9T P
    n 8 C
    2
    . 4
    ) ( ) ( ) (
    e %
    . n
    

    View Slide

11. 
    
    clL 488 Ie w
    MI ng
    ) 8 5 K K
    ) 8 5 ( ) 8 5 .83 5 4/ . t iL
    Th Ly
    
    
    
    
    
    
    b r x x
    nga ( 0 :5.
    

    View Slide

12. 
    
    

    View Slide

13. 
    • : FC CIP5/ TX S fe OL. TX S N
    C ) C 2 C C
    C = C C F C A : C C F C : : ) 1 A : 1 C F 10
    F:FF ) 3:FF C C ) C
    
    
    g ba c c
    _ ( J :
    

    View Slide

14. /
    • dh c a o :
    • )(4 ( ) ) ( ) _a t e gr
    m
    • (4 ( ) ) ( ) m
    • fp = l s SPm C
    _c i grn
    4 . 4 . 4 4
    4 . )(4 ( ) ) ( )
    4 . (4 ( ) ) ( )
    4 4 . 4 .
    

    View Slide

15. /
    • pu alo nde Cm P
    • 7: 21 1 2 288487 91 6 423 m nde s
    fCe
    • 7: 4 1 1 2 288487 91 6 423 P fCe
    • r C U _
    Phi C o s U
    .452 8 P
    ( 0
    ()
    t
    /0 %
    D 7: 21 1 2 288487 91 6 423 7: 4 1 1 2 288487 91 6 423 P
    

    View Slide

16. 
    

    View Slide

17. 
    
    • 8 - n gch y de Gf
    ib oz m N
    • OM rgchw p ʼ ul
    T
    s J F
    8 . D / : 8 IL : :1 / t
    B B : 1
    

    View Slide

18. 
    
    • a n 1 D
    in F
    2 P o F 2
    3
    • q la t6
    n n z 2
    D ( ) a
    2 e b 2u a
    

    View Slide

19. 
    •
    T
    •
    i 1
    •
    

    View Slide