Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Terrene Python SDK

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →

Terrene Python SDK

Avatar for Kash Pourdeilami

Kash Pourdeilami

August 25, 2017

Other Decks in Programming

Transcript

  1. Authentication f r o m t e r r e

    n e . a u t h i m p o r t U s e r P a s s C r e d e n t i a l c r e d e n t i a l s = U s e r P a s s C r e d e n t i a l ( u s e r = " < e m a i l a d d r e s s > " , p a s s w o r d = " < p a s s w o r d > " )
  2. Create a workspace Workspaces are the primary way of managing

    subscriptions and access levels on Terrene f r o m t e r r e n e . w o r k s p a c e s i m p o r t W o r k s p a c e M a n a g e r w o r k s p a c e _ m a n a g e r = W o r k s p a c e M a n a g e r ( c r e d e n t i a l s = c r e d e n t i a l s ) w o r k s p a c e = w o r k s p a c e _ m a n a g e r . c r e a t e ( n a m e = " M y W o r k s p a c e " , d e s c r i p t i o n = " m y w o r k s p a c e " )
  3. Ceate a data warehouse f r o m t e

    r r e n e . s t o r e i m p o r t S t a n d a r d W a r e h o u s e M a n a g e r s t o r e _ m a n a g e r = S t a n d a r d W a r e h o u s e M a n a g e r ( c r e d e n t i a l s = c r e d e n t i a l s , w o r k s p a c e = w o r k s p a c e ) s t o r e = s t o r e _ m a n a g e r . c r e a t e ( n a m e = " d e f a u l t s t o r a g e " , d e s c r i p t i o n = " d e f a u l t w a r e h o u s e f o r
  4. Or connect to existing warehouse f r o m t

    e r r e n e . s t o r e i m p o r t S Q L A l c h e m y W a r e h o u s e M a n a g e r s t o r e _ m a n a g e r = S Q L A l c h e m y W a r e h o u s e M a n a g e r ( c r e d e n t i a l s = c r e d e n t i a l s , w o r k s p a c e = w o r k s p a c e ) s t o r e = s t o r e _ m a n a g e r . c r e a t e ( n a m e = " d e f a u l t s t o r a g e " , d e s c r i p t i o n = " d e f a u l t w a r e h o u s e f o r c o n n e c t i o n _ s t r i n g = " p o s t g r e s : / / < u s e r > : < p a s s w o r d > @ < h o s t > : 5 4 3 2
  5. Upload a dataset f r o m t e r

    r e n e . t r a n s f e r i m p o r t C S V F i l e I n p u t M a n a g e r c s v _ f i l e _ i n p u t _ m a n a g e r = C S V F i l e I n p u t M a n a g e r ( c r e d e n t i a l s = c r e d e n t i a l s , w o r k s p a c e = w o r k s p a c e ) w i t h o p e n ( ' / p a t h / t o / f i l e . c s v ' , ' r ' ) a s i n p u t _ f i l e : c s v _ f i l e _ i n p u t = c s v _ f i l e _ i n p u t _ m a n a g e r . c r e a t e ( n a m e = " m y f i l e " , d e s c r i p t i o n = " t r a i n i n g d a t a s e t " , f i l e = i n p u t _ f i l e , s t o r e = s t o r e , c o n t a i n e r = " t r a i n i n g "
  6. Or use existing dataset f r o m t e

    r r e n e . t r a n s f e r i m p o r t S Q L A l c h e m y D a t a M a n a g e r s q l _ a l c h e m y _ d a t a _ m a n a g e r = S Q L A l c h e m y D a t a M a n a g e r ( c r e d e n t i a l s = c r e d e n t i a l s , w o r k s p a c e = w o r k s p a c e ) q u e r y = " S E L E C T * F R O M u s e r s ; " s q l _ q u e r y _ i n p u t = s q l _ a l c h e m y _ d a t a _ m a n a g e r . c r e a t e ( n a m e = " m y q u e r y " , d e s c r i p t i o n = " t r a i n i n g d a t a s e t " , q u e r y = q u e r y , s t o r e = s t o r e )
  7. Create a predictive model f r o m t e

    r r e n e . e n r i c h i m p o r t P r e d i c t i v e M o d e l p r e d i c t i v e _ m o d e l _ m a n a g e r = P r e d i c t i v e M o d e l ( c r e d e n t i a l s = c r e d e n t i a l s , w o r k s p a c e = w o r k s p a c e ) m o d e l = p r e d i c t i v e _ m o d e l _ m a n a g e r . c r e a t e ( n a m e = " m y p r e d i c t i v e m o d e l " , d e s c r i p t i o n = " p r e d i c t i v e m o d e l " i n p u t _ v a r i a b l e s = " c o l 1 , c o l 2 , c o l 3 , c o l 4 " , o u t p u t _ v a r i a b l e s =
  8. Train the model m o d e l . t

    r a i n ( s t o r e = s t o r e , e p o c h s = 1 0 0 )
  9. Access model over REST endpoint f r o m t

    e r r e n e . s e r v e i m p o r t M o d e l E n d p o i n t m o d e l _ e n d p o i n t _ m a n a g e r = M o d e l E n d p o i n t ( c r e d e n t i a l s = c r e d e n t i a l s , w o r k s p a c e = w o r k s p a c e ) e n d p o i n t = p r e d i c t i v e _ m o d e l _ m a n a g e r . c r e a t e ( e n r i c h = m o d e l )
  10. Make predictions p r e d i c t i

    o n = e n d p o i n t . p r e d i c t ( { " c o l 1 " : 0 , " c o l 2 " : 0 , " c o l 3 " p r i n t ( p r e d i c t i o n )
  11. Store the predictions e n d p o i n

    t . s t o r e = s t o r e e n d p o i n t . t a b l e = " p r e d i c t i o n s " e n d p o i n t . s a v e ( )