API REST & UPLOADS ESCRITO EM GO

Esta apresentação teve como objetivo mostrar de forma simples como funciona toda arquitetura REST e seu ecossistema.

Foi apresentando um exemplo de como implementar uma api para receber uploads de arquivos.

Foi apresentando API Layers, Gateways, Proxy e SSL, Proxy Reverse, Frameworks...

Transcript

1. 29/08/2018 Do zero ao deploy
   https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 1/41
   Do zero ao deploy
   Receiving les in an api REST
   Je erson Otoni Lima
   CEO & Co-Fundador | S3wf & S3commerce entrepreneur 2007
   Full-Stack programmer
   

   View Slide

2. 29/08/2018 Do zero ao deploy
   https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 2/41
   Alguns projetos atuais que participo!
   Web service REST para Uploads e Downloads
   Web service REST para ser consumido
   Microserviços
   Integrações com Mercado Livre / Moip / Correio / JadLog / B2W
   Integrações com Amazon / S3 / EFS / API Gatewy / SES /SQS
   

   View Slide

3. 29/08/2018 Do zero ao deploy
   https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 3/41
   

   View Slide

4. 29/08/2018 Do zero ao deploy
   https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 4/41
   Recebendo arquivos em uma api REST !
   Cronstruindo um restful para ser consumido ...
   

   View Slide

5. 29/08/2018 Do zero ao deploy
   https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 5/41
   Criação do servidor REST
   Qual Gateway ou Proxy Reverse usar ?
   Qual arquitetura implementar ?
   Como vamos Escalar ?
   Qual linguagem/Framework usar ?
   Vamos fazer decomposição do sistema ?
   

   View Slide

6. 29/08/2018 Do zero ao deploy
   https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 6/41
   

   View Slide

7. 29/08/2018 Do zero ao deploy
   https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 7/41
   API Layers, Gateways, Proxy e SSL
   Api Gateway (https://console.aws.amazon.com/apigateway)
   (Amazon)
   Azure (https://docs.microsoft.com/en-us/azure/api-management/)
   (Microsoft)
   Dreamfactory (https://www.dreamfactory.com/)
   (Dreamfactory)
   Firebase (https:// rebase.google.com/docs/database/rest/start?hl=pt-br)
   (Google)
   kong (https://getkong.org/)
   (Gerenciador de APIs e Microserviços open - source)
   trae k (https://trae k.io/)
   (HTTP reverse proxy and load balancer)
   letsencrypt (https://letsencrypt.org/getting-started)
   (SSL letsencrypt free)
   

   View Slide

8. 29/08/2018 Do zero ao deploy
   https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 8/41
   

   View Slide

9. 29/08/2018 Do zero ao deploy
   https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 9/41
   Nossa arquitetura com Gateway
   

   View Slide

10. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 10/41
    Nossa arquitetura com Proxy Reverse
    

    View Slide

11. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 11/41
    Escalando nosso web service
    AWS Elastic Beanstalk
    AWS Elastic Load Balancing
    

    View Slide

12. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 12/41
    Antes vamos contextualizar
    alguns conceitos importantes !
    

    View Slide

13. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 13/41
    O que é REST ?
    REST (https://pt.wikipedia.org/wiki/REST)
    (Representational State Transfer)
    É uma abstração da arquitetura da World Wide Web [pattern]
    2000 por Roy Fielding (https://en.wikipedia.org/wiki/Roy_Fielding)
    RPC (https://pt.wikipedia.org/wiki/Chamada_de_procedimento_remoto)
    não é um exemplo de REST {Apresentação Socket /
    RPC (http://go-talks.appspot.com/github.com/je otoni/gotalks/server-rest.slide)
    }
    RESTful (São as aplicações ou sistemas que usam princípio REST)
    

    View Slide

14. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 14/41
    

    View Slide

15. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 15/41
    Concepções REST
    Resources => /insert, /update, /delete, /search [URI]
    Representation => Html, Json, Xml, ... / Content-Type
    State Transfer => GET, POST, PUT, DELETE ...
    

    View Slide

16. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 16/41
    

    View Slide

17. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 17/41
    Como funciona o protocolo HTTP ?
    Hypertext Transfer Protocol (https://pt.wikipedia.org/wiki/Hypertext_Transfer_Protocol)
    Mensagem HTTP códigos http (https://pt.wikipedia.org/wiki/Lista_de_c%C3%B3digos_de_estado_HTTP)
    Cabeçalho da mensagem RFC 2616 (https://tools.ietf.org/html/rfc2616)
    Corpo da mensagem
    Requisição (Request-Line,Request-header,Method, URI e HTTP-Version)
    Métodos (GET, HEAD, POST, PUT, DELETE, TRACE, OPTIONS e CONNECT)
    

    View Slide

18. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 18/41
    

    View Slide

19. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 19/41
    Clientes REST
    cURL (criar requisições em diversos protocolos) (https://ec.haxx.se)
    Postman (https://www.getpostman.com/)
    HTTPie (https://httpie.org/)
    Hurl.it (https://www.hurl.it/)
    

    View Slide

20. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 20/41
    

    View Slide

21. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 21/41
    Frameworks REST
    awesome-go (https://github.com/avelino/awesome-go/blob/master/README.md)
    (links diversos)
    Slumer (https://github.com/sogko/slumber)
    (API REST)
    Mux (https://github.com/gorilla/mux)
    (simples roteador url)
    HttpRouter (https://github.com/julienschmidt/httprouter)
    (poderoso roteador url)
    Frisby (https://github.com/verdverm/frisby)
    (REST API TEST)
    Pressly chi (https://github.com/pressly/chi)
    (Http Service REST)
    Go JSON handler (https://github.com/rs/formjson)
    gores (https://github.com/alioygur/gores)
    (handles HTML, JSON, XML)
    

    View Slide

22. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 22/41
    

    View Slide

23. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 23/41
    Opa.. Golang now, vamos implementar!
    

    View Slide

24. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 24/41
    Construindo nosso server REST / ListenAndServe ( )
    // http
    //
    http.ListenAndServe(":9999", nil)
    // servindo um site estático
    //
    http.ListenAndServe(":9999", http.FileServer(http.Dir("/static/site"))))
    // ssl
    //
    http.ListenAndServeTLS(":443", server.crt, yourkey.key, nil)
    // Criando chaves ssl
    //
    ~/user-linux$ openssl req -nodes -newkey rsa:2048 -keyout yourkey.key -out serve.csr
    

    View Slide

25. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 25/41
    De nindo Rotas Handlers!
    

    View Slide

26. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 26/41
    Server httpRouter {Criando rotas}
    func main() {
    router := httprouter.New()
    router.GET("/", Index) // curl -X GET localhost:9999
    router.GET("/user/:uid", getuser) // curl -X GET localhost:9999/user/23322
    router.POST("/adduser/:uid", adduser) // curl -X POST localhost:9999/adduser/232
    router.DELETE("/deluser/:uid", deleteuser) // curl -X DELETE localhost:9999/deluser/232
    router.PUT("/moduser/:uid", modifyuser) // curl -X PUT localhost:9999/moduser/232
    // abrindo porta
    log.Fatal(http.ListenAndServe(":9999", router))
    }
    

    View Slide

27. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 27/41
    Rotas e Tipos de Uploads
    func main() {
    router := mux.NewRouter()
    router. // multipart/form-data =namefile=@file.tar
    HandleFunc("/upload-form", uploadFormFile).Methods("POST")
    router. // multipart/form-data =namefile[]=@file.tar
    HandleFunc("/upload-form-multi", uploadFormMuilt).Methods("POST")
    router. // --data-binary "@file1.jpg"
    HandleFunc("/upload-bin", uploadBinary)
    //
    listenAndServer(router)
    }
    

    View Slide

28. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 28/41
    Subindo varias portas com ListenAndServe()
    func listenAndServer(router *mux.Router) {
    //
    conf := &http.Server{Handler: router, Addr: ":8081"}
    go conf.ListenAndServe()
    //
    go func() { http.ListenAndServe(":8082", router) }()
    //
    go func() { http.ListenAndServe(":8083", nil) }()
    //
    func() { http.ListenAndServe(":8084", nil) }()
    }
    

    View Slide

29. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 29/41
    Copy para servidor único arquivio
    func uploadFormFile(w http.ResponseWriter, r *http.Request) {
    //sizeUpload := r.ContentLength / 1048576 // 1Mb convert to Mb
    file, handler, _ := r.FormFile("fileupload")
    r.ParseMultipartForm(10485760)
    defer file.Close()
    pathUserAcess := PathLocal + "/" + acessekey + "/" + handler.Filename
    existPath, _ := os.Stat(PathLocal + "/" + acessekey)
    if existPath == nil { os.MkdirAll(PathLocal+"/"+acessekey, 0777) }
    f, _ := os.OpenFile(pathUserAcess, os.O_WRONLY|os.O_CREATE, 0777)
    defer f.Close()
    fmt.Println("Copy: ", pathUserAcess)
    sizef, _ := io.Copy(f, file)
    fmt.Fprintln(w, "", 500, `{"msg":"ok upload size recebido"}`, sizef, "Bytes")
    }
    

    View Slide

30. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 30/41
    Copy para servidor multipolos arquivos
    func uploadFormFileMulti(w http.ResponseWriter, r *http.Request, files []*multipart.FileHeader) {
    if len(r.MultipartForm.File["fileupload[]"]) > 0 {
    fmt.Println("size array: ", len(files))
    var uploadSize int64
    for i, _ := range files {
    file, err := files[i].Open()
    defer file.Close()
    pathUserAcess := PathLocal + "/" + acessekey + "/" + files[i].Filename
    existPath, _ := os.Stat(PathLocal + "/" + acessekey)
    if existPath == nil { os.MkdirAll(PathLocal+"/"+acessekey, 0777) }
    f, _ := os.Create(pathUserAcess)
    defer f.Close()
    fmt.Println("Copy: ", pathUserAcess)
    sizef, _ := io.Copy(f, file)
    if err == nil {
    uploadSize += sizef
    }
    }
    }
    }
    

    View Slide

31. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 31/41
    Uploads Binary
    func uploadBinary(w http.ResponseWriter, r *http.Request) {
    pathUpKeyUser := PathLocal + "/" + acessekey
    nameFileUp := r.Header.Get("Name-File")
    pathUpKeyUserFull := pathUpKeyUser + "/" + nameFileUp
    existPath, _ := os.Stat(pathUpKeyUserFull)
    if existPath == nil { os.MkdirAll(pathUpKeyUser, 0777) }
    ff, _ := os.OpenFile(pathUpKeyUserFull, os.O_WRONLY|os.O_CREATE, 0777)
    defer ff.Close()
    fmt.Println("Copy: ", pathUpKeyUserFull)
    sizef, _ := io.Copy(ff, r.Body)
    fmt.Fprintln(w, "", 500, `{"msg":"ok upload size recebido"}`, sizef, "Bytes")
    }
    

    View Slide

32. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 32/41
    

    View Slide

33. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 33/41
    cURL testando nosso REST
    

    View Slide

34. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 34/41
    Upload Form / multipart/form-data
    curl -i -X POST http://localhost:9999/upload-form \
    -u "API_KEY:383883jef903xxxx838xxxx" \
    --form "fileupload=@files/file2.pdf"
    

    View Slide

35. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 35/41
    Upload Form multi / multipart/form-data
    curl -i --request POST localhost:9999/upload-form-multi \
    -u "API_KEY:383883jef903xxxx838xxxx" \
    --form 'email=jefferson&password=3838373773' \
    --form "fileupload[]=@files/file1.jpg" \
    --form "fileupload[]=@files/file2.pdf"
    

    View Slide

36. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 36/41
    Upload Binary
    // http://https://xxxxxx.execute-api.us-xxx-x.amazonaws.com/upload-bin \
    curl -i --request POST http://localhost:9999/upload-bin \
    -u "API_KEY:383883jef903xxxx838xxxx" \
    -H "Accept: binary/octet-stream" \
    -H "Content-Type: binary/octet-stream" \
    -H "Name-File: file2.pdf" \
    --data-binary "@files/file2.pdf"
    

    View Slide

37. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 37/41
    Referências
    github.com/avelino/awesome-go/blob/master/README.md (https://github.com/avelino/awesome-
    go/blob/master/README.md)
    golang.org/pkg/net (https://golang.org/pkg/net)
    godoc.org/golang.org/x/net/websocket (https://godoc.org/golang.org/x/net/websocket)
    golang.org/pkg/net/rpc (https://golang.org/pkg/net/rpc)
    github.com/gorilla/mux (https://github.com/gorilla/mux)
    github.com/ orix/wsdl2go (https://github.com/ orix/wsdl2go)
    github.com/julienschmidt/httprouter (https://github.com/julienschmidt/httprouter)
    

    View Slide

38. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 38/41
    Dúvidas?
    

    View Slide

39. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 39/41
    

    View Slide

40. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 40/41
    Thank you
    Je erson Otoni Lima
    CEO & Co-Fundador | S3wf & S3commerce entrepreneur 2007
    Full-Stack programmer
    

    View Slide

41. 29/08/2018 Do zero ao deploy
    https://go-talks.appspot.com/github.com/jeffotoni/gotalks/restful.slide#1 41/41
    

    View Slide