Advanced Serializing in PHP: Speed it up!

Slide 1

Slide 1 text

@michellesanver Advanced serialization in PHP: Speed it up! PHPBenelux 2020

Slide 2

Slide 2 text

@michellesanver WIIIIE \o/ “Learn the most by sharing Your knowledge with others” - @coderabbi

Slide 3

Slide 3 text

@michellesanver Michelle Sanver Colour & Code addict

Slide 4

Slide 4 text

@michellesanver

Slide 5

Slide 5 text

@michellesanver Accent!?!?!?

Slide 6

Slide 6 text

No content

Slide 7

Slide 7 text

@michellesanver This talk is “open source”

Slide 8

Slide 8 text

@michellesanver Beginner friendly talk Advanced serialization is for everyone!

Slide 9

Slide 9 text

@michellesanver Agenda – Biggest retailer of Switzerland has complex data needs! – Advanced serialization in PHP – Using GoLang to GO beyond PHP and speed it up! – Why most PHP serialization libraries are slow for complex data – How we solved the problem in PHP: A 55% overall performance gain, over using JMS. Including a small demo!

Slide 10

Slide 10 text

@michellesanver Our project, a big retailer with complex data

Slide 11

Slide 11 text

DEV: Rae Knowler DEV: Tobias Schultze DEV: Christian Riesen DEV: Thereza Scherrer DEV: Martin Janser DEV: Emanuele Panzeri DEV: Michelle Sanver “Cloud Tamer”: Chregu PO: Timur Erdag PO: Colin Frei SM: Léo Davesne DEV: David Buchmann Team: 8 developers, 2 PO’s 1 SM, and… Chregu @michellesanver

Slide 12

Slide 12 text

@michellesanver A retailer API Biggest retailer of Switzerland

Slide 13

Slide 13 text

@michellesanver REST Endpoints ElasticSearch MySQL The Data Providers Serializing Importing Mapping Beautiful JSON

Slide 14

Slide 14 text

@michellesanver

Slide 15

Slide 15 text

@michellesanver REST Controllers ElasticSearch MySQL The Data Providers Serializing Importing Mapping Beautiful JSON

Slide 16

Slide 16 text

@michellesanver Huge Technology Stack

Slide 17

Slide 17 text

@michellesanver API: Lots of data “Out of memory exception on 100 products… But I’m not gonna wait for 50”

Slide 18

Slide 18 text

@michellesanver Blackﬁre Profile your application!

Slide 19

Slide 19 text

@michellesanver

Slide 20

Slide 20 text

@michellesanver

Slide 21

Slide 21 text

@michellesanver Advanced Serialization

Slide 22

Slide 22 text

@michellesanver Simple Serialization One format to another

Slide 23

Slide 23 text

@michellesanver json_encode / json_decode Use safe php! https://github.com/thecodingmachine/safe

Slide 24

Slide 24 text

@michellesanver

Slide 25

Slide 25 text

@michellesanver

Slide 26

Slide 26 text

@michellesanver Where are the tags? Not there, because protected.

Slide 27

Slide 27 text

@michellesanver Dealing with versions Removing fields, renaming, different structure, you name it.

Slide 28

Slide 28 text

@michellesanver

Slide 29

Slide 29 text

@michellesanver

Slide 30

Slide 30 text

@michellesanver Version 1

Slide 31

Slide 31 text

@michellesanver Version 2+

Slide 32

Slide 32 text

@michellesanver Different views (groups) The common “detail” vs “list” views, handled by one set of data!

Slide 33

Slide 33 text

@michellesanver

Slide 34

Slide 34 text

@michellesanver Version 2+ Detail view

Slide 35

Slide 35 text

@michellesanver Version 2+ API view

Slide 36

Slide 36 text

@michellesanver Virtual properties Properties with a punch

Slide 37

Slide 37 text

@michellesanver

Slide 38

Slide 38 text

@michellesanver

Slide 39

Slide 39 text

@michellesanver

Slide 40

Slide 40 text

@michellesanver

Slide 41

Slide 41 text

@michellesanver Version 1+2

Slide 42

Slide 42 text

@michellesanver Version 3+

Slide 43

Slide 43 text

@michellesanver Advanced serialization One set of data, variable output!

Slide 44

Slide 44 text

@michellesanver Still… Advanced Serialization is slow

Slide 45

Slide 45 text

@michellesanver We tried lots of options And everything is great

Slide 46

Slide 46 text

@michellesanver We tried lots of options And everything is great

Slide 47

Slide 47 text

@michellesanver We tried lots of options And everything sucks

Slide 48

Slide 48 text

@michellesanver JMS Serializer I would say it’s a standard?

Slide 49

Slide 49 text

@michellesanver Symfony Serializer It’s great and all… Use it!

Slide 50

Slide 50 text

@michellesanver Better Serializer Maybe it’d be better, if it worked.

Slide 51

Slide 51 text

@michellesanver Use these serializers! Really, they’re great! https://github.com/php-serializers/ivory-serializer-benchmark

Slide 52

Slide 52 text

@michellesanver Let’s GO beyond PHP!

Slide 53

Slide 53 text

@michellesanver Hire someone amazing They make you GO far!

Slide 54

Slide 54 text

@michellesanver Sheriff https://github.com/liip/sheriff An “advanced” serializer in GO

Slide 55

Slide 55 text

@michellesanver https://github.com/liip/sheriff

Slide 56

Slide 56 text

@michellesanver PHP to GO: Generating GO structs from PHP models https://github.com/mweibel/php-to-go

Slide 57

Slide 57 text

@michellesanver #dpc19 generate();

Slide 58

Slide 58 text

@michellesanver https://github.com/liip/sheriff

Slide 59

Slide 59 text

@michellesanver #dpc19 GoRidge: High-performance PHP-to-Golang IPC bridge https://github.com/spiral/goridge

Slide 60

Slide 60 text

@michellesanver #dpc19 call("App.Serialize", “Products"); https://github.com/spiral/goridge

Slide 61

Slide 61 text

@michellesanver #dpc19 Go + PHP = Crazy love? Sometimes crazy is good ;)

Slide 62

Slide 62 text

@michellesanver But PHP had no fair chance Go was great!

Slide 63

Slide 63 text

@michellesanver Liip Serializer: Speed it up!

Slide 64

Slide 64 text

@michellesanver Model Parser SerializerGenerator DeserializerGenerator

Slide 65

Slide 65 text

@michellesanver Liip Serializer: Demo!

Slide 66

Slide 66 text

@michellesanver Github Repositories Liip Serializer: liip/serializer Meta data parser: liip/metadata-parser JMS Adapter: liip/serializer-jms-adapter Demo code: michellesanver/liip-serializer-demo

Slide 67

Slide 67 text

@michellesanver Final Words

Slide 68

Slide 68 text

@michellesanver Serialization is cool You can do a lot with your data, with an advanced serializer alone

Slide 69

Slide 69 text

@michellesanver You (probably)… Don’t need Liip/Serializer Options out there are fast, performant, and easy to use for 99% of the cases.

Slide 70

Slide 70 text

@michellesanver Monitor performance Find your bottlenecks and fix them!

Slide 71

Slide 71 text

@michellesanver Language limitions... Know your technology and don’t be afraid to GO out of your comfort zone.

Slide 72

Slide 72 text

@michellesanver Cool stuff you do Open source it!

Slide 73

Slide 73 text

@michellesanver Hire someone not like you They will look at the problems with new eyes

Slide 74

Slide 74 text

@michellesanver Dare to experiment Stay curious & Ask questions

Slide 75

Slide 75 text

@michellesanver Different people and views Experiment often Stretch your limitations

Slide 76

Slide 76 text

@michellesanver We can make the impossible, possible Together

Slide 77

Slide 77 text

@michellesanver Thank you By the way, we’re hiring ;) Michelle Sanver michelle@liip.ch https://joind.in/talk/02645