Open Source Development Trends - Erasmus Hogeschool 2014

Slides for my Open Source Development Trends talk at Erasmus Hogeschool Brussels 2014.

1. Open source development trends By Thijs Feryn
2. Hi, I’m Thijs
3. I’m @ThijsFeryn on Twitter
4. I’m an at Evangelist
5. I’m a at board member
7. Modern  web  developer
8. Modern  web  developer Code Infrastructure Agile  processes Quality  assurance Frontend  vs   backend Project   management Build  &  release  cycles Performance  &  scalability Security Flexibility
9. Internet
10. Military
11. Scientific
12. Public (hobbyism)
13. Corporate
14. E-commerce & web applications
15. Web 2.0
16. Software As A Service
17. Social media
19. Mobile
20. Big data
21. Evolution of programming languages
22. EvoluDon  of  programming  languages ✓C ✓C++ ✓C# ✓Objective C ✓Perl ✓VB(A) ✓Java ✓Javascript ✓PHP ✓Ruby ✓Python ✓Node.js
23. Traditional language are still there
24. Interpreted languages are accepted & respected
25. PHP, Perl, Javascript, Ruby, Python, Bash
26. Mix & match
28. Proprietary vs open source
30. Security through obscurity
31. The big boys
32. Liability
33. Linux is a cancer Steve Ballmer, CEO of Microsoft, June 2001
35. Microsoft has changed as a company and is becoming more open in the way that we work with and collaborate with others in the industry, in how we listen to customers, and in our approach to the cloud. We contribute to and partner with open source communities and promote interoperability to make it easier and less costly for customers to develop and manage mixed IT environments. We actively participate in the standards setting process and support established and emerging standards in our products. In the cloud, we support key standards that provide the building blocks for open, interoperable cloud services, and we support developer choice of programming languages. We support data portability and believe customers own and control their data, no matter where it resides.
36. Passion
37. Business model
39. Frontend vs backend
40. Design patterns
41. Decorator
42. interface ServiceClient { function getData(); } ! class MyWebServiceClient implements ServiceClient { private $data; function MyWebServiceClient() { $client = new SoapClient("some.wsdl"); $this->data = $client->getDataFunction(); } function getData() { return $this->data; } }
43. $client = new MyWebServiceClient(); // Later in your code, and possibly in multiple places print $client->getData();
44. abstract class ServiceClientDecorator implements ServiceClient { protected $serviceClient; public function __construct(ServiceClient $serviceClient) { $this->serviceClient = $serviceClient; } } ! class HtmlEntitiesDecorator extends ServiceClientDecorator { public function getData() { return htmlentities($this->serviceClient->getData()); } } ! class ParagraphDecorator extends ServiceClientDecorator { public function getData() { return '<p>'.$this->serviceClient->getData().'</p>'; } }
45. $client = new MyWebServiceClient(); // Add our decorators $client = new HtmlEntititesDecorator($client); $client = new ParagraphDecorator($client); ! // Later in your code, and possibly in multiple places print $client->getData();
46. Factory
47. class DatabaseFactory { // The factory function takes as an argument the // name of the class to produce public static function getInstance($driver) { // Attempt to include the the file containing the class // (not necessary if you use a custom autoloader) if(include_once(dirname(__FILE__).'/drivers/database_'. $driver.'.php')) { // Build the name of the class, instantiate, and return $driver_class = 'Database_'.$driver; return new $driver_class; } else { throw new Exception('Database driver not found'); } } } ! // To use, call the factory's static method: $db = DatabaseFactory::getInstance('MySQL');
48. Singleton
49. class Database { // A static property to hold the single instance of the class private static $instance; ! // The constructor is private so that outside code cannot instantiate private function __construct() { } ! // All code that needs to get and instance of the class should call // this function like so: $db = Database::getInstance(); public function getInstance() { // If there is no instance, create one if (!isset(self::$instance)) { $c = __CLASS__; self::$instance = new $c; } return self::$instance; } // Block the clone method private function __clone() {} } ! // To use, call the static method to get the only instance $db = Database::getInstance();
50. Dependency injection
51. class Book ! {! ! public function __construct() ! {! ! ! $registry = RegistrySingleton::getInstance();! ! ! $this->_database = $registry->database;! ! ! // or! ! ! global $databaseConnection;! ! ! $this->_database = $database;! ! }! }! ! $book = new Book();
52. class Book ! { ! ! private $_databaseConnection;! ! public function __construct() { }! ! public function setDatabaseConnection($databaseConnection) {! ! ! $this->_databaseConnection = $databaseConnection;! ! }! ! }! ! $book = new Book();! $book->setDatabase($databaseConnection);
53. Javascript is back
54. ✓Jquery ✓Angular.js ✓Backbone.js ✓D3.js ✓Node.js & NPM ✓Reveal.js ✓Yo ✓Grunt ✓Bower ✓Yeoman ✓Phantom.js
57. ✓Canvas drawing ✓Movie support ✓Offline data ✓Document editing ✓Drag & drop ✓Geolocation ✓File manipulation ✓New intuitive tags & elements
60. Request & reponse
61. Methods & status codes
62. Headers & body
63. GET  /  HTTP/1.1   Host:  www.erasmushogeschool.be   User-­‐Agent:  Mozilla/5.0  (Macintosh;  Intel  Mac  OS  X   10.9;  rv:27.0)  Gecko/20100101  Firefox/27.0   Accept:  text/html,application/xhtml+xml,application/ xml;q=0.9,*/*;q=0.8   Accept-­‐Language:  en,nl;q=0.7,fr-­‐be;q=0.3   Accept-­‐Encoding:  gzip,  deflate   Cookie:   SESScb94af3218bddf8a6a8a156d8d1cb02a=64a18f65470ea229 b5ad23a83566ab45;  has_js=1;   __utma=26413801.1654633732.1395239322.1395239322.1395 239322.1;  __utmb=26413801.1.10.1395239322;   __utmc=26413801;   __utmz=26413801.1395239322.1.1.utmcsr=(direct)| utmccn=(direct)|utmcmd=(none)   Connection:  keep-­‐alive   Cache-­‐Control:  max-­‐age=0   !
64. HTTP/1.1  200  OK   Date:  Wed,  19  Mar  2014  14:28:31  GMT   Server:  Apache/2.2.16  (Debian)  PHP/5.3.3-­‐7+squeeze15   with  Suhosin-­‐Patch   X-­‐Powered-­‐By:  PHP/5.3.3-­‐7+squeeze15   Last-­‐Modified:  Wed,  19  Mar  2014  11:00:54  GMT   Etag:  "9eb48667197c0cd1817601c4bff5738c"   Expires:  Sun,  19  Nov  1978  05:00:00  GMT   Cache-­‐Control:  must-­‐revalidate   Content-­‐Encoding:  gzip   Keep-­‐Alive:  timeout=15,  max=91   Connection:  Keep-­‐Alive   Transfer-­‐Encoding:  chunked   Content-­‐Type:  text/html;  charset=utf-­‐8   !
65. Status codes hFp://www.w3.org/Protocols/rfc2616/rfc2616-­‐sec10.html hFp://en.wikipedia.org/wiki/List_of_HTTP_status_codes
66. 100 range Magic, fuggedaboudid!
67. 200 range Check!
68. 200 range Check!
69. 200: OK 201: Created 202: Accepted 203: Non-Authoritative 
 Information 204: No content 205: Reset content 206: Partial content
70. 300 range Talk to that guy over there
71. 301: Moved permanently 302: Found 303: See other 304: Not modified 305: Use proxy 306: Unused 307: Temporary redirect
72. 400 range Dude, you f’d up!
73. 400: Bad request 401: Unauthorized 402: Payment required 403: Forbidden 404: Not found 405: Method not allowed 406: Not acceptable 407: Proxy authentication required 408: Request timeout
74. 409: Conflict 410: Gone 411: Length required 412: Precondition failed 413: Request enitity too large 414: Request URI too long 415: Unsupported media type 416: Request range not satisfiable 417: Expectation failed
75. 500 range Sorry man, we f’d up!
76. 500: Internal server error 501: Not implemented 502: Bad gateway 503: Service unavailable 504: Gateway timeout 505: HTTP version not supported
77. Request headers
78. ✓Accept ✓Accept-Charset ✓Accept-Encoding ✓Accept- language ✓Authorization ✓Cache-control ✓Connection ✓Cookie ✓Content-length ✓Date ✓Host ✓If-None-Match ✓Pragma ✓Proxy- Authorization ✓Referer ✓Upgrade ✓User-Agent ✓Via
79. Response headers
80. ✓Age ✓Allow ✓Cache-control ✓Connection ✓Content- Encoding ✓Content- Language ✓Content-Length ✓Content-Type ✓Date ✓ETag ✓Expires ✓Last-Modified ✓Location ✓Pragma ✓Server ✓Set-Cookie ✓Transfer- Encoding ✓Vary
81. GET  /  HTTP/1.1   Host:  www.erasmushogeschool.be   User-­‐Agent:  Mozilla/5.0  (Macintosh;  Intel  Mac  OS  X   10.9;  rv:27.0)  Gecko/20100101  Firefox/27.0   Accept:  text/html,application/xhtml+xml,application/ xml;q=0.9,*/*;q=0.8   Accept-­‐Language:  en,nl;q=0.7,fr-­‐be;q=0.3   Accept-­‐Encoding:  gzip,  deflate   Cookie:   SESScb94af3218bddf8a6a8a156d8d1cb02a=64a18f65470ea229 b5ad23a83566ab45;  has_js=1;   __utma=26413801.1654633732.1395239322.1395239322.1395 239322.1;  __utmb=26413801.1.10.1395239322;   __utmc=26413801;   __utmz=26413801.1395239322.1.1.utmcsr=(direct)| utmccn=(direct)|utmcmd=(none)   Connection:  keep-­‐alive   Cache-­‐Control:  max-­‐age=0   !
82. HTTP/1.1  200  OK   Date:  Wed,  19  Mar  2014  14:28:31  GMT   Server:  Apache/2.2.16  (Debian)  PHP/5.3.3-­‐7+squeeze15   with  Suhosin-­‐Patch   X-­‐Powered-­‐By:  PHP/5.3.3-­‐7+squeeze15   Last-­‐Modified:  Wed,  19  Mar  2014  11:00:54  GMT   Etag:  "9eb48667197c0cd1817601c4bff5738c"   Expires:  Sun,  19  Nov  1978  05:00:00  GMT   Cache-­‐Control:  must-­‐revalidate   Content-­‐Encoding:  gzip   Keep-­‐Alive:  timeout=15,  max=91   Connection:  Keep-­‐Alive   Transfer-­‐Encoding:  chunked   Content-­‐Type:  text/html;  charset=utf-­‐8   !
83. Caching
84. ETag If-­‐Non-­‐Match:  "3e86-­‐410-­‐3596=bc" ETag:  "3e86-­‐410-­‐3596=bc"
85. Expires Expires  "Wed,  1  Jan  2014  20:00:00  GMT"
86. Cache-­‐control Cache-­‐Control  “max-­‐age=3600,  s-­‐ maxage=1000,  public,  must-­‐revalidate”
87. Max-Age: TTL for browsers in seconds S-maxage: TTL for proxies in seconds Public: Proxies & browsers can cache Private: Only browsers can cache No-cache: Revalidate before dropping from cache No-store: don’t cache at all Must-revalidate: Browser revalidate before serving from cache Proxy-revalidate: Browser revalidate before serving from cache
88. Cookies
89. Cookies Tracking Sessions Language
90. Cookies HTTP cookie request header via browser HTTP set-cookie response header via webserver
91. Service oriented architecture
92. API/webservice
93. SOAP ✓WSDL = HTTP GET ✓RPC call = HTTP POST ✓Not cacheable ✓No HTTP vocabuliary re-use ✓Complex markup
94. REpresentational State Transfer
95. Developed in parallel with HTTP/1.1
96. The way the web
 *should* work
97. REST ✓Resources ✓Stateless ✓Cacheable ✓Layered ✓Uniform interface ✓Vocabulary re-use ✓HATEOAS
99. David Zülke @dzuelke
100. Quoting David Zülke ✓A URL identifies a resource. ✓Resources have a hierarchy, so you know that something with additional slashes is a subordinate resource ✓Verbs are used to perform operations on resources ✓The operation is implicit and not part of the URL ✓A hypermedia format is used to represent the data ✓Link relations are used to navigate a service
101. GET POST PUT DELETE Retrieve Insert Update Remove
102. HATEOAS   WTF?
103. Hypertext As The Engine Of Application State
104. GET  /products/1234  HTTP/1.1   Host:  example.com   Accept:  application/vnd.com.example+xml   HTTP/1.1  200  OK   Content-­‐Type:  application/vnd.com.example+xml;  charset=utf-­‐8   Allow:  GET,  PUT,  DELETE   <?  xml  version="1.0"  encoding="utf-­‐8"  ?>   <product  xmlns="urn:com.example.products"  xmlns:atom="http:// w3.org/2005/Atom">      <id>1234</id>      <name  xml:lang="en">My  product</name>      <name  xml:lang="nl">Mijn  product</name>   <price  currency="EUR">5</price>   <price  currency="USD">6.5</price>   <atom:link  rel="payment"  type="application/vnd.com.example +xml"  href="http://example.com/products/1234/payment"   </product>     Thx   David!
105. REST implementations
106. Javascript Ajax Jquery Backbone.js Websockets
107. Open data ✓hFp://appsforghent.be   ✓hFp://opendata.antwerpen.be/apps-­‐antwerp   ✓hFp://www.openbelgium.be  
108. Version Control
116. ✓Twitter Bootstrap ✓Homebrew ✓Ruby On Rails ✓HTML5 Boilerplate ✓Jquery ✓Node.js ✓Phonegap ✓Backbone.js ✓Linux Kernel ✓Symfony2 Frame work ✓Django Framework ✓Zend Framework 2 ✓Git Popular GitHub projects
117. Not Invented Here
119. Managing dependencies
120. Managing dependencies ✓Add to project ✓Share across environment ✓Beste of both worlds: package managers
121. Package managers ✓Ruby: Gem ✓Python: Pip ✓Perl: CPAN ✓PHP: PEAR, PECL & Composer ✓.NET: NuGet ✓Linux: yum, apt-get ✓Javascript: npm, bower
122. Dependency injection pattern
123. Webservers
127. GWS 3%   of  the   internet
128. Facebook’s   PHP  runtime
129. Database servers
134. “I wish I had enough money to run Oracle instead of Postgres." ! “Why do you want to do that?" ! “I dont, I just wish I had enough money to”
135. Addressing the needs of today’s internet
136. Stability
137. Availability
138. Perform ance
140. Scalability Social Mobile Cloud Data
142. Mobile
143. Big data
144. The tools have evolved
145. Not only SQL
149. Message queues
151. Varnish
153. ✓Async, non-blocking, event-driven ✓Javascript based ✓Callbacks ✓Data intensive ✓CK10 problem ✓Not for websites ✓Real-time communication ✓Websockets ✓Hipsters
154. var http = require('http'); http.createServer(function (req, res) { res.writeHead(200, {'Content-Type': 'text/plain'}); res.end('Hello World\n'); }).listen(1337, '127.0.0.1'); console.log('Server running at http:// 127.0.0.1:1337/');
155. Change
156. ✓Flexibility/elasticity ✓Scalability ✓Distributed systems ✓Any server could die any moment ✓Clustering ✓Replication ✓Sharding ✓Modularity
157. Developers Agile
158. ✓People > processes ✓Usability > documentation ✓Late requirement changes ✓Fast changes ✓Prototype ~ production ✓Continuous delivery ✓Short cycles ✓Quick releases
159. Fail fast
162. Sysadmins DevOps
163. Patrick Debois “What is this DevOps thing anyway?” http://www.jedi.be/blog/2010/02/12/ what-is-this-devops-thing-anyway
164. ✓Fear of change ✓Risky deployment ✓It work on my machine ✓Siloisation
165. Kris Buytaert “Building Clouds since before the bookstore” http://www.krisbuytaert.be/blog/what-devops
166. Everything is a Freaking DNS problem
167. That sweet spot between "operating system" or platform stack and the application layer
168. Tearing down silos
169. Infrastructure As Code
171. class  apache  (      $default_mods  =  true,      $service_enable  =  true,      $serveradmin    =  'root@localhost',      $sendfile          =  false,      $purge_vdir      =  true   )  {      include  apache::params   !    package  {  'httpd':          ensure  =>  installed,          name      =>  $apache::params::apache_name,      }   !    #  true/false  is  sufficient  for  both  ensure  and  enable      validate_bool($service_enable)   !    service  {  'httpd':          ensure        =>  $service_enable,          name            =>  $apache::params::apache_name,          enable        =>  $service_enable,  
172. !    file  {  'httpd_vdir':          ensure    =>  directory,          path        =>  $apache::params::vdir,          recurse  =>  true,          purge      =>  $purge_vdir,          notify    =>  Service['httpd'],          require  =>  Package['httpd'],      }   !    if  $apache::params::conf_dir  and  $apache::params::conf_file   {          #  Template  uses:          #  -­‐  $apache::params::user          #  -­‐  $apache::params::group          #  -­‐  $apache::params::conf_dir          #  -­‐  $serveradmin          file  {  "${apache::params::conf_dir}/$ {apache::params::conf_file}":              ensure    =>  present,              content  =>  template("apache/$ {apache::params::conf_file}.erb"),  
174. Vagrant::Config.run  do  |config|      config.vm.box  =  "lucid32"      config.vm.box_url  =  "http://files.vagrantup.com/lucid32.box"      config.vm.customize  [                  "modifyvm",  :id,                  "-­‐-­‐name",  "Varnish  Training",                  "-­‐-­‐memory",  "512"      ]      config.vm.network  :hostonly,  "12.12.12.6"      config.vm.share_folder  "v-­‐data",  "/home/data",  "./"      config.vm.provision  :chef_solo  do  |chef|          chef.cookbooks_path  =  "./tools/chef/cookbooks"          chef.json  =  {              :varnish  =>  {                          :vcl_dir  =>  "/home/data",                                                  :version  =>  "3.0",                          :listen_port  =>  "80",                          :storage  =>  "malloc",                          :storage_size  =>  "256m",                      },              :apache  =>  {                          :listen_ports  =>  ["8080"]       }                                 }          chef.add_recipe("vim")          chef.add_recipe("apache2")          chef.add_recipe("apache2::mod_php5")                  chef.add_recipe("varnish::apt_repo")          chef.add_recipe("varnish::default")      end   end  
175. Measure
176. ✓Google Analytics ✓Access_logs ✓Logstash ✓Graphite ✓Collectd ✓Statsd ✓New Relic ✓Datadog ✓Kibana
177. The community
178. Move fast. Keep up.
179. And   on  that   bombshell  ...
181. Thanks