MongoDB for PHP User Group SG

An introduction to MongoDB, with emphasis on HA

Transcript

1. PHP + MongoDB by @laurenceputra for Singapore PHP User Group
2. Instasyncer HA Database, with automatic fallover
3. Geekcamp.SG HA Database, with automatic fallover
4. Including freelance work, and personal projects Other random projects
5. What is HA?
6. HA for WHAT? Doesn’t it cost more?
7. What if AWS goes down?
8. If you want web-scale db’s
9. Go and use /dev/null It has the fastest write speeds, and is replicated on ALL unix based systems all over the world. Instant replication :D
10. So why should YOU use MongoDB?
11. It’s AWESOME It’s FLEXIBLE It’s FAST
12. And it’s really easy to do all those hardcore DevOps stuff that you’ve been hearing about. Stuff like High Availability, Sharding, and Backups ...
13. ... Add in the fact that you can add in new fields any time. Fast. ...
14. ... and backup your entire database without facing performance issues
15. Unsafe writes? "We try to make it clear in the documentation, but some people never notice that there’s a “safe” option for writes (that defaults to false), and then get very pissed when something wasn’t written."
16. Plus, does this look familiar? $mysqli->query("INSERT blah blah blah"); $mysqli->query("UPDATE blah blah blah");
17. So... Are you convinced?
18. MongoDB mongodb.org
19. Installing and using MongoDB is as simple as downloading the file and typing /path/to/mongod in your terminal (starts the mongo server) Of course there's a whole lot of other ways to do it (RPM, Brew, ...)
20. And to use it you simply need to type /path/to/mongo  
21. And MongoDB is now set up on your server. Tons of awesome documentation over at http://www.mongodb.org/display/DOCS/ Home *they have some of the best documentation I’ve ever seen
22. PHP Drivers (sudo)  pecl  install  mongo Plus add in extension=mongo.so in php.ini
23. That’s it. Your PHP Webapp can now use MongoDB Setup done.
24. That wasn’t that long right?
25. It gets better.
26. Basic syntax $conn  =  new  Mongo(); $db  =  $conn-­‐>php_meetup; $collection  =  $db-­‐>members;
27. $member  =  array( 'name'  =>  'Laurence',   'age'  =>  22 ); $settings  =  array('safe'  =>   MONGO_SAFE_LEVEL); $collection-­‐>insert($member,  $settings);
29. Oops, I forgot a field! And I now have a billion members, which will make "Alter   TABLE" on mySQL take forever to run, making my webapp super laggy for the next hour or so.
30. $query  =  array('name'  =>  'Laurence'); $update  =  array( '$set'  =>  array( 'twitter'  =>  '@laurenceputra' )); $settings  =  array('safe'  =>  MONGO_SAFE_LEVEL); $collection-­‐>update($query,  $update,   $settings); With MongoDB
32. Now to Scale!
33. Architecture of a production system mongod -configsvr
34. In MongoDB, sharding is the tool for scaling a system, and replication is the tool for data safety, high availability, and disaster recovery.
35. What is sharding?
36. Splitting of data into logical Chunks based on a predefined Shard Key. Max 64 MB per chunk Choose your shard key VERY carefully
37. Machine 1 Machine 2 Machine 3 Alabama → Arizona Colorado → Florida Arkansas → California Indiana → Kansas Idaho → Illinois Georgia → Hawaii Maryland → Michigan Kentucky → Maine Minnesota → Missouri Montana → Montana Nebraska → New Jersey Ohio → Pennsylvania New Mexico → North Dakota Rhode Island → South Dakota Tennessee → Utah Vermont → West Virgina Wisconsin → Wyoming
38. mongos : to determine which mongod to send request to mongod --configsvr : stores information on what each shard contains (consumes little resources) mongod : a shard (normally a part of a replica set) containing the data
39. Want to know more?
40. RTFM!
41. Replica Sets?
42. Simply creates multiple copies of the data on multiple servers/nodes, such that if any server/node goes down, the database is still up.
43. Of course, if 2012 happens, you’re out of luck ;)
44. mongod  -­‐-­‐port  27017  -­‐-­‐dbpath  $HOME/mongodb/ data/  -­‐-­‐logpath  $HOME/mongodb/logs/ mongodb.log  -­‐-­‐logappend  -­‐-­‐fork  -­‐-­‐replSet   demo1  -­‐-­‐oplogSize  50  -­‐-­‐keyFile  $HOME/ mongokey
45. rs.initiate() rs.add('mongodb2.cloudapp.net:27017') rs.add('mongodb3.cloudapp.net:27017') var  c  =  rs.config() c.members[0].priority  =  7 rs.reconfig(c)
46. db.addUser('admin','demopassword') db.auth('admin','demopassword')
47. mongo -u admin -p demopassword --host YOUR_URL_HERE --port 27017 admin
48. Demo Servers provided by They actually have customer support
49. Architecture of a production system (recap) mongod -configsvr
50. The whole stack (mine) Request App server mongod App server mongod Server Server Server specs Space: 100GB RAM: 256MB Bandwidth: 600GB RAM quota excludes OS/ Apache/mySQL/PgSQL Sign up here: http://bit.ly/Nz252v mongod
51. Automated tasks 0  0  *  *  *  $HOME/webapps/mongodb/mongo/ mongodump  -­‐u  backup  -­‐p  MYPASSWORD!  -­‐-­‐oplog   -­‐-­‐port  19904  -­‐o  $HOME/dump;  git  -­‐-­‐git-­‐dir= $HOME/dump/.git  -­‐-­‐work-­‐tree=$HOME/dump  add   -­‐A;  git  -­‐-­‐git-­‐dir=$HOME/dump/.git  -­‐-­‐work-­‐ tree=$HOME/dump  commit  -­‐m  "updated  backup";   git  -­‐-­‐git-­‐dir=$HOME/dump/.git  -­‐-­‐work-­‐tree= $HOME/dump  push
52. Automated tasks 5,15,25,35,45,55  *  *  *  *  $HOME/webapps/ mongodb/mongo/mongod  -­‐-­‐port  19904  -­‐-­‐dbpath   $HOME/webapps/mongodb/data/  -­‐-­‐logpath   $HOME/webapps/mongodb/logs/mongodb.log  -­‐-­‐ logappend  -­‐-­‐fork  -­‐-­‐replSet  laurenceputra1   -­‐-­‐oplogSize  50  -­‐-­‐keyFile  $HOME/mongokey
53. Automated tasks 0  0  *  *  *  killall  -­‐SIGUSR1  mongod
54. Automated tasks 0  1  1  *  *  rm  $HOME/webapps/mongodb/logs/ mongodb.log.*
55. limitations of MongoDB No full text search More than 100 shards untested No random sorting
56. GeekcampSG - 18th August Website - Geekcamp.SG
57. The End @laurenceputra geeksphere.net