JUDCon Brazil - Building Polyglot Persistence Java Application

JUDCon Brazil - Building Polyglot Persistence Java Application

Transcript

1. Building Polyglot Persistence Applications on OpenShift PRESENTED BY Shekhar Gulati
2. AGENDA
3. WHO AM I? • Shekhar Gulati • OpenShift Developer Evangelist at Red Hat • 8 years of software development experience • Learning JavaScript these days :) • Java / NoSQL/ Cloud • Loves to learn and try new technologies • Twitter Handle : shekhargulati • Github https://github.com/shekhargulati • Slides https://speakerdeck.com/shekhargulati
4. WHO ARE YOU?
5. In how many days/months/years JavaScript was written?
6. ASSUMPTIONS • You want to learn how to use OpenShift • You can write or read Java • You will ask questions
7. There are no stupid questions only stupid answers. So ask questions ASK QUESTIONS
8. http://nosql-database.org/ lists 150 databases Now we have choices ...
9. • Widely used and understood • Tested in real environments • Efficient use of storage space if data normalized properly • Great tools support • ACID semantics • Incredibly flexible and powerful query language • Great framework support WHY RDBMS?
10. • Complex object graphs does not map very well with flat tables. • Difficult to evolve Schema with time. • Data constraints and JOINs can be expensive at runtime. • Difficult to scale horizontally. RDBMS LIMITATIONS
11. NoSQL Databases to rescue
12. • Schema-less • Eventual consistent • Fast writes • Easy to scale horizontally to add processing power and storage • Tries to solve few practical use-cases NoSQL TO RESCUE
13. Using multiple data storage technologies, chosen based upon the way data is being used by individual applications or components of single application. Martin Fowler http://martinfowler.com/articles/nosql-intro.pdf POLYGLOT PERSISTENCE
14. http://martinfowler.com/articles/nosql-intro.pdf HYPOTHETICAL EXAMPLE
15. GET MORE INFO AT
16. APPLICATION http://localjobs-cix.rhcloud.com/
17. • OpenShift • MongoDB • PostgreSQL • Java – Spring framework , Spring Social, Spring MongoDB, Spring Security etc. • Searchify : Full-text Search as a Service • Git • Twitter Bootstrap • Backbone.js TECHNOLOGY CHOICES
18. • Document Oriented database – JSON-style documents • Schema-less – Each document is heterogeneous, and may have completely unique structure compared to other documents. • Fast and horizontally scalable • Rich query language MONGODB
19. Database → Database Table → Collection Row → Document Index → Index MONGODB TERMINOLOGY MONGODB TERMINOLOGY
20. • Easy to get running • Open Source • Active community • Rich documents • Geospatial indexing • Writes are very fast. You can customize it using WriteConcern WHY MONGODB?
21. RICH DOCUMENT
22. 22  What is it for?  Find all the MongoDB jobs near me – Proximity Queries  Find all the MongoDB jobs within Colombo – Bounded Queries  Find all the MongoDB job at this location – Exact Queries • Supports only two dimensional indexes.  You can only have one geospatial index per collection.  By default, 2d geospatial indexes assume longitude and latitude have boundaries of -180 inclusive and 180 non-inclusive (i.e. [-180, 180)) GEOSPATIAL INDEXING BASICS
23. 23 1) Put your coordinates into an array { loc : [ 50 , 30 ] } //SUGGESTED OPTION { loc : { x : 50 , y : 30 } } { loc : { foo : 50 , y : 30 } } 1) { loc : { lon : 40.739037, lat: 73.992964 } } 2) Make a 2d index db.places.ensureIndex( { loc : "2d" } ) 3) If you use latitude and longitude as your coordinate system, always store longitude first. MongoDB’s 2d spherical index operators only recognize [ longitude, latitude] ordering. HOW TO MAKE IT WORK
24. 24 • When you create the index, MongoDB converts location data to binary geohash values and calculates these values using the location data and the index’s location range • Geohashes have a precision that is determined by the number of bits in the hash. Default value 26 • More bits allow the index to provide results with greater precision • You can configure number of bits at index creation db.collection.ensureIndex( {<location field>: "2d"} , { bits: <bit precision> } ) GEOHASHES
25. 25 • MongoDB supports compound geospatial indexes. • the field with location data is the first field db.jobs.ensureIndex( { location: "2d", skills: 1 } ) COMPOUND GEOSPATIAL INDEXES
26. OpenShift is PaaS by Red Hat Multi-language, Auto-Scaling, Self-service, Elastic, Cloud Application Platform
27. Lowers Cost Improves Developer Efficiency Scales WHY PAAS?
28. origin Public Cloud Service On- premise or Private Cloud Software Open Source Project FLAVORS OF OPENSHIFT
29. • Supports MongoDB and PostgreSQL. Also supports MySQL • Multi-language support. Supports Java, Node.js, Perl, Python, PHP and Ruby • Extensible via DIY • No need to learn anything new • Open source – OpenShift Origin • Scalable • FREE! WHY OPENSHIFT?
30. Developer IDE Integrations Web Browser Console Command Line Tooling REST APIs INTERACTIONS
31. • OpenShift is free-as-in-beer & free-as-in-freedom • You get three free gears, each with 512MB memory and 1GB of disk space. • Need more resources, just ask! • The catch is we are in developer preview right now WHAT DO I GET?
32. 32 Let's get our hands dirty
33. 33 https://openshift.redhat.com/app/account/new Promo code is JUDCONBR13 CREATING OPENSHIFT ACCOUNT
34. 34 ➢ Login to OpenShift web console ➢ Click on “My Account” ➢ Namespace – JUDCONBR – Unique per user CREATING NAMESPACE
35. 35 Some terminology for today 1. Application – your web code and any data store. Has to be on 1 or more gears 2. Gear – is like a server. It can have only 1 language for the web programming. 3. Cartridge – it adds a language, a data store, or other functionality 4. Git – used for version control and managing code between server and your development machine 5. Ssh – command line tool to connect to your gear
36. 36 Install Ruby 1.8.7 or greater Install Git Install rhc OpenShift gem Refer to documentation INSTALLING CLIENT TOOLS
37. 37 rhc setup -l <openshift_login> -> creates namespace -> upload ssh keys SETUP OPENSHIFT ENVIRONMENT
38. 38 1. Git add . (means add all new files as being tracked in the local repository) 2. Git commit –am “your message” (means commit all my changes to the local repository with this message) 3. Git push (means push from your local repository to the repository on your OpenShift gear) 3 COMMANDS YOU SHOULD KNOW
39. 39 $ rhc app create localjobs jbosseap mongodb-2.2 postgresql-8.4 -s $ git remote add upstream -m master https://github.com/shekhargulati/localjobs- scalable.git $ git pull -s recursive -X theirs upstream master $ rhc app show -a localjobs $ scp jobs-data.json <ssh url>:app-root/data $ rhc app ssh -a localjobs $ cd app-root/data $ mongoimport -d localjobs -c jobs --file jobs-data.json -u $OPENSHIFT_MONGODB_DB_USERNAME -p $OPENSHIFT_MONGODB_DB_PASSWORD -h $OPENSHIFT_MONGODB_DB_HOST -port $OPENSHIFT_MONGODB_DB_PORT $ mongo $ db.jobs.ensureIndex({“location”:”2d”}) DEMO : LOCALJOBS APP
40. 40 git push
41. 41 Code Walkthrough
42. QUESTIONS?
43. DONE!