Upgrade to Pro — share decks privately, control downloads, hide ads and more …

How X.commerce is building a platform on open source - Saleem Shafi, X.commerce

mongodb
February 17, 2012

How X.commerce is building a platform on open source - Saleem Shafi, X.commerce

MongoDB Austin 2012

X.commerce is a new business unit in the Ebay, Inc family that is revolutionizing commerce for consumers, merchants and developers. In this presentation, we will look at how our technology strategy aligns with open source principles and how open source is helping X.commerce achieve its vision, both in providing technical solutions, such as MongoDB, as well as helping to develop the community needed for us to be successful.

mongodb

February 17, 2012
Tweet

More Decks by mongodb

Other Decks in Technology

Transcript

  1. No, really, what the heck is it? l  eBay, Inc.'s

    newest business unit l  going to bring everything eBay, Inc. has to merchants, large and small l  a way for commerce developers to reach more merchants with innovative capabilities l  an open platform, built greenfield, to make the last two points happen
  2. How do we pull this off? l  X.commerce Cloud l 

    X.commerce Fabric integration platform l  X.commerce Open Commerce Language l  All built on open source!
  3. X.commerce Fabric Point-to-point integrations Reuse model Merchant: easy adoption of

    new capabilities, low switching costs Developer: no barriers to entry, easy on-boarding of customers
  4. Open Commerce Language l  Commerce Esperanto l  Defined with Avro

    schemas l  Compatibility l  Evolvability l  Developed in the open l  Cannot be an innovation bottleneck l  github.com/xcommerce/X.commerce-Contracts
  5. Why Open Source? l  Our team's experience and willingness to

    invest l  Our principles l  Transparency l  Consensus l  Distributed responsibility/autonomy l  Collaboration l  Meritocracy l  We're building a community
  6. Key Partnerships VMWare l  CloudFoundry l  RabbitMQ l  Spring Rackspace

    l  OpenStack Cloudera l  Hadoop l  Avro l  ZooKeeper 10gen l  MongoDB
  7. MongoDB in X.commerce l  A core component of the X.commerce

    Cloud l  The standard data store for all in-house capabilities l  The Fabric l  Authorization and configuration data l  Message tracing
  8. Why MongoDB? l  Quality attributes l  Elastic l  Reliable l 

    Manageable l  Deployment l  Uniform l  Easily automated l  Scales down Data model Flexible Constrained Simple optimizations Already integrated with Cloud Foundry
  9. Schema evolution l  Initial model for inventory data { sku:

    “123123”, available: 83, reserved: 2, locations: ! [ { location: “austin”, available: 36, reserved: 1 }, ! { location: “san jose”, available: 47, reserved: 1 } ]! } l  Lots of contention at high volume l  Traditional locking mechanisms failed
  10. Schema evolution l  More scalable model { item: “123123-1”, sku:

    “123123”, location: “austin”,! status: “reserved” },! { item: “123123-2”, sku: “123123”, location: “austin”,! status: “available” },! { item: “123123-3”, sku: “123123”, location: “san jose”,! status: “available” } l  document-per-item l  trade-off: space vs. contention l  For more, attend Kevin Hanson's session
  11. Message Tracing l  Fabric-specific logging mechanism { guid: “80B2A”, parentGuid:

    “80B1E”, ! topic: “/order/created”, size: 112, status: 200 } l  Time-capped collection used for real-time access l  Built-in in Mongo 2.2? l  Backed up with Hadoop cluster for historical data l  Map-reduce for on-the-fly metrics
  12. Some Lessons Learned l  Open source is an investment l 

    Get involved with the community l  Leverage partnerships to manage risk l  Plan on implementing (at least) twice