MongoDB Sao Paulo 2012: Como usei MongoDB no meu projeto de graduação (English)

BREAKING
PARADIGMS
How I used
in my graduation project
sexta-feira, 6 de julho de 12

View Slide

BREAK
PARADIGMS
ING

View Slide

PARADIGM
pattern or model;
assumptions, concepts,
values and practices;

View Slide

how a paradigm
is created

View Slide


View Slide

is about...
this talk

View Slide

paradigms
is about...
this talk

View Slide

college
paradigms
is about...
this talk

View Slide

monkeys
college
paradigms
is about...
this talk

View Slide

dragon ball z
monkeys
college
paradigms
is about...
this talk

View Slide

mongoDB
dragon ball z
monkeys
college
paradigms
is about...
this talk

View Slide

a cool software
is about...
this talk mongoDB
dragon ball z
monkeys
college
paradigms

View Slide

challenges
is about...
this talk
mongoDB
dragon ball z
monkeys
college
paradigms
a cool software

View Slide

me
is about...
this talk
mongoDB
dragon ball z
monkeys
college
paradigms
a cool software
challenges

View Slide

IT`S A SELFISH TALK
you’re right...

View Slide

@shamanime
Jefferson
Queiroz
Venerando

View Slide


View Slide

COLLEGE
it all starts with

View Slide

THERE’S A TRUTH
ABOUT COLLEGE

View Slide

how I think it will be...

View Slide

what my mom thinks...

View Slide

what my mom thinks...
what it really is...

View Slide

while you seek
your graduation

View Slide

You face a lot of paradigms.

View Slide

YOU LEARN PRETTY MUCH...
one way to code.
one way to model your database.
one way to document.

View Slide

There is not enough time
to teach everything.

View Slide

And it all comes down to
your graduation project.
If you're doing IT.

View Slide

So you come back to
what you have learned.

View Slide

So you come back to
what you have learned.
}
Can you ﬁnd
some paradigms
in your way here?

View Slide

LET’S GET OUR HANDS DIRTY.

View Slide

LET’S GET OUR HANDS DIRTY.
I HAD TO GRADUATE, TOO.

View Slide

I worked at an advertising agency

View Slide

it lacked good software

View Slide

too much hard labour to compensate it

View Slide

too much hard labour to compensate it
why not solve this?

View Slide

a software for control of
advertising agencies
+
Ruby on Rails and a
relational database

View Slide

a software for control of
advertising agencies
+
Ruby on Rails and a
relational database
LET’S DO IT!

View Slide

I didn’t know Rails.
Nice challenge. And paradigm.

View Slide

I learned it.
And it wasn’t that bad.

View Slide

the
BIG PROBLEM
really

View Slide

DATA MODELING

View Slide

WHY IT WAS HARD #1
requirements are NOT fully
defined in the start...
…it changes over development.

View Slide

WHY IT WAS HARD #2
changes requires
migrations...
…hard to keep track,
…a pain to go back and redo.

View Slide

WHY IT WAS HARD #3
requirements are still
unstable...
…development needs
to be fast.

View Slide

WHY IT WAS HARD #4
business rules are
complicated...
…many relations
and joins.

View Slide


View Slide

WHY IT WAS HARD #5
FIXED
SCHEMA
…objects can be
unique.

View Slide

REVIEW
Unstable requirements
Hard to model the business rules
Slow development
WHY IT WAS HARD

View Slide

LET’S
LOOK
AT THE OTHER
SIDE OF
THE COIN

View Slide

MySQL
Firebird
PostgreSQL
SQLite
Oracle
DB2
CouchDB
BigData
Vertica
Cassandra
MemcacheDB

View Slide

WHY
SHINES

View Slide

WHY IT SHINES
Document data model

View Slide

WHY IT SHINES
Document data model
It’s schema free

View Slide

WHY IT SHINES
Document data model
It’s n-dimensional

View Slide

WHY IT SHINES
Document data model
No joins

View Slide

WHY IT SHINES
Document data model
It has a...

View Slide

JSON
STRUCTURE

View Slide

JSON
STRUCTURE
FRIDAY 13

View Slide

WHY IT SHINES
Ad hoc queries

View Slide

WHY IT SHINES
Ad hoc queries
Dynamic queries

View Slide

WHY IT SHINES
Secondary indexes

View Slide

WHY IT SHINES
Secondary indexes
Up to 64 indexes per collection

View Slide

WHY IT SHINES
Replication

View Slide

WHY IT SHINES
Replication
Used for redundancy

View Slide

WHY IT SHINES
Replication
Automated failover

View Slide

WHY IT SHINES
Speed and durability

View Slide

WHY IT SHINES
Journaling or replication

View Slide

WHY IT SHINES
Scaling

View Slide

WHY IT SHINES
Scaling
Horizontal scaling is plain easy

View Slide

WHY IT SHINES
REVIEW
Document data model
Ad hoc queries
Secondary indexes
Replication
Scaling

View Slide

how it
HELPED ME

View Slide

SCHEMALESS
represent data as it really is;
no migrations = more time developing;
one query gives all you need;

View Slide

"With great power
comes great responsibility"
- Uncle Ben

View Slide

DON’T LET YOUR DOCUMENTS
BECOME A MESS

View Slide

RELATIONAL MODEL
DOCUMENTS
no redundancy,
normal forms
no joins,
redundancy is ok

View Slide

DOCUMENTS
They are self-contained
One query returns the whole thing

View Slide

DOCUMENTS
Performance++
One query returns all I need

View Slide

DOCUMENTS
Can be liked or embed

View Slide

LINKED DOCUMENTS
Mostly used for many to many
relationships;
Good when data duplication is
a problem;

View Slide

EMBED DOCUMENTS
Yo dawg, I heard you like
documents so I put a document
in your document so you can
have many documents in your
document.

View Slide

MAKING IT REAL #1
// representação de um job
{ "_id" : ObjectId( "4fa969cef8955b304e000056" ),
"campanha" : "Promoção de férias sup. Thiago",
"cliente_id" : ObjectId( "4f271132f8955b177a000019" ),
"data_entrada" : Date( 1337040000000 ),
"data_entrega" : Date( 1337040000000 ),
"func_nome" : "Jefferson Queiroz",
"func_usuario" : "jefferson",
"funcionario_id" : ObjectId( "4f271132f8955b177a000004" ),
"numero" : 4,
"status" : "produção",
"titulo" : "Férias legais",
"updated_at" : Date( 1336502734000 ),
"verba" : "4500.0" }

View Slide

MAKING IT REAL #2
// inserir cliente e telefones
> db.clientes.insert({
nome: 'Jefferson Queiroz Venerando',
cidade: 'Iturama',
telefones: [
numero: '34 5687-1432', op: 'TIM'},
numero: '34 3442-4321', op: 'Vivo'}
]
})

View Slide

{ "_id" : ObjectId( "4f2c0bec740e950417000038" ),
"created_at" : Date( 1328286700000 ),
"desconto_cliente" : 0,
"formato" : "40x50",
"func_nome" : "Jefferson",
"func_usuario" : "jefferson",
"funcionario_id" : ObjectId( "4f271132f8955b177a000001" ),
"job_id" : ObjectId( "4f2acb2d740e950417000017" ),
"servico_id" : ObjectId( "4f271133f8955b177a00002e" ),
"status" : "criação",
"titulo" : "Outdoor",
"updated_at" : Date( 1334175800000 ),
"valor_fornecedores" : [
{ "_id" : ObjectId( "4f457739f8955b5420000001" ),
"fornecedor_id" : ObjectId( "4f271132f8955b177a00001a" ),
"valor" : "321.0" },
{ "_id" : ObjectId( "4f457739f8955b5420000002" ),
"fornecedor_id" : ObjectId( "4f271132f8955b177a00001b" ),
"valor" : "123.0" } ],
"vlr_com_desconto" : "50.0",
"vlr_fornecedores" : "444.0",
"vlr_servico" : "50.0",
"vlr_total" : "494.0" }

View Slide

DOCUMENTS
Work with data as it is
Development is fast
Consistency is up to you
REVIEW

View Slide

MAP REDUCE IS HOT!
ALSO

View Slide

not everything is
FLOWERS

View Slide

SOME LIMITATIONS
It uses memory-mapped files

View Slide

SOME LIMITATIONS
Best to run on 64-bit

View Slide

SOME LIMITATIONS
Memory for the data will be
allocated automatically

View Slide

SOME LIMITATIONS
Replication is important

View Slide

SOME LIMITATIONS
Document size limit
16 MB in MongoDB v2.0

View Slide

SOME LIMITATIONS
Document size limit
#1 discourage documents with
deep levels of nesting

View Slide

SOME LIMITATIONS
Document size limit
#2 performance

View Slide

SOME LIMITATIONS
No transactions support

View Slide

SOME LIMITATIONS
Work with 1 document at once

View Slide

SOME LIMITATIONS
No BEGIN, COMMIT or ROLLBACK

View Slide

SOME LIMITATIONS
Make sure to understand it, too.
There are more...

View Slide

SOME LIMITATIONS
No ACID
Be sure to have enough memory
No transactions, really
REVIEW

View Slide

in the end
WHAT WAS DONE

View Slide

our idea...
WAS BUILT FROM THE GROUND UP
USING MONGODB

View Slide


View Slide

IT WORKS VERY WELL
MongoDB was a great choice

View Slide

IT WORKS VERY WELL
Even for ‘small’ projects

View Slide

IT WORKS VERY WELL
No headaches so far

View Slide

I GRADUATED

View Slide

AND BROKE
THE COLLEGE
PARADIGM

View Slide

the
BECAME A PRODUCT

View Slide

WORKING IN
PRODUCTION

View Slide

LEARNING
NEVER
ENDS
REVIEW

View Slide

QUESTIONS?

View Slide

Thanks!
JEFFERSON Q. VENERANDO
@shamanime
Thanks Stephanie Pellegrino for the illustrations
http://shamani.me

View Slide

MongoDB Sao Paulo 2012: Como usei MongoDB no meu projeto de graduação (English)

MongoDB Sao Paulo 2012: Como usei MongoDB no meu projeto de graduação (English)

mongodb

More Decks by mongodb

Featured

Transcript