Slide 1
Slide 1 text
No content
Slide 2
Slide 2 text
Introductions
Slide 3
Slide 3 text
Twitter @lgleasain
Github lgleasain
!
www.lancegleason.com
www.polyglotprogrammincinc.com
[email protected]
!
Slide 4
Slide 4 text
No content
Slide 5
Slide 5 text
No content
Slide 6
Slide 6 text
No content
Slide 7
Slide 7 text
No content
Slide 8
Slide 8 text
http://www.polyglotprogramminginc.com/purr-
programming-2-0/
Slide 9
Slide 9 text
www.purrprogramming.com
Slide 10
Slide 10 text
?
Slide 11
Slide 11 text
No content
Slide 12
Slide 12 text
No content
Slide 13
Slide 13 text
No content
Slide 14
Slide 14 text
No content
Slide 15
Slide 15 text
No content
Slide 16
Slide 16 text
No content
Slide 17
Slide 17 text
No content
Slide 18
Slide 18 text
No content
Slide 19
Slide 19 text
No content
Slide 20
Slide 20 text
No content
Slide 21
Slide 21 text
?
Slide 22
Slide 22 text
Scaling
Slide 23
Slide 23 text
No content
Slide 24
Slide 24 text
No content
Slide 25
Slide 25 text
No content
Slide 26
Slide 26 text
Supporting More
Users
Slide 27
Slide 27 text
SQL
Slide 28
Slide 28 text
No content
Slide 29
Slide 29 text
Optimized Queries
Slide 30
Slide 30 text
No content
Slide 31
Slide 31 text
Replication
Slide 32
Slide 32 text
No content
Slide 33
Slide 33 text
Sharding
Slide 34
Slide 34 text
No content
Slide 35
Slide 35 text
How do you
support this
with
ActiveRecord?
Slide 36
Slide 36 text
DB-Charmer
Slide 37
Slide 37 text
No content
Slide 38
Slide 38 text
production:
blah:
adapter:
mysql
username:
blah
host:
blah.local
database:
blah
!
foo:
adapter:
mysql
username:
foo
host:
foo.local
database:
foo
Slide 39
Slide 39 text
class
Foo
<
ActiveRecord::Model;
end
!
Foo.switch_connection_to(:blah)
Foo.switch_connection_to('foo')
Foo.switch_connection_to(Bar)
Foo.switch_connection_to(Baz.connectio
n)
Foo.switch_connection_to(nil)
Slide 40
Slide 40 text
Migrations
Slide 41
Slide 41 text
class
MultiDbTest
<
ActiveRecord::Migration
db_magic
:connection
=>
:second_db
!
def
self.up
create_table
:test_table,
:force
=>
true
do
|t|
t.string
:test_string
t.timestamps
end
end
!
def
self.down
drop_table
:test_table
end
end
Slide 42
Slide 42 text
class
MultiDbTest
<
ActiveRecord::Migration
def
self.up
on_db
:second_db
do
create_table
:test_table,
:force
=>
true
do
|t|
t.string
:test_string
t.timestamps
end
end
end
!
def
self.down
on_db
:second_db
{
drop_table
:test_table
}
end
end
Slide 43
Slide 43 text
class
MultiDbTest
<
ActiveRecord::Migration
db_magic
:connections
=>
[:second_db,
:default]
!
def
self.up
create_table
:test_table,
:force
=>
true
do
|t|
t.string
:test_string
t.timestamps
end
end
!
def
self.down
drop_table
:test_table
end
end
Slide 44
Slide 44 text
Replication
Slide 45
Slide 45 text
Auto Switch All
Connections To Slaves
Slide 46
Slide 46 text
class
Foo
<
ActiveRecord::Base
db_magic
:slave
=>
:slave01
end
!
class
Bar
<
ActiveRecord::Base
db_magic
:slaves
=>
[
:slave01,
:slave02
]
end
Slide 47
Slide 47 text
Default Master Slave
Class Connections
Slide 48
Slide 48 text
class
Foo
<
ActiveRecord::Base
db_magic
:connection
=>
:foo
end
class
Bar
<
ActiveRecord::Base
db_magic
:connection
=>
:bar,
:slave
=>
:bar_slave
end
Slide 49
Slide 49 text
Per Query Connection
Management
Slide 50
Slide 50 text
class
Foo
<
ActiveRecord::Model;
end
!
Foo.switch_connection_to(:blah)
Foo.switch_connection_to('foo')
Foo.switch_connection_to(Bar)
Foo.switch_connection_to(Baz.connectio
n)
Foo.switch_connection_to(nil)
Slide 51
Slide 51 text
User.on_master
do
user
=
User.find_by_login('foo')
user.update_attributes!(:activated
=>
true)
end
Slide 52
Slide 52 text
Comment.on_master.last(:limit
=>
5)
User.on_master.find_by_activation_code(code)
User.on_master.exists?(:login
=>
login,
:password
=>
password)
Slide 53
Slide 53 text
Comment.on_db(:olap).count
Post.on_db(:foo).find(:first)
Slide 54
Slide 54 text
Sharding
Slide 55
Slide 55 text
Sharding
• Range
Slide 56
Slide 56 text
Sharding
• Range
• hash_map
Slide 57
Slide 57 text
Sharding
• Range
• hash_map
• db_block_map
Slide 58
Slide 58 text
Sharding
• Range
• hash_map
• db_block_map
• db_block_group_map
Slide 59
Slide 59 text
Custom Sharding Methods
Slide 60
Slide 60 text
No content
Slide 61
Slide 61 text
Is it thread safe?
Slide 62
Slide 62 text
Sort of
Slide 63
Slide 63 text
Testing
Slide 64
Slide 64 text
No transaction rollbacks
Slide 65
Slide 65 text
Limitations
Slide 66
Slide 66 text
No content
Slide 67
Slide 67 text
•MySQL Only
Slide 68
Slide 68 text
•MySQL Only
•Doesn’t Support Rails 4
Slide 69
Slide 69 text
No content
Slide 70
Slide 70 text
No content
Slide 71
Slide 71 text
•Supports Postgres and MySQL
Slide 72
Slide 72 text
•Supports Postgres and MySQL
•Includes migrations for moving
data between shards
Slide 73
Slide 73 text
octopus:
replicated:
true
production:
slave1:
adapter:
mysql
host:
localhost
database:
octopus_shard2
slave2:
adapter:
mysql
host:
localhost
database:
octopus_shard3
slave3:
adapter:
mysql
host:
localhost
database:
octopus_shard4
slave4:
adapter:
mysql
host:
localhost
database:
octopus_shard5
Slide 74
Slide 74 text
User.where(:name
=>
"Thiago").limit(3).using(:slave_one)
Octopus.using(:slave_two)
do
User.create(:name
=>
"Mike")
end
Slide 75
Slide 75 text
class
CreateUsersOnBothShards
<
ActiveRecord::Migration
using(:brazil,
:canada)
!
def
self.up
User.create!(:name
=>
"Both")
end
!
def
self.down
User.delete_all
end
end
Slide 76
Slide 76 text
class
ApplicationController
<
ActionController::Base
around_filter
:select_shard
!
def
select_shard(&block)
Octopus.using(:brazil,
&block)
end
end
Slide 77
Slide 77 text
Which One?
Slide 78
Slide 78 text
No content
Slide 79
Slide 79 text
Alternatives
Slide 80
Slide 80 text
Amazon Cloud
Search
Slide 81
Slide 81 text
Asari
Slide 82
Slide 82 text
Active Asari
Slide 83
Slide 83 text
Cacheing
Slide 84
Slide 84 text
No content
Slide 85
Slide 85 text
No content
Slide 86
Slide 86 text
No content
Slide 87
Slide 87 text
No content
Slide 88
Slide 88 text
No content
Slide 89
Slide 89 text
Twitter @lgleasain
Github lgleasain
!
www.lancegleason.com
www.polyglotprogrammincinc.com
[email protected]
!