Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Atlas - owl vs deer
Search
MetaBroadcast
June 19, 2013
Programming
0
240
Atlas - owl vs deer
Talk given by MetaBroadcast's Engineer Fred van den Driessche. Jun 19th, 2013.
MetaBroadcast
June 19, 2013
Tweet
Share
More Decks by MetaBroadcast
See All by MetaBroadcast
PhotoGlut
metabroadcast
2
360
Machine learning: boldly going where Twitter's APIs don't
metabroadcast
0
130
monitoring: it gets better
metabroadcast
1
560
The ABCs of MetaBroadcast APIs
metabroadcast
0
180
APIs for app developers
metabroadcast
1
140
Polishing Varnish
metabroadcast
0
820
Atlas - 3.0 to 4.0
metabroadcast
0
240
Storm - an overview
metabroadcast
0
120
The world of HTML5
metabroadcast
1
76
Other Decks in Programming
See All in Programming
仕様変更に耐えるための"今の"DRY原則を考える
mkmk884
9
3.1k
CSS Linter による Baseline サポートの仕組み
ryo_manba
1
150
Jakarta EE meets AI
ivargrimstad
0
320
GoとPHPのインターフェイスの違い
shimabox
2
210
Domain-Driven Transformation
hschwentner
2
1.9k
pylint custom ruleで始めるレビュー自動化
shogoujiie
0
150
AIの力でお手軽Chrome拡張機能作り
taiseiue
0
190
CDK開発におけるコーディング規約の運用
yamanashi_ren01
2
250
Kotlinの開発でも AIをいい感じに使いたい / Making the Most of AI in Kotlin Development
kohii00
5
980
ソフトウェアエンジニアの成長
masuda220
PRO
12
2.1k
Rubyと自由とAIと
yotii23
6
1.6k
ファインディLT_ポケモン対戦の定量的分析
fufufukakaka
0
910
Featured
See All Featured
VelocityConf: Rendering Performance Case Studies
addyosmani
328
24k
Designing on Purpose - Digital PM Summit 2013
jponch
117
7.1k
Agile that works and the tools we love
rasmusluckow
328
21k
Testing 201, or: Great Expectations
jmmastey
42
7.2k
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
233
17k
Embracing the Ebb and Flow
colly
84
4.6k
A Tale of Four Properties
chriscoyier
158
23k
Large-scale JavaScript Application Architecture
addyosmani
511
110k
The Cult of Friendly URLs
andyhume
78
6.2k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
eileencodes
33
2.1k
Build your cross-platform service in a week with App Engine
jlugia
229
18k
Adopting Sorbet at Scale
ufuk
74
9.2k
Transcript
Atlas 4.0 owl vs deer Fred van den Driessche Engineer
@fredvdd
What is Atlas? “the global video and audio index”
What is Atlas? • aggregates metadata from multiple sources •
stores in a uniform model • APIs + feeds provide consolidated data
What is Atlas? ATLAS DB BBC PA C4 etc... /content
/schedules /topics sitemaps radioplayer interlinking
Atlas Data Model brand item series version broadcast location
History •2008: 0.5 • MySQL • URIs • RDF •
POST to Update • /content
History •2009: 1.0 • Adapters • POST to Update
History •2010: 2.0 “otter” • MongoDB • denormalization • /discover
• /schedules • uploading
History •2011: 3.0 “owl” • MongoDB :-( • less denormalization
• /discover • annotations
DEMO
Objectives for 4.0 “deer” Easy scaling • Discovery • Faster
updates • More consistent, rational API • extensive use of HTTP
External Changes - quite small • IDs not URIs •
URL structures: /content/<id> not /content?uri=<uri> • More flexible filtering • Better annotations • Richer output • Better error handling • Consistently fast
Internal Changes - almost everything • New Technologies • New
Persistence Layer • Flexible Denormalisation • Bootstrapping • Queue
DEMO
Optional Extras • improvements to storage and indexing • monitor
all the things • small core • decentralization • queue-triggered processing • all data submitted via POST? • generalization of feed output • new equivalence algorithm?
Questions? more at http://atlas.metabroadcast.com follow @mb_atlas