Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Atlas - owl vs deer
Search
MetaBroadcast
June 19, 2013
Programming
0
240
Atlas - owl vs deer
Talk given by MetaBroadcast's Engineer Fred van den Driessche. Jun 19th, 2013.
MetaBroadcast
June 19, 2013
Tweet
Share
More Decks by MetaBroadcast
See All by MetaBroadcast
PhotoGlut
metabroadcast
2
350
Machine learning: boldly going where Twitter's APIs don't
metabroadcast
0
120
monitoring: it gets better
metabroadcast
1
560
The ABCs of MetaBroadcast APIs
metabroadcast
0
160
APIs for app developers
metabroadcast
1
140
Polishing Varnish
metabroadcast
0
820
Atlas - 3.0 to 4.0
metabroadcast
0
240
Storm - an overview
metabroadcast
0
120
The world of HTML5
metabroadcast
1
76
Other Decks in Programming
See All in Programming
Universal Linksの実装方法と陥りがちな罠
kaitokudou
1
220
Vitest Browser Mode への期待 / Vitest Browser Mode
odanado
PRO
2
1.7k
Why Spring Matters to Jakarta EE - and Vice Versa
ivargrimstad
0
1k
外部システム連携先が10を超えるシステムでのアーキテクチャ設計・実装事例
kiwasaki
1
230
/←このスケジュール表に立ち向かう フロントエンド開発戦略 / A front-end development strategy to tackle a single-slash schedule.
nrslib
1
590
開発効率向上のためのリファクタリングの一歩目の選択肢 ~コード分割~ / JJUG CCC 2024 Fall
ryounasso
0
370
GitHub Actionsのキャッシュと手を挙げることの大切さとそれに必要なこと
satoshi256kbyte
5
390
『ドメイン駆動設計をはじめよう』のモデリングアプローチ
masuda220
PRO
8
440
From Subtype Polymorphism To Typeclass-based Ad hoc Polymorphism- An Example
philipschwarz
PRO
0
170
Kaigi on Rails 2024 - Rails APIモードのためのシンプルで効果的なCSRF対策 / kaigionrails-2024-csrf
corocn
5
3.4k
OpenTelemetryでRailsのパフォーマンス分析を始めてみよう(KoR2024)
ymtdzzz
4
1.6k
AWS IaCの注目アップデート 2024年10月版
konokenj
3
3.1k
Featured
See All Featured
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
328
21k
Optimizing for Happiness
mojombo
376
69k
[RailsConf 2023 Opening Keynote] The Magic of Rails
eileencodes
28
9.1k
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
eileencodes
14
1.9k
Java REST API Framework Comparison - PWX 2021
mraible
PRO
28
7.9k
Reflections from 52 weeks, 52 projects
jeffersonlam
346
20k
How STYLIGHT went responsive
nonsquared
95
5.2k
Bootstrapping a Software Product
garrettdimon
PRO
305
110k
The Power of CSS Pseudo Elements
geoffreycrofte
72
5.3k
Save Time (by Creating Custom Rails Generators)
garrettdimon
PRO
27
790
Rebuilding a faster, lazier Slack
samanthasiow
79
8.6k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
eileencodes
32
1.8k
Transcript
Atlas 4.0 owl vs deer Fred van den Driessche Engineer
@fredvdd
What is Atlas? “the global video and audio index”
What is Atlas? • aggregates metadata from multiple sources •
stores in a uniform model • APIs + feeds provide consolidated data
What is Atlas? ATLAS DB BBC PA C4 etc... /content
/schedules /topics sitemaps radioplayer interlinking
Atlas Data Model brand item series version broadcast location
History •2008: 0.5 • MySQL • URIs • RDF •
POST to Update • /content
History •2009: 1.0 • Adapters • POST to Update
History •2010: 2.0 “otter” • MongoDB • denormalization • /discover
• /schedules • uploading
History •2011: 3.0 “owl” • MongoDB :-( • less denormalization
• /discover • annotations
DEMO
Objectives for 4.0 “deer” Easy scaling • Discovery • Faster
updates • More consistent, rational API • extensive use of HTTP
External Changes - quite small • IDs not URIs •
URL structures: /content/<id> not /content?uri=<uri> • More flexible filtering • Better annotations • Richer output • Better error handling • Consistently fast
Internal Changes - almost everything • New Technologies • New
Persistence Layer • Flexible Denormalisation • Bootstrapping • Queue
DEMO
Optional Extras • improvements to storage and indexing • monitor
all the things • small core • decentralization • queue-triggered processing • all data submitted via POST? • generalization of feed output • new equivalence algorithm?
Questions? more at http://atlas.metabroadcast.com follow @mb_atlas