GoLang by Brad Fitzpatrick. Maintainer Mathieu Lonjaret. Reprised by Clive Boulton for Google Developer Groups NYC. Jan 9, 2017. https://www.meetup.com/gdgnyc/events/234963670/
member of the Go team at Google, working primarily on the standard library. • Brad wanted to create a system to store all of the content he’s created, which is currently scattered across multiple sites and disks. He started hacking in this directory: $ Content Addressable Multi Level Indexed Storage = Camlistore
(merge resolution at higher layers) • corruption verification/repair • de-duping Content Addressable: What things are named depends on their content. Two identical things have the same name. For example, the "name" or "key" for the data is the SHA-1 for the data, ala git.
UI, FUSE, CU, apps are just clients of search + blob storage Multi-Layer: The whole storage stack is built out of several layers. The blob store sits on the bottom, and only knows about bytes, and access is via the SHA-1 of those bytes. Things that you might store (Files, directories, sets, collections of tweets, social graphs, etc) build on top of the blob store by additional blobs that hold pointers to data blobs. Again, it's sort of like git. A front-end might sit on top of that abstraction.
find Indexed: blobs of JSON that have a few special attributes are recognized and indexed. So, you might have a bunch of blobs with these special attributes (ie, "tag") and be able to ask the indexer "Give me all blobs with tag equal to foo", rather than having to search through the blobs directly.
for Social Backup. • Security is private by default (share if you wish, more sharing in v.10) • FUSE file system • Data versioning, time travel • Snappy UI (react.js like Instagram moving to gopherjs) • Clients in JavaScript, Java, Obj-C, • Deploy Web, Phone, Home, S3, GCE (Docker) • Targets Desktop Chrome, Firefox, Safari, Edge (last two stable versions). • Targets Safari and Chrome on Android and iOS tablets (last two stable ver)
few other candidate languages: • Perl and Python: too slow and single-threaded • C++ and Java: tedious and not fun (slow builds) • Go? Yeah. As Brad hacked on Camlistore, he realized he needs to implement support for various formats and protocols (like mime/multipart) and improve stdlib packages (like os/exec nee exec, database/sql, etc.). Camlistore ⇔ 20 per cent time (now a side project)
Camlistore server on GCE+MySQL+Cloud Storage a few clicks from a web app, using CoreOS, Docker, and the various Google Cloud Platform APIs.. Visit https://camlistore.org/launch/ which lets you create your own camlistore instance on GCE. The Camlistore website will say: Step 1) go to https://console.developers.google.com/project Step 2) click "Create Project". remember its name. Step 3) Enable billing. (tell Google your credit card info) [Ed note. Dev’s sign up for GCP get $x00 credit for 60 days] Step 4) Enter your project name: [ ] [ Create ] You click Create, and then we send you on an OAuth2 voyage to get access to create VMs & DBs & Buckets on your behalf, and then we create it all, including creating a minimal CoreOS VM that boots right up into a tiny Docker container just running camlistore. [Ed note, the API forms are also Camlistore open source]
AES, … • JSON, XML • WebSockets • SMTP server (coming) • Rolling checksums • GIF/JPG/PNG en/dec, resizing, thumbnails • FUSE • Notification bus • database/sql, MySQL, Postgres, MongoDB • OpenPGP signing & verification Ed note: NYC is adoption center for Blockchain technologies, also written in GoLang
cliveb
oracle4engineer
keio_smilab
rishigami
kimitashoichi
yayoi_dd
ma2shita
k0kubun
taka_aki
yoshikiiida
pfn
sansantech
theburningmonk
jakevdp
revolveconf
jonrohan
keavy
garrettdimon
chriscoyier
gr2m
moore
addyosmani
stephaniewalter
aki_iinuma
