Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Kumquat

 Kumquat

Fred Benenson

August 17, 2015

Transcript

32 slides
  1. The data you report to yourself is the story you

    tell yourself about your business.
  2. There are a couple of ways to look at data*

    • Interactive Tools • Dashboards • Recurring Reports • One-off reports
  3. knitr & RMarkdown • Like Markdown, but for R •

    Can evaluate R code chunks into HTML & PNG output (or PDF) • Helpful for generating reproducible reports A Test Report for Kumquat ======================================================== This is some code for Knitr, including [a link](https://www.kickstarter.com). A list: * One * Another thing * Last thing! ### More stuff. Lorem Ipsum. ```{r, fig.width=10, fig.height=8, echo=FALSE, message=FALSE} library(ggplot2) qplot(data = data.frame( x = runif(100), y = runif(100) ), x = x, y = y) ``` ### Another ```{r, fig.width=10, fig.height=8, echo=FALSE, message=FALSE} library(ggplot2) qplot(data = data.frame( x = runif(100), y = runif(100) ), x = x, y = y) ``` ### A Table ```{r, results='asis', echo=FALSE} library(hwriter) cat(hwrite(data.frame( x = runif(10), y = runif(10) ))) ```
  4. A Test Report for Kumquat ======================================================== This is some code

    for Knitr, including [a link](https://www.kickstarter.com). A list: * One * Another thing * Last thing! ### More stuff. Lorem Ipsum. ```{r, fig.width=10, fig.height=8, echo=FALSE, message=FALSE} Normal Markdown } library(ggplot2) qplot(data = data.frame( x = runif(100), y = runif(100) ), x = x, y = y) ``` knitr call } R code }
  5. R + ggplot2 + knitr + Redshift + Rails +

    Email = New Email Reporting Framework
  6. Kumquat • Shells out to `Rscript`, runs knitr, returns HTML

    & base64 encoded images • Includes a Ruby Template Handler for rendering .Rmd Files • Includes a Mail Interceptor for attaching inline images • Includes a Chef recipe for installing R & libraries in production
  7. Rails Template Handlers • Extremely flexible system for adding support

    for new file types to your system • .haml, .ruby, etc. • So why not .Rmd?
  8. Running RScript in Production $ Rscript -e "library(knitr); library(redshift); setwd('/var/folders/sy/

    gsrl8ysx5jvdmjc61b__qyhw0000gn/T/kumquat_20150313-85241-10r0rg6'); source('redshift_credentials.r'); knit2html('/Users/fcb/Desktop/Kickstarter/kickstarter/app/ reports/admin_mailer/_live_project_graphs.Rmd', options=c('use_xhtml','smartypants','mathjax','highlight_code', 'base64_images'))" 2>&1
  9. Template Handler for .Rmd class RmdTemplateHandler class_attribute :default_format self.default_format =

    Mime::HTML def call(template) k = Knit2HTML.new(Rails.root.join(template.inspect)) k.knit.inspect + '.html_safe' end end
  10. Mail Interceptor pt. 1 def extract_images cleaned = @content.dup ts

    = Time.now.to_f @content.scan(/img src="(.+?)"/).flatten.each.with_index do |img_data, index| (type, b64) = img_data.split(',', 2) name = "image_#{index}" cid = "#{ts}_#{name}@kumquat.magic" @images[name] = { mime_type: type[%r|\w+/\w+|], content: Base64.decode64(b64), cid: cid, content_id: "<#{cid}>" } cleaned.gsub!(img_data, "cid:#{URI.escape(cid)}") end cleaned end
  11. Mail Interceptor pt. 2 def process mail['X-KUMQUAT'] = nil mail.html_part.body

    = extract_images mail['X-SIG'] = 'bypass' m = mail # Need a local variable so that we don't fight with the mail object mixed_part = Mail::Part.new do content_type 'multipart/alternative' m.parts.delete_if { |p| add_part p } end mail.add_part mixed_part # Set the message content-type to be 'multipart/mixed' mail.content_type 'multipart/related' mail.header['content-type'].parameters[:boundary] = mail.body.boundary @images.each do |key, image| mail.attachments.inline[key] = image end mail end
  12. _test_report.Rmd A Test Report for Kumquat ======================================================== This is some

    code for Knitr, including [a link](https://www.kickstarter.com). A list: * One * Another thing * Last thing! ### More stuff. Lorem Ipsum. ```{r, fig.width=10, fig.height=8, echo=FALSE, message=FALSE} library(ggplot2) qplot(data = data.frame( x = runif(100), y = runif(100) ), x = x, y = y) ```
  13. ⚡

More Decks by Fred Benenson

Other Decks in Technology