DST4L 2015 - Ch3

DST4L 2015 - Ch3

9332028514858a918dc4af231d4cb4bc?s=128

James Davenport

February 06, 2015
Tweet

Transcript

  1. Survey: How many days do you wear your jeans before

    they need washing? ifweassume.com @jradavenport
  2. Survey: How many days do you wear your jeans before

    they need washing? men women both ifweassume.com @jradavenport Survey responses from Reddit
  3. ifweassume.com @jradavenport Emotional responses from Reddit

  4. The “Quantified Self”

  5. What is the “Quantified Self”? • Tracking data about yourself

    • aka “life logging” • (either intentionally or not) • Use data to modify behavior
  6. The Original
 Quantified Self

  7. None
  8. None
  9. A modern leader of the Quantified Self movement

  10. None
  11. Outgoing emails over time

  12. Email time versus date

  13. “Scientist, study thyself.” #ScienceProverb

  14. None
  15. None
  16. None
  17. None
  18. http://www.jamierubin.net/2013/03/20/one-full-year-of-fitbit-pedometer-data-part-1-a-look-back/

  19. http://www.jamierubin.net/2013/03/20/one-full-year-of-fitbit-pedometer-data-part-1-a-look-back/ Steps taken over 1 year

  20. Personal Finance

  21. Gas Prices & MPG

  22. Gas Prices & MPG

  23. Gas Prices & MPG

  24. GitHub Contributions Visualization

  25. Data visualization a key piece of the Quantified Self:
 enables

    “a ha!” moments
  26. Data visualization a key piece of the Quantified Self:
 collecting/seeing

    data can be it’s own intervention!
  27. Example of useful data collection: web traffic

  28. an OK post a less good post

  29. Time Internet Traffic on IfWeAssume.com

  30. Internet Traffic on IfWeAssume.com

  31. Internet Traffic on IfWeAssume.com

  32. Internet Traffic on IfWeAssume.com

  33. Project: Studying Netflix Viewing Data

  34. None
  35. Not a “clean & tidy” source of data!

  36. None
  37. None
  38. None
  39. All I care about (for this analysis)

  40. (DVD)

  41. None
  42. None
  43. None
  44. Let’s try playing with this data. On to the IPython

    Notebook!
  45. None
  46. ifweassume.com @jradavenport

  47. ifweassume.com @jradavenport Battery

  48. This script runs every minute I use my computer: date

    >> ~/batlog.dat /usr/sbin/ioreg -l | grep “CycleCount” >> ~/batlog.dat /usr/sbin/ioreg -l | grep “Capacity” >> ~/batlog.dat ifweassume.com @jradavenport
  49. This script runs every minute I use my computer: date

    >> ~/batlog.dat /usr/sbin/ioreg -l | grep “CycleCount” >> ~/batlog.dat /usr/sbin/ioreg -l | grep “Capacity” >> ~/batlog.dat ifweassume.com @jradavenport
  50. None
  51. None
  52. Days Since Purchase ifweassume.com @jradavenport

  53. Days Since Purchase ifweassume.com @jradavenport

  54. (ignore the blue/black color swap)

  55. “Capacity” (2012)

  56. Unexpected responses / interactions ifweassume.com @jradavenport

  57. not always positive… but always amusing! ifweassume.com @jradavenport

  58. This script runs every minute I use my computer: ifweassume.com

    @jradavenport date >> ~/batlog.dat /usr/sbin/ioreg -l | grep “CycleCount” >> ~/batlog.dat /usr/sbin/ioreg -l | grep “Capacity” >> ~/batlog.dat
  59. Fold data by day-of-week

  60. None
  61. Days Since Purchase Time of Day Inspired by Stephen Wolfram

    Summer Internship (2013)
  62. old laptop new laptop

  63. old laptop new laptop Sleep (usually) Dinner Summer Internship (2013)

    Vacation
  64. None
  65. None
  66. Wanted: this digital fingerprint data from other people!

  67. Let’s try playing with this data. On to the IPython

    Notebook!
  68. What I wanted to cover today • About me, my

    blog, my varied interests • The two methods for coming up with blog posts • Visualization & it’s role in asking questions • What is the Quantified Self? • Hands-on examples of my analysis • Discussion: the role of a library for the modern data-driven researcher?