Vanity performance metrics — Looking beyond the numbers

My deck from RuhrJS in Germany—Slide notes, references and Shoutouts to those who shared so much great and interesting data about global internet connectivity are missing! I'll attempt to update the deck in a couple of days after jetlag stops hurting me so much :-)

Shout out to Bruce Lawson for being such a thoughtful and clever person.

Transcript

1. Vanity performance metrics— 

   Looking beyond the numbers
   with Ben Schwarz
   No trigger warnings ahead
   

   View Slide

2. 7.4
   billion
   13 hours
   900 km/h
   Speed of light
   

   View Slide

3. Time
   is
   money
   

   View Slide

4. 14.5ms 1980s
   13.1ms 2010
   4.2-5.2ms Microwave links
   3.93ms Speed of light
   New York — Chicago
   

   View Slide

5. 7200
   Tweets
   54,000
   Google searches
   Every second
   on the internet
   

   View Slide

6. 57%
   do not
   43%
   have access
   

   View Slide

7. How quickly will the 

   internet grow?
   

   View Slide

8. The number of internet users in India
   will grow by 100 million in 2016.
   

   View Slide

9. Airtel, India’s largest mobile phone carrier
   has almost 250 million customers, but only
   a 32% market share.
   

   View Slide

10. 65% of the 1.2 Billion population, do not
    have access to the internet today.
    

    View Slide

11. Number of hours worked
    for 500mb of data
    India 17 hrs
    Brazil 13 hrs
    Indonesia 6 hrs
    Germany <1 hr
    

    View Slide

12. 1hr of work for:
    8 songs on Spotify
    6 minutes of Youtube
    Less than 1 hour playing
    online games.
    

    View Slide

13. 3.7GB

    of data used to make this
    presentation
    
    

    View Slide

14. Connections used
    Cable – 70mbps
    ADSL – 16mbps
    Plane wifi – 3mbps
    Phone tethering – 0—120mbps
    Hotel wifi – 1mbps
    

    View Slide

15. Even if you’ve bought 500mb of
    data, and 4G is available, we
    cannot assume it will be 4G.
    

    View Slide

16. Facebook Lite
    • 1mb to download
    • 1mb total footprint
    • Used by over

    100M people
    

    View Slide

17. Two versions of the internet
    The one we imagine
    Cable
    Fibre
    Large corporates
    University
    Airplanes

    Hotels

    Coffee shop wifi

    Conference wifi
    Lie-fi
    The one we don’t
    

    View Slide

18. Devices, connections,
    languages, contexts and abilities
    are different for everyone.
    

    View Slide

19. 1. Gather knowledge
    2. Build with understanding

    and empathy
    

    View Slide

20. Mobile first
    Mobile is majority
    

    View Slide

21. The metrics that we’re using to talk
    about performance tell us nothing
    about the users.
    

    View Slide

22. onDomContentLoaded
    onLoad
    Metrics that don’t even
    

    View Slide

23. Can’t be gamed
    Aren’t at risk of failure
    Good metrics
    

    View Slide

24. First paint
    Visual completeness
    Timed-user interactions
    Good metrics are
    

    View Slide

25. “My customers aren’t in
    India, they’re in ______”
    

    View Slide

26. View Slide

27. View Slide

28. View Slide

29. Wealthy Western Web
    

    View Slide

30. World Wide Web
    

    View Slide

31. calibreapp.com
    Perf email
    perf.email
    

    View Slide

32. View Slide

33. “I read a study that measured the efficiency of locomotion for
    various species on the planet. The condor used the least
    energy to move a kilometre. Humans came in with a rather
    unimpressive showing about a third of the way down the
    list....That didn't look so good, but then someone at Scientific
    American had the insight to test the efficiency of locomotion
    for a man on a bicycle and a man on a bicycle blew the condor
    away. That's what a computer is to me: the computer is the
    most remarkable tool that we've ever come up with. It's the
    equivalent of a bicycle for our minds.”
    

    View Slide

34. A computer is the equivalent of
    bicycle for our minds.
    

    View Slide

35. Danke
    @benschwarz
    

    View Slide