Mobile Device APIs for Fun and Profit

Slide 1

Slide 1 text

James Pearce

Slide 2

Slide 2 text

No content

Slide 3

Slide 3 text

No content

Slide 4

Slide 4 text

No content

Slide 5

Slide 5 text

No content

Slide 6

Slide 6 text

A medium that would be innovative, beautiful, disruptive, and with us everywhere “ ”

Slide 7

Slide 7 text

@media screen and (max-‐width: 320px)

Slide 8

Slide 8 text

I had rather hoped that the web would be more awesome than this by now

Slide 9

Slide 9 text

No content

Slide 10

Slide 10 text

No content

Slide 11

Slide 11 text

Web iPhone Android

Slide 12

Slide 12 text

Device APIs

Slide 13

Slide 13 text

Client-side APIs that enable the development of Web Applications that interact with device hardware http://www.w .org/ / /DeviceAPICharter “ ”

Slide 14

Slide 14 text

320px

Slide 15

Slide 15 text

Storage GPS device Audio player Video player Accelerometer Compass Camera Bluetooth Telephony Messaging Contacts Calendar Notiﬁcations Proximity sensor Thermometer Pressure gauge NFC RFID

Slide 16

Slide 16 text

No content

Slide 17

Slide 17 text

No content

Slide 18

Slide 18 text

Call us // call.wmls extern function makeCall() { WTAPublic.makeCall("16505551234"); }

Slide 19

Slide 19 text

Pick up! // call.wmls extern function acceptCall() { WTACallCont.accept("1", 1); }

Slide 20

Slide 20 text

// sms.wmls extern function sendMsg() { WTANetText.send("16505551234", "WML rocks"); } extern function readMsg(i) { var sms = WTANetText.read(i); return WTANetText.getFieldValue( sms, "body" ); }

Slide 21

Slide 21 text

// contacts.wmls extern function addFriend(i, num, name) { WTAPhoneBook.write(i, num, name); } // return structs of contact details extern function getFriendById(i) { return WTAPhoneBook.read("i", i); } extern function getFriendByName(name) { return WTAPhoneBook.read("t", name); }

Slide 22

Slide 22 text

You still can’t do any of this in a contemporary mobile browser

Slide 23

Slide 23 text

▪ Accelerometer ▪ Calendar ▪ Camera ▪ Contacts ▪ Core ▪ Device interaction ▪ Device status ▪ File system ▪ Geolocation ▪ Messaging ▪ Orientation ▪ Tasks ▪ Viewport ▪ Webview http://specs.wacapps.net/

Slide 24

Slide 24 text

to create client-side APIs that enable the development of Web Applications [..] that interact with devices' services such as Calendar, Contacts, Camera, etc “ ” http://www.w .org/ /dap/

Slide 25

Slide 25 text

▪ Media Capture (forms) ▪ Media Capture (.getUserMedia) ▪ Contacts ▪ Battery Status ▪ Network Information ▪ Sensor ▪ Vibration ▪ Calendar ▪ Menu ▪ Permissions ▪ Media Capture (.device) ▪ Messaging ▪ Gallery ▪ System info

Slide 26

Slide 26 text

Geolocation http://www.w .org/ /geolocation/ Web Apps http://www.w3.org/ /webapps/ Web Notiﬁcations http://www.w .org/ /web-notiﬁcations/

Slide 27

Slide 27 text

A few quick examples

Slide 28

Slide 28 text

▪ Store ﬁnder ▪ Check-in ▪ Localizing search ▪ Weather Geolocation

Slide 29

Slide 29 text

navigator.geolocation.getCurrentPosition( function(point) { console.log(point); } ); http://www.w .org/TR/geolocation-API/

Slide 30

Slide 30 text

No content

Slide 31

Slide 31 text

No content

Slide 32

Slide 32 text

No content

Slide 33

Slide 33 text

https://github.com/jamesgpearce/compios

Slide 34

Slide 34 text

var bearing = Math.atan2( Math.sin(lon2 -‐ lon1) * Math.cos(lat2), Math.cos(lat1) * Math.sin(lat2) -‐ Math.sin(lat1) * Math.cos(lat2) * Math.cos(lon2 -‐ lon1) ) * 180 / Math.PI; arrow.style.webkitTransform = 'rotateZ(' + bearing + 'deg)'; http://www.movable-type.co.uk/scripts/latlong.html

Slide 35

Slide 35 text

No content

Slide 36

Slide 36 text

▪ Proﬁle pictures ▪ Photo sharing ▪ Review sites ▪ Recognition Camera & User media

Slide 37

Slide 37 text

http://dev.w .org/ /dap/camera/

Slide 38

Slide 38 text

var photo = document.getElementById('photo'); photo.files[0].getFormatData( function (data) {}, // success function () {} // error ); // file is a MediaFile, extending File. // data is a MediaFileData, containing: // codecs, bitrate, height, width, duration http://dev.w .org/ /dap/camera/

Slide 39

Slide 39 text

navigator.getUserMedia( { audio: false, video: true }, function (stream) {}, // success function () {} // error ); // stream is a LocalMediaStream: // use URL.createObjectURL(stream) // to bind to src http://dev.w .org/ /webrtc/editor/getusermedia.html

Slide 40

Slide 40 text

http://caniuse.com/#search=getusermedia

Slide 41

Slide 41 text

http://bit.ly/gumsto

Slide 42

Slide 42 text

Temperature, ºC AmbientLight, Lux AmbientNoise, dbA MagneticField, uTesla Proximity, cm AtmPressure, kP RelHumidity, var sensor = new SensorConnection( 'Temperature' );

Slide 43

Slide 43 text

navigator.contacts.find( ['name', 'emails'], // fields function (contacts) {}, // success function () {}, // error { // find options filter: 'James', multiple: true } ); // displayName, name, nickname, phoneNumbers // emails, addresses, ims, organizations, birthday // note, photos, categories, urls http://www.w .org/TR/contacts-api/

Slide 44

Slide 44 text

The ability to add and update contact information is not a function of the API provided in this speciﬁcation “ ”

Slide 45

Slide 45 text

Save Contacts var vcard = 'BEGIN:VCARD\r\n' + 'VERSION:3.0\r\n' + 'UID:' + contact.id + '\r\n' + 'N:Pearce;James\r\n' + 'FN:James Pearce\r\n' + 'END:VCARD'; document.getElementById('vcard').href = 'data:text/x-‐vcard;charset=utf-‐8,' + encodeURIComponent(vcard);

Slide 46

Slide 46 text

▪ Sharing ▪ Notiﬁcations ▪ Ofﬂine transport fallback ▪ Frictionless web sign-on Messaging

Slide 47

Slide 47 text

navigator.sendMessage( "sms:16505551234?" + "body=JavaScript%20says%20hi", [], // attachments as File array function () {}, // success function () {} // error ); // also mms: and mailto: http://dev.w .org/ /dap/messaging/

Slide 48

Slide 48 text

No content

Slide 49

Slide 49 text

▪ Telephony ▪ Messaging ▪ Contacts ▪ Camera ▪ Network ▪ USB ▪ Embedded browser ▪ Battery ▪ Device Status ▪ Settings ▪ Mouse Lock ▪ Vibration ▪ NFC ▪ Bluetooth ▪ Calendar ▪ Background services

Slide 50

Slide 50 text

https://wiki.mozilla.org/WebAPI “ ” The Mozilla WebAPI team is pushing the envelope of the web to include - and in places exceed - the capabilities of competing stacks

Slide 51

Slide 51 text

No content

Slide 52

Slide 52 text

No content

Slide 53

Slide 53 text

var myCall = navigator.telephony.dial("16505551234"); myCall.state; // dialing, ringing, busy, connecting, // connected, disconnecting, disconnected, // incoming myCall.onconnected = function () {}; // onbusy, ondisconnected etc myCall.hangup(); myCall2.answer(); https://wiki.mozilla.org/WebAPI/WebTelephony

Slide 54

Slide 54 text

var contact = new mozContact(); contact.init({ name: 'James', tel: '16505551234' }); navigator.mozContacts.save(contact);

Slide 55

Slide 55 text

No content

Slide 56

Slide 56 text

No content

Slide 57

Slide 57 text

Challenges & moving forward

Slide 58

Slide 58 text

No content

Slide 59

Slide 59 text

http://caniuse.com/#search=getusermedia

Slide 60

Slide 60 text

At some point, Progressive Enhancement can give way to No Compromise

Slide 61

Slide 61 text

No content

Slide 62

Slide 62 text

http://rng.io

Slide 63

Slide 63 text

Core Mobile Web Platform http://coremob.org

Slide 64

Slide 64 text

@ Labs

Slide 65

Slide 65 text

No content

Slide 66

Slide 66 text

James Pearce

Slide 67

Slide 67 text

▪ http://www.flickr.com/photos/troymccluresf ▪ http://www.flickr.com/photos/chrisangle ▪ http://www.flickr.com/photos/ivan_kaurin ▪ http://www.flickr.com/photos/ @N /