Slide 1

Slide 1 text

Delete Your Dependencies: What the Browser Can Do Now Paul Conroy / @conroyp 22nd October, 2026

Slide 2

Slide 2 text

Paul Conroy ๐Ÿ‡ฎ๐Ÿ‡ช From Dublin, Ireland ๐Ÿ‘ด Started playing with the web 30+ years ago (Notepad, table layouts, spacer GIFs, & FTP deploys!) CTO at Square1 ๐ŸŒ conroyp.com / @conroyp

Slide 3

Slide 3 text

I have a problem! โ— Iโ€™m working on an android app โ— Client call coming up โ— They want a demo โ— The call is on google meet

Slide 4

Slide 4 text

No content

Slide 5

Slide 5 text

No content

Slide 6

Slide 6 text

No content

Slide 7

Slide 7 text

Making the connection โ— I need my browser to show a partial desktop view โ— What lives in the middle? โ—‹ Screen capture software? โ—‹ Virtual camera? โ—‹ External plugin?

Slide 8

Slide 8 text

Making the connection โ— I need my browser to show a partial desktop view โ— What lives in the middle? โ—‹ Screen capture software? โ—‹ Virtual camera? โ—‹ External plugin?

Slide 9

Slide 9 text

๐ŸŽฅ

Slide 10

Slide 10 text

โœ‚

Slide 11

Slide 11 text

๐Ÿ–ผ

Slide 12

Slide 12 text

The page: three elements

Slide 13

Slide 13 text

The page: three elements

Slide 14

Slide 14 text

LIMITED Capture the screen const stream = await navigator.mediaDevices.getDisplayMedia({ video: { frameRate: 30 }, audio: false, }); video.srcObject = stream;

Slide 15

Slide 15 text

LIMITED Capture the screen const stream = await navigator.mediaDevices.getDisplayMedia({ video: { frameRate: 30 }, audio: false, }); video.srcObject = stream;

Slide 16

Slide 16 text

BROAD Select: pick an area of the screen // The video is shrunk to fit (object-fit: contain) // so work out where it sits const box = overlay.getBoundingClientRect(); const scale = Math.min(box.width / video.videoWidth, box.height / video.videoHeight); const offsetX = (box.width - video.videoWidth * scale) / 2; const offsetY = (box.height - video.videoHeight * scale) / 2; // sel = rectangle the user dragged on the overlay const sx = (sel.x - offsetX) / scale; const sy = (sel.y - offsetY) / scale; const sw = sel.w / scale; const sh = sel.h / scale;

Slide 17

Slide 17 text

Crop: copy part of the video into canvas // Swap views: the canvas is what the user sees now portalScreen.hidden = false; canvas.width = sw; canvas.height = sh; function draw() { ctx.drawImage(video, sx, sy, sw, sh, // from: this rectangle of the video 0, 0, canvas.width, canvas.height); // to: whole canvas requestAnimationFrame(draw); } draw();

Slide 18

Slide 18 text

Crop: copy part of the video into canvas // Swap views: the canvas is what the user sees now portalScreen.hidden = false; canvas.width = sw; canvas.height = sh; function draw() { ctx.drawImage(video, sx, sy, sw, sh, // from: this rectangle of the video 0, 0, canvas.width, canvas.height); // to: whole canvas requestAnimationFrame(draw); } draw();

Slide 19

Slide 19 text

Crop: copy part of the video into canvas // Swap views: the canvas is what the user sees now portalScreen.hidden = false; canvas.width = sw; canvas.height = sh; function draw() { ctx.drawImage(video, sx, sy, sw, sh, // from: this rectangle of the video 0, 0, canvas.width, canvas.height); // to: whole canvas requestAnimationFrame(draw); } draw();

Slide 20

Slide 20 text

BROAD Back to the three elements

Slide 21

Slide 21 text

BROAD Back to the three elements

Slide 22

Slide 22 text

BROAD Gotcha: You canโ€™t hide the video! // โŒ The obvious way to hide the setup screen setupScreen.style.display = 'none'; // โœ… Invisible to the user, still "rendered" for the browser Object.assign(setupScreen.style, { position: 'absolute', width: '1px', height: '1px', opacity: '0', overflow: 'hidden', pointerEvents: 'none', });

Slide 23

Slide 23 text

BROAD Gotcha: You canโ€™t hide the video! // โŒ The obvious way to hide the setup screen setupScreen.style.display = 'none'; // โœ… Invisible to the user, still "rendered" for the browser Object.assign(setupScreen.style, { position: 'absolute', width: '1px', height: '1px', opacity: '0', overflow: 'hidden', pointerEvents: 'none', });

Slide 24

Slide 24 text

Success! โ— Video inside tab โ— Share tab on call โ— It works! โ— Interactive while sharing

Slide 25

Slide 25 text

Success! โ— Video inside tab โ— Share tab on call โ— It works! โ— Interactive while sharing https://github.com/conroyp/screen-portal/

Slide 26

Slide 26 text

๐Ÿ’ก Get an idea!

Slide 27

Slide 27 text

๐Ÿ’ก Get an idea! ๐Ÿ”Ž Look for solution

Slide 28

Slide 28 text

๐Ÿ’ก Get an idea! ๐Ÿ”Ž ๐Ÿ“ฆ Install package / library Look for solution

Slide 29

Slide 29 text

๐Ÿ’ก Get an idea! ๐Ÿš€ Deploy code ๐Ÿ”Ž ๐Ÿ“ฆ Install package / library Look for solution

Slide 30

Slide 30 text

๐Ÿ’ก Get an idea! ๐Ÿš€ Deploy code ๐Ÿ”Ž ๐Ÿ“ฆ Install package / library Look for solution

Slide 31

Slide 31 text

๐Ÿ˜ฑ ๐Ÿš€ upply s t u o ab Panic ulnerability v chain Deploy code ๐Ÿ’ก Get an idea! ๐Ÿ”Ž ๐Ÿ“ฆ Install package / library Look for solution

Slide 32

Slide 32 text

Every dependency is a tax โ— Larger bundle size โ— Increased maintenance overhead โ— Additional complexity โ— Security โ—‹ โ€œSlop-squattingโ€ is a new AI risk

Slide 33

Slide 33 text

Where each example works BROAD Current major browsers LIMITED A browser or device gap CHROMIUM Chrome, Edge and related browsers PREVIEW Requires a flag or preview setup CHROME Chrome-only

Slide 34

Slide 34 text

Can I Useโ€ฆ ? https://caniuse.com/?search=position-area

Slide 35

Slide 35 text

No content

Slide 36

Slide 36 text

A very detailed order โ— Textarea for freetext input โ— What about very long entry? โ— Canโ€™t see it all! โ— Manually make it bigger? โ— Plugin to detect when itโ€™s full โ—‹ Resize?

Slide 37

Slide 37 text

A very detailed order โ— Textarea for freetext input โ— What about very long entry? โ— Canโ€™t see it all! โ— Manually make it bigger? โ— Plugin to detect when itโ€™s full โ—‹ Resize?

Slide 38

Slide 38 text

BROAD textarea { field-sizing: content; } min-height: 5rem; max-height: 14rem;

Slide 39

Slide 39 text

BROAD textarea { field-sizing: content; } min-height: 5rem; max-height: 14rem;

Slide 40

Slide 40 text

โ— Dependent sub-menu โ— Position relative to trigger button โ— Handle browser resizing โ— Plugin time?

Slide 41

Slide 41 text

BROAD Relative positioning, no JS! More actions โ€ฆ #actions { margin: 0; position-area: right; position-try-fallbacks: flip-inline; }

Slide 42

Slide 42 text

BROAD Relative positioning, no JS! More actions โ€ฆ #actions { margin: 0; position-area: right; position-try-fallbacks: flip-inline; }

Slide 43

Slide 43 text

BROAD Relative positioning, no JS! More actions โ€ฆ #actions { margin: 0; position-area: right; position-try-fallbacks: flip-inline; }

Slide 44

Slide 44 text

BROAD Relative positioning, no JS! More actions โ€ฆ #actions { margin: 0; position-area: right; position-try-fallbacks: flip-inline; }

Slide 45

Slide 45 text

BROAD Relative positioning, no JS! More actions โ€ฆ #actions { margin: 0; position-area: right; position-try-fallbacks: flip-inline; }

Slide 46

Slide 46 text

Orders โ— Open one order from list โ— Start editing โ— Go to do something else โ— Open same order from list โ— Start editingโ€ฆ

Slide 47

Slide 47 text

Orders โ— Open one order from list โ— Start editing โ— Go to do something else โ— Open same order from list โ— Start editingโ€ฆ

Slide 48

Slide 48 text

Orders โ— Open one order from list โ— Start editing โ— Go to do something else โ— Open same order from list โ— Start editingโ€ฆ

Slide 49

Slide 49 text

Orders โ— Open one order from list โ— Start editing โ— Go to do something else โ— Open same order from list โ— Start editingโ€ฆ

Slide 50

Slide 50 text

Orders โ— Open one order from list โ— Start editing โ— Go to do something else โ— Open same order from list โ— Start editingโ€ฆ

Slide 51

Slide 51 text

Four tabs, four pollers #150 #150 #150 #150

Slide 52

Slide 52 text

Broadcast Channel โ— Share communication across tabs, windows, iframes, workers โ—‹ Same origin, same browser profile, same device โ— No backend server needed โ— No polling โ— No localstorage workaround needed

Slide 53

Slide 53 text

BROAD Broadcast Channel // Something got updated const orders = new BroadcastChannel('orders'); // Something got updated orders.postMessage({ type: 'order-updated', id: 150 });

Slide 54

Slide 54 text

BROAD Broadcast Channel // Something got updated const orders = new BroadcastChannel('orders'); // Something got updated orders.postMessage({ type: 'order-updated', id: 150 }); // Something changed? Update from source orders.onmessage = ({ data }) => { if (data.type === 'order-updated') { refreshOrder(data.id); } };

Slide 55

Slide 55 text

One message, every tab #150 #150 #150 #150

Slide 56

Slide 56 text

One message, every tab #150 #150 #150 #150

Slide 57

Slide 57 text

One message, every tab #150 #150 #150 #150

Slide 58

Slide 58 text

One message, every tab #150 #150 #150 โ— Each browser knows what has changed locally โ— Tell any other open browsers โ— No backend management required #150

Slide 59

Slide 59 text

But some changes come from outside #150 ๐Ÿง‘๐Ÿ’ป #150 #150 #150

Slide 60

Slide 60 text

But some changes come from outside #150 ๐Ÿง‘๐Ÿ’ป #150 #150 #150

Slide 61

Slide 61 text

Web locks โ— Make one instance responsible for polling โ— If the tab dies, another takes over automatically โ— Held only until the promise settles โ— When that tab gets the update, broadcast it โ— Same scope as BroadcastChannel โ— The web got mutexes! ๐Ÿ”’

Slide 62

Slide 62 text

BROAD // Every tab queues up to be the poller. navigator.locks.request('orders-poller', async () => { // We've the lock until this function returns while (true) { const fresh = await fetch('/api/orders?new=1') .then(r => r.json()); renderOrders(fresh); orders.postMessage({ type: 'orders-updated', orders: fresh }); } }); await new Promise(r => setTimeout(r, 10_000));

Slide 63

Slide 63 text

BROAD // Every tab queues up to be the poller. navigator.locks.request('orders-poller', async () => { // We've the lock until this function returns while (true) { const fresh = await fetch('/api/orders?new=1') .then(r => r.json()); renderOrders(fresh); orders.postMessage({ type: 'orders-updated', orders: fresh }); } }); await new Promise(r => setTimeout(r, 10_000));

Slide 64

Slide 64 text

BROAD // Every tab queues up to be the poller. navigator.locks.request('orders-poller', async () => { // We've the lock until this function returns while (true) { const fresh = await fetch('/api/orders?new=1') .then(r => r.json()); renderOrders(fresh); orders.postMessage({ type: 'orders-updated', orders: fresh }); } }); await new Promise(r => setTimeout(r, 10_000));

Slide 65

Slide 65 text

Four tabs, one poller #150 #150 #150 #150

Slide 66

Slide 66 text

Four tabs, one poller #150 #150 #150 #150

Slide 67

Slide 67 text

One poller, then one broadcast #150 #150 #150 #150

Slide 68

Slide 68 text

No content

Slide 69

Slide 69 text

Picture in Picture โ— Important content on a long page (order list, video call controls) โ— Floats above everything while the tab is open โ— Parent can keep a reference and communicate with it โ— Only one at a time per browser!

Slide 70

Slide 70 text

LIMITED const pip = await documentPictureInPicture.requestWindow({ width: 320, height: 480 }); // Bring our styles over document.querySelectorAll('link[rel=stylesheet], style') .forEach(node => pip.document.head.append(node.cloneNode(true))); // Move the order in pip.document.body.append(orderList); // Move it back when we close pip.addEventListener('pagehide', () => { document.querySelector('#orders-slot').append(orderList); });

Slide 71

Slide 71 text

LIMITED const pip = await documentPictureInPicture.requestWindow({ width: 320, height: 480 }); // Bring our styles over document.querySelectorAll('link[rel=stylesheet], style') .forEach(node => pip.document.head.append(node.cloneNode(true))); // Move the order in pip.document.body.append(orderList); // Move it back when we close pip.addEventListener('pagehide', () => { document.querySelector('#orders-slot').append(orderList); });

Slide 72

Slide 72 text

LIMITED const pip = await documentPictureInPicture.requestWindow({ width: 320, height: 480 }); // Bring our styles over document.querySelectorAll('link[rel=stylesheet], style') .forEach(node => pip.document.head.append(node.cloneNode(true))); // Move the order in pip.document.body.append(orderList); // Move it back when we close pip.addEventListener('pagehide', () => { document.querySelector('#orders-slot').append(orderList); });

Slide 73

Slide 73 text

LIMITED const pip = await documentPictureInPicture.requestWindow({ width: 320, height: 480 }); // Bring our styles over document.querySelectorAll('link[rel=stylesheet], style') .forEach(node => pip.document.head.append(node.cloneNode(true))); // Move the order in pip.document.body.append(orderList); // Move it back when we close pip.addEventListener('pagehide', () => { document.querySelector('#orders-slot').append(orderList); });

Slide 74

Slide 74 text

LIMITED const pip = await documentPictureInPicture.requestWindow({ width: 320, height: 480 }); // Bring our styles over document.querySelectorAll('link[rel=stylesheet], style') .forEach(node => pip.document.head.append(node.cloneNode(true))); // Move the order in pip.document.body.append(orderList); // Move it back when we close pip.addEventListener('pagehide', () => { document.querySelector('#orders-slot').append(orderList); });

Slide 75

Slide 75 text

Smooth transitions? โ— Store manager has been playing with their phone โ— Some very nice animations between screens! โ— Can we do it in our SSR web app? โ—‹ Move to React? โ—‹ Vue? โ—‹ Client-side routing?

Slide 76

Slide 76 text

LIMITED /* In the stylesheet shared by both pages */ @view-transition { navigation: auto; } {{-- list.html --}} /* Unique name per item */
#150
#151
#152
{{-- detail.html --}}

#150

Slide 77

Slide 77 text

LIMITED /* In the stylesheet shared by both pages */ @view-transition { navigation: auto; } {{-- list.html --}} /* Unique name per item */
#150
#151
#152
{{-- detail.html --}}

#150

Slide 78

Slide 78 text

No content

Slide 79

Slide 79 text

No content

Slide 80

Slide 80 text

Marketing had an idea ๐Ÿ’ก

Slide 81

Slide 81 text

Marketing had an idea ๐Ÿ’ก

Slide 82

Slide 82 text

No content

Slide 83

Slide 83 text

๐Ÿ˜ ๐Ÿ˜€ ๐Ÿ’ธ 1. Detect face 2. Is there a smile? 3. Discount!

Slide 84

Slide 84 text

๐Ÿ˜ ๐Ÿ˜€ ๐Ÿ’ธ 1. Detect face 2. Is there a smile? 3. Discount!

Slide 85

Slide 85 text

PREVIEW const video = document.querySelector('video'); video.srcObject = await navigator.mediaDevices.getUserMedia({ video: { facingMode: 'user' }, audio: false, }); await video.play(); if (!('FaceDetector' in window)) { throw new Error('No native FaceDetector here!'); } const detector = new FaceDetector({ fastMode: true, maxDetectedFaces: 1 });

Slide 86

Slide 86 text

PREVIEW const video = document.querySelector('video'); video.srcObject = await navigator.mediaDevices.getUserMedia({ video: { facingMode: 'user' }, audio: false, }); await video.play(); if (!('FaceDetector' in window)) { throw new Error('No native FaceDetector here!'); } const detector = new FaceDetector({ fastMode: true, maxDetectedFaces: 1 });

Slide 87

Slide 87 text

PREVIEW const ctx = canvas.getContext('2d'); let hits = 0; async function tick() { ctx.clearRect(0, 0, canvas.width, canvas.height); const [face] = await detector.detect(video); // Count consecutive frames with a face hits = face ? hits + 1 : 0; if (face && hits >= 10) { const { x, y, width, height } = face.boundingBox; // draw box... } video.requestVideoFrameCallback(tick); } video.requestVideoFrameCallback(tick);

Slide 88

Slide 88 text

PREVIEW const ctx = canvas.getContext('2d'); let hits = 0; async function tick() { ctx.clearRect(0, 0, canvas.width, canvas.height); const [face] = await detector.detect(video); // Count consecutive frames with a face hits = face ? hits + 1 : 0; if (face && hits >= 10) { const { x, y, width, height } = face.boundingBox; // draw box... } video.requestVideoFrameCallback(tick); } video.requestVideoFrameCallback(tick);

Slide 89

Slide 89 text

PREVIEW const ctx = canvas.getContext('2d'); let hits = 0; async function tick() { ctx.clearRect(0, 0, canvas.width, canvas.height); const [face] = await detector.detect(video); // Count consecutive frames with a face hits = face ? hits + 1 : 0; if (face && hits >= 10) { const { x, y, width, height } = face.boundingBox; // draw box... } video.requestVideoFrameCallback(tick); } video.requestVideoFrameCallback(tick);

Slide 90

Slide 90 text

PREVIEW const ctx = canvas.getContext('2d'); let hits = 0; async function tick() { ctx.clearRect(0, 0, canvas.width, canvas.height); const [face] = await detector.detect(video); // Count consecutive frames with a face hits = face ? hits + 1 : 0; if (face && hits >= 10) { const { x, y, width, height } = face.boundingBox; // draw box... } video.requestVideoFrameCallback(tick); } video.requestVideoFrameCallback(tick); Run in web worker to save main threads!

Slide 91

Slide 91 text

๐Ÿ˜ ๐Ÿ˜€ ๐Ÿ’ธ 1. Detect face 2. Is there a smile? 3. Discount!

Slide 92

Slide 92 text

๐Ÿ˜ ๐Ÿ˜€ ๐Ÿ’ธ 1. Detect face 2. Is there a smile? 3. Discount!

Slide 93

Slide 93 text

const [face] = await detector.detect(video); Smile detection? const mouth = face.landmarks.find(l => l.type === 'mouth'); // We have a mouth, but don't know the shape it makes!

Slide 94

Slide 94 text

const [face] = await detector.detect(video); Smile detection? const mouth = face.landmarks.find(l => l.type === 'mouth'); // We have a mouth, but don't know the shape it makes! โ— We can get coords for eyes and mouth โ— Missing mouth geometry โ— MediaPipe - Google AI & ML tooling โ—‹ All run locally on client side โ—‹ A new dependency! https://developers.google.com/edge/mediapipe/solutions/guide

Slide 95

Slide 95 text

const vision = await FilesetResolver.forVisionTasks( '/mediapipe/wasm' ); const landmarker = await FaceLandmarker.createFromOptions( vision, { baseOptions: { modelAssetPath: '/face_landmarker.task', delegate: 'GPU' }, runningMode: 'VIDEO', // We want the expression scores outputFaceBlendshapes: true, } );

Slide 96

Slide 96 text

const vision = await FilesetResolver.forVisionTasks( '/mediapipe/wasm' ); const landmarker = await FaceLandmarker.createFromOptions( vision, { baseOptions: { modelAssetPath: '/face_landmarker.task', delegate: 'GPU' }, runningMode: 'VIDEO', // We want the expression scores outputFaceBlendshapes: true, } );

Slide 97

Slide 97 text

const result = landmarker.detectForVideo( video, performance.now() ); // Check the scores for each recognised face shape const score = name => result.faceBlendshapes[0]?.categories .find(c => c.categoryName === name)?.score ?? 0; const smile = (score('mouthSmileLeft') + score('mouthSmileRight')) / 2; if (smile > 0.65) { unlockDiscount(); } // SMILE10 โ˜•

Slide 98

Slide 98 text

const result = landmarker.detectForVideo( video, performance.now() ); // Check the scores for each recognised face shape const score = name => result.faceBlendshapes[0]?.categories .find(c => c.categoryName === name)?.score ?? 0; const smile = (score('mouthSmileLeft') + score('mouthSmileRight')) / 2; if (smile > 0.65) { unlockDiscount(); } // SMILE10 โ˜•

Slide 99

Slide 99 text

๐Ÿ˜ ๐Ÿ˜€ ๐Ÿ’ธ 1. Detect face 2. Is there a smile? 3. Discount!

Slide 100

Slide 100 text

๐Ÿ˜ ๐Ÿ˜€ ๐Ÿ’ธ 1. Detect face 2. Is there a smile? 3. Discount!

Slide 101

Slide 101 text

LIMITED Shape detection โ— Face detection is early โ— QR code detection is more stable video.srcObject = await navigator.mediaDevices.getUserMedia({ video: true }); const detector = new BarcodeDetector({ formats: ['qr_code'] }); const [code] = await detector.detect(video); if (code) { console.log(code.rawValue); // CUSTOMER_123_LOYALTY }

Slide 102

Slide 102 text

LIMITED Shape detection โ— Face detection is early โ— QR code detection is more stable video.srcObject = await navigator.mediaDevices.getDisplayMedia({ video: true }); const detector = new BarcodeDetector({ formats: ['qr_code'] }); const [code] = await detector.detect(video); if (code) { console.log(code.rawValue); // CUSTOMER_123_LOYALTY } Swap from camera to screen-sharing

Slide 103

Slide 103 text

Coffee time!

Slide 104

Slide 104 text

Coffee time!

Slide 105

Slide 105 text

Coffee time! #150

Slide 106

Slide 106 text

Physical Connection? โ— Web Bluetooth - Bluetooth, but on the web! โ— A web page can talk to real hardware โ—‹ BLE (Bluetooth Low Energy) โ–  Printers โ–  Thermometers โ–  Smart scales โ—‹ Not all Bluetooth devices support connection

Slide 107

Slide 107 text

CHROMIUM Bluetooth Printer // 1. User picks the printer from the browser's chooser const device = await navigator.bluetooth.requestDevice(); // 2. Connect and find the characteristic we write to const server = await device.gatt.connect(); const PRNT_WRITE = 0x2af1; // Demo printer UUIDs const printer = await service.getCharacteristic(PRNT_WRITE);

Slide 108

Slide 108 text

CHROMIUM // 3. Build bytes array const bytes = new Uint8Array([ new TextEncoder().encode('1 x Flat white for Aoife\n'), ]); // 4. Send in small chunks: BLE packets are tiny for (let i = 0; i < bytes.length; i += 20) { await printer.writeValueWithoutResponse( bytes.slice(i, i + 20) ); } device.gatt.disconnect();

Slide 109

Slide 109 text

CHROMIUM // 3. Build bytes array const bytes = new Uint8Array([ new TextEncoder().encode('1 x Flat white for Aoife\n'), ]); // 4. Send in small chunks: BLE packets are tiny for (let i = 0; i < bytes.length; i += 20) { await printer.writeValueWithoutResponse( bytes.slice(i, i + 20) ); } device.gatt.disconnect();

Slide 110

Slide 110 text

CHROMIUM // 3. Build bytes array const bytes = new Uint8Array([ new TextEncoder().encode('1 x Flat white for Aoife\n'), ]); // 4. Send in small chunks: BLE packets are tiny for (let i = 0; i < bytes.length; i += 20) { await printer.writeValueWithoutResponse( bytes.slice(i, i + 20) ); } device.gatt.disconnect();

Slide 111

Slide 111 text

CHROMIUM const device = await navigator.bluetooth.requestDevice({ filters: [ { namePrefix: 'PLAYBULB' }, // partial name match { services: [0xff0d] }, // ...or this service ] });

Slide 112

Slide 112 text

CHROMIUM const device = await navigator.bluetooth.requestDevice({ filters: [ { namePrefix: 'PLAYBULB' }, // partial name match { services: [0xff0d] }, // ...or this service ] });

Slide 113

Slide 113 text

CHROMIUM const device = await navigator.bluetooth.requestDevice({ filters: [ { namePrefix: 'PLAYBULB' }, // partial name match { services: [0xff0d] }, // ...or this service ] });

Slide 114

Slide 114 text

CHROMIUM const device = await navigator.bluetooth.requestDevice({ filters: [ { namePrefix: 'PLAYBULB' }, // partial name match { services: [0xff0d] }, // ...or this service ] }); const server = await device.gatt.connect(); const service = await server.getPrimaryService(0xff0d); const colour = await service.getCharacteristic(0xfffc); // Mipow Playbulb: 4 bytes, [white, red, green, blue] await colour.writeValueWithResponse( new Uint8Array([0, 255, 120, 0]) );

Slide 115

Slide 115 text

CHROMIUM const device = await navigator.bluetooth.requestDevice({ filters: [ { namePrefix: 'PLAYBULB' }, // partial name match { services: [0xff0d] }, // ...or this service ] }); const server = await device.gatt.connect(); const service = await server.getPrimaryService(0xff0d); const colour = await service.getCharacteristic(0xfffc); // Mipow Playbulb: 4 bytes, [white, red, green, blue] await colour.writeValueWithResponse( new Uint8Array([0, 255, 120, 0]) );

Slide 116

Slide 116 text

CHROMIUM const device = await navigator.bluetooth.requestDevice({ filters: [ { namePrefix: 'PLAYBULB' }, // partial name match { services: [0xff0d] }, // ...or this service ] }); const server = await device.gatt.connect(); const service = await server.getPrimaryService(0xff0d); const colour = await service.getCharacteristic(0xfffc); // Mipow Playbulb: 4 bytes, [white, red, green, blue] await colour.writeValueWithResponse( new Uint8Array([0, 255, 120, 0]) );

Slide 117

Slide 117 text

Live Demo

Slide 118

Slide 118 text

Live Demo

Slide 119

Slide 119 text

AI Assistance ๐Ÿง‘๐Ÿ’ป

Slide 120

Slide 120 text

AI Assistance ๐Ÿง‘๐Ÿ’ป โ— Cost? โ— Privacy implications? โ— Regulatory compliance?

Slide 121

Slide 121 text

CHROME AI Assistance โ— The model ships with the browser โ—‹ Downloads on first run โ—‹ No remote server or API key ๐Ÿง‘๐Ÿ’ป โ— Data stays on the device โ— Tasks APIs, plus a general-purpose one โ— Chrome desktop, decent hardware (GPU, disk space) โ— โš  Firefox and Safari currently opposed โš 

Slide 122

Slide 122 text

CHROME const session = await LanguageModel.create({ initialPrompts: [{ role: 'system', content: 'Summarise this review for me.' }], }); const result = await session.prompt( `${review}`, { responseConstraint: { type: 'object', properties: { summary: { type: 'string' }, sentiment: { enum: ['positive', 'neutral', 'negative']}, }, }}, );

Slide 123

Slide 123 text

โ— Task APIs to simplify common tasks โ—‹ Summarizer โ—‹ Rewriter โ—‹ Translator โ—‹ Proofreader โ— Prompt API for more bespoke requirements const summarizer = await Summarizer.create({ type: 'tldr', length: 'short' }); const summary = await summarizer.summarize(review); CHROME

Slide 124

Slide 124 text

CHROME Go multi-modal! const session = await LanguageModel.create({ expectedInputs: [{ type: 'text' }, { type: 'image' }], }); await session.prompt([{ role: 'user', content: [ { type: 'text', value: `Describe the photo` }, { type: 'image', value: photo }, ]} ]);

Slide 125

Slide 125 text

โ€œBut AI writes all my code nowโ€ฆโ€

Slide 126

Slide 126 text

โ€œBut AI writes all my code nowโ€ฆโ€

Slide 127

Slide 127 text

โ— Side project site โ— Podcast transcription โ— Click to play segment โ— Added WebMCP

Slide 128

Slide 128 text

Will AI use it?

Slide 129

Slide 129 text

Will AI use it?

Slide 130

Slide 130 text

Will AI use it?

Slide 131

Slide 131 text

Know your materials.

Slide 132

Slide 132 text

Screen Capture + Canvas: share one area getUserMedia: use the camera field-sizing: grow textarea with content BarcodeDetector: scan an order code CSS Anchoring: keep a menu by its button Web Bluetooth: connect real-world devices BroadcastChannel: alert another tab Web Locks: give one tab the polling job Document PiP: float the live queue Built-in AI: summarise locally View Transitions: animate server-rendered navigation WebMCP: Simplify agent access to sites Availability, permissions and fallbacks still matter!

Slide 133

Slide 133 text

๐Ÿ˜ฑ ๐Ÿš€ upply s t u o ab Panic ulnerability v chain Deploy code ๐Ÿ’ก Get an idea! ๐Ÿ”Ž ๐Ÿ“ฆ Install package / library Look for solution

Slide 134

Slide 134 text

๐Ÿ˜ฑ ๐Ÿš€ upply s t u o ab Panic ulnerability v chain Deploy code ๐Ÿ’ก Get an idea! ๐Ÿ”Ž Look for solution

Slide 135

Slide 135 text

๐Ÿ˜ฑ ๐Ÿš€ upply s t u o ab Panic ulnerability v chain Deploy code ๐Ÿ’ก Get an idea! ๐Ÿ”Ž Look for solution

Slide 136

Slide 136 text

๐Ÿ’ก Get an idea! ๐Ÿš€ Deploy code ๐Ÿ”Ž Look for solution

Slide 137

Slide 137 text

The hard part isnโ€™t writing the code. Itโ€™s deciding what weโ€™ll work with.

Slide 138

Slide 138 text

Thoughts?

Slide 139

Slide 139 text

Thoughts?

Slide 140

Slide 140 text

Thoughts?

Slide 141

Slide 141 text

Thank you! ๐ŸŒ Conroyp.com ๐ŸŒ @conroyp ๐Ÿ“ง [email protected]