1863 Tips for controlling HVAC and lighting with a voice from xR using Code Engine and watsonx.ai_v3

This is my presentation in IBM TechXchange 2024 Las Vegas. Title is "1863 Tips for controlling HVAC and lighting with a voice from xR using Code Engine and watsonx.ai".

Thank you for graphic materials!

kage-design http://kage-design.com/
human pictogram 2.0 http://pictogram2.com
ICOOON MONO http://icooon-mono.com/
Adobe Stock https://stock.adobe.com/jp

Transcript

1. October 21-24, 2024 Mandalay Bay Convention Center Las Vegas, Nevada Seigo Tanaka, President, 1ft-seabass Takahiro Nakahata, Principal CEO, Smart Light Co., Ltd. Session ID : 1863 Tips for controlling HVAC and lighting with a voice from xR using Code Engine and watsonx.ai!
2. #IBMTechXchange 2 What you will learn in this session IBM TechXchange | © 2024 IBM Corporation 01 02 03 04 05 xR + Voice + AI + Facility Architechture Live demo! Various tips Develop to future
3. #IBMTechXchange Self Introduction Seigo Seigo Tanaka I have been worked front-end Engineer since 2004 and made interactive contents using Adobe FLASH. Recently. I’m based on front-end technology. I’m going to be related to information and user-interface gradually. ex. IoT , Mixed Reality and AI... Additionally, I got awards as an IBM Champion.
4. #IBMTechXchange Self Introduction Taka Takahiro Nakahata I've spent over 20 years in lighting sales and now focus on smart office and home projects using open control protocols. Controlling IoT devices with Node-RED is both my passion and my profession.
5. #IBMTechXchange 5 What you will learn in this session IBM TechXchange | © 2024 IBM Corporation 01 02 03 04 05 xR + Voice + AI + Facility Architechture Live demo! Various tips Develop to future
6. #IBMTechXchange Our collaboration. xR + Voice + AI + Facility Seigo Taka
7. xR controlling to facilities with voice , watsonx.ai and Code Engine. MY POST : https://twitter.com/1ft_seabass/status/1773633863396344150 IBM TechXchange | © 2024 IBM Corporation
8. #IBMTechXchange xR + Voice + AI section. xR + Voice + AI + Facility Seigo
9. #IBMTechXchange Outline this flow. IBM Cloud Code Engine ＋ watsonx.ai Voice Node-RED Air Conditioner Lighting Smart Light Co., Ltd Facility controling Illustration From Adobe Stock(Adobe Express) Meta Quest 3 My Photo
10. #IBMTechXchange About the facility part. xR + Voice + AI + Facility Taka
11. #IBMTechXchange There are some keywords I would like everyone to know in order to explain Facility Control. IBM Cloud Code Engine ＋ watsonx.ai Voice Node-RED Air Conditioner Lighting Smart Light Co., Ltd Facility controling Meta Quest 3 My Photo
12. #IBMTechXchange BACnet DALI
13. #IBMTechXchange Does anyone know about BACnet, KNX and DALI? Please raise your hand if you know them. BACnet DALI
14. #IBMTechXchange These are digital and open communication protocols for facility control BACnet DALI HVAC Lighting Sensor Switch
15. #IBMTechXchange Question
16. #IBMTechXchange Whose data is the sensor data?
17. #IBMTechXchange Whose data is the sensor data? There are a lot of sensors in offices, aren't there?
18. #IBMTechXchange Imagine if you could see the sensor logs Doesn't just thinking about it make you excited?
19. #IBMTechXchange However…
20. #IBMTechXchange Would it be possible for me to receive this sensor data, please? You actually the building owner
21. #IBMTechXchange Would it be possible for me to receive this sensor data, please? You actually the building owner Building facility manager
22. #IBMTechXchange The reason why the sensor data cannot be used 1. Sensors related to lighting, HVAC and other facilities. 2. There is no pathway to send the data 3. They haven’t even considered sending the data externally
23. #IBMTechXchange The building systems are siloed. Lighting HVAC
24. #IBMTechXchange The era of interconnected building facilities Lighting HVAC BACnet DALI
25. #IBMTechXchange These are digital and open communication protocols for facility control BACnet DALI HVAC Lighting Sensor Switch
26. #IBMTechXchange These are digital and open communication protocols for facility control BACnet DALI By using APIs, it will become possible to control and get the status of facilities
27. How to get the lighting status using an API. DALI
28. 照明器具の点灯状態をIP通信で取得する方法 ネットワークSW DALI Ethernet Gateway DALI Signal Line A0 A1 A2 Lighting system with DALI A3 A4 A5 A6 A7 A8
29. 照明器具の点灯状態をIP通信で取得する方法 ネットワークSW DALI Ethernet Gateway DALI Signal Line A0 A1 A2 Lighting system with DALI A3 A4 A5 A6 A7 A8 A2 : Query Status
30. 照明器具の点灯状態をIP通信で取得する方法 ネットワークSW DALI Ethernet Gateway DALI Signal Line A0 A1 A2 Lighting system with DALI A3 A4 A5 A6 A7 A8 Response Status A2 : Query Status
31. 照明器具の点灯状態をIP通信で取得する方法 ネットワークSW DALI Ethernet Gateway DALI Signal Line A0 A1 A2 Lighting system with DALI A3 A4 A5 A6 A7 A8 Command A2: OFF
32. 照明器具の点灯状態をIP通信で取得する方法 ネットワークSW DALI Ethernet Gateway DALI Signal Line A0 A1 A2 Lighting system with DALI A3 A4 A5 A6 A7 A8 Command A2: OFF LIGHT OFF
33. How to get switch and sensor data, using the KNX API.
34. KNXセンサー KNXスイッチ ネットワークSW 制御サーバー ・個別アドレス ・双方向通信 ・信号線で通信 KNXセンサー KNXセンサー KNXスイッチ KNXセンサー センサーやスイッチの状態をIP通信で取得する方法 KNX信号線 KNX IP Interface KNX system Sensor1 Sensor2 Switch1 Sensor3 Sensor4 Switch2 HVAC
35. BACnet/IP 制御サーバー BACnet/IPを 理解できるサーバーで 信号を受信 BACnet You can get various statuses of a building using BACnet. BACnet Gateway Extra : https://github.com/1ft-seabass/ibm-techxchange24-las-vegas/blob/main/04-taka-part.md
36. #IBMTechXchange Our collaboration. xR + Voice + AI + Facility Seigo Taka
37. #IBMTechXchange 37 What you will learn in this session IBM TechXchange | © 2024 IBM Corporation 01 02 03 04 05 xR + Voice + AI + Facility Architechture Live demo! Various tips Develop to future
38. #IBMTechXchange Today xR device... My Apple Vision Pro
39. #IBMTechXchange Architechture xR get a voice. Speech to text. Response on/off. Controlling faciliries Unity Whisper API IBM Cloud Code Engine ＋ watsonx.ai Mic input Speech to text Question Response (JSON) Node-RED Air Conditioner Lighting Smart Light Co., Ltd Facility controling Illustration From Adobe Stock(Adobe Express)
40. #IBMTechXchange 40 What you will learn in this session IBM TechXchange | © 2024 IBM Corporation 01 02 03 04 05 xR + Voice + AI + Facility Architechture Live demo! Various tips Develop to future
41. #IBMTechXchange We try a remote control here to Japan. xR + Cloud + AI are here. Facilities are in Japan. Unity Whisper API IBM Cloud Code Engine ＋ watsonx.ai Mic input Speech to text Node-RED Air Conditioner Lighting Smart Light Co., Ltd Facility controling Here Japan Extra : https://github.com/1ft-seabass/ibm-techxchange24-las-vegas/blob/main/01-live-demo-detail.md
42. #IBMTechXchange Preparation We will share you with live camera about controlled facilities. Air Conditioner Lighting Smart Light Co., Ltd Facility controling Here Japan Camera Control :) Check & Shareing
43. #IBMTechXchange Live demo! From Adobe Stock(Adobe Express)
44. #IBMTechXchange 44 What you will learn in this session IBM TechXchange | © 2024 IBM Corporation 01 02 03 04 05 Facility + AI + Voice + xR Architechture Live demo! Various tips Develop to future
45. #IBMTechXchange Tip: Code Engine is nice glue! Unity Whisper API IBM Cloud Code Engine ＋ watsonx.ai Mic input Speech to text Question Response (JSON) Node-RED Air Conditioner Lighting Smart Light Co., Ltd Facility controling Extra : https://github.com/1ft-seabass/ibm-techxchange24-las-vegas/blob/main/02-codeengine.md
46. #IBMTechXchange Tip: Watson Machine Learning is nice prototyping tool with watsonx.ai! Extra : https://github.com/1ft-seabass/ibm-techxchange24-las-vegas/blob/main/03-ml.md
47. #IBMTechXchange Tips: This prompt in watsonx.ai. My blog : https://www.1ft-seabass.jp/memo/2024/04/08/watsonx-granite-8b-japanese-model-sample-prompt-json-data/
48. #IBMTechXchange 48 What you will learn in this session IBM TechXchange | © 2024 IBM Corporation 01 02 03 04 05 xR + Voice + AI + Facility Architechture Live demo! Various tips Develop to future
49. #IBMTechXchange We think about developing to future. From Adobe Stock(Adobe Express)
50. #IBMTechXchange Seigo side Code Engine and waisonx.ai are nice glue for connecting each technologies. They ease a voice interface using a generative AI. Especially I believed new aspect that controlling xR and facility control in voice command such a understanding human command. From Adobe Stock(Adobe Express)
51. #IBMTechXchange Taka side. In 5 to 10 years, AI will be common. Connecting systems like lighting and HVAC to AI will improve efficiency. Choose systems with open protocols like KNX, DALI, and BACnet, and enjoy new technology. From Adobe Stock(Adobe Express)
52. #IBMTechXchange Conclusion Code Engine and watsonx.ai supported this our prototyping such as connecting technologies and easing to access AI. They also deliver near future thinking and aspects to us! From Adobe Stock(Adobe Express)
53. #IBMTechXchange 53 Q&A IBM TechXchange | © 2024 IBM Corporation Seigo Tanaka President, 1ft-seabass seigo@1ft-seabass.jp Takahiro Nakahata Principal CEO, Smart Light Co., Ltd. nakahata@smartlight.jp
54. #IBMTechXchange 54 Thank You Seigo Tanaka, President, 1ft-seabass Takahiro Nakahata, Principal CEO, Smart Light Co., Ltd. Session ID : 1863 IBM TechXchange | © 2024 IBM Corporation
55. #IBMTechXchange Notices and disclaimers Certain comments made in this presentation may be characterized as forward looking under the Private Securities Litigation Reform Act of 1995. Forward-looking statements are based on the company’s current assumptions regarding future business and financial performance. Those statements by their nature address matters that are uncertain to different degrees and involve a number of factors that could cause actual results to differ materially. Additional information concerning these factors is contained in the Company’s filings with the SEC. Copies are available from the SEC, from the IBM website, or from IBM Investor Relations. Any forward-looking statement made during this presentation speaks only as of the date on which it is made. The company assumes no obligation to update or revise any forward-looking statements except as required by law; these charts and the associated remarks and comments are integrally related and are intended to be presented and understood together. © 2024 International Business Machines Corporation. All rights reserved. This document is distributed “as is” without any warranty, either express or implied. In no event shall IBM be liable for any damage arising from the use of this information, including but not limited to, loss of data, business interruption, loss of profit or loss of opportunity. Customer examples are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual performance, cost, savings or other results in other operating environments may vary. Workshops, sessions and associated materials may have been prepared by independent session speakers, and do not necessarily reflect the views of IBM. Not all offerings are available in every country in which IBM operates. Any statements regarding IBM’s future direction, intent or product plans are subject to change or withdrawal without notice. IBM, the IBM logo, and ibm.com are trademarks of International Business Machines Corporation, registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at “Copyright and trademark information” at: www.ibm.com/legal/copytrade.shtml. IBM TechXchange | © 2024 IBM Corporation 55