[IEICE-RCS202412] (招待講演) 置くだけIoTに向けたCSIによるIoT機器グループ化と実環境における課題 / CSI-Based IoT Device Grouping Toward Put-and-Play IoT System and Practical Challenges

Presented in IEICE-RCS, 函館, December 20, 2024

石田 繁巳
(招待講演) 置くだけIoTに向けたCSIによるIoT機器グループ化と実環境における課題
電子情報通信学会無線通信システム研究会, December 2024

https://ken.ieice.org/ken/program/index.php?tgs_regid=a69058dcf9b054ee56d4690c73bc34d5171b96a34ac79d49e4354655500b3503&tgid=IEICE-RCS

Transcript

1. IEICE RCS IoT CSI IoT <ish@fun.ac.jp> Dec 20, 2024
2. n p 2024 12 @ p 2024 12 20 p December 20, 2024 2
3. 14 December 20, 2024
4. n p ( ) n ( ) p December 20, 2024 15
5. [zhang 19] n p n p l l n p F ( ) ≃ 89.5% December 20, 2024 16 [zhang 19] Danger-pose detection system using commodity Wi-Fi for bathroom monitoring, Sensors, 19(4) https://doi.org/10.3390/s19040884 CSI Illustration by Storyset
6. Figure 8. Experiment setup: (a) transmitter (TX), receiver (RX), and server used in our experiment, and (b) configuration of TX, RX, and bathtub. For the dangerous situation simulation, we assumed three dangerous situations as shown in Figure 9: (1) keep the lying position in a long time, (2) sink the whole body below the water surface, and (3) sink the face below the water surface. The danger-pose detection system is used to detect dangerous situations when taking a bath. Although target dangerous situations are not limited to the three simulated situations, we conducted evaluations with these three situations to demonstrate the basic performance of our system as an initial evaluation. (a) (b) (c) Figure 9. Simulated three dangerous situations: (a) steady lying position, (b) the whole body sinks below the water surface, and (c) the face sinks below the water surface. We collected CSI data at a rate of 20 Hz on channel 40 in a 5-GHz band for couple of hours on six different days during a three-month period. During the three-month period, environmental changes including location of furniture and daily objects have been occurred. Locations of transmitter and receiver might also include errors up to approximately 10 centimeters as we put transmitter and receiver on each of the six days. For not in bath, safe, and danger activities, we collected 119,324, 288,291, and 21,572 CSI data samples, respectively, in total in six days. [zhang 19] Danger-pose detection system using commodity Wi-Fi for bathroom monitoring, Sensors, 19(4) https://doi.org/10.3390/s19040884
7. [uchino 20] n p p n 2 p F : 0.83 December 20, 2024 18 [uchino 20] Initial Design of Two-Stage Acoustic Vehicle Detection System for High Traffic Roads, PerVehicle, IEEE PerCom Workshop D/2 M1 M2 x O d2 d1 D/2 L ౸དྷํ޲ͷมԽΛఆࣜԽ Time t Sound delay Δt ϩόετਪఆʹΑΔ ϑΟοςΟϯά Sound Mapper Vehicle Detector M 2 M 1 Sound Retriever LPFs Out Sound Map 2441 2442 2443 2444 2445 2446 Time [s] −1.5 −1.0 −0.5 0.0 0.5 1.0 1.5 Sound Delay [ms] ֶ ੜ F஋0.83Ͱਐߦํ޲Λࣝผ͠ͳ͕Βं྆Λݕग़
8. n 4 n 60 n 609 n p めっちゃ時間 かかりました! December 20, 2024 19 [uchino 20] Initial Design of Two-Stage Acoustic Vehicle Detection System for High Traffic Roads, PerVehicle, IEEE PerCom Workshop TP 133 132 265 FN 165 179 344 FP 81 80 161 Precision 0.62 0.62 0.62 Recall 0.45 0.42 0.44 F-measure 0.52 0.50 0.51 harmonic mean of precision and recall, which provides a comprehensive evaluation of the classifier. B. Detection Performance Table I shows the system performance, i.e., the number of TP, FN, and FP detections as well as the calculated precision, recall, and F-measure for ✓t = 1.5s. • The precision of the proposed Two-Stage Acoustic Ve- hicle Detection System is 0.76, 14 points higher than SAVeD. By resetting the detection window in the Post- Fitting block and detecting vehicles using only sound map points in the neighborhood of the estimated vehicle passing time, the amount of FP detections was reduced. • The recall of 0.53 is a 9-point improvement compared to previous work. This is due to the system’s ability to make use of all the sound map points corresponding to a given vehicle. • The F-measure of 0.63 is 12 points higher than SAVeD. The relatively low F-measures exhibited by both the Two- Stage Acoustic Vehicle Detection System and SAVeD are due to their low recall values compared to their precision values. As the number of simultaneously passing vehicles increases, the number of sound map points corresponding to a single vehicle decreases because only one point is drawn on the sound map at each time step. As a result, the S-curve becomes sparse, increasing the probability of a FN detection. • The Two-Stage Acoustic Vehicle Detection System de- Fig. 10. Proposed system F-measure as a function of passing time error margin ✓t Microphone setup location Fig. 11. System monitoring viewpoint The above results show that our Two-Stage Acoustic Vehicle Detection System is an improvement over the SAVeD in terms of vehicle detection performance. C. Passing Time Error The detection performance of our system depends strongly on the estimated passing time used in the Post-Fitting block. As described in Section IV-A, the smaller the passing time error margin ✓ts, the higher the number of FP detections. It is therefore important to examine the influence of the passing time error margin on detection performance. Figure 10 shows the F-measures for ✓t between 0.5 s and 2.0 s. The F-measure starts to increase at about ✓t = 0.6 s and stabilizes around ✓t = 1.2 s. The optimum value of ✓t corresponds to the point at which the F-measure just begins to stabilize, as a too large value of ✓t will cause the system
9. ... n IoT → IoT December 20, 2024 20
10. IoT December 20, 2024 21
11. December 20, 2024 22
12. n p n IoT p IoT (?) December 20, 2024 23 Livingroom Bedroom Bath- room Wash- room Dining/Kitchen Nature Remo Switchbot Switchbot Hub Echo Flex Echo Flex Smart power strip (?) (?)
13. IoT (PnP IoT) n IoT December 20, 2024 24 TV 4 ( ) ( OFF)
14. December 20, 2024 25 WPS OK ( ) ( OFF) تُ٭عتم٭؜ ԛ ԛ ԛ
15. December 20, 2024 26 WPS OK ( ) ( OFF) تُ٭عتم٭؜ ԛ ԛ ԛ
16. CSI IoT [ishida 22] Room-by-Room Device Grouping for Put-and- Play IoT System, IEEE Globecom 27 December 20, 2024
17. n WiFi (CSI) p èCSI (= )IoT 28 E F v v A B C D F E G A D E G B C F December 20, 2024
18. n WiFi (IEEE 802.11n, 802.11ac) p ( ) p p 29 CSI (Channel State Information) E[k] R[k] E[k] R[k] ࡶԻn H ௨৴࿏ʢνϟωϧʣ H n Hl = 2 6 6 4 h11 h12 · · · h1j h21 h22 · · · h2j · · · · · · · · · · · · hi1 hi2 · · · hij 3 7 7 5 <latexit sha1_base64="rp1Xu21+xBCNxKf1oM4LDSrS2sg=">AAACs3icdVFRS9xAEN5E22pq21MffVk8LD5dk0BRCgXBFx8VPBUuMWw2k7utm03YnRSOkB/os0/+Gzd3UdTDgYWPb775ZnYmraQw6PuPjru2/unzl41N7+vWt+8/Bts7V6asNYcxL2Wpb1JmQAoFYxQo4abSwIpUwnV6d9rlr/+DNqJUlzivIC7YVIlccIaWSgb3Z4mkf2kkIceJF6UwFaphWrN522gbrTdLmiBo6U/agbADEc9KND3zr6VR1InCZ1G4IgqXohfqQ7B0Es9OYsVJ9E6gsn5KL9JiOsPYSwZDf+Qvgq6CoAdD0sd5MniIspLXBSjkkhkzCfwKY2uLgkuwxrWBivE7NoWJhYoVYOJmsfKWHlgmo3mp7VNIF+zrioYVxsyL1CoLhjPzPteRL7mDN60wP44boaoaQfFlp7yWFEvaHZBmQgNHObeAcS3ssJTPmGYc7Zm7LQTv/7wKrsJR4I+CC3948qffxwbZI/vkkATkiJyQM3JOxoQ7v5yxc+sk7m934qZutpS6Tl+zS96EWzwBZ0nNoQ==</latexit> <latexit sha1_base64="rp1Xu21+xBCNxKf1oM4LDSrS2sg=">AAACs3icdVFRS9xAEN5E22pq21MffVk8LD5dk0BRCgXBFx8VPBUuMWw2k7utm03YnRSOkB/os0/+Gzd3UdTDgYWPb775ZnYmraQw6PuPjru2/unzl41N7+vWt+8/Bts7V6asNYcxL2Wpb1JmQAoFYxQo4abSwIpUwnV6d9rlr/+DNqJUlzivIC7YVIlccIaWSgb3Z4mkf2kkIceJF6UwFaphWrN522gbrTdLmiBo6U/agbADEc9KND3zr6VR1InCZ1G4IgqXohfqQ7B0Es9OYsVJ9E6gsn5KL9JiOsPYSwZDf+Qvgq6CoAdD0sd5MniIspLXBSjkkhkzCfwKY2uLgkuwxrWBivE7NoWJhYoVYOJmsfKWHlgmo3mp7VNIF+zrioYVxsyL1CoLhjPzPteRL7mDN60wP44boaoaQfFlp7yWFEvaHZBmQgNHObeAcS3ssJTPmGYc7Zm7LQTv/7wKrsJR4I+CC3948qffxwbZI/vkkATkiJyQM3JOxoQ7v5yxc+sk7m934qZutpS6Tl+zS96EWzwBZ0nNoQ==</latexit> <latexit sha1_base64="rp1Xu21+xBCNxKf1oM4LDSrS2sg=">AAACs3icdVFRS9xAEN5E22pq21MffVk8LD5dk0BRCgXBFx8VPBUuMWw2k7utm03YnRSOkB/os0/+Gzd3UdTDgYWPb775ZnYmraQw6PuPjru2/unzl41N7+vWt+8/Bts7V6asNYcxL2Wpb1JmQAoFYxQo4abSwIpUwnV6d9rlr/+DNqJUlzivIC7YVIlccIaWSgb3Z4mkf2kkIceJF6UwFaphWrN522gbrTdLmiBo6U/agbADEc9KND3zr6VR1InCZ1G4IgqXohfqQ7B0Es9OYsVJ9E6gsn5KL9JiOsPYSwZDf+Qvgq6CoAdD0sd5MniIspLXBSjkkhkzCfwKY2uLgkuwxrWBivE7NoWJhYoVYOJmsfKWHlgmo3mp7VNIF+zrioYVxsyL1CoLhjPzPteRL7mDN60wP44boaoaQfFlp7yWFEvaHZBmQgNHObeAcS3ssJTPmGYc7Zm7LQTv/7wKrsJR4I+CC3948qffxwbZI/vkkATkiJyQM3JOxoQ7v5yxc+sk7m934qZutpS6Tl+zS96EWzwBZ0nNoQ==</latexit> <latexit sha1_base64="rp1Xu21+xBCNxKf1oM4LDSrS2sg=">AAACs3icdVFRS9xAEN5E22pq21MffVk8LD5dk0BRCgXBFx8VPBUuMWw2k7utm03YnRSOkB/os0/+Gzd3UdTDgYWPb775ZnYmraQw6PuPjru2/unzl41N7+vWt+8/Bts7V6asNYcxL2Wpb1JmQAoFYxQo4abSwIpUwnV6d9rlr/+DNqJUlzivIC7YVIlccIaWSgb3Z4mkf2kkIceJF6UwFaphWrN522gbrTdLmiBo6U/agbADEc9KND3zr6VR1InCZ1G4IgqXohfqQ7B0Es9OYsVJ9E6gsn5KL9JiOsPYSwZDf+Qvgq6CoAdD0sd5MniIspLXBSjkkhkzCfwKY2uLgkuwxrWBivE7NoWJhYoVYOJmsfKWHlgmo3mp7VNIF+zrioYVxsyL1CoLhjPzPteRL7mDN60wP44boaoaQfFlp7yWFEvaHZBmQgNHObeAcS3ssJTPmGYc7Zm7LQTv/7wKrsJR4I+CC3948qffxwbZI/vkkATkiJyQM3JOxoQ7v5yxc+sk7m934qZutpS6Tl+zS96EWzwBZ0nNoQ==</latexit> RXΞϯςφ਺ TXΞϯςφ਺ 𝑅 𝑘 = 𝐻! 𝐸 𝑘 + 𝑛 𝑙: December 20, 2024
19. n CSI p PinLoc [sen 12], PhaseFi [wang 16], DeepFi [wang 17] ➔ n p FUSIC [jiokeng 20], SpotFi [kotaru 15] ➔ December 20, 2024 30 [sen 12] You are facing the Mona Lisa: Spot localization using PHY layer information, ACM MobiSys [wang 16] CSI phase fingerprinnting for indoor localization with a deep learning approach, IEEE Internet Things J., 3(6) [wang 17] CSI-based fingerprinting for indoor localization: A deep learrning approach, IEEE Trans. Veh. Technol., 66(1) [jiokeng 20] When FTM discovered MUSIC: Accurate WiFi-based ranging in the presence of multipath, IEEE INFOCOM [kotaru 15] SpotFi: decimeter level localization using WiFi, ACM SIGCOMM CC Review
20. 31 December 20, 2024
21. December 20, 2024 32 sin ∅"# , cos ∅"# instead of ∅"# mean median max min std p2p iqr
22. December 20, 2024 33 k-means
23. n 1LDK p AP CSI dining p dining, bedroom, living Galaxy S7 edge l : 0 90cm p 10Hz 5 CSI p 34 December 20, 2024
24. n * p NH/* = NH/OP + NH/CL p */OP = NH/OP + DN/OP + LV/ OP + BD/OP December 20, 2024 35 Dataset (5 min each) Abbrv Human walking in Doors No human w/ opened doors NH/OP Opened No human w/ closed doors NH/CL Closed Dining room w/ opened doors DN/OP Dining room Opened Dining room w/ closed doors DN/CL Dining room Closed Living room w/ opened doors LV/OP Living room Opened Living room w/ closed doors LV/CL Living room Closed Bedroom w/ opened doors BD/OP Bedroom Opened Bedroom w/ closed doors BD/CL Bedroom Closed
25. n (ARI) p p −1 ≤ ARI ≤ 1 l 1 l 0 n p December 20, 2024 36 Living room Bedroom
26. 1: n Win size = 10s, 𝑁!"# = 4 n IoT n 100 ARI December 20, 2024 37 Feature */OP */CL */* sin ∅!" , cos ∅!" 𝝍𝒍𝒋 sin ∅!" , cos ∅!" 𝝍𝒍𝒋 sin ∅!" , cos ∅!" 𝝍𝒍𝒋 mean 0.10 0.40 0.44 0.01 0.44 0.35 median 0.10 0.44 0.44 0.03 0.45 0.36 max 0.47 0.39 0.41 0.43 0.44 0.39 min 0.60 0.43 0.39 0.35 0.52 0.44 std 0.69 0.89 0.34 0.81 0.63 0.93 p2p 0.69 0.83 0.52 0.76 0.81 0.89 iqr 0.45 0.85 0.28 0.87 0.36 0.93
27. 1: n Win size = 10s, 𝑁!"# = 4 n IoT n 100 ARI December 20, 2024 38 Feature */OP */CL */* sin ∅!" , cos ∅!" 𝝍𝒍𝒋 sin ∅!" , cos ∅!" 𝝍𝒍𝒋 sin ∅!" , cos ∅!" 𝝍𝒍𝒋 mean 0.10 0.40 0.44 0.01 0.44 0.35 median 0.10 0.44 0.44 0.03 0.45 0.36 max 0.47 0.39 0.41 0.43 0.44 0.39 min 0.60 0.43 0.39 0.35 0.52 0.44 std 0.69 0.89 0.34 0.81 0.63 0.93 p2p 0.69 0.83 0.52 0.76 0.81 0.89 iqr 0.45 0.85 0.28 0.87 0.36 0.93 CSI
28. 2: n IoT n 100 ARI 39 Human location ARI 0.42 Dining room 0.27 Living room 1.00 Bedroom 0.29 Anywhere 0.95 Anywhere or no where 0.95 December 20, 2024
29. ( ) n p CSI p n p CSI = p CSI December 20, 2024 40
30. [ishida 25] CSI Sampling for Room-by-Room Device Grouping in Practical Environments, IEEE CCNC 41 December 20, 2024
31. December 20, 2024 42 1) 0.2 0.9 … 0.1 0.8 … … … … … … 0.2 0.9 … 0.1 0.8 … … … … … … <latexit sha1_base64="vYcOXklh+gWBP/5fdMQ1Vk+XYCU=">AAAB8XicbVDLSgNBEOyNr7i+oh69DIaAp7Ab4uMY8OIxgnlIsoTZyWwyZGZ2mZkVwpKv8CQoiFc/x5N/4yTZgyYWNBRV3XR3hQln2njet1PY2Nza3inuunv7B4dHpeOTto5TRWiLxDxW3RBrypmkLcMMp91EUSxCTjvh5Hbud56o0iyWD2aa0EDgkWQRI9hY6bGfaDbIav5sUCp7VW8BtE78nJQhR3NQ+uoPY5IKKg3hWOue7yUmyLAyjHA6cyv9VNMEkwke0Z6lEguqg2xx8QxVrDJEUaxsSYMWqvtrIsNC66kIbafAZqxXvbn4n9dLTXQTZEwmqaGSLBdFKUcmRvP30ZApSgyfWoKJYvZYRMZYYWJsSK5NwV/9eZ20a1X/qnp5Xy836nkeRTiDc7gAH66hAXfQhBYQEPAMr/DmaOfFeXc+lq0FJ585hT9wPn8A7eqQXQ==</latexit> 21 Subcarrier –28 std p2p iqr … Subcarrier 28 std p2p iqr <latexit sha1_base64="pgBfoqmbH3eroXVc3hDQ/7TuQ2c=">AAAB8XicbVDLSgNBEOyNr7i+oh69DIaAp7Ar8XEMePEYwTwkWcLsZDYZMzO7zMwKYclXeBIUxKuf48m/cZLsQRMLGoqqbrq7woQzbTzv2ymsrW9sbhW33Z3dvf2D0uFRS8epIrRJYh6rTog15UzSpmGG006iKBYhp+1wfDPz209UaRbLezNJaCDwULKIEWys9NBLNOtn/HHaL5W9qjcHWiV+TsqQo9EvffUGMUkFlYZwrHXX9xITZFgZRjidupVeqmmCyRgPaddSiQXVQTa/eIoqVhmgKFa2pEFz1f01kWGh9USEtlNgM9LL3kz8z+umJroOMiaT1FBJFouilCMTo9n7aMAUJYZPLMFEMXssIiOsMDE2JNem4C//vEpa51X/snpxVyvXa3keRTiBUzgDH66gDrfQgCYQEPAMr/DmaOfFeXc+Fq0FJ585hj9wPn8AnWWQ0A==</latexit> lj … Time … Time Time Subcarrier –28 Subcarrier 28 … … <latexit sha1_base64="vYcOXklh+gWBP/5fdMQ1Vk+XYCU=">AAAB8XicbVDLSgNBEOyNr7i+oh69DIaAp7Ab4uMY8OIxgnlIsoTZyWwyZGZ2mZkVwpKv8CQoiFc/x5N/4yTZgyYWNBRV3XR3hQln2njet1PY2Nza3inuunv7B4dHpeOTto5TRWiLxDxW3RBrypmkLcMMp91EUSxCTjvh5Hbud56o0iyWD2aa0EDgkWQRI9hY6bGfaDbIav5sUCp7VW8BtE78nJQhR3NQ+uoPY5IKKg3hWOue7yUmyLAyjHA6cyv9VNMEkwke0Z6lEguqg2xx8QxVrDJEUaxsSYMWqvtrIsNC66kIbafAZqxXvbn4n9dLTXQTZEwmqaGSLBdFKUcmRvP30ZApSgyfWoKJYvZYRMZYYWJsSK5NwV/9eZ20a1X/qnp5Xy836nkeRTiDc7gAH66hAXfQhBYQEPAMr/DmaOfFeXc+lq0FJ585hT9wPn8A7eqQXQ==</latexit> 21 <latexit sha1_base64="pgBfoqmbH3eroXVc3hDQ/7TuQ2c=">AAAB8XicbVDLSgNBEOyNr7i+oh69DIaAp7Ar8XEMePEYwTwkWcLsZDYZMzO7zMwKYclXeBIUxKuf48m/cZLsQRMLGoqqbrq7woQzbTzv2ymsrW9sbhW33Z3dvf2D0uFRS8epIrRJYh6rTog15UzSpmGG006iKBYhp+1wfDPz209UaRbLezNJaCDwULKIEWys9NBLNOtn/HHaL5W9qjcHWiV+TsqQo9EvffUGMUkFlYZwrHXX9xITZFgZRjidupVeqmmCyRgPaddSiQXVQTa/eIoqVhmgKFa2pEFz1f01kWGh9USEtlNgM9LL3kz8z+umJroOMiaT1FBJFouilCMTo9n7aMAUJYZPLMFEMXssIiOsMDE2JNem4C//vEpa51X/snpxVyvXa3keRTiBUzgDH66gDrfQgCYQEPAMr/DmaOfFeXc+Fq0FJ585hj9wPn8AnWWQ0A==</latexit> lj … Feature vector 2) CSI = CSI 3) 𝑁$%&
32. n CSI p CSI n p ➔CSI ➔ CSI December 20, 2024 43 … …
33. CSI December 20, 2024 44 ... Time Device 1 Device 2 ... Device n ICA ICA i ICA j Device 1 Device 2 Device n ... ... ... ... 1) CSI (ICA) 2) ICA 3) CSI
34. : 2LDK ( ) n LAN AP 1 : Buffalo WXR-5700AX7S n IoT 9 : Raspberry Pi 3A+ ( : 0 2m) n : Intel Compute Stick n 4 (40 1 30 1 10 2 ) n CSI 24 n : 60 n 500 p ARI December 20, 2024 45 Bedroom Storeroom CL BR WC CL Living Dining Kitchen AP Data Retriever IoT Devices 2 1,3 4,6 5 7 8 9 5.3m 3.5m 2.5m 4.1m ID 1 290663 2358 2 2968 0 3 198929 2357 4 268754 2880 5 0 0 6 308506 2880 7 347484 2880 8 369627 2880 9 247124 2880
35. 1. ICA ( ) 2. PCA p ICA PCA p ICA 3. p CSI ※ 𝑁$%& = 12 p >0.8 ※ December 20, 2024 46
36. : IoT n ICA 𝑁!"#$ ARI p ICA( ) 𝑁!"#$ = 1 ARI=0.943 l 𝑁1234 = 2 ARI=0.991 l 𝑁1234 ≥ 4 ARI=1.00 p PCA p Random December 20, 2024 47 0 2 4 6 8 10 Nsamp 0.7 0.8 0.9 1.0 Mean ARI ICA PCA Random 44.4%
37. n IoT IoT p CSI p n p p window p l 44.4% ARI=1.00 December 20, 2024 48
38. 49 December 20, 2024
39. n IoT p IoT p IoT p n p CSI IoT n p : ish@fun.ac.jp p Web: https://pman0214.netlify.app/ December 20, 2024 50
40. © 2024 Shigemi ISHIDA, distributed under CC BY-NC 4.0