ears through headphones by using head-related transfer functions (HRTFs) Binaural synthesis for VR space: Given source signals / positions, room conditions, etc. Convolution of source signal and HRTF Binaural reproduction for real world: Based on sound field estimation by using mic array Capturing sound field in large region is necessary for 6DoF VR, but that is still challenging task
mics are now commercially available, but spatial resolution is very low Spherical mic array is typically used for high-resolution recording, but large spherical array is neccesary for capturing sound field in large region Spherical mic array Capturing sound field in large region by single spherical array is sometimes impractical
(e.g., Ambisonic mics) for capturing sound field in large region Sound field recording by flexible and scalable system How to integrate multiple mic array signals…? Multiple small arrays
harmonic analysis Reproduction Binaural rendering from harmonic coefficients with compensation for loudspeaker distance in HRTF measurements • Iijima, et al., “Binaural Rendering From Microphone Array Signals of Arbitrary Geometry,” JASA, 2021. Highly-accurate binaural reproduction in large region can be achieved by flexible and scalable recording system
12) Controllable on Web browser / HMD 360-degree control of viewing and listening directions 2 viewing and listening positions are selectable Position A Position B Composite mic array x y
Koyama, and H. Saruwatari, “Binaural Rendering From Microphone Array Signals of Arbitrary Geometry,” Journal of the Acoustical Society of America (JASA), 2021. 2. N. Ueno, S. Koyama, and H. Saruwatari, “Sound Field Recording Using Distributed Microphones Based on Harmonic Analysis of Infinite Order,” IEEE Signal Processing Letters, vol. 25, no. 1, pp. 135- 139, 2018. Further information https://www.sh01.org/ Performance by 1st Vn.: Atsuko Sahara, 2nd Vn.: Erina Kato, Va.: Atsushi Yoshida, Vc.: Shogo Toyoda