A development of real time reproduction system of the three dimensional visual image and binaural sound -Application to the noise measurement-

In order to apply virtual sound reproduction system to the noise measurements in outdoor field, we developed real time reproduction system of the three-dimensional visual image and the sound image by simple devices. This system is divided into the measurement and the reproduction parts connected each other via the internet. The measurement system is consisted by the 360-degree camera, 4ch microphones and laptop computer. The laptop computer is sending the three-dimensional visual image data and 4ch sound data to the reproduction system through the internet. The reproduction system is consisted by the headmount display, headphone and computer. The three-dimensional sound image is controlled by the binaural sound. Moreover, this system is tracking listener's head movement, and changing the directions of the visual and sound images dynamically. In addition, we tried that apply this system to the railroad noise measurement. One person measured the railroad noise and ambient noise beside the developed measurement system. On the other hand, another person also measured the railroad noise using the reproduction system in the office. As a result, the both persons could similarly separate the railroad noise and ambient noise. This result indicates that the noise measurements in outdoor field can be unmanned.