點矩陣全像繞射光偵測之影音互動系統

Abstract

本研究藉由應用程式來設計點矩陣全像片，使全像片於不同入射方位角度之光源下，可得到繞射光所產生之變圖(image switch)以及流動(flow dynamic)的視覺效果。以此兩種不同視覺效果之點矩陣全像片作為感測媒介建構兩種影音互動裝置。其一互動方式為藉由參與者的肢體擺動改變兩燈源所產生之全像片變圖的頻率，攝影機即時擷取判讀後改變音樂播放的頻率；另一互動方式為以單一光源於不同入射方位角形成的流動效果，攝影機即時擷取全像片顯示影像之變化，經系統判讀後改變音樂播出的節拍，形成新的互動音樂表現型態。本研究以跨領域整合數位影像處理、全像科技、音樂演奏播放及音訊處理，以互動方式將點矩陣全像片賦予新的媒體表現型態。The objective of this research is to develop two hologram-based real-time interactive systems. One system is based on the “image switch” visual effect with the diffractive light from a dot matrix hologram. The participants can interact with audio through two light sources in different incident directions in turns to make the dot matrix hologram displays “image switch” in different colors. The other one is based on the “flow dynamic” visual effect with the diffractive light from a dot matrix hologram. These two systems synthesize audio with different pitches and tempos in accordance with the diffractive light from a dot matrix hologram. As the single light source projects on the dot matrix hologram in different angles, the hologram will display dynamic flow with the lighting orientates. The other system will synthesize audio in different tempos according to the position of the lighting. The two real-time interactive systems have great potential to be new musical expression interfaces. The research has successfully integrated with the fundamental theories of different sciences and technologies, such as optics、digital image processing、musical performance and digital signal processing.