Here is a video test of the Wii controlling sample selection in Logic.
Unlike the Nintendo conductor game, this system uses acceleration and orientation data to control the Mac’s selection of string sounds in real time. In other words, for example, when I make large gestures, samples of musicians playing loudly are used. In addition to controlling the volume of the sounds, the timbre of particular sounds is determined by dynamically selecting the sounds the musicians originally played.