Children with severe cerebral palsy have been successfully testing the keyboard system. That neurological condition often causes involuntary spasms, making it especially challenging to get the software and camera tracker to work. But the children have been able to use the keyboard successfully and have found it therapeutic, Van Dusen says. “Many of the children were more focused on their movements because they were motivated by the sounds they were creating,” he says. One student has used the keyboard to jam with other musicians over the Internet.
So far, the system has been used to produce piano sounds and percussion, though a fully synthesized orchestra could follow. Wide commercial distribution is probably several years away, says Van Dusen, who has graduated and is now working on Wall Street. Researchers at RPI, led by Van Dusen’s former research professor, Pauline Oliveros, continue to refine the tracking device and are trying to broaden the scope of the project to include games and robotic instruments that would operate off of the same keyboard and tracker. That would be sweet music indeed for the disabled.
