‘Eyeharp’ gaze-control software allows people with disabilities to play music

Eyeharp music software
Alexandra Kerlidou, 21, who suffers from cerebral palsy, plays the "Eyeharp", a gaze-controlled digital software that allows people with disabilities to play music, next to computer scientist Zacharias Vamvakousis, during a concert in Athens, Greece, June 14, 2021. Picture taken June 14, 2021. REUTERS/Alkis Konstantinidis

ATHENS, (Reuters) – Alexandra Kerlidou sits in her wheelchair on stage in Athens. With only the shift of her eyes across a computer screen, the 21-year-old fills the air with harp music.

The student with cerebral palsy, who cannot use her hands or speak, is playing the “Eyeharp”, gaze-controlled digital software which allows people with disabilities to play music, something she had never thought possible.

“I felt strange, I had never imagined such a thing,” said Alexandra, using a speech-generating computer program as she described trying the “Eyeharp” for the first time in her home on Lesbos with creator Zacharias Vamvakousis. 

A computer scientist and musician, Vamvakousis was inspired to create the program after a musician friend was hurt in a motorcycle accident shortly before they were to play a concert together. 

“At the beginning it was not clear whether he would be able to move his arms, his hands, and play music again,” said Vamvakousis of his friend, who played the Cretan lyra. “It was a shock for me and I realized there is a need for this kind of technology.”

The digital eye-tracking technology, widely used in gaming, security and medicine, monitors eye movements to perform commands. The eye rests on each musical note spaced out on a wheel on the screen and on average can play three to four notes per second. The program can “play” 25 musical instruments.

“Without doing it digitally this would never be possible to play music in real time,” Vamvakousis said. “It takes away the actual action of strumming a chord.”

The program needs discipline and concentration, he says, as one has to keep the eyes from wandering too quickly to the next note, but students are thrilled when they hear their efforts.     

“Most of the children first start with the drum sound just to make noise, just to interact with the environment right now,” said Vamvakousis.

He has taught the program in special-needs schools in Barcelona, where he studied, and says more than 2,000 people have downloaded the program.  

Due to the pandemic he currently teaches online, mostly children with cerebral palsy, but the program is also designed for those with muscular dystrophy, limb amputation, quadriplegia or spinal cord injury.

“I cried, her mother too,” said Kerlidou’s father Anastasios after his daughter first played the Eyeharp. 

Alexandra, who wants to work in computer programming after finishing school, likes popular Greek songs and the piano. She couldn’t imagine life without music.

“When I am sad, or happy, I put on music,” she says.

(Reporting and writing by Deborah Kyvrikosaios, editing by James Mackenzie and Giles Elgood)

Related article:

Be the first to comment

What do you think?

This site uses Akismet to reduce spam. Learn how your comment data is processed.