Projects

Music Recommendation for hard of hearing people

Hard-of-hearing people who like music can listen to broader genres of music if we can recommend music that is easy to hear.

We experimented on timbre preference and its audibility online.  The results show that the ” recorder ” timbre is more complicated to hear than others. We also examined the audio features to compare the subjective evaluation and found that “entropy” affects the easiness of hearing.

20K20811 (Grant-in-Aid for Challenging Research (Exploratory), 2020-2023)

Music Training for Deaf and hard-of-hearing people for listening to non-verbal sounds

With a synthetic, fun music game, Deaf and hard-of-hearing people concentrate on “listening to sounds” to get used to non-verbal sounds.

We developed a new training system that is easy to customize for purposes such as improving timbre or tempo recognition discrimination.

This is the extension of the past research of Promote active listening with music games

21H00884 (Grant-in-Aid for Scientific Research (B), 2021-2024)

Which music timbres are good for hard of hearing people?

Some music instruments are easy/comfort to listen to, some not. Which instruments, the combination of instruments are good to hard of hearing people?

The Mitsubishi Foundation Research Grants for Social Welfare 2019Fall

Projects by profoundly deaf students

With deaf and hard of hearing students of Tsukuba University of Technology (NTUT) for years, we understand there are many deaf and hard of hearing youth who like music. Some are eager for listening to environmental sounds with which we could perceive seasonal flavors or approaching hazards. My research themes are inspired their interest.

  • Finding out instruments for music classes
    • Nakahara, Y., Hiraga, R., and Kato, N.:A subjective evaluation of music beat recognition with different timbres by hearing-impaired people, ICCHP  2018 , LNCS vol. 10896, Computers Helping People with Special Needs, pp. 207-210.
  • Proposing vibration for singing at Karaoke
  • Learning environmental sound
    • Kato, Y., Hiraga, R., Wakatsuki, D., and Yasu, K: A preliminary observation on the effect of visual information in learning environmental sounds for deaf and hard of hearing people, ICCHP 2018, LNCS vol. 10896, Computers Helping People with Special Needs, pp. 183-186.
    • Rumi Hiraga, Yuu Kato, Masaki Matsubara, Hiroko Terasawa, and Kei Tabaru: A Learning System for Environmental Sounds on Tablets:
      toward a teaching resource for deaf and hard of hearing children, Universal Learning Design Symposium, 31-34, 2016.

ISeee

  • Information support at sports viewing.

past projects

  • Emotion recognition