Skip to main content

It’s more than just a game: UOWD students use Xbox’s Kinect technology to create Sign Language teaching tool

Thursday, 07 May, 2015

Although many may associate Microsoft’s Kinect system with dance games, sports challenges and living-room fitness fads, final year Computer Science students from the University of Wollongong in Dubai have shown that the Xbox sensor-based technology has a capacity to change lives.

SAMA – a language learning program created by UOWD students Rohit Jaggi, Shuji Sheefeeqh and Hassan Belo, uses the technology to teach sign-language to both the hearing and non-hearing community, offering a dynamic system which gives feedback, picks up mistakes from the user and teaches progressively with online lessons and tests.

With an expandable database of signs, the software allows any organization or individual to use SAMA to teach and learn any type of sign language, be it Emirati Sign Language, American Sign Language or British Sign Language.

“Using clever pattern recognition, we have managed to develop an algorithm that can now compare two gestures and return feedback on the accuracy of the gestures,” said Rohit Jaggi, team member of SAMA project. “With this algorithm, we have developed the software to allow individuals to learn sign language on their own, without the help of another person.”

“From our research we realized that very few of the deaf community are employed” added team leader Shuji Shafiq. “This kind of technology would help them and companies to be more integrated into the community, helping them to work and develop. With around 8 million deaf people in the region alone, our work has the capacity to make a real impact on people’s lives – many of who are either unemployed or in low-paid jobs due to their disability.”

“The project started off as an ambitious attempt at making use of a common gaming technology for the greater community,” commented Dr Zeenath Reza Khan, lecturer and supervisor of the project at UOWD. “But the students have really taken on the challenge and been working hard to acquire and develop the algorithm needed to make Kinect read hands, motion and fingers in order to be able to enhance its application to include sign languages.”

The innovative program is already capturing the imagination of the media, speech and language professionals and the research community alike. Duo Rohit Jaggi and Shuji Shefeeqh recently captured the attention of the judges to win the Best Poster Presentation at the 7th Annual Undergraduate Research Conference hosted by Zayed University, Dubai Academic City.

Competing against more than 500 students who were representing 33 universities from across the region with 123 poster presentations, the team’s design was one of just eight of which were declared  top projects by a panel of expert judges.

Timothy Peck, the Program Executive at IBM MEA University Relations, who gave the keynote speech at the conference, was impressed with the project and hailed the students for their efforts. Dr Abdullah Mohammed Almuhaideb, Vice Dean of Academic Affairs, Chairman of Computer Science Department and Assistant Professor at King Faisal University commented, “this project has real potential for real applications, not just to teach sign language, but also to allow those with hearing impairment to communicate with ease… it can be developed to become a sign language translator to be used in airports, hotel industries and so on.”


UOWD in the news

Bodour Al Qasimi promotes Mohammed Al Musharrakh to CEO of ‘Invest in Sharjah’

By Gulf Today, Gulf News, Total UAE

Mohammed Juma Al Musharrakh had been appointed Chief Executive Officer of the Sharjah FDI Office (Invest in Sharjah). More...

UOWD hosts inaugural Middle East CASE Conference

By Yahind

Conference supports advancement of education in the region through shared insights and knowledge. More...

Indian Billionaire B. R. Shetty Is Now Venturing Into Higher Education

By Dubai Forum, Wealth-X

After building a healthcare empire in the U.A.E., Abu Dhabi-based Indian billionaire B. R. Shetty is entering the region’s lucrative higher education sector. More...

Sarra scoops multiple honours in rowing and swimming

By Khaleej Times, The Middle East North Africa Financial Network

Rising sporting star Sarra Lajnef continues to excel in rowing and swimming championships in the region. More...

Dubai Electronic Security Center Receives Overwhelming Interest From Regional and Global Universities For The AED 700,000 ‘Innovation In Cyber Security Award' Competition

By Dubai PR Network, Total UAE, The Middle East North Africa Financial Network

Call for submission for the ‘Innovation In Cyber Security Award’ has earned overwhelming response from regional and global universities. More...

UOWD logistics students tour Jebel Ali Port in Dubai

By Arabian Industry, Dubai Forum

The Master of Science in Logistics at UOWD has been running in the UAE for the last 10 years and is one of the region’s most popular postgraduate courses. More...

Career focus need not stymie personal advancement

By Gulf News Smart Edition

Commitment to study runs deep in employed aspirants, experts say. More...

Most postgraduate students are working people

By Gulf News,

Most of the postgraduate students in the UAE are working people, said universities in the UAE. More...

Chairman Of Dubai-Based University Awarded Order Of Australia

By UAE Today, YaHind, Dubai Forum, Dubai Informer, Go Dubai

Peter Robson, Chairman of the University of Wollongong in Dubai’s, UOWD, Board, has been awarded the Order of Australia, OA. More...

9th Sustainable Development & Inclusive Growth Congress discusses ways to achieve global sustainability

By Go Dubai

Congress focused on the need to follow the principles of sustainable development and inclusive growth to meet global challenges and global sustainability More...

Copyright © 2018 University of Wollongong in Dubai   | Privacy | Disclaimer | Site map