Banca de DEFESA: DIEGO RAMON BEZERRA DA SILVA

Uma banca de DEFESA de DOUTORADO foi cadastrada pelo programa.
STUDENT : DIEGO RAMON BEZERRA DA SILVA
DATE: 20/12/2024
TIME: 09:00
LOCAL: Sala de Reuniões do DCA
TITLE:

A deep learning-based architecture with attention mechanisms for continuous translation of Brazilian Sign Language in contexts without interpreters

KEY WORDS:

Accessibility, Libras, Deep Learning, Sequence-to-sequence, Machine Translation.

PAGES: 99
BIG AREA: Ciências Exatas e da Terra
AREA: Ciência da Computação
SUBÁREA: Metodologia e Técnicas da Computação
SPECIALTY: Processamento Gráfico (Graphics)
SUMMARY:

In Brazil, the deaf represent about 5\% of the population approximately 9.7 million Brazilians. Despite the Brazilian Sign Language (Libras) being recognized as an official language in Brazil, the knowledge and mastery of Libras among the non-deaf is an obstacle, which ends up creating language barriers in accessing basic rights, especially in accessing health services. This has motivated the development of government policies that oblige service providers to provide Libras interpreters to enable access to these services by the deaf community. However, human-based approaches have a high implementation and maintenance cost. From this perspective, it is necessary to develop research and automated methodologies for automatic translation of Libras. Thus in this work, we proposed a methodology for continuous translation of Libras. The proposed methodology does not require any additional hardware, relying entirely on images or image sequences (videos). In addition, a new dataset for Continuous Sign Language Recognition (CSLR) was introduced, containing 10500 videos of 105 distinct sentences in the context of clinical screening. The evaluation experiments achieve a WER of 21.62, while maximum accuracy of about 92.68\% for a set of tests with videos and signers never seen by the model during training.

COMMITTEE MEMBERS:
Presidente - 1345674 - LUIZ MARCOS GARCIA GONCALVES
Externo ao Programa - 1170845 - BRUNO MARQUES FERREIRA DA SILVA - UFRNExterno à Instituição - GUIDO LEMOS DE SOUZA FILHO - UFPB
Externo à Instituição - TIAGO MARITAN UGULINO DE ARAUJO - UFPB
Externa à Instituição - VIRGINIA PINTO CAMPOS - UFPB