Signing Outside the Studio: Benchmarking Background Robustness for Continuous Sign Language Recognition
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Jang, Youngjoon | - |
dc.contributor.author | Oh, Youngtaek | - |
dc.contributor.author | Cho, Jae Won | - |
dc.contributor.author | Kim, Dong Jin | - |
dc.contributor.author | Chung, Joon Son | - |
dc.contributor.author | Kweon, In So | - |
dc.date.accessioned | 2023-08-07T07:50:43Z | - |
dc.date.available | 2023-08-07T07:50:43Z | - |
dc.date.created | 2023-07-20 | - |
dc.date.issued | 2022-11 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/188941 | - |
dc.description.abstract | The goal of this work is background-robust continuous sign language recognition. Most existing Continuous Sign Language Recognition (CSLR) benchmarks have fixed backgrounds and are filmed in studios with a static monochromatic background. However, signing is not limited only to studios in the real world. In order to analyze the robustness of CSLR models under background shifts, we first evaluate existing state-of-the-art CSLR models on diverse backgrounds. To synthesize the sign videos with a variety of backgrounds, we propose a pipeline to automatically generate a benchmark dataset utilizing existing CSLR benchmarks. Our newly constructed benchmark dataset consists of diverse scenes to simulate a real-world environment. We observe even the most recent CSLR method cannot recognize glosses well on our new dataset with changed backgrounds. In this regard, we also propose a simple yet effective training scheme including (1) background randomization and (2) feature disentanglement for CSLR models. The experimental results on our dataset demonstrate that our method generalizes well to other unseen background data with minimal additional training images. | - |
dc.language | 영어 | - |
dc.language.iso | en | - |
dc.publisher | British Machine Vision Association (BMVA) | - |
dc.title | Signing Outside the Studio: Benchmarking Background Robustness for Continuous Sign Language Recognition | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Kim, Dong Jin | - |
dc.identifier.doi | 10.48550/arXiv.2211.00448 | - |
dc.identifier.bibliographicCitation | British Machine Vision Conference, pp.1 - 23 | - |
dc.relation.isPartOf | British Machine Vision Conference | - |
dc.citation.title | British Machine Vision Conference | - |
dc.citation.startPage | 1 | - |
dc.citation.endPage | 23 | - |
dc.type.rims | ART | - |
dc.type.docType | Proceeding | - |
dc.description.journalClass | 3 | - |
dc.description.isOpenAccess | N | - |
dc.description.journalRegisteredClass | other | - |
dc.identifier.url | https://arxiv.org/abs/2211.00448 | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
222, Wangsimni-ro, Seongdong-gu, Seoul, 04763, Korea+82-2-2220-1365
COPYRIGHT © 2021 HANYANG UNIVERSITY.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.