Proposed workflow. The audiological analysis proceeds through audiogram detection and color separation. Following this, symbol detection and axis label recognition occur ...
Abstract:
An audiogram records the hearing status, including each hearing threshold at multiple frequencies. While deep learning is gradually maturing in the clinical research appr...Show MoreMetadata
Abstract:
An audiogram records the hearing status, including each hearing threshold at multiple frequencies. While deep learning is gradually maturing in the clinical research approach, audiologists could speed up their diagnostic process with audiogram digitization for handwritten graphs or electronically generated images from instruments. However, given the diversity of audiogram symbols and formats, the existing audiogram digitization model has room for improvement in recognition accuracy. We propose a multi-stage workflow to enhance accuracy by integrating YOLOv5 and the optical character recognition (OCR) model. Our proposed audiogram digitization model could identify all audiogram symbols with an accuracy rate of 98%. We hope that this model could help future research in audiology.
Proposed workflow. The audiological analysis proceeds through audiogram detection and color separation. Following this, symbol detection and axis label recognition occur ...
Published in: IEEE Access ( Volume: 12)
Funding Agency:
Graduate Institute of Networking and Multimedia, National Taiwan University, Taipei, Taiwan
Ta-Wei Yang received the B.S. degree in computer science and information engineering from National Taiwan University, Taipei, Taiwan, in 2012, the M.S. degree from the Institute of Computer Science and Engineering, National Chiao Tung University, Hsinchu, Taiwan, in 2014, and the Ph.D. degree from the Graduate Institute of Networking and Multimedia, National Taiwan University, in 2024. His research interests include machi...Show More
Ta-Wei Yang received the B.S. degree in computer science and information engineering from National Taiwan University, Taipei, Taiwan, in 2012, the M.S. degree from the Institute of Computer Science and Engineering, National Chiao Tung University, Hsinchu, Taiwan, in 2014, and the Ph.D. degree from the Graduate Institute of Networking and Multimedia, National Taiwan University, in 2024. His research interests include machi...View more
Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan
Chen-Yu Yang received the B.S. degree in computer science and information engineering from National Chiao-Tung University, Hsinchu, Taiwan, in 2019, and the M.S. degree in computer science and information engineering from National Taiwan University, Taipei, Taiwan, in 2023. Her current research interests include machine learning and biomedical information.
Chen-Yu Yang received the B.S. degree in computer science and information engineering from National Chiao-Tung University, Hsinchu, Taiwan, in 2019, and the M.S. degree in computer science and information engineering from National Taiwan University, Taipei, Taiwan, in 2023. Her current research interests include machine learning and biomedical information.View more
Department of Otolaryngology, National Taiwan University Hospital Hsin-Chu Branch, Hsinchu, Taiwan
Hearing and Speech Center, National Taiwan University Hospital, Taipei, Taiwan
Yen-Hui Lee received the M.D. degree from National Taiwan University, Taipei, Taiwan, in 2017. He completed the residency training with the Department of Otolaryngology, National Taiwan University Hospital, Taipei, Taiwan. He is currently an attending Physician with the Department of Otolaryngology, National Taiwan University Hospital Hsin-Chu Branch, Hsinchu, Taiwan. His research interests include clinical otolaryngology...Show More
Yen-Hui Lee received the M.D. degree from National Taiwan University, Taipei, Taiwan, in 2017. He completed the residency training with the Department of Otolaryngology, National Taiwan University Hospital, Taipei, Taiwan. He is currently an attending Physician with the Department of Otolaryngology, National Taiwan University Hospital Hsin-Chu Branch, Hsinchu, Taiwan. His research interests include clinical otolaryngology...View more
Department of Otolaryngology, National Taiwan University Hospital, Taipei, Taiwan
Department of Otolaryngology, MacKay Memorial Hospital, Taipei, Taiwan
Department of Audiology and Speech-Language Pathology, Mackay Medical College, New Taipei City, Taiwan
Pey-Yu Chen received the M.D. degree from Chang Gung University, in 2010. She completed the residency training with the Department of Otolaryngology, National Taiwan University Hospital. She is currently an attending Physician with the Department of Otolaryngology, MacKay Memorial Hospital, and also an Assistant Professor with the Department of Audiology and Speech-Language Pathology, Mackay Medical College. Her clinical ...Show More
Pey-Yu Chen received the M.D. degree from Chang Gung University, in 2010. She completed the residency training with the Department of Otolaryngology, National Taiwan University Hospital. She is currently an attending Physician with the Department of Otolaryngology, MacKay Memorial Hospital, and also an Assistant Professor with the Department of Audiology and Speech-Language Pathology, Mackay Medical College. Her clinical ...View more
Department of Otolaryngology, National Taiwan University Hospital, Taipei, Taiwan
Graduate Institute of Clinical Medicine, College of Medicine, National Taiwan University, Taipei, Taiwan
Pei-Hsuan Lin received the M.D. degree from the National Taiwan University College of Medicine (NTUCM), in 2010. She is currently pursuing the Ph.D. degree with the Graduate Institute of Clinical Medicine, NTUCM. She completed the residency training from the Department of Otolaryngology, National Taiwan University Hospital (NTUH), in 2015. She is also an attending Physician with the Department of Otolaryngology, NTUH, and...Show More
Pei-Hsuan Lin received the M.D. degree from the National Taiwan University College of Medicine (NTUCM), in 2010. She is currently pursuing the Ph.D. degree with the Graduate Institute of Clinical Medicine, NTUCM. She completed the residency training from the Department of Otolaryngology, National Taiwan University Hospital (NTUH), in 2015. She is also an attending Physician with the Department of Otolaryngology, NTUH, and...View more
Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan
Wei-Cheng Wu received the B.S. degree in interdisciplinary program of electrical engineering and computer science from National Central University, Zhongli, Taiwan, in 2022. He is currently pursuing the M.S. degree in computer science and information engineering with National Taiwan University, Taipei, Taiwan. His research interests include machine learning and Intelligence health.
Wei-Cheng Wu received the B.S. degree in interdisciplinary program of electrical engineering and computer science from National Central University, Zhongli, Taiwan, in 2022. He is currently pursuing the M.S. degree in computer science and information engineering with National Taiwan University, Taipei, Taiwan. His research interests include machine learning and Intelligence health.View more
Department of Otolaryngology, National Taiwan University Hospital, Taipei, Taiwan
Department of Medical Genetics, National Taiwan University Hospital, Taipei, Taiwan
Department of Medical Research, National Taiwan University Hospital Hsin-Chu Branch, Hsinchu, Taiwan
Chen-Chi Wu received the M.D. degree from NTUCM, in 1999, and the master’s and Ph.D. degrees from the Graduate Institute of Clinical Medicine, NTUCM, in 2004 and 2010, respectively. He received the residency training with the Department of Otolaryngology, NTUH. From 2012 to 2013, he was trained as a Postdoctoral Research Fellow of molecular genetics of deafness with Massachusetts Eye and Ear Infirmary, Harvard Medical Sch...Show More
Chen-Chi Wu received the M.D. degree from NTUCM, in 1999, and the master’s and Ph.D. degrees from the Graduate Institute of Clinical Medicine, NTUCM, in 2004 and 2010, respectively. He received the residency training with the Department of Otolaryngology, NTUH. From 2012 to 2013, he was trained as a Postdoctoral Research Fellow of molecular genetics of deafness with Massachusetts Eye and Ear Infirmary, Harvard Medical Sch...View more
Graduate Institute of Networking and Multimedia, National Taiwan University, Taipei, Taiwan
Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan
Cheng-Fu Chou received the M.S. and Ph.D. degrees in computer science from the University of Maryland, College Park, in 1999 and 2002, respectively. After his graduation, he joined the Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan, where he is currently a Professor. He was the Director of the Information Technology office, National Taiwan University Hospital, from A...Show More
Cheng-Fu Chou received the M.S. and Ph.D. degrees in computer science from the University of Maryland, College Park, in 1999 and 2002, respectively. After his graduation, he joined the Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan, where he is currently a Professor. He was the Director of the Information Technology office, National Taiwan University Hospital, from A...View more
Contents Graduate Institute of Networking and Multimedia, National Taiwan University, Taipei, Taiwan
Ta-Wei Yang received the B.S. degree in computer science and information engineering from National Taiwan University, Taipei, Taiwan, in 2012, the M.S. degree from the Institute of Computer Science and Engineering, National Chiao Tung University, Hsinchu, Taiwan, in 2014, and the Ph.D. degree from the Graduate Institute of Networking and Multimedia, National Taiwan University, in 2024. His research interests include machine learning, wireless networks, and the related performance evaluation.
Ta-Wei Yang received the B.S. degree in computer science and information engineering from National Taiwan University, Taipei, Taiwan, in 2012, the M.S. degree from the Institute of Computer Science and Engineering, National Chiao Tung University, Hsinchu, Taiwan, in 2014, and the Ph.D. degree from the Graduate Institute of Networking and Multimedia, National Taiwan University, in 2024. His research interests include machine learning, wireless networks, and the related performance evaluation.View more
Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan
Chen-Yu Yang received the B.S. degree in computer science and information engineering from National Chiao-Tung University, Hsinchu, Taiwan, in 2019, and the M.S. degree in computer science and information engineering from National Taiwan University, Taipei, Taiwan, in 2023. Her current research interests include machine learning and biomedical information.
Chen-Yu Yang received the B.S. degree in computer science and information engineering from National Chiao-Tung University, Hsinchu, Taiwan, in 2019, and the M.S. degree in computer science and information engineering from National Taiwan University, Taipei, Taiwan, in 2023. Her current research interests include machine learning and biomedical information.View more
Department of Otolaryngology, National Taiwan University Hospital Hsin-Chu Branch, Hsinchu, Taiwan
Hearing and Speech Center, National Taiwan University Hospital, Taipei, Taiwan
Yen-Hui Lee received the M.D. degree from National Taiwan University, Taipei, Taiwan, in 2017. He completed the residency training with the Department of Otolaryngology, National Taiwan University Hospital, Taipei, Taiwan. He is currently an attending Physician with the Department of Otolaryngology, National Taiwan University Hospital Hsin-Chu Branch, Hsinchu, Taiwan. His research interests include clinical otolaryngology, genomics of deafness, and neuro-otology.
Yen-Hui Lee received the M.D. degree from National Taiwan University, Taipei, Taiwan, in 2017. He completed the residency training with the Department of Otolaryngology, National Taiwan University Hospital, Taipei, Taiwan. He is currently an attending Physician with the Department of Otolaryngology, National Taiwan University Hospital Hsin-Chu Branch, Hsinchu, Taiwan. His research interests include clinical otolaryngology, genomics of deafness, and neuro-otology.View more
Department of Otolaryngology, National Taiwan University Hospital, Taipei, Taiwan
Department of Otolaryngology, MacKay Memorial Hospital, Taipei, Taiwan
Department of Audiology and Speech-Language Pathology, Mackay Medical College, New Taipei City, Taiwan
Pey-Yu Chen received the M.D. degree from Chang Gung University, in 2010. She completed the residency training with the Department of Otolaryngology, National Taiwan University Hospital. She is currently an attending Physician with the Department of Otolaryngology, MacKay Memorial Hospital, and also an Assistant Professor with the Department of Audiology and Speech-Language Pathology, Mackay Medical College. Her clinical interest lies in pediatric otology, hereditary hearing loss, cochlear implantation, and hearing (re)habilitation. Her research interests include genetics of deafness, cochlear implantation, speech, and language development of deaf and tinnitus.
Pey-Yu Chen received the M.D. degree from Chang Gung University, in 2010. She completed the residency training with the Department of Otolaryngology, National Taiwan University Hospital. She is currently an attending Physician with the Department of Otolaryngology, MacKay Memorial Hospital, and also an Assistant Professor with the Department of Audiology and Speech-Language Pathology, Mackay Medical College. Her clinical interest lies in pediatric otology, hereditary hearing loss, cochlear implantation, and hearing (re)habilitation. Her research interests include genetics of deafness, cochlear implantation, speech, and language development of deaf and tinnitus.View more
Department of Otolaryngology, National Taiwan University Hospital, Taipei, Taiwan
Graduate Institute of Clinical Medicine, College of Medicine, National Taiwan University, Taipei, Taiwan
Pei-Hsuan Lin received the M.D. degree from the National Taiwan University College of Medicine (NTUCM), in 2010. She is currently pursuing the Ph.D. degree with the Graduate Institute of Clinical Medicine, NTUCM. She completed the residency training from the Department of Otolaryngology, National Taiwan University Hospital (NTUH), in 2015. She is also an attending Physician with the Department of Otolaryngology, NTUH, and a Clinical Instructor with NTUCM. Her clinical interest lies in hearing loss, tinnitus, middle ear, and endoscopic ear surgery. Her research interests include genetics and pathophysiology of pediatric hearing loss and auditory neuropathy.
Pei-Hsuan Lin received the M.D. degree from the National Taiwan University College of Medicine (NTUCM), in 2010. She is currently pursuing the Ph.D. degree with the Graduate Institute of Clinical Medicine, NTUCM. She completed the residency training from the Department of Otolaryngology, National Taiwan University Hospital (NTUH), in 2015. She is also an attending Physician with the Department of Otolaryngology, NTUH, and a Clinical Instructor with NTUCM. Her clinical interest lies in hearing loss, tinnitus, middle ear, and endoscopic ear surgery. Her research interests include genetics and pathophysiology of pediatric hearing loss and auditory neuropathy.View more
Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan
Wei-Cheng Wu received the B.S. degree in interdisciplinary program of electrical engineering and computer science from National Central University, Zhongli, Taiwan, in 2022. He is currently pursuing the M.S. degree in computer science and information engineering with National Taiwan University, Taipei, Taiwan. His research interests include machine learning and Intelligence health.
Wei-Cheng Wu received the B.S. degree in interdisciplinary program of electrical engineering and computer science from National Central University, Zhongli, Taiwan, in 2022. He is currently pursuing the M.S. degree in computer science and information engineering with National Taiwan University, Taipei, Taiwan. His research interests include machine learning and Intelligence health.View more
Department of Otolaryngology, National Taiwan University Hospital, Taipei, Taiwan
Department of Medical Genetics, National Taiwan University Hospital, Taipei, Taiwan
Department of Medical Research, National Taiwan University Hospital Hsin-Chu Branch, Hsinchu, Taiwan
Chen-Chi Wu received the M.D. degree from NTUCM, in 1999, and the master’s and Ph.D. degrees from the Graduate Institute of Clinical Medicine, NTUCM, in 2004 and 2010, respectively. He received the residency training with the Department of Otolaryngology, NTUH. From 2012 to 2013, he was trained as a Postdoctoral Research Fellow of molecular genetics of deafness with Massachusetts Eye and Ear Infirmary, Harvard Medical School, under the supervision of Prof. Konstantina Stankovic. He is currently an attending Physician with the Department of Otolaryngology, National Taiwan University Hospital (NTUH), and a Professor with the National Taiwan University College of Medicine (NTUCM). He is also the Head of the Cochlear Implantation Program, NTUH, and the Director of the Department of Medical Research and the Department of Otolaryngology–Head and Neck Surgery, National Taiwan University Hospital Hsin-Chu Branch. His clinical interest lies in pediatric otology, cochlear implantation, endoscopic ear surgery, and lateral skull base surgery. His research interests include genetics of deafness, cochlear implantation, minimally-invasive ear surgery, and molecular diagnostics/therapeutics of inner ear diseases. His team has been dedicated to the early detection, diagnosis, and management of childhood hearing impairment over the past 15 years. His previous and current work includes clinical genetic studies, translational studies, and basic animal studies, covering a wide but continuous range of research interests in this field. He has been extensively involved in numerous international academic societies. He is also a Board Member of Asia Pacific Symposium on Cochlear Implant and Related Sciences (APSCI) and an Active Member of American Academy of Otolaryngology-Head and Neck Surgery (AAO-HNSF), the Association for Research in Otolaryngology (ARO), American Society of Human Genetics (ASHG), the Barany Society, the International Otopathology Society, and the Politzer Society. He was just approved as a member of the prestigious Collegium Oto-Rhino-Laryngologicum Amicitiae Sacrum (CORLAS) in 2022.
Chen-Chi Wu received the M.D. degree from NTUCM, in 1999, and the master’s and Ph.D. degrees from the Graduate Institute of Clinical Medicine, NTUCM, in 2004 and 2010, respectively. He received the residency training with the Department of Otolaryngology, NTUH. From 2012 to 2013, he was trained as a Postdoctoral Research Fellow of molecular genetics of deafness with Massachusetts Eye and Ear Infirmary, Harvard Medical School, under the supervision of Prof. Konstantina Stankovic. He is currently an attending Physician with the Department of Otolaryngology, National Taiwan University Hospital (NTUH), and a Professor with the National Taiwan University College of Medicine (NTUCM). He is also the Head of the Cochlear Implantation Program, NTUH, and the Director of the Department of Medical Research and the Department of Otolaryngology–Head and Neck Surgery, National Taiwan University Hospital Hsin-Chu Branch. His clinical interest lies in pediatric otology, cochlear implantation, endoscopic ear surgery, and lateral skull base surgery. His research interests include genetics of deafness, cochlear implantation, minimally-invasive ear surgery, and molecular diagnostics/therapeutics of inner ear diseases. His team has been dedicated to the early detection, diagnosis, and management of childhood hearing impairment over the past 15 years. His previous and current work includes clinical genetic studies, translational studies, and basic animal studies, covering a wide but continuous range of research interests in this field. He has been extensively involved in numerous international academic societies. He is also a Board Member of Asia Pacific Symposium on Cochlear Implant and Related Sciences (APSCI) and an Active Member of American Academy of Otolaryngology-Head and Neck Surgery (AAO-HNSF), the Association for Research in Otolaryngology (ARO), American Society of Human Genetics (ASHG), the Barany Society, the International Otopathology Society, and the Politzer Society. He was just approved as a member of the prestigious Collegium Oto-Rhino-Laryngologicum Amicitiae Sacrum (CORLAS) in 2022.View more
Graduate Institute of Networking and Multimedia, National Taiwan University, Taipei, Taiwan
Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan
Cheng-Fu Chou received the M.S. and Ph.D. degrees in computer science from the University of Maryland, College Park, in 1999 and 2002, respectively. After his graduation, he joined the Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan, where he is currently a Professor. He was the Director of the Information Technology office, National Taiwan University Hospital, from August 2019 to July 2023. He has been the Director of the Computer and Information Networking Center, National Taiwan University, since August 2023. From June 2002 to September 2002 and 2017 August to July 2018, he was a Visiting Scholar with the Department of Computer Science, University of Southern California, Los Angeles. His current research interests include distributed machine learning systems, wireless networks, multimedia systems, and their performance evaluations. In November 2020, he was elected as a member of the IFIP WG7.3 on Computer Performance Modeling and Analysis.
Cheng-Fu Chou received the M.S. and Ph.D. degrees in computer science from the University of Maryland, College Park, in 1999 and 2002, respectively. After his graduation, he joined the Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan, where he is currently a Professor. He was the Director of the Information Technology office, National Taiwan University Hospital, from August 2019 to July 2023. He has been the Director of the Computer and Information Networking Center, National Taiwan University, since August 2023. From June 2002 to September 2002 and 2017 August to July 2018, he was a Visiting Scholar with the Department of Computer Science, University of Southern California, Los Angeles. His current research interests include distributed machine learning systems, wireless networks, multimedia systems, and their performance evaluations. In November 2020, he was elected as a member of the IFIP WG7.3 on Computer Performance Modeling and Analysis.View more