Upper Airway Classification in Sleep Endoscopy Examinations using Convolutional Recurrent Neural Networks

Publikation: Bidrag til bog/antologi/rapportKonferencebidrag i proceedingsForskningfagfællebedømt

Dokumenter

  • Fulltext

    Forlagets udgivne version, 3 MB, PDF-dokument

  • Umaer Hanif
  • Eric Kezirian
  • Eva Kirkegaard Kiar
  • Emmanuel Mignot
  • Helge B.D. Sorensen
  • Jennum, Poul

Assessing the upper airway (UA) of obstructive sleep apnea patients using drug-induced sleep endoscopy (DISE) before potential surgery is standard practice in clinics to determine the location of UA collapse. According to the VOTE classification system, UA collapse can occur at the velum (V), oropharynx (O), tongue (T), and/or epiglottis (E). Analyzing DISE videos is not trivial due to anatomical variation, simultaneous UA collapse in several locations, and video distortion caused by mucus or saliva. The first step towards automated analysis of DISE videos is to determine which UA region the endoscope is in at any time throughout the video: V (velum) or OTE (oropharynx, tongue, or epiglottis). An additional class denoted X is introduced for times when the video is distorted to an extent where it is impossible to determine the region. This paper is a proof of concept for classifying UA regions using 24 annotated DISE videos. We propose a convolutional recurrent neural network using a ResNet18 architecture combined with a two-layer bidirectional long short-term memory network. The classifications were performed on a sequence of 5 seconds of video at a time. The network achieved an overall accuracy of 82% and F1-score of 79% for the three-class problem, showing potential for recognition of regions across patients despite anatomical variation. Results indicate that large-scale training on videos can be used to further predict the location(s), type(s), and degree(s) of UA collapse, showing potential for derivation of automatic diagnoses from DISE videos eventually.

OriginalsprogEngelsk
Titel2021 43rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2021
ForlagIEEE
Publikationsdato2021
Sider3957-3960
ISBN (Elektronisk)9781728111797
DOI
StatusUdgivet - 2021
Begivenhed43rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2021 - Virtual, Online, Mexico
Varighed: 1 nov. 20215 nov. 2021

Konference

Konference43rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2021
LandMexico
ByVirtual, Online
Periode01/11/202105/11/2021
SponsorElsevier, The Institution of Engineering and Technology (IET)
NavnProceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
ISSN1557-170X

Bibliografisk note

Funding Information:
Research has been supported by the Klarman Family Foundation, Stanford University, Technical University of Denmark, and Rigshospitalet with supporting grants from Danmark-Amerika Fondet

Publisher Copyright:
© 2021 IEEE.

ID: 304302369