Novel low memory footprint DNN models for edge classification of surgeons’ postures

Skill assessment is fundamental to enhance current laparoscopic surgical training and reduce the incidence of musculoskeletal injuries from performing these procedures. Recently, deep neural networks (DNNs) have been used to improve human posture and surgeons’ skills training. While they work well i...

Full description

Saved in:
Bibliographic Details
Main Authors: Alex Hanneman, Terry Fawden, Marco Branciforte, Maria Celvisia Virzi, Esther L Moss, Luciano Ost, Massimiliano Zecca
Format: Default Article
Published: 2022
Subjects:
Online Access:https://hdl.handle.net/2134/20415477.v1
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Skill assessment is fundamental to enhance current laparoscopic surgical training and reduce the incidence of musculoskeletal injuries from performing these procedures. Recently, deep neural networks (DNNs) have been used to improve human posture and surgeons’ skills training. While they work well in lab, they normally require significant computational power which makes it impossible to use them on edge devices. This paper presents two low memory footprint DNN models used for classifying laparoscopic surgical skill levels at the edge. Trained models were deployed on three Arm Cortex-M processors using the X-Cube-AI and TensorFlow Lite Micro (TFLM) libraries. Results show that the CUBE-AI-based models give the best relative performance, memory footprint, and accuracy trade-offs when executed on the Cortex-M7.