CLUSTERING SURGEMES USING PROTOTYPES FROM ROBOTIC KINEMATIC INFORMATION

Authors

  • Safaa Albasri Electrical Engineering and Computer Science, University of Missouri-Columbia, Columbia, MO 65211 USA https://orcid.org/0000-0002-5130-5600
  • Omar Ibrahim Electrical Engineering and Computer Science, University of Missouri-Columbia, Columbia, MO 65211 USA
  • Mihail Popescu Health Management and Informatics, University of Missouri-Columbia, Columbia, MO 65211 USA
  • James Keller Electrical Engineering and Computer Science, University of Missouri-Columbia, Columbia, MO 65211 USA

DOI:

https://doi.org/10.31272/jeasd.26.5.3

Keywords:

RMIS, FCM, Ward, Rand Index, Surgical Gestures, Kinematic Data, Clustering, DTW

Abstract

Training a surgeon to be skilled and competent to perform a given surgical procedure is essential in providing a high quality of care and reducing the risk of complications. However, existing training techniques limit us from conducting in-depth analyses of surgical motions to evaluate these skills accurately. We develop a method to identify the gestures by applying unsupervised methods to cluster the surgical activities learned directly from raw kinematic data. We design an unsupervised method to determine the surgical motions in a Suturing procedure based on predefined surgical gestures. The first step is to find the prototypes by clustering the surgemes of the expert surgeon from all the same expert trials. Then, we map the other surgeons surgemes to the nearest representative of the prototypes and report the clustering accuracy by employing the rand index technique. We utilize four techniques in our proposed unsupervised approach for gesture clustering based on Hierarchical and FCM algorithms. In addition, we highlight the advantages of representing time series data before clustering in terms of computation time saving and system complexity reduction, respectively.

References

I. Surgical. https://www.intuitive.com/en-us (accessed.

Y. Gao, S. S. Vedula, G. I. Lee, M. R. Lee, S. Khudanpur, and G. D. Hager, "Unsupervised surgical data alignment with application to automatic activity annotation," 2016: IEEE, doi: 10.1109/icra.2016.7487608. [Online]. Available: https://dx.doi.org/10.1109/icra.2016.7487608

M. J. Fard, "Computational modeling approaches for task analysis in robotic-assisted surgery," Wayne State University, 2016.

J. Reason, Human error. Cambridge university press, 1990.

F. Despinoy et al., "Unsupervised trajectory segmentation for surgical gesture recognition in robotic training," IEEE Transactions on Biomedical Engineering, vol. 63, no. 6, pp. 1280-1291, 2015.

R. Dipietro and G. D. Hager, "Unsupervised Learning for Surgical Motion by Learning to Predict the Future," Springer International Publishing, 2018, pp. 281-288.

M. J. Fard, S. Ameri, R. B. Chinnam, and R. D. Ellis, "Soft Boundary Approach for Unsupervised Gesture Segmentation in Robotic-Assisted Surgery," IEEE Robotics and Automation Letters, vol. 2, no. 1, pp. 171-178, 2017, doi: 10.1109/lra.2016.2585303.

A. Murali et al., "TSC-DL: Unsupervised trajectory segmentation of multi-modal surgical demonstrations with Deep Learning," 2016: IEEE, doi: 10.1109/icra.2016.7487607. [Online]. Available: https://dx.doi.org/10.1109/icra.2016.7487607

S. Hirano and S. Tsumoto, "Empirical comparison of clustering methods for long time-series databases," in Active Mining: Springer, 2005, pp. 268-286.

T. Oates, M. D. Schmill, and P. R. Cohen, "A method for clustering the experiences of a mobile robot that accords with human judgments," in AAAI/IAAI, 2000, pp. 846-851.

S. Theodoridis and K. Koutroumbas, "Pattern recognition, edition," ed: Academic Press, fourth edition Edition, 2009.

J. M. Keller, D. Liu, and D. B. Fogel, Fundamentals of computational intelligence: neural networks, fuzzy systems, and evolutionary computation. John Wiley & Sons, 2016.

S. Albasri, M. Popescu, and J. Keller, "A Novel Distance for Automated Surgical Skill Evaluation," in 2019 E-Health and Bioengineering Conference (EHB), 2019: IEEE, pp. 1-6.

S. Salvador and P. Chan, "Toward accurate dynamic time warping in linear time and space," Intelligent Data Analysis, vol. 11, no. 5, pp. 561-580, 2007.

S. Albasri, M. Popescu, and J. Keller, "Surgery Task Classification Using Procrustes Analysis," in 2019 IEEE Applied Imagery Pattern Recognition Workshop (AIPR), 2019: IEEE, pp. 1-6.

Y. Gao et al., "Jhu-isi gesture and skill assessment working set (jigsaws): A surgical activity dataset for human motion modeling," in Miccai workshop: M2cai, 2014, vol. 3, p. 3.

M. Chiş, S. Banerjee, and A. E. Hassanien, "Clustering time series data: an evolutionary approach," in Foundations of Computational, IntelligenceVolume 6: Springer, 2009, pp. 193-207.

W. M. Rand, "Objective criteria for the evaluation of clustering methods," Journal of the American Statistical association, vol. 66, no. 336, pp. 846-850, 1971.

U. Maulik and S. Bandyopadhyay, "Performance evaluation of some clustering algorithms and validity indices," IEEE Transactions on pattern analysis and machine intelligence, vol. 24, no. 12, pp. 1650-1654, 2002.

T. Caliński and J. Harabasz, "A dendrite method for cluster analysis," Communications in Statistics-theory and Methods, vol. 3, no. 1, pp. 1-27, 1974.

X. L. Xie and G. Beni, "A validity measure for fuzzy clustering," IEEE Transactions on pattern analysis and machine intelligence, vol. 13, no. 8, pp. 841-847, 1991.

L. Van der Maaten and G. Hinton, "Visualizing data using t-SNE," Journal of machine learning research, vol. 9, no. 11, 2008.

Downloads

Published

2022-09-01

How to Cite

Albasri, S., Omar Ibrahim, Mihail Popescu, & James Keller. (2022). CLUSTERING SURGEMES USING PROTOTYPES FROM ROBOTIC KINEMATIC INFORMATION . Journal of Engineering and Sustainable Development, 26(5), 22–34. https://doi.org/10.31272/jeasd.26.5.3