Award Abstract # 1563805
RI: Medium: Active Sensing, Localization, and Mapping in Dynamic Deformable Environments for Image-Guided Interventions
NSF Org: |
IIS
Division of Information & Intelligent Systems
|
Recipient: |
CASE WESTERN RESERVE UNIVERSITY
|
Initial Amendment Date:
|
April 19, 2016 |
Latest Amendment Date:
|
May 10, 2024 |
Award Number: |
1563805 |
Award Instrument: |
Continuing Grant |
Program Manager: |
Andy Duan
yduan@nsf.gov
(703)292-4286
IIS
Division of Information & Intelligent Systems
CSE
Directorate for Computer and Information Science and Engineering
|
Start Date: |
August 1, 2016 |
End Date: |
July 31, 2025 (Estimated) |
Total Intended Award
Amount: |
$1,000,000.00 |
Total Awarded Amount to
Date: |
$1,056,000.00 |
Funds Obligated to Date:
|
FY 2016 = $281,055.00
FY 2017 = $726,945.00
FY 2018 = $8,000.00
FY 2019 = $16,000.00
FY 2020 = $8,000.00
FY 2022 = $16,000.00
|
History of Investigator:
|
-
Cenk
Cavusoglu
(Principal Investigator)
mcc14@case.edu
-
Michael
Branicky
(Co-Principal Investigator)
-
Mark
Griswold
(Co-Principal Investigator)
-
Nicole
Seiberlich
(Co-Principal Investigator)
|
Recipient Sponsored Research
Office: |
Case Western Reserve University
10900 EUCLID AVE
CLEVELAND
OH
US
44106-4901
(216)368-4510
|
Sponsor Congressional
District: |
11
|
Primary Place of
Performance: |
Case Western Reserve University
10900 Euclid Ave
Cleveland
OH
US
44106-7221
|
Primary Place of
Performance Congressional District: |
11
|
Unique Entity Identifier
(UEI): |
HJMKEF7EJW69
|
Parent UEI: |
|
NSF Program(s): |
Robust Intelligence
|
Primary Program Source:
|
01001920DB NSF RESEARCH & RELATED ACTIVIT
01002223DB NSF RESEARCH & RELATED ACTIVIT
01001718DB NSF RESEARCH & RELATED ACTIVIT
01002021DB NSF RESEARCH & RELATED ACTIVIT
01001819DB NSF RESEARCH & RELATED ACTIVIT
01001617DB NSF RESEARCH & RELATED ACTIVIT
|
Program Reference
Code(s): |
7495,
9251,
7924
|
Program Element Code(s):
|
749500
|
Award Agency Code: |
4900
|
Fund Agency Code: |
4900
|
Assistance Listing
Number(s): |
47.070
|
ABSTRACT

This study aims to address two important research problems in realizing intelligent robotic systems for image-guided needle and catheter based surgical interventions. The first research thrust focuses on localization and tracking of flexible instruments and anatomical targets during the surgical intervention using medical imaging. Algorithms for robustly tracking the instrument, target tissue, and other relevant anatomical structures, including obstacles and anatomical structures that need to be avoided, under noisy, incomplete sensor measurements are essential for the robotic system for successfully performing the procedure. The second research thrust aims to develop algorithms for dynamically controlling the medical imaging system during the procedure. The goal is to minimize the number of sensor measurements, and hence reduce costs associated with sensing, while still obtaining sufficient sensing information. This project will have direct broad societal impacts in healthcare, by developing technologies that will improve percutaneous interventions, which are widely used for both diagnostic and therapeutic applications.
The purpose of the present study is the development of methods for active control of intra-operative medical imaging systems for localization and tracking of instruments and anatomical structures during percutaneous interventions. Specifically, the research will focus on development of algorithms for active localization and mapping in dynamic deformable environments, and active sensing algorithms for dynamically controlling intra-operative imaging system. The developed technologies will be realized in hardware and validated in benchtop experimental studies on a clinical interventional magnetic resonance imaging system using real-time magnetic resonance imaging techniques. The intellectual merit of the project comes from the scientific contributions to the fields of robotics and medical imaging as well as a synergistic integration of the two technologies.
PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:
When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external
site maintained by the publisher. Some full text articles may not yet be available without a
charge during the embargo (administrative interval).
Some links on this page may take you to non-federal websites. Their policies may differ from
this site.
(Showing: 1 - 10 of 44)
(Showing: 1 - 44 of 44)
E. E. Tuna, and M. C. Cavusoglu
"Localization of Point-of-Interest Positions on Cardiac Surface for Robotic-Assisted Beating Heart Surgery"
Proceedings of the 43rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC 2021)
, 2021
E. E. Tuna, D. Franson, N. Seiberlich, and M. C. Cavusoglu
"Deformable Cardiac Surface Tracking by Adaptive Estimation Algorithms"
Scientific Reports
, v.13
, 2023
10.1038/s41598-023-28578-0
E. E. Tuna, N. Lombard Poirot, D. Franson, S. Huang, N. Seiberlich, M. Griswold, and M. Cenk Cavusoglu
"MRI Distortion Correction and Robot-to-MRI Scanner Registration for an MRI-Guided Robotic Catheter System."
IEEE Access
, 2022
10.1109/ACCESS.2022.3207156
E. E. Tuna, N. Lombard Poirot, J. Barrera Bayona, D. Franson, S. Huang, J. Narvaez, N. Seiberlich, M. Griswold, M. C. Cavusoglu
"Differential Image Based Robot to MRI Scanner Registration with Active Fiducial Markers for an MRI-Guided Robotic Catheter System"
Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2020)
, 2020
10.1109/IROS45743.2020.9341043
E. E. Tuna, T. Liu, R. Jackson, N. Lombard Poirot, M. Russell, and M. C. Cavusoglu
"Analysis of Dynamic Response of an MRI-Guided Magnetically-Actuated Steerable Catheter System"
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2018)
, 2018
Greigarn, Tipakorn and Jackson, Russell and Cavusoglu, M. Cenk
"State Estimation for MRI-Actuated Cathers via Catadioptric Stereo Camera"
Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2018)
, 2018
10.1109/IROS.2018.8594153
Citation
Details
Greigarn, Tipakorn and Jackson, Russell and Liu, Taoming and Cavusoglu, M. Cenk
"Experimental validation of the pseudo-rigid-body model of the MRI-actuated catheter"
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA 2017)
, 2017
10.1109/ICRA.2017.7989414
Citation
Details
Greigarn, Tipakorn and Poirot, Nate Lombard and Xu, Xinyang and Cavusoglu, M. Cenk
"Jacobian-Based Task-Space Motion Planning for MRI-Actuated Continuum Robots"
IEEE Robotics and Automation Letters
, v.4
, 2019
10.1109/LRA.2018.2881987
Citation
Details
Hao, Ran and Çavuolu, M. Cenk
"A Probabilistic Approach for Contact Stability and Contact Safety Analysis of Robotic Intracardiac Catheter"
Journal of Dynamic Systems, Measurement, and Control
, v.143
, 2021
https://doi.org/10.1115/1.4050692
Citation
Details
Hao, Ran and Erdem Tuna, E. and Çavuolu, M. Cenk
"Contact Stability and Contact Safety of a Magnetic Resonance Imaging-Guided Robotic Catheter Under Heart Surface Motion"
Journal of Dynamic Systems, Measurement, and Control
, v.143
, 2021
https://doi.org/10.1115/1.4049837
Citation
Details
Hao, RanPoirot
"Analysis of Contact Stability and Contact Safety of a Robotic Intravascular Cardiac Catheter under Blood Flow Disturbances"
Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2020)
, 2020
https://doi.org/10.1109/IROS45743.2020.9341527
Citation
Details
H. Su, K.-W. Kwok, K. Cleary, I. Iordachita, M. C. Cavusoglu, J. Desai, G. S. Fischer
"State of the Art and Future Opportunities in MRI Guided Robot-Assisted Surgery and Interventions"
Proceedings of the IEEE
, v.110
, 2022
10.1109/JPROC.2022.3169146
Liu, Taoming and Jackson, Russell and Franson, Dominique and Lombard Poirot, Nate and Criss, Reinhardt Kam and Seiberlich, Nicole and Griswold, Mark A. and Cavusoglu, M. Cenk
"Iterative Jacobian-Based Inverse Kinematics and Open-Loop Control of an MRI-Guided Magnetically-Actuated Steerable Catheter System"
IEEE/ASME Transactions on Mechatronics
, 2017
10.1109/TMECH.2017.2704526
Citation
Details
Liu, Taoming and Lombard Poirot, Nate and Greigarn, Tipakorn and Cenk Çavusoglu, M.
"Design of a Magnetic Resonance Imaging Guided Magnetically Actuated Steerable Catheter"
Journal of Medical Devices
, v.11
, 2017
10.1115/1.4036095
Citation
Details
Lu, Su and Shkurti, Thomas and Cavusoglu, M. Cenk
"Dual-Arm Needle Manipulation with the da Vinci ® Surgical Robot"
Proceedings of the International Symposium on Medical Robotics (ISMR 2020)
, 2020
https://doi.org/10.1109/ISMR48331.2020.9312930
Citation
Details
Lu, Su and Shkurti, Thomas and Cavusoglu, M. Cenk
"Dual-Arm Needle Manipulation with the da Vinci ® Surgical Robot Under Uncertainty"
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA 2021)
, 2021
https://doi.org/10.1109/ICRA48506.2021.9562054
Citation
Details
M. Renfrew, M. Griswold, and M. C. Cavusoglu
"Active Localization and Tracking of Needle and Target in Robotic Image-Guided Intervention Systems"
Autonomous Robots
, 2018
10.1007/s10514-017-9640-2
O. Ozguner, R. Hao, R. Jackson, T. Shkurti, W. S. Newman, and M. C. Cavusoglu
"Three-Dimensional Surgical Needle Localization and Tracking Using Stereo Endoscopic Image Streams"
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA 2018)
, 2018
O. Ozguner, T. Shkurti, S. Huang, R. Hao, R. C. Jackson, W. Newman, and M. C. Cavusoglu
"Camera-Robot Calibration for the da Vinci Robotic Surgery System"
IEEE Transactions on Automation Science and Engineering
, 2020
10.1109/TASE.2020.2986503
O. Ozguner, T. Shkurti, S. Lu, W. S. Newman, M. C. Cavusoglu
"Visually Guided Needle Driving and Pull for Autonomous Suturing"
Proceedings of the IEEE International Conference on Automation Science and Engineering (CASE 2021)
, 2021
Ozguner, Orhan and Shkurti, Tom and Lu, Su and Newman, Wyatt and Cavusoglu, M. Cenk
"Visually Guided Needle Driving and Pull for Autonomous Suturing"
Proceedings of the IEEE International Conference on Automation Science and Engineering (CASE 2021)
, 2021
https://doi.org/10.1109/CASE49439.2021.9551453
Citation
Details
Ozguner, OrhanHao
"Three-Dimensional Surgical Needle Localization and Tracking Using Stereo Endoscopic Image Streams"
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA 2018)
, 2018
https://doi.org/10.1109/ICRA.2018.8460867
Citation
Details
Renfrew, Mark and Griswold, Mark and Cavusoglu, M. Cenk
"Active localization and tracking of needle and target in robotic image-guided intervention systems"
Autonomous Robots
, 2017
10.1007/s10514-017-9640-2
Citation
Details
R. Hao, and M. C. Cavusoglu
"Homology-Class Guided Rapidly-Exploring Random Tree For Belief Space Planning"
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2022)
, 2022
10.1109/IROS47612.2022.9981602
R. Hao, E.E. Tuna, M. C. Cavusoglu
"Contact Stability and Contact Safety of a Magnetic Resonance Imaging-Guided Robotic Catheter under Cardiac Surface Motion"
ASME Journal of Dynamical Systems, Measurement, and Control
, 2021
10.1115/1.4049837
R. Hao, M. C. Cavusoglu
"A Probabilistic Approach for Contact Stability and Contact Safety Analysis of Robotic Intracardiac Catheter"
ASME Journal of Dynamical Systems, Measurement, and Control
, 2021
10.1115/1.4050692
R. Hao, N. Lombard Poirot, M. C. Cavusoglu
"Analysis of Contact Stability and Contact Safety of a Robotic Intravascular Cardiac Catheter under Blood Flow Disturbances"
Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2020)
, 2020
10.1109/IROS45743.2020.9341527
R. Hao, O. Ozguner, and M. C. Cavusoglu
"Vision-Based Surgical Tool Pose Estimation for the da Vinci Robotic Surgical System"
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2018)
, 2018
R. Hao, T. Greigarn, and M. C. Cavusoglu
"Contact Stability of Magnetically-Actuated Robotic Catheter Under Surface Motion"
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA 2020)
, 2020
10.1109/ICRA40945.2020.9196951
R. Hao, Y. Itsarachaiyot, and M. C. Cavusoglu
"Bayesian Optimization Based Preprocedural Planning for Robotic Left Atrial Appendage Occlusion"
Proceedings of the International Symposium on Medical Robotics (ISMR 2024)
, 2024
R. Jackson, R. Yuan, D.-L. Chow, W. Newman, and M. C. Cavusoglu
"Real-Time Visual Tracking of Dynamic Surgical Suture Threads"
IEEE Transactions on Automation Science and Engineering
, v.15
, 2018
10.1109/TASE.2017.2726689
S. Lu, T. Shkurti, and M. C. Cavusoglu
"Dual-Arm Needle Manipulation with the da Vinci® Surgical Robot under Uncertainty"
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA 2021)
, 2021
S. Lu, T. Shkurti, M. C. Cavusoglu
"Dual-Arm Needle Manipulation with the da Vinci (R) Surgical Robot"
Proceedings of the International Symposium on Medical Robotics (ISMR 2020)
, 2020
10.1109/ISMR48331.2020.9312930
T. Greigarn and M. C. Cavusoglu
"Active Sensing for Continuous State and Action Spaces via Task-Action Entropy Minimization"
Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2016), Deajeon, South Korea
, 2016
, p.4678
10.1109/IROS.2016.7759688
T. Greigarn, M.S. Branicky, and M. C. Cavusoglu
"Task-Oriented Active Sensing via Action Entropy Minimization"
IEEE Access
, 2019
10.1109/ACCESS.2019.2941706
T. Greigarn, N. Lombard Poirot, X. Xu, and M. C. Cavusoglu
"Jacobian-Based Task-Space Motion Planning for MRI-Actuated Continuum Robots"
Robotics and Automation Letters
, v.4
, 2019
, p.145
10.1109/LRA.2018.2881987
T. Greigarn, R. Jackson, and M. C. Cavusoglu
"State Estimation for MRI-Actuated Catheters via Catadioptric Stereo Camera"
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2018)
, 2018
10.1109/IROS.2018.8594153
T. Greigarn, R. Jackson, T. Liu, M. C. Cavusoglu
"Experimental Validation of the Pseudo-Rigid-Body Model of the MRI-Actuated Catheter"
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA 2017), Singapore, May 29-June 3, 2017
, 2017
, p.3600
T. Liu, N. Lombard Poirot, T. Greigarn and M. C. Cavusoglu
"Design of an MRI-Guided Magnetically-Actuated Steerable Catheter"
ASME Journal of Medical Devices
, v.11
, 2017
10.1115/1.4036095
T. Liu, R. Jackson, D. Franson, N. Lombard Poirot, R. K. Criss, N. Seiberlich, M. A. Griswold and M. C. Cavusoglu
"Jacobian-Based Inverse Kinematics and Open-Loop Control of an MRI-Guided Magnetically-Actuated Steerable Catheter System"
IEEE/ASME Transactions on Mechatronics
, 2017
10.1109/TMECH.2017.2704526
T. Shkurti, A. Nahari, W. Newman, M. C. Cavusoglu
"Precision Camera Calibration Using Known Target Motions along Three Perpendicular Axes"
Optical Engineering
, v.63
, 2024
, p.024101
10.1117/1.OE.63.2.024101
Tuna, E. ErdemLombard
"Differential Image Based Robot to MRI Scanner Registration with Active Fiducial Markers for an MRI-Guided Robotic Catheter System"
Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2020)
, 2020
https://doi.org/10.1109/IROS45743.2020.9341043
Citation
Details
Y. Itsarachaiyot, R. Hao, and M. C. Cavusoglu
"Analytical Computation of the Contact Force Jacobian for MRI-Actuated Robotic Catheter"
Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2023)
, 2023
10.1109/IROS55552.2023.10342418
(Showing: 1 - 10 of 44)
(Showing: 1 - 44 of 44)
Please report errors in award information by writing to: awardsearch@nsf.gov.