Registration of physical space to laparoscopic image space for use in minimally invasive hepatic surgery

James D. Stefansic, Alan Joseph Herline, Yu Shyr, William C. Chapman, J. Michael Fitzpatrick, Benoit M. Dawant, Robert L. Galloway

Research output: Contribution to journalArticle

48 Citations (Scopus)

Abstract

While laparoscopes are used for numerous minimally invasive (MI) procedures, MI liver resection and ablative surgery is infrequently performed. The paucity of cases is due to the restriction of the field of view by the laparoscope and the difficulty in determining tumor location and margins under video guidance. By merging MI surgery with interactive, image-guided surgery (IIGS), we hope to overcome localization difficulties present in laparoscopic liver procedures. One key component of any IIGS system is the development of accurate registration techniques to map image space to physical or patient space. This manuscript focuses on the accuracy and analysis of the direct linear transformation (DLT) method to register physical space with laparoscopic image space on both distorted and distortion-corrected video images. Experiments were conducted on a liver-sized plastic phantom affixed with 20 markers at various depths. After localizing the points in both physical and laparoscopic image space, registration accuracy was assessed for different combinations and numbers of control points (n) to determine the quantity necessary to develop a robust registration matrix. For n = 11, average target registration error (TRE) was 0.70±0.20 mm. We also studied the effects of distortion correction on registration accuracy. For the particular distortion correction method and laparoscope used in our experiments, there was no statistical significance between physical to image registration error for distorted and corrected images. In cases where a minimum number of control points (n = 6) are acquired, the DLT is often not stable and the mathematical process can lead to high TRE values. Mathematical filters developed through the analysis of the DLT were used to prospectively eliminate outlier cases where the TRE was high. For n = 6, prefilter average TRE was 17.4±153 mm for all trials; when the filters were applied, average TRE decreased to 1.64±1.10 mm for the remaining trials.

Original languageEnglish (US)
Pages (from-to)1012-1023
Number of pages12
JournalIEEE Transactions on Medical Imaging
Volume19
Issue number10
DOIs
StatePublished - Oct 1 2000

Fingerprint

Minimally Invasive Surgical Procedures
Laparoscopes
Surgery
Laparoscopy
Computer-Assisted Surgery
Linear transformations
Liver
Plastics
Image registration
Merging
Tumors
Experiments
Neoplasms

ASJC Scopus subject areas

  • Software
  • Radiological and Ultrasound Technology
  • Computer Science Applications
  • Electrical and Electronic Engineering

Cite this

Stefansic, J. D., Herline, A. J., Shyr, Y., Chapman, W. C., Fitzpatrick, J. M., Dawant, B. M., & Galloway, R. L. (2000). Registration of physical space to laparoscopic image space for use in minimally invasive hepatic surgery. IEEE Transactions on Medical Imaging, 19(10), 1012-1023. https://doi.org/10.1109/42.887616

Registration of physical space to laparoscopic image space for use in minimally invasive hepatic surgery. / Stefansic, James D.; Herline, Alan Joseph; Shyr, Yu; Chapman, William C.; Fitzpatrick, J. Michael; Dawant, Benoit M.; Galloway, Robert L.

In: IEEE Transactions on Medical Imaging, Vol. 19, No. 10, 01.10.2000, p. 1012-1023.

Research output: Contribution to journalArticle

Stefansic, JD, Herline, AJ, Shyr, Y, Chapman, WC, Fitzpatrick, JM, Dawant, BM & Galloway, RL 2000, 'Registration of physical space to laparoscopic image space for use in minimally invasive hepatic surgery', IEEE Transactions on Medical Imaging, vol. 19, no. 10, pp. 1012-1023. https://doi.org/10.1109/42.887616
Stefansic, James D. ; Herline, Alan Joseph ; Shyr, Yu ; Chapman, William C. ; Fitzpatrick, J. Michael ; Dawant, Benoit M. ; Galloway, Robert L. / Registration of physical space to laparoscopic image space for use in minimally invasive hepatic surgery. In: IEEE Transactions on Medical Imaging. 2000 ; Vol. 19, No. 10. pp. 1012-1023.
@article{c0984e35986e4a6dad8a81f8c980b659,
title = "Registration of physical space to laparoscopic image space for use in minimally invasive hepatic surgery",
abstract = "While laparoscopes are used for numerous minimally invasive (MI) procedures, MI liver resection and ablative surgery is infrequently performed. The paucity of cases is due to the restriction of the field of view by the laparoscope and the difficulty in determining tumor location and margins under video guidance. By merging MI surgery with interactive, image-guided surgery (IIGS), we hope to overcome localization difficulties present in laparoscopic liver procedures. One key component of any IIGS system is the development of accurate registration techniques to map image space to physical or patient space. This manuscript focuses on the accuracy and analysis of the direct linear transformation (DLT) method to register physical space with laparoscopic image space on both distorted and distortion-corrected video images. Experiments were conducted on a liver-sized plastic phantom affixed with 20 markers at various depths. After localizing the points in both physical and laparoscopic image space, registration accuracy was assessed for different combinations and numbers of control points (n) to determine the quantity necessary to develop a robust registration matrix. For n = 11, average target registration error (TRE) was 0.70±0.20 mm. We also studied the effects of distortion correction on registration accuracy. For the particular distortion correction method and laparoscope used in our experiments, there was no statistical significance between physical to image registration error for distorted and corrected images. In cases where a minimum number of control points (n = 6) are acquired, the DLT is often not stable and the mathematical process can lead to high TRE values. Mathematical filters developed through the analysis of the DLT were used to prospectively eliminate outlier cases where the TRE was high. For n = 6, prefilter average TRE was 17.4±153 mm for all trials; when the filters were applied, average TRE decreased to 1.64±1.10 mm for the remaining trials.",
author = "Stefansic, {James D.} and Herline, {Alan Joseph} and Yu Shyr and Chapman, {William C.} and Fitzpatrick, {J. Michael} and Dawant, {Benoit M.} and Galloway, {Robert L.}",
year = "2000",
month = "10",
day = "1",
doi = "10.1109/42.887616",
language = "English (US)",
volume = "19",
pages = "1012--1023",
journal = "IEEE Transactions on Medical Imaging",
issn = "0278-0062",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "10",

}

TY - JOUR

T1 - Registration of physical space to laparoscopic image space for use in minimally invasive hepatic surgery

AU - Stefansic, James D.

AU - Herline, Alan Joseph

AU - Shyr, Yu

AU - Chapman, William C.

AU - Fitzpatrick, J. Michael

AU - Dawant, Benoit M.

AU - Galloway, Robert L.

PY - 2000/10/1

Y1 - 2000/10/1

N2 - While laparoscopes are used for numerous minimally invasive (MI) procedures, MI liver resection and ablative surgery is infrequently performed. The paucity of cases is due to the restriction of the field of view by the laparoscope and the difficulty in determining tumor location and margins under video guidance. By merging MI surgery with interactive, image-guided surgery (IIGS), we hope to overcome localization difficulties present in laparoscopic liver procedures. One key component of any IIGS system is the development of accurate registration techniques to map image space to physical or patient space. This manuscript focuses on the accuracy and analysis of the direct linear transformation (DLT) method to register physical space with laparoscopic image space on both distorted and distortion-corrected video images. Experiments were conducted on a liver-sized plastic phantom affixed with 20 markers at various depths. After localizing the points in both physical and laparoscopic image space, registration accuracy was assessed for different combinations and numbers of control points (n) to determine the quantity necessary to develop a robust registration matrix. For n = 11, average target registration error (TRE) was 0.70±0.20 mm. We also studied the effects of distortion correction on registration accuracy. For the particular distortion correction method and laparoscope used in our experiments, there was no statistical significance between physical to image registration error for distorted and corrected images. In cases where a minimum number of control points (n = 6) are acquired, the DLT is often not stable and the mathematical process can lead to high TRE values. Mathematical filters developed through the analysis of the DLT were used to prospectively eliminate outlier cases where the TRE was high. For n = 6, prefilter average TRE was 17.4±153 mm for all trials; when the filters were applied, average TRE decreased to 1.64±1.10 mm for the remaining trials.

AB - While laparoscopes are used for numerous minimally invasive (MI) procedures, MI liver resection and ablative surgery is infrequently performed. The paucity of cases is due to the restriction of the field of view by the laparoscope and the difficulty in determining tumor location and margins under video guidance. By merging MI surgery with interactive, image-guided surgery (IIGS), we hope to overcome localization difficulties present in laparoscopic liver procedures. One key component of any IIGS system is the development of accurate registration techniques to map image space to physical or patient space. This manuscript focuses on the accuracy and analysis of the direct linear transformation (DLT) method to register physical space with laparoscopic image space on both distorted and distortion-corrected video images. Experiments were conducted on a liver-sized plastic phantom affixed with 20 markers at various depths. After localizing the points in both physical and laparoscopic image space, registration accuracy was assessed for different combinations and numbers of control points (n) to determine the quantity necessary to develop a robust registration matrix. For n = 11, average target registration error (TRE) was 0.70±0.20 mm. We also studied the effects of distortion correction on registration accuracy. For the particular distortion correction method and laparoscope used in our experiments, there was no statistical significance between physical to image registration error for distorted and corrected images. In cases where a minimum number of control points (n = 6) are acquired, the DLT is often not stable and the mathematical process can lead to high TRE values. Mathematical filters developed through the analysis of the DLT were used to prospectively eliminate outlier cases where the TRE was high. For n = 6, prefilter average TRE was 17.4±153 mm for all trials; when the filters were applied, average TRE decreased to 1.64±1.10 mm for the remaining trials.

UR - http://www.scopus.com/inward/record.url?scp=0034287382&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0034287382&partnerID=8YFLogxK

U2 - 10.1109/42.887616

DO - 10.1109/42.887616

M3 - Article

VL - 19

SP - 1012

EP - 1023

JO - IEEE Transactions on Medical Imaging

JF - IEEE Transactions on Medical Imaging

SN - 0278-0062

IS - 10

ER -