architecture

跟踪式增强现实显示器的实时自校准


摘要

目的:尽管已有研究提出将增强现实系统应用于图像引导下的穿刺介入治疗,但受限于便携性差、显示刷新率低以及校准流程繁琐等因素,此类系统尚未在临床实践中得到广泛应用。为此,我们提出了一种基于手持式平板电脑的自校准图像叠加系统。

方法:我们利用一台平板电脑和一面半透半反镜,构建了一个模块化的手持式增强现实观察盒。我们设计了一种无需借助任何临时标记物即可实现系统精确校准的、具有一致性和高精度的自校准方法。通过光学姿态追踪器,系统可同时追踪附着在观察盒及患者体表的标记物,从而实时反馈患者相对于显示图像平面的空间位置信息。该系统的软件部分基于开源应用平台 3D Slicer 的 SlicerIGT 扩展模块及 PLUS 工具包进行开发。

结果:在图像引导下的穿刺介入治疗场景中,该图像叠加系统的准确性测试结果显示:在图像叠加平面内,其平均绝对位置误差为 0.99 mm(第 95 百分位数为 1.93 mm);在图像叠加平面外,其平均绝对位置误差为 0.61 mm(第 95 百分位数为 1.19 mm)。对于肌肉骨骼注射等各类临床操作中的器械引导而言,这一精度水平在临床上是可接受的。

结论:本研究针对一种具备追踪功能增强现实显示设备,开发并评估了一种自校准方法。研究结果表明,此类手持式图像叠加系统在涉及图像引导穿刺介入治疗的临床研究中,具有广阔的应用潜力。

Real-time self-calibration of a tracked augmented reality display
Zachary BaumAndras LassoTamas UngiGabor Fichtinger
Abstract
PURPOSE: Augmented reality systems have been proposed for image-guided needle interventions but they have not become widely used in clinical practice due to restrictions such as limited portability, low display refresh rates, and tedious calibration procedures. We propose a handheld tablet-based self-calibrating image overlay system.

METHODS: A modular handheld augmented reality viewbox was constructed from a tablet computer and a semi-transparent mirror. A consistent and precise self-calibration method, without the use of any temporary markers, was designed to achieve an accurate calibration of the system. Markers attached to the viewbox and patient are simultaneously tracked using an optical pose tracker to report the position of the patient with respect to a displayed image plane that is visualized in real-time. The software was built using the open-source 3D Slicer application platform's SlicerIGT extension and the PLUS toolkit.

RESULTS: The accuracy of the image overlay with image-guided needle interventions yielded a mean absolute position error of 0.99 mm (95th percentile 1.93 mm) in-plane of the overlay and a mean absolute position error of 0.61 mm (95th percentile 1.19 mm) out-of-plane. This accuracy is clinically acceptable for tool guidance during various procedures, such as musculoskeletal injections.

CONCLUSION: A self-calibration method was developed and evaluated for a tracked augmented reality display. The results show potential for the use of handheld image overlays in clinical studies with image-guided needle interventions.