Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Fully automatic three-dimensional visualization of intravascular optical coherence tomography images: methods and feasibility in vivo

Open Access Open Access

Abstract

Intravascular optical coherence tomography (IV-OCT) is an imaging modality that can be used for the assessment of intracoronary stents. Recent publications pointed to the fact that 3D visualizations have potential advantages compared to conventional 2D representations. However, 3D imaging still requires a time consuming manual procedure not suitable for on-line application during coronary interventions. We propose an algorithm for a rapid and fully automatic 3D visualization of IV-OCT pullbacks. IV-OCT images are first processed for the segmentation of the different structures. This also allows for automatic pullback calibration. Then, according to the segmentation results, different structures are depicted with different colors to visualize the vessel wall, the stent and the guide-wire in details. Final 3D rendering results are obtained through the use of a commercial 3D DICOM viewer. Manual analysis was used as ground-truth for the validation of the segmentation algorithms. A correlation value of 0.99 and good limits of agreement (Bland Altman statistics) were found over 250 images randomly extracted from 25 in vivo pullbacks. Moreover, 3D rendering was compared to angiography, pictures of deployed stents made available by the manufacturers and to conventional 2D imaging corroborating visualization results. Computational time for the visualization of an entire data sets resulted to be ~74 sec. The proposed method allows for the on-line use of 3D IV-OCT during percutaneous coronary interventions, potentially allowing treatments optimization.

©2012 Optical Society of America

1. Introduction

Intravascular optical coherence tomography (IV-OCT) is a catheter based imaging modality for the visualization of coronary arteries [1]. Since its inception, IV-OCT is increasingly being used during percutaneous coronary intervention (PCI) to improve the understanding of the anatomy of complex lesions and to elucidate the mechanisms of atherosclerosis. When compared to other vascular imaging modalities, IV-OCT presents an axial resolution (~10-15 µm) improved of approximately one order of magnitude than intravascular ultrasound (IVUS) (>100 µm), coronary angiography (~200 µm) and computed tomography (CT) (>300 µm) [2]. This exceptional resolution makes IV-OCT the most suitable imaging modality for the visualization of small intraluminal structures such as thrombus [3], atherosclerotic plaques, vessel dissections and coronary stent struts [4].

Recent publications pointed to the fact that three dimensional (3D) IV-OCT visualization has potential advantages compared to conventional two dimensional (2D) image representation [58]. It was shown that 3D IV-OCT may be of help for a better characterization of stent malapposition and identification of thrombus, guiding stent post-dilation and aspiration thrombectomy [9]. Moreover, it allows for the assessment of jailed side branches and for the rewiring of a side-branch ostium during percutaneous coronary intervention (PCI) minimizing the risk of floating struts [5,6,8]. Given that this is not something easily achievable with conventional 2D imaging, potential applications of 3D IV-OCT for the management of acute myocardial infarction have been identified.

As indicated by [5,8], the major pitfall of 3D visualization is that image preparation currently has to be done manually. To apply 3D IV-OCT to stent assessment, each stent strut needs to be manually identified and segmented on every image. This results in a labor intensive and time-consuming procedure (i.e., >3 hours per pullback [10]) making the approach not suitable for on-line application during PCI or for large scale use in clinical trials. In fact, the clinical need of a tool for automatic 3D IV-OCT visualization is underlined by several publications [8,11,12]. In particular, the team of Serruys stated that the potential of three-dimensional IV-OCT is real as a complimentary tool to 2D IV-OCT, if available as ‘push-of-a-button’ at the time of the data acquisition [5]. A similar statement was made by the team of Akasaka, underlining the fact that automatic 3D visualization would bring IV-OCT closer to becoming a practical imaging technique in the daily cardiac catheterization laboratory [8].

As such, the aim of the current study was to achieve a rapid and fully automatic 3D visualization of IV-OCT pullbacks.

2. Algorithm for automatic three-dimensional visualization

The flowchart in Fig. 1 illustrates the entire image processing framework. First, the imaging catheter is segmented in the IV-OCT pullback leading to automatic image calibration. Then guide-wire(s) boundaries are located and vessel lumen and stent struts are automatically segmented through the entire data set. Subsequently, 3-dimensional visualization is generated through dedicated software for volume-rendering.

 figure: Fig. 1

Fig. 1 Flowchart of the entire method. Following the segmentation of the imaging catheter, the guide-wire(s), stent struts and the vessel lumen, three-dimensional rendering of IV-OCT data is automatically obtained. Automatic pullback calibration is obtained by employing imaging catheter segmentation results.

Download Full Size | PDF

2.1. Segmentation of the imaging catheter

The IV-OCT imaging catheter appears as multiple bright concentric circular rings (equivalent to vertical lines in the polar image domain). As illustrated by Fig. 2 , such object is composed of a plastic sheet (green narrow arrow) covering the internal structures. The diameter of the catheter is typically used for the manual calibration of the IV-OCT images. However, the external plastic sheet often appears to be deformed during vessel flushing, image acquisition and when it is pushed against the vessel wall and can thus not be used for robust calibration. The internal structures of the catheter however (Fig. 2, yellow large arrows), always maintain a fixed appearance. We therefor propose an algorithm for a rapid and robust segmentation of these inner structures allowing for the automatic segmentation of the imaging catheter and for the automatic calibration of the images.

 figure: Fig. 2

Fig. 2 Hough transform for the automatic detection of the imaging catheter. The imaging catheter is automatically located on the polar image domain by a rapid algorithm for the detection of vertical lines based on the Hough transform. Segmentation over multiple frames makes the process robust to noise or image artifacts. The large yellow arrow is pointing to catheter’s internal structures (largest concentric ring), the green arrow to the plastic external sheet covering the imaging catheter and x- and y axes are arbitrarily set to define the Hough space as detailed in the text.

Download Full Size | PDF

Hereto polar domain images are processed via a rapid algorithm based on the Hough transform [13]. The standard Hough transform is a global technique for the detection of parameterizable patterns in digital images. By transforming the Cartesian space to a parametric space (i.e., Hough space) any parametric curve can be defined. In the current situation (Fig. 2c), lines can be parameterized as:

ρ=xcos(θ)+ysin(θ),

where ρ is the distance between the line and the origin and θ is the angle of the line according to the positive x-direction as shown in Fig. 2c. By imposing boundaries on the value of θ (i.e., θ = 90°), detection of vertical lines only is made possible. More specific details about Hough transform are available in literature [13,14].

Through Eq. (1), vertical lines are detected in multiple adjacent images. As the largest concentric ring represents the true position of the catheter, the position of the line with the largest value of ρ is averaged through the entire pullback. The use of 3D information from multiple frames makes the detection process robust with respect to noise or image artifacts.

The detected catheter size is first used to automatically calibrate the entire pullback (catheter size is known a priori); then a mask is automatically applied over the entire pullback to exclude the imaging catheter from further processing.

2.2. Segmentation of the guide-wire(s)

The correct identification and segmentation of the guide-wire (GW) in a single image can be challenging due to the presence of stent struts and artifacts. Moreover, the number of guide-wires present in the image is not known a-priori (e.g., in case of PCI at a vessel bifurcation). Guide-wires are segmented by implying spatial continuity through the entire pullback. Given that the GW is characterized by a bright reflection immediately followed by a shadow, A-lines containing a GW (Fig. 3a ) present low accumulated intensities [15]. To exploit this characteristic, an accumulated intensity feature image is generated from the entire pullback. Hereto, every A-line is processed by accumulating pixel intensities as a function of depth. In this way, an entire 2D image could be represented by a single (accumulated intensity) profile. Profiles of multiple consecutive frames generate the final feature image (Fig. 3b).

 figure: Fig. 3

Fig. 3 Visual example of the guide wire segmentation procedure. A feature image is created from the entire pullback by accumulating pixel intensities over individual A-lines (fig. b). Then morphological operations are applied (fig. c) and the guide-wire(s) is located as a connected object in fig. (d). Figures (e) and (f) show segmentation results over the entire pullback and on a single frame, respectively.

Download Full Size | PDF

The left and the right edges of the GW are then located as connected contours in the feature image through morphological operations. The feature image is first processed by global image thresholding using Otsu’s method (Fig. 3c) [16]. Then, morphological closing, area constrain and morphological majority operations followed by a morphological dilation [13,17,18] are applied (Fig. 3d). This results in a robust and fully automatic procedure able to segment multiple GWs through entire IV-OCT pullbacks (Fig. 3e) and thus on every image (Fig. 3f). Note that in case the guide-wire is wrapped around the A-line with an acquisition angle of 0°, it results to be divided into two pieces: one on the right and the other on the left side of the image. Image padding (by adding a fixed number of A-lines from the right border to the left and vice versa) and recovering of the original image after GW segmentation can easily solve this problem.

2.3. Stent struts and lumen segmentation

Stent struts and the vessel lumen are segmented by an algorithm previously developed and validated by our research group [19]. In brief, stent struts are detected through individual A-line analysis in the polar image domain (Fig. 4a ). In this domain, a single A-line corresponds to an intensity profile varying as a function of depth I(d). First, A-lines are classified according to their intensity profile properties: (1) maximum intensity level; (2) number of pixels exceeding the full-width partial maximum intensity FWPM; (3) presence of a shadow and (4) shadow length.

 figure: Fig. 4

Fig. 4 Stent struts and lumen segmentation. Following A-line classification on the polar image domain, segmentation is obtained by applying spatial continuity over multiple A-lines (a). Thus, the image is scan-converted to Cartesian domain for visualization and quantification of strut apposition (b).

Download Full Size | PDF

Shadows are located by looking at the average intensity of pixels after the shallowest intensity peak, while shadow length is computed through the use of a sliding window. The use of an intensity level threshold allows identifying the presence of a shadow along an A-line. In a similar way, shadow’s length is quantified. According to these properties, strut A-lines are classified through the entire image.

Stent struts are subsequently segmented by employing spatial continuity. First, luminal stent strut surface is located in every single A-line through a peak detection procedure. Then, 1-dimensional filtering is applied to clusters of adjacent strut A-lines smoothing the detected surface. In a similar way, the vessel wall is segmented by applying spatial continuity through multiple A-lines by the use of a smoothing B-spline (Fig. 4).

Images are then scan-converted to Cartesian domain and strut apposition is subsequently quantified. Discrimination of malapposed from apposed struts is obtained through the use of a priori data on stent thickness [12]. The algorithm was previously validated against the manual analysis of two expert IV-OCT image readers over a large data set.

A more extensive explanation on the development and the validation of this segmentation algorithm is available in literature [19].

2.4. 3-dimensional rendering

Prior to 3D IV-OCT visualization, detected stent struts are automatically painted with a predefined intensity value exceeding the dynamic range of the IV-OCT data. Different values are given to apposed and malapposed struts, respectively. Segmented images are subsequently stored as DICOM and 3D visualization is automatically obtained by the means of dedicated software for volume rendering.

The same look-up table and opacity table were used as an input for the 3D rendering software and applied to all the data sets to be visualized. Opacity was set to be higher for stent struts with respect to the vessel wall and very low intensity pixels were made transparent. The look-up table depicts the vessel wall in red, apposed stent struts in copper and malapposed stent struts in blue. The opacity table and the look-up table are reported on Fig. 5 . Real object dimensions are employed for voxels’ rendering.

 figure: Fig. 5

Fig. 5 Look-up and opacity tables. Different opacity values (y-axis) are given to stents struts and the vessel wall. The intensity range for the different structures is displayed by the x-axis. Moreover, also the colormap utilized for 3D rendering is reported.

Download Full Size | PDF

2.5. Implementation details

Algorithms for imaging catheter and guide-wire segmentation were implemented in Matlab 2011a, 64-bit version 7.12.0 (MathWorks, Natick, MA), while the algorithms for image scan-conversion [19,20] were implemented in Visual C++ 2008 (Microsoft, Redmond, WA). The C++ code is executed in Matlab by the means of the MEX libraries (MathWorks).

3D visualization is obtained through the use of the windows based software INTAGE Realia (Cybernet Systems Co., Ltd, Tokyo, Japan). INTAGE Realia is a 3D DICOM viewer free of charge, publically available for download from Cybernet Systems Co. website [21].

The quantification of computation time was made on a laptop computer with the following characteristics: processor Intel Core i7-3720QM (Intel Corporation, Santa Clara, CA), memory 16GB RAM, 1866MHz DDR3, video card Nvidia Quadro k2000M (Nvidia Corporation, Santa Clara, CA), 64-bit Windows 7 OS (Microsoft) and 128GB solid state hard drive.

Default morphological operations as defined in the Matlab Processing Toolbox 2011 (MathWorks) were used in this study. The algorithm parameter defining the area constrain operation for guide-wire segmentation was set equals to 3500 pixels and kept constant for all the data sets analyzed in this study. The parameters for peak detection in the Hough transform matrix H are set to their default values as defined in the Matlab Image Processing Toolbox (MathWorks) with two exceptions: (1) the parameter defining the maximum number of peaks to be detected was set equal to 4 and (2) the threshold at which the values of H are considered to be peaks was set equals to 0.9.

3. Methods: validation experiments

The algorithms for the segmentation of the imaging catheter and guide-wire were validated against manual analysis performed by an expert image reader blinded to the automatic results.

25 in vivo IV-OCT pullbacks, randomly selected from an already existing database, were both automatically and manually calibrated and the difference between the two procedures (calculated in pixels) quantified as the automatic calibration error. Then, the coordinates of the GW boundaries were automatically located and compared to the manual segmentation over 250 images extracted at random from the previously selected data sets. Given that such pullbacks represent in vivo real-life IV-OCT data, selected images included multiple image artifacts such as incomplete blood clearance, motion artifact (commonly called sew-up artifact), very eccentric catheter position and sunflower artifact. Therefore, validation was obtained using manual analysis as the ground truth by regression analysis and Bland-Altman statistics, defining the range of agreement as mean bias ±1.96 SD [22].

To test final 3D visualization results, IVOCT data sets were selected a priori on the basis of their clinical scenario to illustrate a wide range of different situations. 3D IV-OCT stent patterns were visually compared to photographic pictures of the deployed stents made available by the manufacturers. Similarly, 3D renderings were visually compared to angiographic appearance of the analyzed vessel. Finally, small intraluminal details such as thrombus, stent malapposition, guide-wires and vessel wall dissection were visualized by 3D IV-OCT and compared to conventional 2D images. Both single vessel and bifurcation PCI procedures were taken into account.

Computational times required by the different modules for automatic processing of an entire IV-OCT pullback were also quantified.

3.1. IV-OCT data

IV-OCT pullbacks were acquired through the use of a commercially available FD-OCT system (C7-XR system, St. Jude, St. Paul, Minnesota) and by the means of the Dragonfly catheter (St. Jude) in the context of a clinical trial (University Hospital Leuven – STACCATO, NCT01065519) and other clinical studies. All patients gave informed consent. The system acquires data at a frame-rate of 100 images per second (54,000 A-lines per second) with a pullback length of ~54 mm and a scan range (in contrast medium) of ~5 mm. The system is equipped with a near infrared light source with a central wavelength of 1305 nm and a scan range of ±80 nm. Imaging specifications, according to the manufacturer, are an axial resolution <20 µm and a lateral resolution of 25-60 µm. Acquisition speeds of both 20 mm/s and 10 mm/s were employed.

4. Results

Figure 6 illustrates the validation results for both the algorithms for automatic segmentation of the imaging catheter and the guide-wire. A correlation coefficient of 0.99 was found in both cases and Bland-Altman statistic did not show any bias together with narrow limits of agreement: mean bias ~–0.2 ± 13.7 for the GW segmentation algorithm and ~–0.5 ± 4.0 for the imaging catheter segmentation algorithm (values are expressed in pixels with a pixel size of ~5.2 µm). Over a total of 250 images, only in 3 single images (~1%) the presence of a second guide-wire was not correctly detected (false negative).

 figure: Fig. 6

Fig. 6 Validation results. Above: regression analysis and Bland-Altman statistics for automatic calibration results. Below: guide-wire segmentation results. Values are expressed in pixels, with a pixel size of ~5.2 µm. For the validation of the automatic calibration algorithm, reported values correspond to the pixel shift in the original image automatically (y-axis) and manually (x-axis) obtained. For the GW segmentation, reported values correspond to the A-line number where guide-wire boundaries are located both automatically (y-axis) and manually (x-axis).

Download Full Size | PDF

Figures 712 show examples of fully automatic 3D reconstructions. Figures 7 and 8 compare 3D visualization to stent patterns a priori known from the manufacturers. In addition, Fig. 7 illustrates an example of stent edge dissection, while Fig. 8 presents results of an IV-OCT pullback acquired at lower pullback speed (10mm/s vs. 20mm/s). Figure 9 shows 3D renderings of simple lesions compared to angiography.

 figure: Fig. 7

Fig. 7 Fully automatic 3D IV-OCT imaging. The figure compares 3D IV-OCT stent pattern to a priori data from the manufacturer (Promus Element, Boston Scientific, Natick, MA). Small details of the stent pattern (green circles) are visible in both 3D images and manufacturer data. An edge dissection is also clearly visible in the 3D image (yellow arrow). Asterisk (*) indicates guide-wire shadowing artifact.

Download Full Size | PDF

 figure: Fig. 8

Fig. 8 3D IV-OCT stent pattern of another stent device (Xience Prime, Abbott Vascular, Santa Clara, CA). Yellow arrows point to a fine stent detail correctly visualized by 3D IV-OCT in a reproducible way. In addition, the figure shows that a slower acquisition speed (10 mm/s) results in an improved longitudinal resolution.

Download Full Size | PDF

 figure: Fig. 9

Fig. 9 Both figures (a) and (b) compare automatic 3D imaging to stent appearance at angiography (arrows point to vessel stenosis). Figure (a) shows a simple lesion before and after stent implantation in the left anterior descending artery (LAD). In fig. (b) a lesion located very close to the ostium of side branches of the LAD is depicted. 3D images are able to better illustrate vessel anatomy compared to conventional 2D images. *Asterisk indicates side-branches – † indicates the guide-wire.

Download Full Size | PDF

Figures 10 , 11 , and 12 show additional examples of 3D IV-OCT images for the visualization of small intraluminal structures. Figure 10a presents an example of thrombus and Fig. 10b an example of a jailed side-branch. Figure 11 deals with the automatic detection and 3D characterization of stent strut malapposition and Fig. 12 illustrates an example of 3D visualization during a side-branch rewiring and reopening procedure (bifurcation PCI).

 figure: Fig. 10

Fig. 10 Panel (a) shows coronary intraluminal thrombus partially covering a stent automatically displayed by 3D IV-OCT (yellow arrows). A stent over a side branch and its different compartments (4 in total) are visible in the 3D rendering in fig. (b). Assessment of the such jailing compartments would be very difficult on conventional 2D IV-OCT images. Asterisk (*) indicates guide-wire shadowing artifact.

Download Full Size | PDF

 figure: Fig. 11

Fig. 11 Example of automatic characterization of stent malapposition. 3D spatial distribution of a stent edge malapposition is displayed fully automatically (blue color).If compared to 2D images, 3D IV-OCT better illustrates spatial distribution of malapposed struts.

Download Full Size | PDF

 figure: Fig. 12

Fig. 12 Example of automatic IV-OCT 3D visualization of a rewired side-branch in bifurcation PCI. Image on the top illustrates how 3D IVOCT can guide the positioning of the guide-wire (yellow arrow) in a distal cell for subsequent side-branch reopening. This can potentially optimize side-branch rewiring and reopening procedures. Evaluation of stent cells through 2D images and guide-wire positioning, may be unfeasible. Bottom figure illustrates the final result of side branch reopening, confirming the absence of free floating material. Asterisk (*) indicates the guide-wire in conventional 2D images.

Download Full Size | PDF

The total processing time for a 30 mm stent (corresponding to 150 images for 20 mm/s acquisition speed) resulted to be approximately 74 seconds. More specifically, automatic imaging catheter segmentation and pullback calibration took ~1.3 seconds, guide-wire(s) segmentation ~1.4 seconds. Stent and lumen segmentation took ~46 seconds and scan-conversion to Cartesian images of 800·800 pixels ~24 seconds.

5. Discussion

A fully automatic algorithm for 3D IV-OCT imaging was developed. Multiple examples from real life in vivo clinical cases (selected a priori on the basis of their clinical relevance) were shown to demonstrate the validity of the proposed method. Comparison to angiographic data (Fig. 9) showed visual consistency of the vessel appearance by looking at anatomical features such as side branches and vessel stenosis. Moreover, 3D IV-OCT stent patterns of different devices (Figs. 7 and 8) visually fitted to a priori data from the manufacturers. In fact, from those figures, it is possible to appreciate that also small details of the stent metallic framework were correctly visualized corroborating the results of the proposed method. Furthermore, small intraluminal details such as vessel dissections (Fig. 7), thrombus (Fig. 10a), jailing struts (Fig. 10b), stent strut apposition (Fig. 11), guide-wire and stent cells (Fig. 12) were clearly visualized and discernible from the other structures.

Given that the described method is fast (processing time for an entire data set ~1 min), together with the fact that no manual interaction is required, makes 3D IV-OCT available through the ‘push-of-a-button’ as a complimentary tool to conventional 2D IV-OCT images. As such, it was shown that the proposed method is suitable for the application of 3D IV-OCT visualization in clinical scenarios and it can be applied for the optimization of PCI procedures as indicated by the team of Serruys [5] and the team of Akasaka [8].

5.1. Validation

Algorithms for automatic guide-wire and imaging catheter segmentation were validated against the manual analysis of IV-OCT images. In a similar way, the accuracy of the algorithms for lumen segmentation and stent struts detection was previously reported [19]. Given that manual analysis is considered to be the gold standard for image segmentation [12], the validity of the proposed methods was proven. In addition, IV-OCT 3D rendering was validated by comparing algorithm results to angiographic data, manufacturers’ stent data and to conventional 2D images.

Although the segmentation algorithms were validated through a quantitative procedure, only a qualitative validation of final 3D visualization results was made. The validation of 3D rendering is always a controversial and challenging task. An alternative approach would make use of IV-OCT phantoms [20,23]. Such phantoms were typically used to validate the ability of IV-OCT to quantify vessel morphology measurement such as lumen area and lumen diameters. However, even through the use of phantom models, quantitative validation of 3D visualization algorithms remains a very challenging task. Moreover, to the best knowledge of the authors, this is the first report of an automatic method for 3D visualization of IV-OCT data. As such, comparison to previous studies is not possible. In any case, qualitative visual inspection of algorithm results showed consistency through all the figures from 7 to 12 corroborating 3D visualization results.

Furthermore, 3D rendering was obtained through the same predefined color map and opacity table. In a similar way, the same 3D image illumination and shading are applied to all the data showed in this study. Although this generates uniform results, the evaluation of different solutions for 3D rendering was beyond the scope of this study. Only future standardization efforts from the IV-OCT community would be able to create a consensus about optimal guidelines for 3D IV-OCT visualization and validation.

As an additional consideration, it is important to stress the fact that 3D IV-OCT is intended as a complimentary tool to 2D IV-OCT. In fact, only the combination of both modalities would be potentially able to make IV-OCT a practical tool in percutaneous coronary interventions [5,8].

5.2. Further improvements

Figure 8 shows that acquisitions at lower pullback speed (acquiring a higher number of frames) allow for more detailed 3D IV-OCT. However, slower acquisitions potentially make IV-OCT imaging more vulnerable to motion artifacts (e.g., cardiac motion) [5]. Thus, a future generation of IV-OCT systems with an improved frame-rate will be able to provide additional benefits for 3D applications. Similarly, software based approaches (e.g., longitudinal low pass filtering) could mitigate the sampling effect of IV-OCT in the pullback direction but, as a tradeoff, they would decrease 3D image resolution. Moreover, newer generations of IV-OCT systems designed for the reduction of motion artifacts (e.g., non-uniform rotation distortion and relative motion of the imaging catheter to the vessel wall) [23], would be able to further improve the accuracy of 3D visualizations.

The method proposed in this study is able to segment and depict intracoronary stents in 3D through a fully automatic procedure. Although the method was developed to be robust with respect to common image artifacts and suboptimal image quality [19], automatic strut detection may generate false positive as well as false negative results. However, study results showed the accuracy of 3D stent visualization. Moreover, the automatic correction of false positives or the recovery of missed struts using spatial information would be a very challenging task, given that hundreds of different stent designs are currently present on the market [24].

As an additional consideration, no specific color was given to the guide-wire. Although when working with the on-line 3D rendering tool the guide-wire position is usually totally clear, the use of a dedicated color (e.g., green) would improve the quality of the 3D visualization even more.

For the rendering of an entire stent, a processing time of ~1 min is required. Even if this is suitable for the on-line use of the proposed method, specific customization of the proposed algorithms (e.g., GPU parallel computing implementation) would be able to further reduce the time of the computations, potentially allowing (close to) real-time 3D IV-OCT visualizations.

6. Conclusion

An algorithm for the automatic 3D visualization of IV-OCT data was developed and validated. Given the fact that the method is accurate and that it allows for the rapid assessment of entire pullbacks, it is suitable for the on-line application during coronary interventions. This potentially allows for an expanding use of 3D IV-OCT in clinical routine and PCI optimization, making 3D IV-OCT visualization available through the ‘push-of-a-button’ as a complimentary tool to conventional 2D images.

Acknowledgments

IV-OCT data were acquired in the context of a clinical trial sponsored by Research Foundation Flanders (FWO). Tom Adriaenssens is supported from a doctoral grant from FWO. Presented work was also partially founded by an IOF KU Leuven grant.

References and links

1. G. J. Tearney, S. Waxman, M. Shishkov, B. J. Vakoc, M. J. Suter, M. I. Freilich, A. E. Desjardins, W. Y. Oh, L. A. Bartlett, M. Rosenberg, and B. E. Bouma, “Three-dimensional coronary artery microscopy by intracoronary optical frequency domain imaging,” JACC Cardiovasc. Imaging 1(6), 752–761 (2008). [CrossRef]   [PubMed]  

2. E. Regar, J. A. Schaar, E. Mont, R. Virmani, and P. W. Serruys, “Optical coherence tomography,” Cardiovasc. Radiat. Med. 4(4), 198–204 (2003). [CrossRef]   [PubMed]  

3. T. Kume, T. Akasaka, T. Kawamoto, Y. Ogasawara, N. Watanabe, E. Toyota, Y. Neishi, R. Sukmawan, Y. Sadahira, and K. Yoshida, “Assessment of coronary arterial thrombus by optical coherence tomography,” Am. J. Cardiol. 97(12), 1713–1717 (2006). [CrossRef]   [PubMed]  

4. Y. Ozaki, M. Okumura, T. F. Ismail, H. Naruse, K. Hattori, S. Kan, M. Ishikawa, T. Kawai, Y. Takagi, J. Ishii, F. Prati, and P. W. Serruys, “The fate of incomplete stent apposition with drug-eluting stents: an optical coherence tomography-based natural history study,” Eur. Heart J. 31(12), 1470–1476 (2010). [CrossRef]   [PubMed]  

5. V. Farooq, B. D. Gogas, T. Okamura, J. H. Heo, M. Magro, J. Gomez-Lara, Y. Onuma, M. D. Radu, S. Brugaletta, R. J. van Geuns, H. M. Garcia-Garcia, and P. W. Serruys, “Three-dimensional optical frequency domain imaging in conventional percoutaneous coronary intervention: the potential for clinical application,” Eur. Heart J. (advance access), http://eurheartj.oxfordjournals.org/content/early/2011/11/21/eurheartj.ehr409.extract.

6. P. H. Chan, E. Alegria-Barrero, and C. Di Mario, “Tools & Techniques: Intravascular ultrasound and optical coherence tomography,” EuroIntervention 7(11), 1343–1349 (2012). [CrossRef]   [PubMed]  

7. T. Okamura, Y. Onuma, H. M. García-García, E. Regar, J. J. Wykrzykowska, J. Koolen, L. Thuesen, S. Windecker, R. Whitbourn, D. R. McClean, J. A. Ormiston, P. W. Serruys, and ABSORB Cohort B Investigators, “3-Dimensional optical coherence tomography assessment of jailed side branches by bioresorbable vascular scaffolds: a proposal for classification,” JACC Cardiovasc. Interv. 3(8), 836–844 (2010). [CrossRef]   [PubMed]  

8. T. Kubo, A. Tanaka, H. Kitabata, Y. Ino, T. Tanimoto, and T. Akasaka, “Application of optical coherence tomography in percutaneous coronary intervention,” Circ. J. 76(9), 2076–2083 (2012). [CrossRef]   [PubMed]  

9. B. D. Gogas, V. Farooq, Y. Onuma, M. Magro, M. D. Radu, R. J. van Geuns, E. Regar, and P. W. Serruys, “3-dimensional optical frequency domain imaging for the evaluation of primary percutaneous coronary intervention in ST-segment elevation myocardial infarction,” Int. J. Cardiol. 151(1), 103–105 (2011). [CrossRef]   [PubMed]  

10. T. Okamura, “Angioplasty Summit MD” (2010). http://www.summitmd.com/pdf/pdf/1430_Safety_4_TakayukiOkamura.pdf

11. C. Di Mario, W. J. van der Giessen, N. Foin, T. Adriaenssens, P. Tyczynski, L. Ghilencea, N. Viceconte, and A. C. Linsday, “Optical coherence tomography for guidance in bifurcation lesion treatment,” EuroIntervention 6(1), 99–106 (2011).

12. H. G. Bezerra, M. A. Costa, G. Guagliumi, A. M. Rollins, and D. I. Simon, “Intracoronary optical coherence tomography: a comprehensive review clinical and research applications,” JACC Cardiovasc. Interv. 2(11), 1035–1046 (2009). [CrossRef]   [PubMed]  

13. L. G. Shapiro and G. C. Stockman, Computer Vision (Prentice-Hall Inc., 2001), Chaps. 3 and 10.

14. M. Atiquzzaman and M. W. Akhtar, “A robust Hough transform technique for complete line segment description,” Real-Time Imaging 1(6), 419–426 (1995). [CrossRef]  

15. Z. Wang, H. Kyono, H. G. Bezerra, D. L. Wilson, M. A. Costa, and A. M. Rollins, “Automatic segmentation of intravascular optical coherence tomography images facilitating quantitative diagnosis of atherosclerosis,” Proc. SPIE 7889, 78890N, 78890N-7 (2011). [CrossRef]  

16. A. Otsu, “A threshold selection method from gray-level histograms,” IEEE Trans. Syst. Man Cybern. 9(1), 62–66 (1979). [CrossRef]  

17. W. K. Pratt, Digital Image Processing (Wiley, 2001), Chap 14.

18. T. Y. Kong and A. Rosenfeld, Topological Algorithms for Digital Image Processing (Elsevier Science, 1996), Chap 2.

19. G. J. Ughi, T. Adriaenssens, K. Onsea, P. Kayaert, C. Dubois, P. Sinnaeve, M. Coosemans, W. Desmet, and J. D’hooge, “Automatic segmentation of in-vivo intra-coronary optical coherence tomography images to assess stent strut apposition and coverage,” Int. J. Cardiovasc. Imaging 28(2), 229–241 (2012). [CrossRef]   [PubMed]  

20. G. J. Ughi, T. Adriaenssens, M. Larsson, C. Dubois, P. R. Sinnaeve, M. Coosemans, W. Desmet, and J. D’hooge, “Automatic three-dimensional registration of intravascular optical coherence tomography images,” J. Biomed. Opt. 17(2), 026005 (2012). [CrossRef]   [PubMed]  

21. Cybernet Systems Co, Ltd., “Free 3D DICOM viewer INTAGE Realia” (2010), http://kgt.cybernet.co.jp/viz/realia/english/intage_realia.html.

22. J. M. Bland and D. G. Altman, “Statistical methods for assessing agreement between two methods of clinical measurement,” Lancet 327(8476), 307–310 (1986). [CrossRef]   [PubMed]  

23. J. Ha, H. Yoo, G. J. Tearney, and B. E. Bouma, “Compensation of motion artifacts in intracoronary optical frequency domain imaging and optical coherence tomography,” Int. J. Cardiovasc. Imaging 28(6), 1299–1304 (2012). [CrossRef]   [PubMed]  

24. Global Industry Analysts, Inc., “Coronary stents - a global strategic business report (2011),” http://www.strategyr.com/Coronary_Stents_Market_Report.asp.

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (12)

Fig. 1
Fig. 1 Flowchart of the entire method. Following the segmentation of the imaging catheter, the guide-wire(s), stent struts and the vessel lumen, three-dimensional rendering of IV-OCT data is automatically obtained. Automatic pullback calibration is obtained by employing imaging catheter segmentation results.
Fig. 2
Fig. 2 Hough transform for the automatic detection of the imaging catheter. The imaging catheter is automatically located on the polar image domain by a rapid algorithm for the detection of vertical lines based on the Hough transform. Segmentation over multiple frames makes the process robust to noise or image artifacts. The large yellow arrow is pointing to catheter’s internal structures (largest concentric ring), the green arrow to the plastic external sheet covering the imaging catheter and x- and y axes are arbitrarily set to define the Hough space as detailed in the text.
Fig. 3
Fig. 3 Visual example of the guide wire segmentation procedure. A feature image is created from the entire pullback by accumulating pixel intensities over individual A-lines (fig. b). Then morphological operations are applied (fig. c) and the guide-wire(s) is located as a connected object in fig. (d). Figures (e) and (f) show segmentation results over the entire pullback and on a single frame, respectively.
Fig. 4
Fig. 4 Stent struts and lumen segmentation. Following A-line classification on the polar image domain, segmentation is obtained by applying spatial continuity over multiple A-lines (a). Thus, the image is scan-converted to Cartesian domain for visualization and quantification of strut apposition (b).
Fig. 5
Fig. 5 Look-up and opacity tables. Different opacity values (y-axis) are given to stents struts and the vessel wall. The intensity range for the different structures is displayed by the x-axis. Moreover, also the colormap utilized for 3D rendering is reported.
Fig. 6
Fig. 6 Validation results. Above: regression analysis and Bland-Altman statistics for automatic calibration results. Below: guide-wire segmentation results. Values are expressed in pixels, with a pixel size of ~5.2 µm. For the validation of the automatic calibration algorithm, reported values correspond to the pixel shift in the original image automatically (y-axis) and manually (x-axis) obtained. For the GW segmentation, reported values correspond to the A-line number where guide-wire boundaries are located both automatically (y-axis) and manually (x-axis).
Fig. 7
Fig. 7 Fully automatic 3D IV-OCT imaging. The figure compares 3D IV-OCT stent pattern to a priori data from the manufacturer (Promus Element, Boston Scientific, Natick, MA). Small details of the stent pattern (green circles) are visible in both 3D images and manufacturer data. An edge dissection is also clearly visible in the 3D image (yellow arrow). Asterisk (*) indicates guide-wire shadowing artifact.
Fig. 8
Fig. 8 3D IV-OCT stent pattern of another stent device (Xience Prime, Abbott Vascular, Santa Clara, CA). Yellow arrows point to a fine stent detail correctly visualized by 3D IV-OCT in a reproducible way. In addition, the figure shows that a slower acquisition speed (10 mm/s) results in an improved longitudinal resolution.
Fig. 9
Fig. 9 Both figures (a) and (b) compare automatic 3D imaging to stent appearance at angiography (arrows point to vessel stenosis). Figure (a) shows a simple lesion before and after stent implantation in the left anterior descending artery (LAD). In fig. (b) a lesion located very close to the ostium of side branches of the LAD is depicted. 3D images are able to better illustrate vessel anatomy compared to conventional 2D images. *Asterisk indicates side-branches – † indicates the guide-wire.
Fig. 10
Fig. 10 Panel (a) shows coronary intraluminal thrombus partially covering a stent automatically displayed by 3D IV-OCT (yellow arrows). A stent over a side branch and its different compartments (4 in total) are visible in the 3D rendering in fig. (b). Assessment of the such jailing compartments would be very difficult on conventional 2D IV-OCT images. Asterisk (*) indicates guide-wire shadowing artifact.
Fig. 11
Fig. 11 Example of automatic characterization of stent malapposition. 3D spatial distribution of a stent edge malapposition is displayed fully automatically (blue color).If compared to 2D images, 3D IV-OCT better illustrates spatial distribution of malapposed struts.
Fig. 12
Fig. 12 Example of automatic IV-OCT 3D visualization of a rewired side-branch in bifurcation PCI. Image on the top illustrates how 3D IVOCT can guide the positioning of the guide-wire (yellow arrow) in a distal cell for subsequent side-branch reopening. This can potentially optimize side-branch rewiring and reopening procedures. Evaluation of stent cells through 2D images and guide-wire positioning, may be unfeasible. Bottom figure illustrates the final result of side branch reopening, confirming the absence of free floating material. Asterisk (*) indicates the guide-wire in conventional 2D images.

Equations (1)

Equations on this page are rendered with MathJax. Learn more.

ρ=xcos(θ)+ysin(θ),
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.