• We are sorry, but NCBI web applications do not support your browser and may not function properly. More information
Logo of bmcmiBioMed Centralsearchsubmit a manuscriptregisterthis articleBMC Medical Imaging
BMC Med Imaging. 2012; 12: 37.
Published online Dec 21, 2012. doi:  10.1186/1471-2342-12-37
PMCID: PMC3560228

An automated method for analysis of microcirculation videos for accurate assessment of tissue perfusion

Abstract

Background

Imaging of the human microcirculation in real-time has the potential to detect injuries and illnesses that disturb the microcirculation at earlier stages and may improve the efficacy of resuscitation. Despite advanced imaging techniques to monitor the microcirculation, there are currently no tools for the near real-time analysis of the videos produced by these imaging systems. An automated system tool that can extract microvasculature information and monitor changes in tissue perfusion quantitatively might be invaluable as a diagnostic and therapeutic endpoint for resuscitation.

Methods

The experimental algorithm automatically extracts microvascular network and quantitatively measures changes in the microcirculation. There are two main parts in the algorithm: video processing and vessel segmentation. Microcirculatory videos are first stabilized in a video processing step to remove motion artifacts. In the vessel segmentation process, the microvascular network is extracted using multiple level thresholding and pixel verification techniques. Threshold levels are selected using histogram information of a set of training video recordings. Pixel-by-pixel differences are calculated throughout the frames to identify active blood vessels and capillaries with flow.

Results

Sublingual microcirculatory videos are recorded from anesthetized swine at baseline and during hemorrhage using a hand-held Side-stream Dark Field (SDF) imaging device to track changes in the microvasculature during hemorrhage. Automatically segmented vessels in the recordings are analyzed visually and the functional capillary density (FCD) values calculated by the algorithm are compared for both health baseline and hemorrhagic conditions. These results were compared to independently made FCD measurements using a well-known semi-automated method. Results of the fully automated algorithm demonstrated a significant decrease of FCD values. Similar, but more variable FCD values were calculated using a commercially available software program requiring manual editing.

Conclusions

An entirely automated system for analyzing microcirculation videos to reduce human interaction and computation time is developed. The algorithm successfully stabilizes video recordings, segments blood vessels, identifies vessels without flow and calculates FCD in a fully automated process. The automated process provides an equal or better separation between healthy and hemorrhagic FCD values compared to currently available semi-automatic techniques. The proposed method shows promise for the quantitative measurement of changes occurring in microcirculation during injury.

Background

Understanding the distribution and circulation of blood in capillaries has been considered a key aspect for assessment of tissue perfusion [1]. Visualization and quantification of changes in microcirculation has been proposed as a potential tool in diagnosis and treatment of illnesses and diseases such as sepsis [2], sickle cell disease [3,4], chronic ulcers, diabetes mellitus and hypertension [5,6]. In each of these diseases, several characteristics of the microcirculation such as the structure of capillaries and quality of blood flow in the capillaries change over time [7-11]. A recent study suggests there is value in monitoring the microcirculation for titrating vasodilators in perioperative use [12]. Monitoring microcirculation during resuscitation could also be envisioned as a tool to prevent over and under resuscitation of victims of hemorrhage and other critical illness and injuries such as sepsis. Therefore, quantitative and accurate analysis of the microcirculation is likely to be essential if microcirculatory imaging is to be adopted as useful tool in clinical monitoring [13].

Orthogonal polarization spectral (OPS) imaging [1,2,5] and side-stream dark field (SDF) imaging [13,14] have been extensively employed in the field of clinical microcirculatory research. OPS and SDF imaging are both non-invasive imaging modalities and have been used to track changes in the microcirculation on mucosal surfaces. Most studies have used the sublingual surfaces of the oral cavity. These imaging techniques use green polarized light with wavelength of 550 nm which is absorbed by hemoglobin and makes red blood cells visible [15,16].

To analyze microcirculatory images and videos, several software tools have been developed. However currently available software is unable to perform real or near real time analysis of the videos and require manual intervention to ensure accurate results. Researchers in the field have stated the need for improvements of current software to expedite clinical bedside use [17]. The computer-assisted image analysis system CapImage (Zeintl, Heidelberg, Germany) was originally developed for traditional intravital microscopy [18], but is capable of analysis of SDF and OPS images [19]. It uses a Line Shift Diagram Method for measurement of velocity and real-time movement correlation. This software tool is capable of measuring different properties of the microcirculation such as blood cell velocity and capillary density. However, it is only capable of detecting straight blood vessels which limits its efficacy since the microvascular geometry is complex. Expert users of CapImage claim that analysis of microcirculation with CapImage is time consuming and may only be performed off-line [20].

CapiScope, a system for the measurement of capillary morphology and capillary blood cell velocity, requires stable images, but lacks a stabilization function [21]. JavaCap and Capilap Toolbox are two other available software tools which use triangulation methods to calculate intercapillary distance [22,23].

Automated Vascular Analysis (AVA)—also known as MAS (Microvascular Analysis Software, Microvision Medical BV)—is the most current commercial software tool developed by Dobbe et al [24] for analysis of microcirculation videos. The method is the most accurate among the existing systems and performs a semi-automated process based on image stabilization, centerline detection and space time diagram. Despite all the capabilities provided by AVA, it does not provide full automation which leaves the burden of selecting the areas of interest, configuration, initialization, filtering of many false positives, dealing with many false negatives, and addressing of connectivity to the user. In addition, according to the developers of AVA, the software provides neither automatic vessel detection nor vessel diameter and blood flow calculation [24]. The system, while an improvement, requires manual editing which can take over 20 minutes for a typical video sequence.

The aim of this study is to automate the analysis of microcirculatory video recordings and the derivation of Functional Capillary Density (FCD). FCD is defined as the ratio of the area of functionally active capillaries to the entire area of the image. FCD has been considered an important measurement of the microcirculation to indicate the quality of tissue perfusion [25]. Image processing algorithms are designed for this study to automatically detect capillaries and small blood vessels in order to derive diagnostically useful information that may assist clinicians and medical researchers in the future.

Methods

The methodology behind the proposed algorithm to quantify the assessment of the microcirculation is summarized in Figure Figure1.1. The process—which is not shown in the schematic diagram—starts with the stabilization of the video frames. The weighted mean of consecutive frames from the stabilized video is calculated for each five-frame block. Pre-processing, multi-thresholding and vessel segmentation are the following steps and are highlighted in the diagram. A more detailed diagram is provided in Figure Figure22 to describe pre-processing, multi-thresholding and segmentation algorithm. After performing morphological operations such as filling and opening, the binary images resulting from segmentation are unioned together. If a pixel is segmented as vessel in more than one frame, it is assigned the label of “vessel”. Post processing includes additional morphological operations (e.g., bridge, spur, fill) and region growing to eliminate any possible discontinuities. Vessels with blood flow—perfused vessels—are identified in the last step and FCD is calculated accordingly.

Figure 1
Schematic of the proposed methodology. Proposed methodology is summarized in Figure Figure1.1. Stabilization of the videos is not included in the schematics. After stabilization, the weighted mean of five consecutive frames is calculated and the ...
Figure 2
Detailed diagram of pre-processing and vessel segmentation. Figure Figure22 provides a detailed diagram of preprocessing and segmentation steps for different threshold levels. It starts with the averaged frame. For 10 different threshold levels, ...

Stabilization

The microcirculatory videos are captured by a commercially available hand-held SDF device (Microscan, Microvision Medical, BV). Because it is hand-held and is highly susceptible to motion artifacts due to movement of subject and/or device, we developed a stabilization algorithm to eliminate these motion artifacts. A block matching algorithm is developed that calculates cross-correlation coefficients to measure the similarity of the blocks. Block matching algorithms use a predefined size of windows-blocks or even entire images to estimate motion vectors. One of the disadvantages of block matching methods is defined as 'remarkableness' of the window content [26]. If a window does not contain distinctive details, there is a high probability of mismatch. To avoid errors caused by ‘remarkableness’ issues, i.e. using points for matching that have no significant image-processing values (e.g. regular pixels inside the background) the processed blocks are checked to ensure they include blood vessels using Laplacian of Gaussian filtering. The stabilization process is described in detail in a previously published study [27]. Gradients of the frames are calculated using the first order derivative of the Gaussian function. Gradient of the Gaussian enhances images and improves visibility of blood vessels. Distinctive features of the images, which are typically the branching points of blood vessels, are selected and assigned as control points to overcome remarkableness issues. Control points are selected which are known to belong to capillaries to calculate the transformation between two consecutive frames. For this purpose, a 3-by-3 Laplacian filter which calculates second order derivatives is applied to the output of the Gaussian Gradient.

The maximum values from seven areas of the frame are selected as control points. Then, around the control points, 25 × 25 pixel windows are selected as sub-regions. The cross-correlation is calculated between these sub-regions in the current frame and a 40 × 40 pixel window around these sub-regions in the following frame. The size of the windows discussed above was optimized based on a previous visual empirical assessment of the algorithm over a set of microcirculation videos. The frames are registered according to the results of correlation calculations. Since the control points are defined for the first frame and they are tracked through adjacent frames, Laplacian filtering is not repeated throughout the algorithm. If any of the defined control points leaves the current frame due to excessive motion, new control points are defined using the same method.

Preprocessing, multi-thresholding, and segmentation

After the stabilization of the video recordings, the weighted mean of five consecutive frames is calculated to improve connectivity of the blood vessels. The frame in the middle has the highest weight in this process. Averaging the frames is followed by preprocessing algorithms. The vessel extraction algorithm is based on multiple level thresholding. Preprocessing is repeated at each threshold with different parameters.

Video contrast and clarity vary widely from source to source and necessitate preprocessing in order to generate images that will yield accurate results. To enhance the local contrast, Contrast Limited Adaptive Histogram Equalization (CLAHE) is performed on microcirculation images. CLAHE partitions the image into small regions, called ‘tiles’, and applies histogram equalization to each tile in order to even out the overall gray level distribution of the image [28]. Histogram equalization is followed by median filtering. To remove noise, median filtering is a widely preferred method in the literature [29]. In this application, the purpose of applying median filtering is smoothing.

The window sizes of adaptive histogram equalization and median filtering are subject to change at each threshold level. At low threshold levels, in order to include only wide and clear vessels, histogram equalization is applied in smaller windows. The median filter size is kept large at these low threshold levels. As the threshold level increases, the result of the process is a darker binary image with almost all vessels and background included. Window size of adaptive histogram equalization is increased and median filter size is reduced to enhance the thinner vessels. Without these steps results will suffer as vessels may not be fully segmented and flow correctly detected. This preprocessing is followed by thresholding.

Vessel segmentation is based on verifying each pixel at multiple threshold levels as vessel. The method is modified from a pixel verification method proposed by Jiang et al. using retinal images [30]. The pre-processed images are converted to binary images using multiple threshold levels resulting in multiple binary images. Euclidean Distance Transform (EDT) is created for each binary image. EDT calculates the distance of nearest background pixel for each object pixel. The coordinates of the nearest background pixel is the second output of the transform. For each pixel of each binary image, three different features are calculated using the outputs of the EDT and the gray-level intensity values of the pixels. Two of these parameters are the diameter Pd and the angle Pθ of the vessel, which are considered as geometrical features. The gray level intensity values of pre-processed images are used to calculate the third feature, PC, which is the contrast ratio identifying the ratio of intensity across background and blood vessel pixels. These three features serve to determine if a pixel in the image is indeed a vessel pixel. Pd limits the size of the vessel to ensure it is a capillary. Pθ ensures curvilinear structure to the pixel, and excludes any anomalous pixels because of physiological improbabilities. Pc, ensures contrast between background and vessel pixels.

Figure Figure33 provides a visual depiction of these parameters. 5*5 neighborhood of a candidate pixel is included in the calculations. The current pixel is referred to as ‘p’, which is a vessel candidate. Its 24 neighbors are defined as N1N24. The nearest background pixel to ‘p’ is ‘bp’ and the nearest background pixels to each of the 24 neighbors are ‘bn1bn24’. The bn1-24 having the greatest distance from bp is considered the opposite background pixel, bmax. The maximum Euclidean distance from ‘bp’ to ‘bn1-bn24’ is decided to be the diameter of the candidate pixel:

Figure 3
Method of validating vessel pixels. A vessel candidate pixel is labeled as p in Figure Figure3.3. The output of EDT is used to find the nearest background pixel to p, bp. For each of the 24 neighboring pixels in the 5 × 5 neighborhood ...
d=maxbjbn1bn24bp,bj¯
(1)

where bp,bj¯ is the distance between bp and bj. The parameter θ is the angle between the background pixels ‘bp’ and ‘bn1-bn24’ according to Figure Figure3.3. The angle is calculated using the cosine rule. If d is less than Pd then the angle, θ, is calculated between bp, p and bmax. The maximum angle derived from the 24 neighbor pixels is used as ‘θ’:

θ=maxbjbn1bn24cos1p,bp¯2+p,bj¯2d22p,bp¯p,bj¯
(2)

Finally the third feature is the ratio of gray level values of nearest background pixels and the vessel candidate ’p’:

C=maxbjbn1bn24GLbjGLp
(3)

where GL(p) is the gray-level intensity value of current pixel ’p’. To calculate contrast ratio, images with enhanced contrast are used. Therefore, GL in Equation 3 stands for the gray level of the output of the CLAHE.

To verify the vessel candidate pixel, ’d’ needs to be less than pre-defined Pd to avoid large vessels, ’θ’ needs to be larger than Pθ to assure curvilinear structure and the calculated contrast ratio needs to be higher than PC to remove background noise. If the pixel in the binary image is black and it meets the criteria defined by three parameters Pd, Pθ and PC, it is verified to be a vessel pixel. After repeating the same procedure for all threshold levels, the segmented images of each threshold level are combined resulting in one segmented binary image for each frame.

The parameters, Pd, Pθ and PC were selected from multiple experiments using a set of training videos. Pd controls the maximum diameter of the blood vessels to accept. It is determined based on the diameter of blood vessels and capillaries to be included in the microcirculation. Pθ is another geometric parameter to ensure curvilinear structure of the vessels and is empirically derived.

Region growing

Since the segmentation algorithm is based on pixel verification, it is possible to have isolated pixels in the result. To prevent that, binary morphological operators are used before region growing. The morphological operators include filling the isolated interior pixels and opening.

The region growing algorithm is developed to overcome disconnectivity of blood vessels. First, the final segmented image is divided into 35*35 windows to determine the orientation of segmented vessel within the window. The vessel is allowed to grow in the computed direction if the gray level is within the range of average gray level of vessel pixels in the window ±0.5*standard deviation.

FCD calculation

Segmentation processes described up until this stage detect all blood vessels at each frame of the video recording. To provide quantitative information on blood flow, the vessels through which blood is flowing must be identified. To that end, the difference of consecutive segmented frames is calculated pixel by pixel. If the summation of difference for twenty segmented frames is higher than a threshold value, the pixel is assigned as an active blood vessel.

FCD is currently one of the main parameters used to evaluate the microcirculation. FCD can be calculated using two different approaches: one is completely manual by gridding the frame and counting the number of vessels crossing the grid lines; the second approach calculates the ratio of perfused vessels to the total surface using a software tool [31]. FCD is calculated automatically in this study by dividing the area of active vessels to the total area of interest. It is much easier to form the skeleton of the network of active capillaries and calculate the length of this skeleton to form the density measure. However, since the width/thickness of capillaries along this network would be inconsistent (on the actual sublingual surface, the captured video, and in the processed image), the density measure calculated on this length would be the least reliable measure, as it does not incorporate the changes in the thickness of the capillary and therefore the true extent of circulation inside the capillary. The area-based density measure, on the other hand, since it incorporates the thickness of the capillaries into the calculation, is not susceptible to this issue. We have also included the length-based FCD calculation in this paper for comparison with the output from AVA.

Results and discussion

Results

The proposed experimental algorithm and the software product Microcirculation Analyzer (MCA) were applied to videos acquired from a library of microcirculatory videos of a previous animal study. The protocol was approved by the Virginia Commonwealth University Institutional Animal Care and Use Committee in accordance with the National Institutes of Health Guide for the Care and Use of Laboratory Animals (National Institutes of Health Publication 86-23, revised 1996). In this animal study, sublingual microcirculatory videos were taken from nine healthy juvenile swine at baseline as well as after 40% of the animal’s blood was removed. All animals were under a state of general anesthesia. Twenty frames from each video were used for the assessment of the video recordings. The parameters at multi-thresholding stage are defined empirically. Specifically, a series of videos were used as the training set in which we change the values of these parameters over a reasonable range and choose the values that give the parameters providing the best segmentation results. In this study, “the best segmentation result” was visually evaluated. According to this process the image features are obtained; Pd =13, Pθ =130 and PC = 1.17. The angle is calculated in degrees. In order to capture desired vessels and avoid segmenting larger structures like venules, Pd =13 corresponds to a vessel diameter of about 20 μm at the resolution captured by the test camera. An original frame from sublingual microcirculatory video of a healthy subject is displayed in Figure Figure4.4. Active capillaries segmented using MCA are highlighted in Figure Figure55.

Figure 4
An example frame from a healthy subject. An example frame from a sublingual microcirculatory video captured from a healthy baseline subject is presented.
Figure 5
Segmented active capillaries of the frame in FigureFigure44. The result of the proposed algorithm highlights all active capillaries from the original frame in Figure Figure44.

FCD parameters are calculated from SDF videos for nine subjects in both baseline (PPV = 1) and hemorrhage (PPV < 1) conditions. As expected, a significant decrease in FCD is noticed during hemorrhage recordings with respect to baseline videos. For MCA, a paired-samples t-test was conducted to compare FCD values of healthy baseline and hemorrhage video recordings. There was a significant difference in the scores for healthy baseline (μ = 12.68, σ = 1.479, area-based; μ = 3.26 × 10-5, σ = 5.93 × 10-6, length-based) and hemorrhage (μ = 7.35, σ = 2.139, area-based; μ = 1.99 × 10-5, σ = 5.53 × 10-6, length-based) conditions; with t8 = 6.50 and p-value = .000189. These results suggest that the proposed algorithm, MCA, can successfully derive quantitative information from microcirculation videos. Specifically, the results suggest that microcirculatory alterations caused by hemorrhage can be identified by analyzing sublingual microcirculatory video recordings. FCD percentages for nine subjects for healthy baseline and hemorrhage conditions are shown in Table Table11.

Table 1
Calculated FCD values using the automated MCA algorithm, including both area and length based results

The same videos were analyzed using the currently available semi-automated tool, AVA, with manual editing. Analysis was performed using the method described in the manufacture’s tutorial of the product. All videos were analyzed in an identical format. The microcirculation videos are first automatically analyzed using the software tools and then manual interaction with the software for manipulation of the segmentation results must be performed to remove the large vessels, false positives, and vessels without flow. Figure Figure66 provides and example of the microcirculation after hemorrhage and can be compared to the healthy (baseline) microcirculation in Figure Figure44.

Figure 6
Example of hemorrhage subject video source. An original frame from sublingual microcirculatory video of a hemorrhage subject.

Videos were analyzed by two experts previously trained with AVA and the results for each video averaged in the analysis of FCD. These individuals were blinded to FCD values derived from the fully automated method. The analysis resulted in a Kappa coefficient of 0.9 (very good agreement). The Kappa coefficient is a statistical measure of inter-rater agreement. The FCD results of this analysis are provided in Table Table2.2. A significant difference is also noticed in these scores for healthy baseline conditions (μ = 12.26, σ = 1.759, area-based; μ = 1.65 × 10-5, σ = 5.485 × 10-6, length-based) versus hemorrhage conditions (μ = 8.56, σ = 1.432, area-based; μ = 1.20 × 10-5, σ = 4.124 × 10-6, length-based); with t8 = 4.19 and p-value = 0.003.

Table 2
Calculated FCD values using semi-automated software, AVA

It should be pointed out that even though AVA allows manual interaction, the version we had access to does not allow the user to draw the capillaries to be included. If the user sees that a capillary has not been identified, the user must define an area that the vessel resides in and then have the program outline the vessel. However, in some instances, the program will still not outline the vessel for inclusion in the FCD calculations. The user cannot manually force the outlining of vessels.

To clearly understand the results generated by the proposed experimental algorithm (MCA) and heavily edited AVA, a chart is generated showing the FCD values for healthy baseline and hemorrhage conditions. Figure Figure77 shows the results from the heavily edited AVA software. The FCD values from subjects in the healthy baseline condition (PPV = 1) are labeled as baseline. Results of MCA are displayed in Figure Figure8.8. The decrease in FCD values for hemorrhage (PPV < 1) is clearly visible for each subject for the FCD values calculated by the experimental MCA automated algorithm. Figures Figures99 and and1010 provide an example of the overlay between MCA and the edited semi-automated AVA method. However, comparing the compilation of data shown in Figures Figures77 and and88 and Tables Tables11 and and2,2, we conclude that MCA provides a better separation of FCD values between healthy baseline and hemorrhage. Furthermore, a Bland-Altman comparison of heavily edited AVA vs. fully-automated MCA (Figure (Figure11)11) shows that MCA is capable of producing results in line with those achieved from edited AVA.

Figure 7
FCD results calculated from heavily edited AVA. The FCD values calculated from heavily edited AVA for both healthy baseline and hemorrhage conditions are displayed. The healthy condition FCD values are labeled as baseline. The change in FCD values during ...
Figure 8
FCD results calculated using the proposed algorithm (MCA). The FCD values calculated using the proposed algorithm for both healthy baseline and hemorrhage conditions are displayed. The healthy condition FCD values are labeled as baseline. The decrease ...
Figure 9
Overlay of proposed automated method onto heavily edited AVA results showing a high degree of similarity. Results from proposed automated method (green) superimposed over results from heavily edited AVA (red/black). Proposed method returns results 60 ...
Figure 10
Frame of video used for analysis in FigureFigure99. An example frame of the video used to generate Figure Figure99 in both MCA and heavily edited AVA.
Figure 11
Bland-Altman plots showing validity of fully-automated MCA as a measurement tool vs. current “gold standard” of heavily edited AVA (baseline (a) and hemorrhagic (b).a: Bland-Altman plot showing correlation between heavily edited AVA and ...

Discussion

This study presents an entirely automated method, MCA, to derive quantitative information from microcirculatory videos in near real-time. Currently available techniques for analysis of the microcirculation, in their present state, do not appear to be practical in the clinical setting due to the need for significant manual interaction with the software in order to process the image and determine FCD. The significant difference in calculated FCD values across healthy baseline and hemorrhage shows that MCA has the potential for analyzing microcirculation videos in the clinical settings. Although the sample size of this study is relatively small, the algorithm demonstrates promise in its ability to rapidly provide quantitative information. Future studies will test the MCA algorithm on larger datasets—including human microcirculation videos—and improved accordingly. To overcome the variance among different video recordings, machine learning techniques, in particular neural networks and support vector machines that show superior performance in detection of elongated vessel-like objects in both biomedical image processing applications [32,33] as well as other image processing applications [34], will be applied and algorithm parameters adjusted accordingly. The use of machine learning techniques provide for a means to compensate for variations due to differences in factors such as lighting, pressure, video quality and specific machine/camera used for imaging. Notwithstanding the small sample size, the results show promise for an automated system that derives diagnostically important information from microcirculation videos.

MCA and semi-automated AVA both show a significant decrease in FCD values for the hemorrhagic subjects. Even though FCD values calculated using semi-automated AVA are statistically different for the healthy and hemorrhagic cases (μ=3.78, σ=2.267, t8=5.0, p-value = 1.1 × 10−3), the difference is not consistent (Figure (Figure7).7). As noted in Figure Figure9,9, the overlay of analyzed results demonstrates very close performance between the automated MCA algorithm and that of the heavily edited AVA method. FCD values during hemorrhage generated by MCA were consistently lower than FCD values from the healthy baseline state (Figure (Figure8).8). Visual inspection of the videos confirmed the ability of MCA to identify more vessels without flow and thus not include them in the determination of FCD. A potential limitation to this finding is new version of AVA that reportedly allows users to add missed vessels by manual drawing. We did not have access to this version. While use of this newer version may have reduced the differences between semi-automated AVA and the fully automated MCA, this improved version of AVA still requires editing and interaction of the user with the software.

While the approach taken with MCA cannot be considered actual real-time, the 20 second wait for results versus the 20-40 minutes of manual interaction required with semi-automated AVA makes the use of MCA near real-time and may thus be appropriate in the future for bedside point-of-care decision making. Additionally, the use of MCA would negate the considerable training that must be provided to the AVA user in order for them to be able to properly identify the active vessels in the results. This is in contrast to the proposed automated system, which incorporates that knowledge in the algorithm.

In the future, the automated method could be easily integrated into existing SDF or OPSI hardware systems which would allow real-time bedside determinations of FCD and potentially other microcirculatory parameters such as flow quantification. It is likely that in order to use SDF or OPSI derived FCD measures to affect care, an automated and reproducible software approach to analysis will be required for regulatory approval of such an approach.

Recent automated capillary detection methods such as Bezemer et al. [35] demonstrated impressive speed in its analysis. The authors of this method, however, indicate that performance is limited by high cell densities and velocities, which severely impede the applicability of this method in real SDF images. We believe this is due to the fact that many factors and thresholds in this method were set to fixed numbers and that they require adjustment from one video to another (just as in AVA). Again, these issues form the basis for the MCA approach as a means of reaching true automation. While we used a binary assessment of flow (flow or no-flow) in identifying functional capillaries, improvements in assessing flow beyond this simple method may be helpful. This might result in improved accuracy and compensation for some of the mechanical shortcomings of image acquisition using the camera technology, which, is capable of producing pressure related flow artifacts.

Conclusions

A suggested algorithm to analyze microcirculation video recordings based on advanced machine learning is proposed which is capable of identifying active capillaries and calculating FCD parameters automatically. The approach is capable of detecting significant changes in FCD produced by hemorrhage and are comparable to a heavily manually edited commercially available software product. Future work will focus on adjusting the algorithm parameters on larger datasets and improving accuracy as well as developing improved methods of quantifying blood flow. It is hoped that these expanded methods and analyses will lead to the ability to derive diagnostically important decisions from the microcirculatory video recordings as well as to guide therapeutic interventions.

Competing interests

Dr. Demir has intellectual property including pending patents on the technology discussed in this manuscript through Virginia Commonwealth University. She also has served as an employee of Signal Processing Technologies, LLC.

Dr. Hakimzadeh has intellectual property including pending patents on the technology discussed in this manuscript. She also is a co-owner/share-holder of Signal Processing Technologies, LLC which received an NSF SBIR grant for this research. She also serves as Chief Executive Officer at the company.

Dr. Hargraves has intellectual property including pending patents on the technology discussed in this manuscript. She also is a co-owner/share-holder of Signal Processing Technologies, LLC and serves as Chief Technology Officer at the company.

Dr. Ward has intellectual property including pending patents on the technology discussed in this manuscript through Virginia Commonwealth University. He also has serves as an uncompensated consulted to Signal Processing Technologies (SPT), LLC. Dr. Ward used to serve as Chief Medical Officer for SPT with ownership interest but currently he neither has any ownership in SPT nor serves as an officer for this company.

Mr. Myer has intellectual property including pending patents on the technology discussed in this manuscript through Virginia Commonwealth University. He has also served as an employee of Signal Processing Technologies, LLC.

Dr. Najarian has intellectual property including pending patents on the technology discussed in this manuscript through Virginia Commonwealth University. His wife is a co-owner/share-holder of Signal Processing Technologies, LLC, which received an NSF SBIR grant for this research. Dr. Najarian has also served as a technology advisor for Signal Processing Technology LLC.

Authors’ contributions

Dr. SUD participated in the design of the image reprocessing algorithms, implemented the algorithms and processed the videos using the proposed algorithm. Dr.RH supervised the coordination of the entire study and the design and testing of the software. Dr. RHH co-supervised the design, implementation, testing and validation of the vessel detection algorithms and identification of pixels in vessels based on angle, intensity and width. Dr. KRW formed the guidelines for data collection, provided the data, outlined the clinical objectives of the study, and assessed the results from physiological and clinical standpoint and oversaw the general development and refinement of the image processing algorithm. Mr. EVM designed the improvements to the per-processing steps, participated in conducting the comparison between the proposed method and other methods, and carries out the statistical analysis. Dr. KN supervised the design of the entire image processing algorithm, in particular stabilization and region growing. All authors’ read and approved the final manuscript.

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1471-2342/12/37/prepub

Acknowledgments

This material is based upon work supported by the National Science Foundation under Grant No. 1046521. All authors equally contributed to this work. The dataset used in this research was provided by Virginia Commonwealth University, Department of Emergency Medicine. In addition, the authors would like to thank Dr. Hakam Tiba and Gerard Draucker from the Virginia Commonwealth University Reanimation Engineering Science Center (VCURES) for their participation in sample preparation, data collection and verification of the results.

References

  • Cĕrný V, Turek Z, Pařízková R. Orthogonal polarization spectral imaging: a review. Physiol Res. 2007;56:141–147. [PubMed]
  • Bateman R, Sharpe M, Ellis C. Bench-to-bedside review: microvascular dysfunction in sepsis: hemodynamics, oxygen transport and nitric oxide. Crit Care Med. 2003;7:359–373. doi: 10.1186/cc2353. [PMC free article] [PubMed] [Cross Ref]
  • Hebbel R, Osarogiagbon R, Kaul D. The endothelial biology of sickle cell disease; inflammation and chronic vasculopathy. Microcirculation. 2004;11:129–151. [PubMed]
  • Stuart M, Nagel R. Sickle cell disease. Lancet. 2004;364:1343–1360. doi: 10.1016/S0140-6736(04)17192-4. [PubMed] [Cross Ref]
  • Levy B, Ambrosio G, Pries A, Struijker-Boudier H. Microcirculation in hypertension: a new target for treatment? Circulation. 2001;104:735–740. doi: 10.1161/hc3101.091158. [PubMed] [Cross Ref]
  • Verdant C, Backer DD. Monitoring of the microcirculation may help us at the bedside. Curr OpinCrit Care. 2005;11(3):240–244. doi: 10.1097/01.ccx.0000158849.94225.11. [PubMed] [Cross Ref]
  • Nath K, Katusic Z, Gladwin M. The perfusion paradox and instability in sickle cell disease. Microcirculation. 2004;11:179–193. [PubMed]
  • Kaul D, Farby M. In vivo studies of sickle red blood cells. Microcirculation. 2004;11:153–156. [PubMed]
  • Touyz R. Intracellular mechanisms involved in vascular remodeling of resistance arteries in hypertension: role of angiotensin II. Exp Physiol. 2005;90:449–455. doi: 10.1113/expphysiol.2005.030080. [PubMed] [Cross Ref]
  • Serne E, Gans R, ter Maaten J, Tangelder G, Donker A, Stehouwer C. Impaired skin capillary recruitment in essential hypertension is caused by both functional and structural capillary rarefaction. Hypertension. 2001;38:238–242. doi: 10.1161/01.HYP.38.2.238. [PubMed] [Cross Ref]
  • Creager M, Luscher T, Cosentino F, Bechkman J. Diabetes and vascular disease: pathophysiology, clinical consequences, and medical therapy: part I. Circulation. 2003;108:1527–1532. doi: 10.1161/01.CIR.0000091257.27563.32. [PubMed] [Cross Ref]
  • Atasever B, Boer C, van der Kuil M. Quantitative imaging of microcirculatory response during nitroglycerin-induced hypotension. J Cardiothorac Vasc Anesth. 2011;25(1):140–144. doi: 10.1053/j.jvca.2009.11.006. [PubMed] [Cross Ref]
  • Balestra G, Bezemer R, Boerma E, Yong Z, Sjauw K, Engstrom A, Koopmans M, Ince C. Improvement of sidestream dark field imaging with an image acquisition stabilizer. BMC Med Imaging. 2010;10:15. doi: 10.1186/1471-2342-10-15. [PMC free article] [PubMed] [Cross Ref]
  • Ince C. Sidestream dark field imaging: an improved technique to observe sublingual microcirculation. Crit Care. 2005;9:72.
  • Groner W, Winkelman JW, Harris AG, Ince C, Bouma GJ, Messmer K, Nadeau RG. Orthogonal polarization spectral imaging: a new method for study of the microcirculation. Natmed. 1999;5:1209–1212. [PubMed]
  • Goedhart PT, Khalilzada M, Bezemer R, Merza J, Ince C. Sidestream dark field (SDF) imaging: a novel stroboscopic LED ring-based imaging modality for clinical assessment of the microcirculation. Opt Express. 2007;15:15101–15114. doi: 10.1364/OE.15.015101. [PubMed] [Cross Ref]
  • Awan ZA, Wester T, Kvernebo K. Human microvascular imaging: a review of skin and tongue videomicroscopy techniques and analysing variables. Clin Physiol Funct Imaging. 2010;30:79–88. doi: 10.1111/j.1475-097X.2009.00913.x. [PubMed] [Cross Ref]
  • Klyscz T, Junger M, Jung F, Zeintl H. Cap image: a new kind of computer-assisted video image analysis system for dynamic capillary microscopy. Biomed Tech (Berl) 1997;42:168–175. [PubMed]
  • Genzel-Boroviczeny O, Strotgen J, Harris AG, Messmer K, Christ F. Orthogonal polarization spectral imaging (OPS): a novel method to measure the microcirculation in term and preterm infants transcutaneously. Pediatr Res. 2002;51:386–391. doi: 10.1203/00006450-200203000-00019. [PubMed] [Cross Ref]
  • Bauer A, Kofler S, Thiel M, Elfert S, Christ F. Monitoring of the sublingual microcirculation in cardiac surgery using orthogonal polarization spectral imaging. The American Society of Anesthesiologists. 2007;107(6):939–945. [PubMed]
  • Schaudig S, Dadasch B, Kellam K, Christ F. Proceedings of the 7th World Congress for Microcirculation. Sydney: Australian and New Zealand Microcirculation Society; 2001. Validation of an analysis software for OPS-imaging used in humans; pp. 2–59.
  • Zhong J, Asker C, Salerud E. Imaging, image processing and pattern analysis of skin capillary ensembles. Skin Res Technol. 2000;6:45–57. doi: 10.1034/j.1600-0846.2000.006002045.x. [PubMed] [Cross Ref]
  • Sainthillier J, Gharbi T, Muret P, Humbert P. Skin capillary network recognition and analysis by means of neural algorithms. Skin Res Technol. 2005;11:9–16. doi: 10.1111/j.1600-0846.2005.00087.x. [PubMed] [Cross Ref]
  • Dobbe J, Streekstra G, Atasever B, van Zijderveld R, Ince C. The measurement of functional microcirculatory density and velocity distributions using automated image analysis. Med BiolEngComput. 2008;46(7):659–670. [PMC free article] [PubMed]
  • Nolte D, Zeintl H, Steinbauer M, Pickelmann S, Messmer K. Functional capillary density: an indicator of tissue perfusion? Int J MicrocircClinExp. 1995;15:244–249. doi: 10.1159/000179025. [PubMed] [Cross Ref]
  • Zitov_a B, Flusser J. Image registration methods: a survey. Image and Vision Computing. 2003;21(11):977–1000. doi: 10.1016/S0262-8856(03)00137-9. [Cross Ref]
  • Demir S, Mirshahi N, Tiba M, Draucker G, Ward K, Hobson R, Najarian K. ICME International Conference on Complex Medical Engineering (CME 2009): 9-11 April 2009; Tempe. IEEE; 2009. Image processing and machine learning for diagnostic analysis of microcirculation; pp. 1–5.
  • Zuiderveld K. In: Graphics Gems IV. Heckbert PS, editor. San Francisco: Morgan Kaufmann; 1994. Contrast limited adaptive histogram equalization; pp. 474–485.
  • Najarian K, Splinter R. Biomedical Signal and Image Processing. Boca Raton: The CRC Press; 2005.
  • Jiang X, Mojon D. Adaptive local thresholding by verification-based multithreshold probing with application to vessel detection in retinal images. IEEE Trans Pattern Anal Mach Intell. 2003;25:131–137. doi: 10.1109/TPAMI.2003.1159954. [Cross Ref]
  • Backer DD, Hollenberg S, Boerma C, Goedhart P, Büchele G, Ospina-Tascon G, Dobbe I, Ince C. How to evaluate the microcirculation: report of a round table conference. Crit Care. 2007;11(5):R101. doi: 10.1186/cc6118. [PMC free article] [PubMed] [Cross Ref]
  • Chen W, Smith R, Ji SY, Ward K, Najarian K. Automated ventricular systems segmentation in brain CT images by combining low-level segmentation and high level template matching. BMC Med Inform Decis Mak. 2009;9(Suppl 1):S4. doi: 10.1186/1472-6947-9-S1-S4. [PMC free article] [PubMed] [Cross Ref]
  • Ji SY, Smith R, Huynh T, Najarian K. A comparative analysis of multi-level computer-assisted decision making systems for traumatic brain injuries. BMC Med Inform Decis Mak. 2009;9:2. doi: 10.1186/1472-6947-9-2. [PMC free article] [PubMed] [Cross Ref]
  • Muralikrishnan B, Najarian K, Raja J. Surface wavelength based clustering using neural networks for manufacturing process mapping. Int J Mach Tool Manuf. 2003;43(4):369–477. doi: 10.1016/S0890-6955(02)00272-9. [Cross Ref]
  • Bezemer R, Dobbe J, Bartels S, Boerma C, Elbers P, Heger M, Ince C. Rapid automatic assessment of microvascular density in sidestream dark field images. Med Biol Eng Comput. 2011;49:1269–1278. doi: 10.1007/s11517-011-0824-1. [PMC free article] [PubMed] [Cross Ref]

Articles from BMC Medical Imaging are provided here courtesy of BioMed Central
PubReader format: click here to try

Formats:

Related citations in PubMed

See reviews...See all...

Cited by other articles in PMC

Links

  • MedGen
    MedGen
    Related information in MedGen
  • PubMed
    PubMed
    PubMed citations for these articles

Recent Activity

    Your browsing activity is empty.

    Activity recording is turned off.

    Turn recording back on

    See more...