An innovative system for 3D clinical photography in the resource-limited settings
- Saharnaz Baghdadchi†1,
- Kimberly Liu†2,
- Jacquelyn Knapp3,
- Gabriel Prager4,
- Susannah Graves1,
- Kevan Akrami1,
- Rolanda Manuel5,
- Rui Bastos5,
- Erin Reid1,
- Dennis Carson1,
- Sadik Esener1,
- Joseph Carson6Email author and
- Yu-Tsueng Liu1Email author
© Baghdadchi et al.; licensee BioMed Central Ltd. 2014
Received: 3 April 2014
Accepted: 6 June 2014
Published: 15 June 2014
Kaposi’s sarcoma (KS) is the most frequently occurring cancer in Mozambique among men and the second most frequently occurring cancer among women. Effective therapeutic treatments for KS are poorly understood in this area. There is an unmet need to develop a simple but accurate tool for improved monitoring and diagnosis in a resource-limited setting. Standardized clinical photographs have been considered to be an essential part of the evaluation.
When a therapeutic response is achieved, nodular KS often exhibits a reduction of the thickness without a change in the base area of the lesion. To evaluate the vertical space along with other characters of a KS lesion, we have created an innovative imaging system with a consumer light-field camera attached to a miniature “photography studio” adaptor. The image file can be further processed by computational methods for quantification.
With this novel imaging system, each high-quality 3D image was consistently obtained with a single camera shot at bedside by minimally trained personnel. After computational processing, all-focused photos and measurable 3D parameters were obtained. More than 80 KS image sets were processed in a semi-automated fashion.
In this proof-of-concept study, the feasibility to use a simple, low-cost and user-friendly system has been established for future clinical study to monitor KS therapeutic response. This 3D imaging system can be also applied to obtain standardized clinical photographs for other diseases.
It cannot be over-emphasized that high-quality images are critical for clinical decisions. The current trend of establishing electronic health record (EHR) in the resource-rich settings and mobile device-based health care system to reach patients in the resource-limited settings makes standardization and acquisition of high-quality clinical photography an imperative issue. Standardization of clinical images is not only crucial for disease diagnosis, patient follow-up, clinical communication and medical education, but also for computer-aided clinical management. While nearly all of the radiological imaging systems, e.g. plain X ray, CT, MRI and ultrasound, have standard guidelines for obtaining and interpreting images, there is little consensus or effort in clinical photography except for a few areas, such as presenting the outcome of a plastic surgery. In fact, many diseases can be diagnosed by their characteristic presentations before any further confirmation tests. Several medical journals, such as the New England Journal of Medicine (Images in Clinical Medicine and Image Challenge) , Journal of American Medical Association (Clinical Challenge) , British Medical Journal (Picture Quiz), etc., frequently publish typical diseases that may be diagnosed through the analysis of a single clear and informative image.
In 1989, The AIDS Clinical Trial Group (ACTG) proposed a KS staging system using a three-tiered system that classified the extent of tumor (T) involvement, the status of a patient’s immune system (I) assessed by CD4 cell count, and the severity of their systemic illness (S) as “good risk” or “poor risk” . The ACTG staging system and variants that are used to assess KS therapeutic response may include lesion counts, assessment of lesion color, nodularity, ulceration and associated edema, measurement of sum of the product of the diameters of 5 marker lesions, and evaluation for oral KS and secondary effects of KS [3–6]. The color and degree of nodularity of KS lesions are difficult to quantify, but often provide important information about response to treatment . While conventional photography is probably the single most useful technique for imaging KS, it does not provide enough information about tumor nodularity and other important characteristics.
In contrast to what many would think, obtaining high-quality clinical photography is not trivial [7–9]. The suggestion of using professional clinical photographers in the professional studio settings to control the surrounding environment for light, angle etc. is not overstated for producing clear and informative photographs. However, a photographer cannot focus on a relevant lesion unless he or she has been told by an experienced clinician. Therefore, it would be difficult to generate informative images without knowing where to focus. To overcome this dilemma and to ease the technical hurdles, we have developed an innovative approach by taking advantage of the light-field photography in conjunction with a design of a miniaturized “photography studio” to control environment and standardize the image presentation. Here we present a proof-of-concept approach for developing a 3D image based system to monitor therapeutic response of Kaposi’s sarcoma in Mozambique. While this system is developed for clinical photography, applications exist for other areas that require collecting evidence by non-professional personnel in field, including applications for veterinary, agriculture, and even crime investigation.
3D imaging system
Miniature “Photography Studio” Adaptor
The adaptor was designed to create a standardized background environment for the Lytro snapshot by fulfilling the mechanical, optical and post processing requirements. It is to be placed at the front end of the Lytro camera and holds the camera at 45 degree with respect to the skin (Figure 1). The SolidWorks software was used to design the mechanical structure of the adaptor. It consists of two conceptual parts that are attached together and then 3D printed as a single element. The Dimension 1200es 3D Printer from Stratasys Company was used for this purpose. The layer thickness of the printer is 0.254 mm (.010 in.) and it uses ABSplus (acrylonitrile butadiene styrene)  that is resistant to alcohol and is therefore suitable for sterilization purposes. Different views of the CAD (Computer-aided design) structure can be seen in Figure 1A-1C. Designed to enable optimal object illumination, the adaptor consists of a matrix of two by two strip LEDs (Figure 1C and 1F) along with a switching circuit that are installed and fitted on the adaptor’s top surface.
Kaposi sarcoma lesions
Anonymous clinical photographs of KS lesions were obtained from the Dermatology Service at the Maputo Central Hospital (MCH) in Maputo, Mozambique. The great majority of patients (>90%) with KS at MCH are infected with HIV, and many are diagnosed as HIV positive at the time that they present with KS. Ten to fifteen patients with KS are admitted to the Dermatology service at MCH per month. Currently, MCH physicians document treatment response in the clinical chart using sketch diagrams and verbal descriptions.
All-focused image and 3D image model
Using a program modified from an open source python library, lfp-reader-2.0.0 , the original Lytro image file (.lfp) was extracted to obtain JPEG images (usually 12) of different focused depths, and a corresponding depth map was generated. We used batch processing to generate 12 JPEG files, a depth map and an all-focused image. The procedure was controlled through a graphic user interface (GUI) for ease of code execution. The final data was outputted into individual folders for each Lytro image set.
Another GUI program was created for rendering the 3D model of each Lytro image data using the aforementioned depth map and all-focused image. This program is a modification of the code from a command-line based C program .
We also used a computational software program, Mathematica, to perform a final 3D display with interactive rotation capabilities. As inputs, Mathematica receives the depth map, stored in ASCII format, as well as the corresponding all-focused JPEG. Our customized display script calls the Mathematica function ListSurfacePlot3D to generate the 3D shape from the depth map. Within this function, Mathematica’s PlotStyle option is called to texture the rendered 3D shape with the all-focused JPEG. Once the fully textured 3D data is displayed, Mathematica’s standard interactive tools may be used to rotate the object around any of the three dimensional axes.
Evaluation of relative volume change
The relative volume change was evaluated by a prototype software program that uses the projected area of a lesion to derive an average radius. The average radius is then used to approximate a three-dimensional volume. The prototype software program carries out these procedures by first counting the number of pixels, in a single 2D digital image, occupied by the object. This number of pixels represents the object’s projected area, in relative units. In order to convert this into a signature radius, the program generates a hypothetical circle whose area, in pixel units, is equal to the object’s projected area. Using the formula for the area of a circle, Area = π(radius) 2 , the program solves for a radius, in units of pixels, using the aforementioned measured area. This procedure is repeated for each unique perspective snapshot, and the radii are averaged. The camera adaptor (Figure 1) ensures that the distance to the object remains constant between the unique perspective snapshots. The averaged radius value is then converted into a volume, in units of cubic pixels, using the formula for a sphere, Volume = 4/3 π(radius) 3 . This value represents a signature relative volume, which may be used to measure fractional relative changes between a lesion that is photographed at different points in time.
A challenge for the aforementioned technique is accurately identifying, in the digital image, the visual boundary between the lesion and the background skin surface, a step that is necessary in order for the program to accurately calculate the projected area. In our current proof-of-concept program, we have successfully applied two different methods for determining this boundary: (1) by utilizing the information in the depth map to separate the lesion from the background surface through differences in depth; and (2) by visual inspection and manual input from a user who traces out the edge of the lesion on a digital touchscreen. In test cases, both strategies proved effective for a range of images, though each method has its strengths and limitations. Method (1) successfully works as long as program parameters are carefully optimized for typical depth map shapes. While proving effective for a range of lesion types, it can be a risky strategy for lesions that may represent diverse sizes, depths, and viewing angles. For example, it has particular difficulties for shallow lesions, where there is little change in height between the lesion and the skin. Despite these drawbacks, an advantage of this method is that it is fully automated, once parameters are well tuned, and therefore avoids potential errors associated with human error. Method (2), lesion boundary identification by visual inspection, has proven in our tests to be the most accurate method and the most capable method for accommodating diverse lesion sizes and shapes. Its primary disadvantage is that it requires human input and therefore adds an element of potential subjectivity, and potential human error, into the procedure.
Miniature “Photography Studio” Adaptor
The adaptor is used to maintain constant geometric conditions of the environment and to provide controllable illumination. Its development was motivated by our having experienced initial difficulty to obtain a reliable 3D image using the Lytro camera alone. The adaptor simplifies the effort to generate a 3D image with a single shot and to compare the images of lesions before and after treatment.
All-focused image and 3D image model
Evaluation of relative volume change
An increasing number of digital technologies are being applied to promote virtual communication between patients and healthcare providers and medical specialists, without requiring face-to-face encounters. Accordingly, there has been a surging interest in utilizing mobile technology to meet the rising healthcare demand in developed countries, as well as to serve people living in a more resource-limited world.
An opportunity exists to apply a novel digital imaging technology to improve diagnosis and long-term monitoring of Kaposi’s Sarcoma (KS) in a resource limited setting. A recent report from Mozambique has shown that KS is the most frequent cancer among men and the second most frequent among women . Remarkably, 20% (296/1507) of cancers diagnosed at the Maputo Central Hospital (MCH) are KS. The therapeutic response of KS may be different between this region and western countries, providing some of the motivation for effective monitoring tools . Furthermore, in many cases, multiple KS lesions develop simultaneously, and may progress and regress independently. Unfortunately, relatively little is known about the varying response to treatment, and about the most effective therapeutic regimens . Infrastructural inadequacies in the provisions of cancer care in sub-Saharan Africa pose great challenges for precise therapeutic monitoring. Therefore, there is an unmet need to develop a simple, but accurate, tool for improving diagnosis and long-term monitoring in such a resource-limited setting. While color and thickness of KS lesions are difficult to quantify, they provide important information about response to treatment . Our simple and inexpensive imaging system and analytic software will resolve such a dilemma. Furthermore, the single processed all-focused images of the KS lesions were mostly around 80 kb (30–220 kb for 185 snapshots). This file size is transmissible through a mobile phone for preliminary diagnosis or triage.
The myriad benefits of such a tool should not be underestimated. In medicine, as in many fields, a picture is often worth a thousand words. Photographs are important tools for recording and tracking the progression of visible lesions. Effective utilization of photographic techniques can help reduce the patient and physician’s anxiety about adequate detection of lesion changes, help early identification and treatment of malignancy, and lead to fewer invasive procedures . However, acquiring a clear, informative photo is not trivial. Apparently, one of the most obvious problems with conventional photography is the burden of accurate focus on the target. Our recent adoption of an emerging technology, light field photography using the Lytro camera, succeeds in capturing multi-focal images with a single photo shot. However, we and others have often experienced frustrations in acquiring such ideal images .Combining theoretical and experimental approaches, we were able to design an adaptor to serve as a miniature “photography studio” that enables reliable and predictable 3D image acquisition (Figure 1). Such an adaptor provides a controllable light source and enables standardized images (with a fixed camera-to-object distance and angle) for automated computational analysis. This is a very important step since, without this adaptor, image quality can suffer from day-to-day and person-to-person variations. Moreover, it makes the operation simple and intuitive, as one only needs the same level of skill required to use a smartphone or a digital camera. While our current software system is capable of producing a 3D image from a single Lytro snapshot (see Figures 2 and 3), our next-generation software should also be able to take advantage of instances where the clinical staff collects multiple snapshots to provide more comprehensive data.We envision the light field camera as a useful general tool for clinical photography. There is no need to select focal planes because the Lytro camera records all of the light rays within a distance based on the setting. This is a very attractive function for a busy clinic that may lack trained personnel to take medical photography. Importantly, a clinician can review the images at other focal planes that may not be foreseen as necessary, but become crucial when a disease progresses. Furthermore, an all-focused image (Figure 2) or a 3D rotatable model can be created computationally, as shown in Figure 3. While we used a commercially available program (e.g. Mathematica) for fast, prototype-level, 3D image modeling, we plan to transition to an open-source, 3D modeling program. This final version is intended to integrate and streamline every aspect of the image processing, enabling a user-friendly automatic system that can be used in the resource limited settings.
For surface volumetric analysis, we used a simple prototype software program, as previously described. There are many other computational methods for 3D volume measurement . Clinically, it has been discussed whether more sophisticated medical imaging methods, such as CT and MRI, are more useful for measuring clinical outcomes . It appears that the usefulness of a method is not only associated with the power of the computational algorithm, but also the limitation of the available technologies and practical requirements of standardization. Historically, the World Health Organization (WHO) proposed, more than 30 years ago, a system for obtaining cross-sectional images as a biomarker for therapeutic response . For example, in this system a partial response is designated when bi-dimensional measurement of a single lesion shows greater than 50% reduction in cross-sectional area (as measured by perpendicular diameters). While the WHO criteria remain useful, an attempt to further simplify and standardize methods has been recently made [26, 27]. The response evaluation criteria in solid tumors (RECIST) were proposed by the European Organization for Research and Treatment of Cancer (EORTC) in collaboration with the National Cancer Institute (NCI) and the National Cancer Institute of Canada Clinical Trials Group. Interestingly, the RECIST criteria only made use of the one-dimensional measurement rather than the product of two perpendicular linear measurements. According to their system, a partial response is defined as at least a 30% decrease in the sum of the longest diameter of the target lesions. It appears that the RECIST criteria were designed to simplify the way to gather and record information, not necessarily to increase accuracy. Whether 1D, 2D or 3D models are more useful seems to be associated with the nature of lesions, and will be constantly debated [24, 27–29]. Nevertheless, the variations of measurement should be reasonably small if the method is to be useful. In our study (Figure 4), the simple technique can successfully measure relative changes in volume (for longitudinal follow-up) with an uncertainty of 4%, which is useful. But it would not be useful for horizontal comparison for two unrelated lesions (34% uncertainty). We are currently exploring different techniques and expect to use multiple methods depending on conditions.
As described earlier, a critical factor for volume estimation is identifying the boundary of a lesion. We have applied two non-mutual exclusive approaches. A third potential method, that we have yet to test, is boundary identification through changes in color. This strategy holds some promise as either an independent technique or as a supplement to the aforementioned methods. It holds the potential to be fully automatable, but may require optimization for typical patient skin color and typical lesion color characteristics. Ultimately, the optimal technique for lesion boundary identification is an area of investigation that requires further development, perhaps in conjunction with a careful analysis of typical lesion characteristics. It may require some combination of the three described techniques. We defer such a detailed investigation for future work.
Although our report focuses on the application of our imaging system to potentially monitor therapeutic response of KS, the same approach can be applied for screening skin lesions, especially for longitudinal follow-up . While early diagnosis and treatment is the best strategy for reducing cancer mortality, overuse of expensive and/or invasive procedures increases morbidity and healthcare costs in developed countries [30, 31] and is impractical in resource-limited settings. However, introduction of simple and inexpensive diagnostics and imaging devices has been proven to be useful in clinics. For example, the number-needed-to-excise (NNE) value, a measurement for accuracy of melanoma diagnosis, has been improved only in specialized and not in non-specialized clinical settings in a multicenter study over a 10-year period . The main difference has been attributed to a larger use of diagnostic techniques, especially the simple and inexpensive dermatoscope, and digital monitoring [22, 33]. As described earlier, our 3D imaging system may be especially useful in the telehelth settings as high-quality and relevant images can be obtained without extensive training of the operator. Moreover, it is possible to have a preliminary analysis by a software system as standardized images are obtained.
In this proof-of-concept study, a feasibility to use a simple, low-cost and user-friendly system has been established for future clinical study to monitor KS therapeutic response. This innovative system can also be applied to obtain standardized clinical photographs for other diseases.
This research is supported by UCSD Cancer Center (NIH/NCI P30 CA23100 ) and Center for AIDS Research (NIAID P30 AI36214) HIV associated malignancy pilot grant (YL), and 5R21CA137346-02 (YL). We thank Robert Schooley for his support and advice on this study, Isaiah Freerksen and Mark Steinborn for assisting 3D printing and Alex Liu for preparing Figure 1 A-C.
- Kassirer JP: Images in Clinical Medicine. N Engl J Med. 1992, 326: 829-830. 10.1056/NEJM199203193261211.View ArticlePubMedGoogle Scholar
- Chang HJ, Fontanarosa PB: Introducing the JAMA Clinical Challenge. JAMA. 2011, 305: 1910-1910. 10.1001/jama.2011.625.View ArticleGoogle Scholar
- Krown SE, Metroka C, Wernz JC: Kaposis Sarcoma in the Acquired Immune-Deficiency Syndrome - a Proposal for Uniform Evaluation, Response, and Staging Criteria. J Clin Oncol. 1989, 7: 1201-1207.PubMedGoogle Scholar
- Uldrick TS, Wyvill KM, Kumar P, O'Mahony D, Bernstein W, Aleman K, Polizzotto MN, Steinberg SM, Pittaluga S, Marshall V, Whitby D, Little RF, Yarchoan R: Phase II study of bevacizumab in patients with HIV-associated Kaposi’s sarcoma receiving antiretroviral therapy. J Clin Oncol. 2012, 30: 1476-1483. 10.1200/JCO.2011.39.6853.PubMed CentralView ArticlePubMedGoogle Scholar
- O’Mahony D, Gandjbakche A, Hassan M, Vogel A, Yarchoan R: Imaging techniques for Kaposi’s sarcoma. J HIV Ther. 2008, 13: 65-71.PubMed CentralPubMedGoogle Scholar
- Krown SE, Testa MA: Huang J: AIDS-related Kaposi’s sarcoma: prospective validation of the AIDS Clinical Trials Group staging classification. AIDS Clinical Trials Group Oncology Committee. J Clin Oncol. 1997, 15: 3085-3092.PubMedGoogle Scholar
- Nayler JR: Clinical photography: a guide for the clinician. J Postgrad Med. 2003, 49: 256-262.PubMedGoogle Scholar
- Persichetti P, Simone P, Langella M, Marangi GF, Carusi C: Digital photography in plastic surgery: How to achieve reasonable standardization outside a photographic studio. Aesthetic Plast Surg. 2007, 31: 194-200. 10.1007/s00266-006-0125-5.View ArticlePubMedGoogle Scholar
- Barut C, Ertilav H: Guidelines for standard photography in gross and clinical anatomy. Anat Sci Educ. 2011, 4: 348-356. 10.1002/ase.247.View ArticlePubMedGoogle Scholar
- Ng R: Light Field Photography with a Hand-held Plenoptic Camera. 2005, Stanford, California: Stanford Tech Report CTSR 2005–02Google Scholar
- Georgiev T, Yu Z, Lumsdaine A, Goma S: Lytro camera technology: theory, algorithms, performance analysis. Proc. SPIE 8667, Multimedia Content and Mobile Devices, 86671J. 2013, doi:10.1117/12.2013581Google Scholar
- Bishop TE, Favaro P: The Light Field Camera: Extended Depth of Field, Aliasing, and Superresolution. IEEE Trans Pattern Anal Mach Intell. 2012, 34: 972-986.View ArticlePubMedGoogle Scholar
- Bogost I: A Machine That Makes Cameras: The Aesthetics of the Lytro. The Atlantic. 2012,http://www.theatlantic.com/technology/archive/2012/12/a-machine-that-makes-cameras-the-aesthetics-of-the-lytro/265692/,Google Scholar
- Adelson EH, Wang JYA: Single Lens Stereo with a Plenoptic Camera. IEEE Trans Pattern Anal Mach Intell. 1992, 14: 99-106. 10.1109/34.121783.View ArticleGoogle Scholar
- Novakova-Marcincinova L, Novak-Marcincin J, Barna J, Torok J: Special materials used in FDM rapid prototyping technology application. Intelligent Engineering Systems (INES), 2012 IEEE 16th International Conference on; 13–15 June 2012. 2012, 73-76.http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=6249805,Google Scholar
- lfp-reader 2.0.0.https://pypi.python.org/pypi/lfp-reader/2.0.0,
- Simple OpenGL lfp viewer.https://github.com/syoyo/lfptools/tree/master/glview,
- Krown SE: Metroka C, Wernz JC: Kaposi’s sarcoma in the acquired immune deficiency syndrome: a proposal for uniform evaluation, response, and staging criteria. AIDS Clinical Trials Group Oncology Committee. J Clin Oncol. 1989, 7: 1201-1207.PubMedGoogle Scholar
- Carrilho C, Ferro J, Lorenzoni C, Sultane T, Silva-Matos C, Lunet N: A contribution for a more accurate estimation of the incidence of Kaposi sarcoma in Mozambique. Int J Cancer. 2013, 132: 988-989. 10.1002/ijc.27714.View ArticlePubMedGoogle Scholar
- Letang E, Lewis JJ, Bower M, Mosam A, Borok M, Campbell TB, Naniche D, Newsom-Davis T, Shaik F, Fiorillo S, Miro JM, Schellenberg D, Easterbrook PJ: Immune reconstitution inflammatory syndrome associated with Kaposi sarcoma: higher incidence and mortality in Africa than in the UK. AIDS. 2013, 27: 1603-1613. 10.1097/QAD.0b013e328360a5a1.View ArticlePubMedGoogle Scholar
- Krown SE: Treatment strategies for Kaposi sarcoma in sub-Saharan Africa: challenges and opportunities. Curr Opin Oncol. 2011, 23: 463-468. 10.1097/CCO.0b013e328349428d.PubMed CentralView ArticlePubMedGoogle Scholar
- Menzies SW, Emery J, Staples M, Davies S, McAvoy B, Fletcher J, Shahid KR, Reid G, Avramidis M, Ward AM, Burton RC, Elwood JM: Impact of dermoscopy and short-term sequential digital dermoscopy imaging for the management of pigmented lesions in primary care: a sequential intervention trial. Br J Dermatol. 2009, 161: 1270-1277. 10.1111/j.1365-2133.2009.09374.x.View ArticlePubMedGoogle Scholar
- Preim B, Botha CP: Visual Computing for Medicine: Theory, Algorithms, and Applications. 2013, Burlington, Massachusetts: Morgan KaufmannGoogle Scholar
- Gavrielides MA, Kinnard LM, Myers KJ, Petrick N: Noncalcified lung nodules: volumetric assessment with thoracic CT. Radiology. 2009, 251: 26-37. 10.1148/radiol.2511071897.PubMed CentralView ArticlePubMedGoogle Scholar
- Miller AB, Hoogstraten B, Staquet M, Winkler A: Reporting results of cancer treatment. Cancer. 1981, 47: 207-214. 10.1002/1097-0142(19810101)47:1<207::AID-CNCR2820470134>3.0.CO;2-6.View ArticlePubMedGoogle Scholar
- Therasse P, Arbuck SG, Eisenhauer EA, Wanders J, Kaplan RS, Rubinstein L, Verweij J, Van Glabbeke M, van Oosterom AT, Christian MC, Gwyther SG: New guidelines to evaluate the response to treatment in solid tumors. European Organization for Research and Treatment of Cancer, National Cancer Institute of the United States, National Cancer Institute of Canada. J Natl Cancer Inst. 2000, 92: 205-216. 10.1093/jnci/92.3.205.View ArticlePubMedGoogle Scholar
- Eisenhauer EA, Therasse P, Bogaerts J, Schwartz LH, Sargent D, Ford R, Dancey J, Arbuck S, Gwyther S, Mooney M, Rubinstein L, Shankar L, Dodd L, Kaplan R, Lacombe D, Verweij J: New response evaluation criteria in solid tumours: revised RECIST guideline (version 1.1). Eur J Cancer. 2009, 45: 228-247. 10.1016/j.ejca.2008.10.026.View ArticlePubMedGoogle Scholar
- Tirkes T, Hollar MA, Tann M, Kohli MD, Akisik F, Sandrasegaran K: Response criteria in oncologic imaging: review of traditional and new criteria. Radiographics. 2013, 33: 1323-1341. 10.1148/rg.335125214.View ArticlePubMedGoogle Scholar
- Petrick N, Kim HJ, Clunie D, Borradaile K, Ford R, Zeng R, Gavrielides MA, McNitt-Gray MF, Lu ZQ, Fenimore C, Zhao B, Buckler AJ: Comparison of 1D, 2D, and 3D nodule sizing methods by radiologists for spherical and complex nodules on thoracic CT phantom images. Acad Radiol. 2014, 21: 30-40. 10.1016/j.acra.2013.09.020.View ArticlePubMedGoogle Scholar
- IOM: Care at Lower Cost: The Path to Continuously Learning Health Care in America. 2012, Washington, D.C: The National Academies PressGoogle Scholar
- Qaseem A, Alguire P, Dallas P, Feinberg LE, Fitzgerald FT, Horwitch C, Humphrey L, Leblond R, Moyer D, Wiese JG, Weinberger S: Appropriate Use of Screening and Diagnostic Tests to Foster High-Value, Cost-Conscious Care. Ann Intern Med. 2012, 156: 147-149. 10.7326/0003-4819-156-2-201201170-00011.View ArticlePubMedGoogle Scholar
- Argenziano G, Cerroni L, Zalaudek I, Staibano S, Hofmann-Wellenhof R, Arpaia N, Bakos RM, Balme B, Bandic J, Bandelloni R, Brunasso AM, Cabo H, Calcara DA, Carlos-Ortega B, Carvalho AC, Casas G, Dong H, Ferrara G, Filotico R, Gomez G, Halpern A, Ilardi G, Ishiko A, Kandiloglu G, Kawasaki H, Kobayashi K, Koga H, Kovalyshyn I, Langford D, Liu X: Accuracy in melanoma detection: a 10-year multicenter survey. J Am Acad Dermatol. 2012, 67: 54-59. 10.1016/j.jaad.2011.07.019.View ArticlePubMedGoogle Scholar
- Carli P, De Giorgi V, Crocetti E, Mannone F, Massi D, Chiarugi A, Giannotti B: Improvement of malignant/benign ratio in excised melanocytic lesions in the ’dermoscopy era’: a retrospective study 1997–2001. Br J Dermatol. 2004, 150: 687-692. 10.1111/j.0007-0963.2004.05860.x.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.