A Novel Method to Improve Quality Surface Coverage in Multi-View Capture arXiv The depth of field of a camera is a limiting factor for applications that require taking images at a short subject-to-camera distance or using a large focal length, such as total body photography, archaeology, and other close-range photogrammetry applications. Furthermore, in multi-view capture, where the target is larger than the camera’s field of view, an efficient way to optimize surface coverage captured with quality remains a challenge. Given the 3D mesh of the target object and camera poses, we propose a novel method to derive a focus distance for each camera that optimizes the quality of the covered surface area. We first design an Expectation-Minimization (EM) algorithm to assign points on the mesh uniquely to cameras and then solve for a focus distance for each camera given the associated point set. We further improve the quality surface coverage by proposing a -view algorithm that solves for the points assignment and focus distances by considering multiple views simultaneously. We demonstrate the effectiveness of the proposed method under various simulations for total body photography. The EM and -view algorithms improve the relative cost of the baseline single-view methods by at least 24% and 28% respectively, corresponding to increasing the in-focus surface area by roughly 1550cm2 and 1780cm2. We believe the algorithms can be useful in a number of vision applications that require photogrammetric details but are limited by the depth of field. Published In : arXiv
A Shape-Aware Total Body Photography System for In-focus Surface Coverage Optimization
AI-Powered Dermatology: Lumo Imaging Wins NSF Grant for Total Body Photography Breakthrough By Daniel Fleury Rockville, MD, 7/20/2021 – Lumo Imaging, a forerunner in AI-based Total Body Photography (TBP) systems, is thrilled to announce its successful acquisition of a National Science Foundation (NSF) Small Business Technology Transfer (STTR) grant. The $256,000 award, which includes a subaward to Johns Hopkins University, is earmarked for the innovative research and development (R&D) of a state-of-the-art pigmented lesion analysis system tailored for wide field-of-view images. Our groundbreaking software has the potential to propel TBP to the forefront of dermatology. By enhancing the capabilities of our pioneering TBP system – Lumo Scanner – we aim to offer unparalleled full-body skin lesion resolution, thereby transforming the way dermatologists diagnose, monitor, and manage clinically-relevant skin lesions.In the US, nearly 5 million people require treatment for skin cancer annually, with a staggering estimated cost of $8.1 billion. However, by facilitating early detection of suspicious pigmented lesions (SPLs) through our advanced Total Body Photography technology, we can significantly improve melanoma prognosis and potentially reduce treatment costs by up to 20-fold. The combination of our Lumo Scanner and the new cutting-edge screening algorithms developed through this project promises to revolutionize dermatology practices. By enabling technicians to perform highly accurate total body scans, dermatologists can prioritize high-risk patients, improving efficiency and patient care. Moreover, our innovative TBP system can help address the shortage of dermatology services in under-resourced areas.Andrea Belz, Division Director of the Division of Industrial Innovation and Partnerships at NSF, extols the NSF’s commitment to supporting transformative ideas that can shape the future of science, engineering, and particularly dermatology.Lumo Imaging’s Managing Director, Davood Tashayyod, stated, “In the context of a national screening program, Lumo Imaging’s advanced Total Body Photography system could democratize access to high-quality dermatology services. Our mission is to make low-cost annual full-body skin screenings a reality for everyone, irrespective of their geographical location or financial circumstances.”Securing a Phase I SBIR/STTR grant primes small businesses for the opportunity to apply for a Phase II grant and the possibility of securing additional matching funds. This NSF initiative champions the development of promising technologies with the potential to revolutionize sectors, including dermatology, and yield significant societal impact. About the NSF’s Small Business Programs: America’s Seed Fund, powered by NSF, dedicates $200 million annually to support startups and small businesses, turning scientific discoveries into products and services that can reshape industries and improve lives.About Lumo Imaging: Lumo Imaging is a trailblazer in the development of smart imaging devices for dermatology and forensic markets. Our current focus lies in developing machine learning applications for the accurate documentation, efficient monitoring, and reliable screening of skin lesions and cancers. With the support of the NSF and future grant funding, Lumo Imaging is poised to secure FDA clearance for its skin cancer screening device in the next three years.
Revisiting Lesion Tracking in 3D Total Body Photography
Revisiting Lesion Tracking in 3D Total Body Photography submitted to Medical Image Analysis Melanoma is the most deadly form of skin cancer. Tracking the evolution of nevi and detecting new lesions across the body is essential for the early detection of melanoma. Despite prior work on longitudinal tracking of skin lesions in 3D total body photography, there are still several challenges, including: 1) low accuracy for finding correct lesion pairs across scans, 2) sensitivity to noisy lesion detection, 3) lack of large-scale datasets with numerous annotated lesion pairs. We propose a framework that takes in a pair of 3D textured meshes, matches lesions in the context of total body photography, and identifies unmatchable lesions. We start by computing correspondence maps bringing the source and target meshes to a template mesh. Using these maps to define source/target signals over the template domain, we construct a flow field aligning the mapped signals. The initial correspondence maps are then refined by advecting forward/backward along the vector field. Finally, lesion assignment is performed using the refined correspondence maps. We propose the first large-scale dataset for skin lesion tracking with 25K lesion pairs across 198 subjects. The proposed method achieves a success rate of 89.9% (at 10 mm criterion) for all pairs of annotated lesions and a matching accuracy of 98.2% for subjects with more than 200 lesions. Published In : Medical Image Analysis Informatics ( Early Access )
A TBP DICOM format for total-body scanner-independent lesion evolution detection
AI-Powered Dermatology: Lumo Imaging Wins NSF Grant for Total Body Photography Breakthrough By Daniel Fleury Rockville, MD, 7/20/2021 – Lumo Imaging, a forerunner in AI-based Total Body Photography (TBP) systems, is thrilled to announce its successful acquisition of a National Science Foundation (NSF) Small Business Technology Transfer (STTR) grant. The $256,000 award, which includes a subaward to Johns Hopkins University, is earmarked for the innovative research and development (R&D) of a state-of-the-art pigmented lesion analysis system tailored for wide field-of-view images. Our groundbreaking software has the potential to propel TBP to the forefront of dermatology. By enhancing the capabilities of our pioneering TBP system – Lumo Scanner – we aim to offer unparalleled full-body skin lesion resolution, thereby transforming the way dermatologists diagnose, monitor, and manage clinically-relevant skin lesions.In the US, nearly 5 million people require treatment for skin cancer annually, with a staggering estimated cost of $8.1 billion. However, by facilitating early detection of suspicious pigmented lesions (SPLs) through our advanced Total Body Photography technology, we can significantly improve melanoma prognosis and potentially reduce treatment costs by up to 20-fold. The combination of our Lumo Scanner and the new cutting-edge screening algorithms developed through this project promises to revolutionize dermatology practices. By enabling technicians to perform highly accurate total body scans, dermatologists can prioritize high-risk patients, improving efficiency and patient care. Moreover, our innovative TBP system can help address the shortage of dermatology services in under-resourced areas.Andrea Belz, Division Director of the Division of Industrial Innovation and Partnerships at NSF, extols the NSF’s commitment to supporting transformative ideas that can shape the future of science, engineering, and particularly dermatology.Lumo Imaging’s Managing Director, Davood Tashayyod, stated, “In the context of a national screening program, Lumo Imaging’s advanced Total Body Photography system could democratize access to high-quality dermatology services. Our mission is to make low-cost annual full-body skin screenings a reality for everyone, irrespective of their geographical location or financial circumstances.”Securing a Phase I SBIR/STTR grant primes small businesses for the opportunity to apply for a Phase II grant and the possibility of securing additional matching funds. This NSF initiative champions the development of promising technologies with the potential to revolutionize sectors, including dermatology, and yield significant societal impact. About the NSF’s Small Business Programs: America’s Seed Fund, powered by NSF, dedicates $200 million annually to support startups and small businesses, turning scientific discoveries into products and services that can reshape industries and improve lives.About Lumo Imaging: Lumo Imaging is a trailblazer in the development of smart imaging devices for dermatology and forensic markets. Our current focus lies in developing machine learning applications for the accurate documentation, efficient monitoring, and reliable screening of skin lesions and cancers. With the support of the NSF and future grant funding, Lumo Imaging is poised to secure FDA clearance for its skin cancer screening device in the next three years.