News, Analysis, Trends, Management Innovations for
Clinical Laboratories and Pathology Groups

Hosted by Robert Michel

News, Analysis, Trends, Management Innovations for
Clinical Laboratories and Pathology Groups

Hosted by Robert Michel
Sign In

Artificial Intelligence in the Operating Room: Dutch Scientists Develop AI Application That Informs Surgical Decision Making during Cancer Surgery

Speedy DNA sequencing and on-the-spot digital imaging may change the future of anatomic pathology procedures during surgery

Researchers at the Center for Molecular Medicine (CMM) at UMC Utrecht, a leading international university medical center in the Netherlands, have paired artificial intelligence (AI) and machine learning with DNA sequencing to develop a diagnostic tool cancer surgeons can use during surgeries to determine in minutes—while the patient is still on the operating table—whether they have fully removed all the cancerous tissue.

The method, “involves a computer scanning segments of a tumor’s DNA and alighting on certain chemical modifications that can yield a detailed diagnosis of the type and even subtype of the brain tumor,” according to The New York Times, which added, “That diagnosis, generated during the early stages of an hours-long surgery, can help surgeons decide how aggressively to operate, … In the future, the method may also help steer doctors toward treatments tailored for a specific subtype of tumor.”

This technology has the potential to reduce the need for frozen sections, should additional development and studies confirm that it accurately and reliably shows surgeons that all cancerous cells were fully removed. Many anatomic pathologists would welcome such a development because of the time pressure and stress associated with this procedure. Pathologists know that the patient is still in surgery and the surgeons are waiting for the results of the frozen section. Most pathologists would consider fewer frozen sections—with better patient outcomes—to be an improvement in patient care.

The UMC Utrecht scientist published their findings in the journal Nature titled, “Ultra-Fast Deep-Learned CNS Tumor Classification during Surgery.”

 “It’s imperative that the tumor subtype is known at the time of surgery,” Jeroen de Ridder, PhD (above), associate professor in the Center for Molecular Medicine at UMC Utrecht and one of the study leaders, told The New York Times. “What we have now uniquely enabled is to allow this very fine-grained, robust, detailed diagnosis to be performed already during the surgery. It can figure out itself what it’s looking at and make a robust classification,” he added. How this discovery affects the role of anatomic pathologists and pathology laboratories during cancer surgeries remains to be seen. (Photo copyright: UMC Utrecht.)

Rapid DNA Sequencing Impacts Brain Tumor Surgeries

The UMC Utrecht scientists employed Oxford Nanopore’s “real-time DNA sequencing technology to address the challenges posed by central nervous system (CNS) tumors, one of the most lethal type of tumor, especially among children,” according to an Oxford Nanopore news release.

The researchers called their new machine learning AI application the “Sturgeon.”

According to The New York Times, “The new method uses a faster genetic sequencing technique and applies it only to a small slice of the cellular genome, allowing it to return results before a surgeon has started operating on the edges of a tumor.”

Jeroen de Ridder, PhD, an associate professor in the Center for Molecular Medicine at UMC Utrecht, told The New York Times that Sturgeon is “powerful enough to deliver a diagnosis with sparse genetic data, akin to someone recognizing an image based on only 1% of its pixels, and from an unknown portion of the image.” Ridder is also a principal investigator at the Oncode Institute, an independent research center in the Netherlands.

The researchers tested Sturgeon during 25 live brain surgeries and compared the results to an anatomic pathologist’s standard method of microscope tissue examination. “The new approach delivered 18 correct diagnoses and failed to reach the needed confidence threshold in the other seven cases. It turned around its diagnoses in less than 90 minutes, the study reported—short enough for it to inform decisions during an operation,” The New York Times reported.

But there were issues. Where the minute samples contain healthy brain tissue, identifying an adequate number of tumor markers could become problematic. Under those conditions, surgeons can ask an anatomic pathologist to “flag the [tissue samples] with the most tumor for sequencing, said PhD candidate Marc Pagès-Gallego, a bioinformatician at UMC Utrecht and a co-author of the study,” The New York Times noted. 

“Implementation itself is less straightforward than often suggested,” Sebastian Brandner, MD, a professor of neuropathology at University College London, told The Times. “Sequencing and classifying tumor cells often still required significant expertise in bioinformatics as well as workers who are able to run, troubleshoot, and repair the technology,” he added. 

“Brain tumors are also the most well-suited to being classified by the chemical modifications that the new method analyzes; not all cancers can be diagnosed that way,” The Times pointed out.

Thus, the research continues. The new method is being applied to other surgical samples as well. The study authors said other facilities are utilizing the method on their own surgical tissue samples, “suggesting that it can work in other people’s hands.” But more work is needed, The Times reported.

UMC Utrecht Researchers Receive Hanarth Grant

To expand their research into the Sturgeon’s capabilities, the UMC Utrecht research team recently received funds from the Hanarth Fonds, which was founded in 2018 to “promote and enhance the use of artificial intelligence and machine learning to improve the diagnosis, treatment, and outcome of patients with cancer,” according to the organization’s website.

The researchers will investigate ways the Sturgeon AI algorithm can be used to identify tumors of the central nervous system during surgery, a UMC Utrecht news release states. These type of tumors, according to the researchers, are difficult to examine without surgery.

“This poses a challenge for neurosurgeons. They have to operate on a tumor without knowing what type of tumor it is. As a result, there is a chance that the patient will need another operation,” said de Ridder in the news release.

The Sturgeon application solves this problem. It identifies the “exact type of tumor during surgery. This allows the appropriate surgical strategy to be applied immediately,” the news release notes.

The Hanarth funds will enable Jeroen and his team to develop a variant of the Sturgeon that uses “cerebrospinal fluid instead of (part of) the tumor. This will allow the type of tumor to be determined already before surgery. The main challenge is that cerebrospinal fluid contains a mixture of tumor and normal DNA. AI models will be trained to take this into account.”

The UMC Utrecht scientists’ breakthrough is another example of how organizations and research groups are working to shorten time to answer, compared to standard anatomic pathology methods. They are combining developing technologies in ways that achieve these goals.

—Kristin Althea O’Connor

Related Information:

Ultra-fast Deep-Learned CNS Tumor Classification during Surgery

New AI Tool Diagnoses Brain Tumors on the Operating Table

Pediatric Brain Tumor Types Revealed Mid-Surgery with Nanopore Sequencing and AI

AI Speeds Up Identification Brain Tumor Type

Four New Cancer Research Projects at UMC Utrecht Receive Hanarth Grants

Rapid Nanopore Sequencing, Machine Learning Enable Tumor Classification during Surgery

Asian Company Launches World’s First Diagnostic Test for Microbiome of the Mouth

Collected data could give healthcare providers and clinical laboratories a practical view of individuals’ oral microbiota and lead to new diagnostic assays

When people hear about microbiome research, they usually think of the study of gut bacteria which Dark Daily has covered extensively. However, this type of research is now expanding to include more microbiomes within the human body, including the oral microbiome—the microbiota living in the human mouth. 

One example is coming from Genefitletics, a biotech company based in New Delhi, India. It recently launched ORAHYG, the first and only (they claim) at-home oral microbiome functional activity test available in Asia. The company is targeting the direct-to-consumer (DTC) testing market.

According to the Genefitletics website, the ORAHYG test can decode the root causes of:

The test can also aid in the early detection development of:

“Using oral microbial gene expression sequencing technology and its [machine learning] model, [Genefitletics] recently debuted its oral microbiome gene expression solution, which bridges the gap between dentistry and systemic inflammation,” ETHealthworld reported.

“The molecular insights from this test would give an unprecedented view of functions of the oral microbiome, their interaction with gut microbiome and impact on metabolic, cardiovascular, cognitive, skin, and autoimmune health,” BioSpectrum noted.

Sushant Kumar

“Microbes, the planet Earth’s original inhabitants, have coevolved with humanity, carry out vital biological tasks inside the body, and fundamentally alter how we think about nutrition, medicine, cleanliness, and the environment,” Sushant Kumar (above), founder and CEO of Genefitletics, told the Economic Times. “This has sparked additional research over the past few years into the impact of the trillions of microorganisms that inhabit the human body on our health and diverted tons of funding into the microbiome field.” Clinical laboratories may eventually see an interest and demand for testing of the oral microbiome. (Photo copyright: ETHealthworld.)


Imbalanced Oral Microbiome Can Trigger Disease

The term microbiome refers to the tiny microorganisms that reside on and inside our bodies. A high colonization of these microorganisms—including bacteria, fungi, yeast, viruses, and protozoa—live in our mouths.

“Mouth is the second largest and second most diverse colonized site for microbiome with 770 species comprising 100 billion microbes residing there,” said Sushant Kumar, founder and CEO of Genefitletics, BioSpectrum reported. “Each place inside the mouth right from tongue, throat, saliva, and upper surface of mouth have a distinctive and unique microbiome ecosystem. An imbalanced oral microbiome is said to trigger onset and progression of type 2 diabetes, arthritis, heart diseases, and even dementia.”

The direct-to-consumer ORAHYG test uses a saliva sample taken either by a healthcare professional or an individual at home. That sample is then sequenced through Genefitletics’ gene sequencing platform and the resulting biological data set added to an informatics algorithm.

Genefitletics’ machine-learning platform next converts that information into a pre-symptomatic molecular signature that can predict whether an individual will develop a certain disease. Genefitletics then provides that person with therapeutic and nutritional solutions that can suppress the molecules that are causing the disease. 

“The current industrial healthcare system is really a symptom care [system] and adopts a pharmaceutical approach to just make the symptoms more bearable,” Kumar told the Economic Times. “The system cannot decode the root cause to determine what makes people develop diseases.”

Helping People Better Understand their Health

Founded in 2019, Genefitletics was created to pioneer breakthrough discoveries in microbial science to promote better health and increase longevity in humans. The company hopes to unravel the potential of the oral microbiome to help people fend off illness and gain insight into their health. 

“Microorganisms … perform critical biological functions inside the body and transform our approach towards nutrition, medicine, hygiene and environment,” Kumar told CNBC. “It is important to understand that an individual does not develop a chronic disease overnight.

“It starts with chronic inflammation which triggers pro-inflammatory molecular indications. Unfortunately, these molecular signatures are completely invisible and cannot be measured using traditional clinical grade tests or diagnostic investigations,” he added. “These molecular signatures occur due to alteration in gene expression of gut, oral, or vaginal microbiome and/or human genome. We have developed algorithms that help us in understanding these alterations way before the clinical symptoms kick in.” 

Genefitletics plans to utilize individuals’ collected oral microbiome data to determine their specific nutritional shortcomings, and to develop personalized supplements to help people avoid disease.

The company also produces DTC kits that analyze gut and vaginal microbiomes as well as a test that is used to evaluate an infant’s microbiome.

“The startup wants to develop comparable models to forecast conditions like autism, PCOS [polycystic ovarian syndrome], IBD [Inflammatory bowel disease], Parkinson’s, chronic renal [kidney] disease, anxiety, depression, and obesity,” the Economic Times reported.

Time will tell whether the oral microbiome tests offered by this company prove to be clinically useful. Certainly Genefitletics hopes its ORAHYG test can eventually provide healthcare providers—including clinical laboratory professionals—with a useful view of the oral microbiome. The collected data might also help individuals become aware of pre-symptomatic conditions that make it possible for them to seek confirmation of the disease and early treatment by medical professionals.   

—JP Schlingman

Related Information:

Genefitletics Brings Asia’s First Oral Microbiome Test ORAHYG

Let’s Focus on the Role of Microbiomes in Systemic Inflammation and Disease Development: Sushant Kumar, Genefitletics

Genefitletics Can Now Predict and Detect Chronic Diseases and Cancer

Genefitletics Can Now Predict and Detect Chronic Diseases and Cancer

Healthtech Startup Genefitletics Raises Undisclosed Amount in Pre-seed Funding

Understanding Oral Microbiome Testing: What You Need to Know

Executive War College Headliners Connect Genetic Testing, Wearable Technology, Precision Medicine, and Struggle Over Claim Reimbursement between Clinical Labs and Payers

Keynote speakers advise clinical laboratory leaders to leverage diagnostic data that feeds precision therapies

At this week’s Executive War College on Diagnostics, Clinical Laboratory, and Pathology Management in New Orleans, keynote presenters dissected ways that clinical laboratory leaders and anatomic pathologists can contribute to innovative treatment approaches, including wearable technology and precision medicine.

The speakers also noted that labs must learn to work collaboratively with payers—perhaps through health information technology (HIT)—to establish best practices that improve reimbursements on claims for novel genetic tests.

Harnessing the ever-increasing volume of diagnostic data that genetic testing produces should be a high priority for labs, said William Morice II, MD, PhD, CEO and President of Mayo Clinic Laboratories.

“There will be an increased focus on getting information within the laboratory … for areas such as genomics and proteomics,” Morice told the keynote audience at the Executive War College on Wednesday.

William Morice II, MD, PhD

“Wearable technology data is analyzed using machine learning. Clinical laboratories must participate in analyzing that spectrum of diagnostics,” said William Morice II, MD, PhD (above), CEO and President of Mayo Clinic Laboratories. Morice spoke during this week’s Executive War College.

Precision Medicine Efforts Include Genetic Testing and Wearable Devices

For laboratories new to genetic testing that want to move it in-house, Morice outlined effective first steps to take, including the following:

  • Determine and then analyze the volume of genetic testing that a lab is sending out.
  • Research and evaluate genetic sequencing platforms that are on the market, with an eye towards affordable cloud-based options.
  • Build a business case to conduct genetic tests in-house that focuses on the long-term value to patients and how that could also improve revenue.

Morice suggested that neuroimmunology is a reasonable place to start with genetic testing. Mayo Clinic Laboratories found early success with tests in this area because autoimmune disorders are rising among patients.

A related area for clinical laboratories and pathology practices to explore is their role in how clinicians treat patients using wearable technology.

For example, according to Morice, Mayo Clinic has monitored 20,000 cardiac patients with wearable devices. The data from the wearable devices—which includes diagnostic information—is analyzed using machine learning, a subset of artificial intelligence.

In one study published in Scientific Reports, scientists from Mayo’s Departments of Neurology and Biomedical Engineering found “clear evidence that direct seizure forecasts are possible using wearable devices in the ambulatory setting for many patients with epilepsy.”

Clinical laboratories fit into this picture, Morice explained. For example, depending on what data it provides, a wearable device on a patient with worsening neurological symptoms could trigger a lab test for Alzheimer’s disease or other neurological disorders.

“This will change how labs think about access to care,” he noted.

For Payers, Navigating Genetic Testing Claims is Difficult

While there is promise in genetic testing and precision medicine, from an administrative viewpoint, these activities can be challenging for payers when it comes to verifying reimbursement claims.

“One of the biggest challenges we face is determining what test is being ordered. From the perspective of the reimbursement process, it’s not always clear,” said Cristi Radford, MS, CGC, Product Director at healthcare services provider Optum, a subsidiary of UnitedHealth Group, located in Eden Prairie, Minnesota. Radford also presented a keynote at this year’s Executive War College.

Approximately 400 Current Procedural Terminology (CPT) codes are in place to represent the estimated 175,000 genetic tests on the market, Radford noted. That creates a dilemma for labs and payers in assigning codes to novel genetic tests.

During her keynote address, Radford showed the audience of laboratory executives a slide that charted how four labs submitted claims for the same high-risk breast cancer panel. CPT code choices varied greatly.

“Does the payer have any idea which test was ordered? No,” she said. “It was a genetic panel, but the information doesn’t give us the specificity payers need.”

In such situations, payers resort to prior authorization to halt these types of claims on the front end so that more diagnostic information can be provided.

“Plans don’t like prior authorization, but it’s a necessary evil,” said Jason Bush, PhD, Executive Vice President of Product at Avalon Healthcare Solutions in Tampa, Florida. Bush co-presented with Radford.

[Editor’s note: Dark Daily offers a free webinar, “Learning from Payer Behavior to Increase Appeal Success,” that teaches labs how to better understand payer behavior. The webinar features recent trends in denials and appeals by payers that will help diagnostic organizations maximize their appeal success. Click here to stream this important webinar.]

Payers Struggle with ‘Explosion’ of Genetic Tests

In “UnitedHealth’s Optum to Offer Lab Test Management,” Dark Daily’s sister publication The Dark Report, covered Optum’s announcement that it had launched “a comprehensive laboratory benefit management solution designed to help health plans reduce unnecessary lab testing and ensure their members receive appropriate, high-quality tests.”

Optum sells this laboratory benefit management program to other health plans and self-insured employers. Genetic test management capabilities are part of that offering.

As part of its lab management benefit program, Optum is collaborating with Avalon on a new platform for genetic testing that will launch soon and focus on identifying test quality, streamlining prior authorization, and providing test payment accuracy in advance.

“Payers are struggling with the explosion in genetic testing,” Bush told Executive War College attendees. “They are truly not trying to hinder innovation.”

For clinical laboratory leaders reading this ebriefing, the takeaway is twofold: Genetic testing and resulting precision medicine efforts provide hope in more effectively treating patients. At the same time, the genetic test juggernaut has grown so large so quickly payers are finding it difficult to manage. Thus, it has become a source of continuous challenge for labs seeking reimbursements.

Heath information technology may help ease the situation. But, ultimately, stronger communication between labs and payers—including acknowledgement of what each side needs from a business perspective—is paramount. 

Scott Wallask

Related Information:

Executive War College Keynote Speakers Highlight How Clinical Laboratories Can Capitalize on Multiple Growth Opportunities

What Key Laboratory Leaders Will Learn at This Week’s 2023 Executive War College on Diagnostics, Clinical Laboratory, and Pathology Management

Ambulatory Seizure Forecasting with a Wrist-Worn Device Using Long-Short Term Memory Deep Learning

UnitedHealth’s Optum to Offer Lab Test Management

Learning from Payer Behavior to Increase Appeal Success

Hackensack Meridian Health and Hologic Tap Google Cloud’s New Medical Imaging Suite for Cancer Diagnostics

Google designed the suite to ease radiologists’ workload and enable easy and secure sharing of critical medical imaging; technology may eventually be adapted to pathologists’ workflow

Clinical laboratory and pathology group leaders know that Google is doing extensive research and development in the field of cancer diagnostics. For several years, the Silicon Valley giant has been focused on digital imaging and the use of artificial intelligence (AI) algorithms and machine learning to detect cancer.

Now, Google Cloud has announced it is launching a new medical imaging suite for radiologists that is aimed at making healthcare data for the diagnosis and care of cancer patients more accessible. The new suite “promises to make medical imaging data more interoperable and useful by leveraging artificial intelligence,” according to MedCity News.

In a press release, medical technology company Hologic, and healthcare provider Hackensack Meridian Health in New Jersey, announced they were the first customers to use Google Cloud’s new suite of medical imaging products.

“Hackensack Meridian Health has begun using it to detect metastasis in prostate cancer patients earlier, and Hologic is using it to strengthen its diagnostic platform that screens women for cervical cancer,” MedCity News reported.

Alissa Hsu Lynch

“Google pioneered the use of AI and computer vision in Google Photos, Google Image Search, and Google Lens, and now we’re making our imaging expertise, tools, and technologies available for healthcare and life sciences enterprises,” said Alissa Hsu Lynch (above), Global Lead of Google Cloud’s MedTech Strategy and Solutions, in a press release. “Our Medical Imaging Suite shows what’s possible when tech and healthcare companies come together.” Clinical laboratory companies may find Google’s Medical Imaging Suite worth investigating. (Photo copyright: Influencive.)

.

Easing the Burden on Radiologists

Clinical laboratory leaders and pathologists know that laboratory data drives most healthcare decision-making. And medical images make up 90% of all healthcare data, noted an article in Proceedings of the IEEE (Institute of Electrical and Electronics Engineers).

More importantly, medical images are growing in size and complexity. So, radiologists and medical researchers need a way to quickly interpret them and keep up with the increased workload, Google Cloud noted.

“The size and complexity of these images is huge, and, often, images stay sitting in data siloes across an organization,” said Alissa Hsu Lynch, Global Lead, MedTech Strategy and Solutions at Google, told MedCity News. “In order to make imaging data useful for AI, we have to address interoperability and standardization. This suite is designed to help healthcare organizations accelerate the development of AI so that they can enable faster, more accurate diagnosis and ease the burden for radiologists,” she added.

According to the press release, Google Cloud’s Medical Imaging Suite features include:

  • Imaging Storage: Easy and secure data exchange using the international DICOM (digital imaging and communications in medicine) standard for imaging. A fully managed, highly scalable, enterprise-grade development environment that includes automated DICOM de-identification. Seamless cloud data management via a cloud-native enterprise imaging PACS (picture archiving and communication system) in clinical use by radiologists.
  • Imaging Lab: AI-assisted annotation tools that help automate the highly manual and repetitive task of labeling medical images, and Google Cloud native integration with any DICOMweb viewer.
  • Imaging Datasets and Dashboards: Ability to view and search petabytes of imaging data to perform advanced analytics and create training datasets with zero operational overhead.
  • Imaging AI Pipelines: Accelerated development of AI pipelines to build scalable machine learning models, with 80% fewer lines of code required for custom modeling.
  • Imaging Deployment: Flexible options for cloud, on-prem (on-premises software), or edge deployment to allow organizations to meet diverse sovereignty, data security, and privacy requirements—while providing centralized management and policy enforcement with Google Distributed Cloud.

First Customers Deploy Suite

Hackensack Meridian Health hopes Google’s imaging suite will, eventually, enable the healthcare provider to predict factors affecting variance in prostate cancer outcomes.

“We are working toward building AI capabilities that will support image-based clinical diagnosis across a range of imaging and be an integral part of our clinical workflow,” said Sameer Sethi, Senior Vice President and Chief Data and Analytics Officer at Hackensack, in a news release.

The New Jersey healthcare network said in a statement that its work with Google Cloud includes use of AI and machine learning to enable notification of newborn congenital disorders and to predict sepsis risk in real-time.

Hologic, a medical technology company focused on women’s health, said its collaboration integrates Google Cloud AI with the company’s Genius Digital Diagnostics System.

“By complementing our expertise in diagnostics and AI with Google Cloud’s expertise in AI, we’re evolving our market-leading technologies to improve laboratory performance, healthcare provider decision making, and patient care,” said Michael Quick, Vice President of Research and Development and Innovation at Hologic, in the press release.

Hologic says its Genius Digital Diagnostics System combines AI with volumetric medical imaging to find pre-cancerous lesions and cancer cells. From a Pap test digital image, the system narrows “tens of thousands of cells down to an AI-generated gallery of the most diagnostically relevant,” according to the company website.

Hologic plans to work with Google Cloud on storage and “to improve diagnostic accuracy for those cancer images,” Hsu Lynch told MedCity News.

Medical image storage and sharing technologies like Google Cloud’s Medical Imaging Suite provide an opportunity for radiologists, researchers, and others to share critical image studies with anatomic pathologists and physicians providing care to cancer patients.   

One key observation is that the primary function of this service that Google has begun to deploy is to aid in radiology workflow and productivity, and to improve the accuracy of cancer diagnoses by radiologists. Meanwhile, Google continues to employ pathologists within its medical imaging research and development teams.

Assuming that the first radiologists find the Google suite of tools effective in support of patient care, it may not be too long before Google moves to introduce an imaging suite of tools designed to aid the workflow of surgical pathologists as well.

Donna Marie Pocius

Related Information:

Google Cloud Delivers on the Promise of AI and Data Interoperability with New Medical Imaging Suite

Review of Deep Learning in Medical Imaging: Imaging Traits, Technology Trends, Case Studies with Progress Highlights, and Future Promises

Google Cloud Unveils Medical Imaging Suite with Hologic, Hackensack Meridian as First Customers

Google Cloud Medical Imaging Suite and its Deep Insights

Hackensack Meridian Health and Google Expand Relationship to Improve Patient Care

Google Cloud Introduces New AI-Powered Medical Imaging Suite

Researchers Create Artificial Intelligence Tool That Accurately Predicts Outcomes for 14 Types of Cancer

Proof-of-concept study ‘highlights that using AI to integrate different types of clinically informed data to predict disease outcomes is feasible’ researchers say

Artificial intelligence (AI) and machine learning are—in stepwise fashion—making progress in demonstrating value in the world of pathology diagnostics. But human anatomic pathologists are generally required for a prognosis. Now, in a proof-of-concept study, researchers at Brigham and Women’s Hospital in Boston have developed a method that uses AI models to integrate multiple types of data from disparate sources to accurately predict patient outcomes for 14 different types of cancer.

The process also uncovered “the predictive bases of features used to predict patient risk—a property that could be used to uncover new biomarkers,” according to Genetic Engineering and Biotechnology News (GEN).

Should these research findings become clinically viable, anatomic pathologists may gain powerful new AI tools specifically designed to help them predict what type of outcome a cancer patient can expect.

The Brigham scientists published their findings in the journal Cancer Cell, titled, “Pan-cancer Integrative Histology-genomic Analysis via Multimodal Deep Learning.”

Faisal Mahmood, PhD

“Experts analyze many pieces of evidence to predict how well a patient may do. These early examinations become the basis of making decisions about enrolling in a clinical trial or specific treatment regimens,” said Faisal Mahmood, PhD (above) in a Brigham press release. “But that means that this multimodal prediction happens at the level of the expert. We’re trying to address the problem computationally,” he added. Should they be proven clinically-viable through additional studies, these findings could lead to useful tools that help anatomic pathologists and clinical laboratory scientists more accurately predict what type of outcomes cancer patient may experience. (Photo copyright: Harvard.)

AI-based Prognostics in Pathology and Clinical Laboratory Medicine

The team at Brigham constructed their AI model using The Cancer Genome Atlas (TCGA), a publicly available resource which contains data on many types of cancer. They then created a deep learning-based algorithm that examines information from different data sources.

Pathologists traditionally depend on several distinct sources of data, such as pathology images, genomic sequencing, and patient history to diagnose various cancers and help develop prognoses.

For their research, Mahmood and his colleagues trained and validated their AI algorithm on 6,592 H/E (hematoxylin and eosin) whole slide images (WSIs) from 5,720 cancer patients. Molecular profile features, which included mutation status, copy-number variation, and RNA sequencing expression, were also inputted into the model to measure and explain relative risk of cancer death. 

The scientists “evaluated the model’s efficacy by feeding it data sets from 14 cancer types as well as patient histology and genomic data. Results demonstrated that the models yielded more accurate patient outcome predictions than those incorporating only single sources of information,” states a Brigham press release.

“This work sets the stage for larger healthcare AI studies that combine data from multiple sources,” said Faisal Mahmood, PhD, Associate Professor, Division of Computational Pathology, Brigham and Women’s Hospital; and Associate Member, Cancer Program, Broad Institute of MIT and Harvard, in the press release. “In a broader sense, our findings emphasize a need for building computational pathology prognostic models with much larger datasets and downstream clinical trials to establish utility.”

Future Prognostics Based on Multiple Data Sources

The Brigham researchers also generated a research tool they dubbed the Pathology-omics Research Platform for Integrative Survival Estimation (PORPOISE). This tool serves as an interactive platform that can yield prognostic markers detected by the algorithm for thousands of patients across various cancer types.  

The researchers believe their algorithm reveals another role for AI technology in medical care, but that more research is needed before their model can be implemented clinically. Larger data sets will have to be examined and the researchers plan to use more types of patient information, such as radiology scans, family histories, and electronic medical records in future tests of their AI technology.

“Future work will focus on developing more focused prognostic models by curating larger multimodal datasets for individual disease models, adapting models to large independent multimodal test cohorts, and using multimodal deep learning for predicting response and resistance to treatment,” the Cancer Cell paper states.

“As research advances in sequencing technologies, such as single-cell RNA-seq, mass cytometry, and spatial transcriptomics, these technologies continue to mature and gain clinical penetrance, in combination with whole-slide imaging, and our approach to understanding molecular biology will become increasingly spatially resolved and multimodal,” the researchers concluded.  

Anatomic pathologists may find the Brigham and Women’s Hospital research team’s findings intriguing. An AI tool that integrates data from disparate sources, analyzes that information, and provides useful insights, could one day help them provide more accurate cancer prognoses and improve the care of their patients.   

JP Schlingman

Related Information:

AI Integrates Multiple Data Types to Predict Cancer Outcomes

Pan-cancer Integrative Histology-genomic Analysis via Multimodal Deep Learning

New AI Technology Integrates Multiple Data Types to Predict Cancer Outcomes

Artificial Intelligence in Digital Pathology Developments Lean Toward Practical Tools

Florida Hospital Utilizes Machine Learning Artificial Intelligence Platform to Reduce Clinical Variation in Its Healthcare, with Implications for Medical Laboratories

Artificial Intelligence and Computational Pathology

;