▾ G11 Media Network: | ChannelCity | ImpresaCity | SecurityOpenLab | Italian Channel Awards | Italian Project Awards | Italian Security Awards | ...
InnovationOpenLab

Shift Bioscience Publishes Improved Metric Calibration Framework for Robust Genetic Perturbation Modeling Using AI Virtual Cells

Shift Bioscience (Shift), a biotechnology company uncovering the biology of cell rejuvenation to end the morbidity and mortality of aging, today announced the release of new research detailing an impr...

Immagine
  • AI virtual cells outperform key baselines on well-calibrated metrics, challenging prior reports of poor model performance
  • Foundational research reinforces the use of virtual cell models to accelerate target identification pipelines

CAMBRIDGE, England: Shift Bioscience (Shift), a biotechnology company uncovering the biology of cell rejuvenation to end the morbidity and mortality of aging, today announced the release of new research detailing an improved framework for evaluating benchmark metric calibration in virtual cell models1. Using well-calibrated metrics, the study demonstrates that virtual cell models consistently outperform key baselines, providing valuable and actionable biological insights to accelerate target identification pipelines.

Genetic perturbation response models are a subset of AI virtual cells used to predict how cells will respond to various genetic alterations, including up- and down-regulation of genes. These models are a valuable tool to augment target identification pipelines, providing a rapidly scalable, in silico solution to identify promising genetic targets without the time and resource requirements of wet lab experiments. However, recently published papers have questioned the utility of these models to correctly identify gene targets, noting concerns that virtual cell models fail to outperform simple, uninformative baselines in some experiments.

In this latest study from Shift Bioscience, the team demonstrated that incidents of poor model performance largely reflect metric miscalibration, with commonly-used metrics routinely failing to distinguish robust predictions from uninformative ones, particularly in datasets with weaker perturbations. Building on this finding, the team developed an improved framework for metric calibration. Using 14 perturb-seq datasets, the team identified several rank-based and DEG (Differentially Expressed Gene)-aware metrics that are well-calibrated across datasets.

Virtual cell models evaluated using these well-calibrated metrics were able to consistently outperform uninformative mean, control and linear baselines, providing clear evidence that virtual cell models can distinguish biologically significant signals when appropriate calibration is applied. These results challenge prior reports that genetic perturbation models do not work, and suggest that AI Virtual Cells can be effectively applied for target discovery.

Henry Miller, Ph.D., Head of Machine Learning, Shift Bioscience, commented:This latest research from our talented team provides clear evidence that the reports of poor performance in AI virtual cells is largely due to limitations of metrics, not due to issues with the models. We showed that when models are evaluated on well-calibrated metrics, they perform quite well and consistently outperform key baselines. We believe that this work opens the door to more widespread use of virtual cells and reinforces our confidence in the virtual cell models that are helping to drive our target identification program for cell rejuvenation.

  • Deep Learning-Based Genetic Perturbation Models Do Outperform Uninformative Baselines on Well-Calibrated Metrics

  • Fonte: Business Wire

    If you liked this article and want to stay up to date with news from InnovationOpenLab.com subscribe to ours Free newsletter.

    Related news

    Last News

    RSA at Cybertech Europe 2024

    Alaa Abdul Nabi, Vice President, Sales International at RSA presents the innovations the vendor brings to Cybertech as part of a passwordless vision for…

    Italian Security Awards 2024: G11 Media honours the best of Italian cybersecurity

    G11 Media's SecurityOpenLab magazine rewards excellence in cybersecurity: the best vendors based on user votes

    How Austria is making its AI ecosystem grow

    Always keeping an European perspective, Austria has developed a thriving AI ecosystem that now can attract talents and companies from other countries

    Sparkle and Telsy test Quantum Key Distribution in practice

    Successfully completing a Proof of Concept implementation in Athens, the two Italian companies prove that QKD can be easily implemented also in pre-existing…

    Most read

    MathWorks Showcases AI for Safety-Critical Systems at NeurIPS 2025

    NeurIPS 2025, Booth #732 – MathWorks, the leading developer of mathematical computing software, will showcase how engineers and scientists can use MATLAB®…

    CORRECTING and REPLACING Block Processes 124 Million Transactions as Americans…

    In Lower West Side, Chicago section, first bullet point should read: Total BFCM Weekend Volume: $8.4M (instead of Total BFCM Weekend Volume: $49M). The…

    Palantir Launches Chain Reaction to Build American AI Infrastructure;…

    Palantir Technologies Inc. (NASDAQ: PLTR) today unveiled Chain Reaction, the operating system for American AI infrastructure. The bottleneck to AI innovation…

    Andersen Consulting Expands Presence Through Collaboration with Hilal…

    #AndersenConsulting--Andersen Consulting enters into a Collaboration Agreement with Hilal Technology to strengthen its capabilities in digital infrastructure,…

    Newsletter signup

    Join our mailing list to get weekly updates delivered to your inbox.

    Sign me up!