▾ G11 Media Network: | ChannelCity | ImpresaCity | SecurityOpenLab | GreenCity | Italian Channel Awards | Italian Project Awards | ...

DataRobot Collaborates with IMDA to Make LLM Evaluation More Accessible to AI Builders with Project Moonshot

DataRobot, the enterprise AI platform leader, today announced the integration of LLM evaluation measures aligned with a new initiative from the Singapore Government Agency, Infocomm Media Development ...

Business Wire

New framework and set of capabilities for benchmarking and red teaming AI evaluation

SINGAPORE: DataRobot, the enterprise AI platform leader, today announced the integration of LLM evaluation measures aligned with a new initiative from the Singapore Government Agency, Infocomm Media Development Authority (IMDA). The “Project Moonshot” initiative unveiled at the Singapore Asia Tech x Summit offers new capabilities that help AI practitioners and system owners manage LLM deployment risks by providing a common framework for benchmarking and red teaming evaluation.

“At DataRobot, our focus is addressing the confidence gap and helping organizations scale responsible use of generative AI,” said Jay Schuren, Chief Customer Officer, DataRobot. “We’re excited to announce that our latest product release incorporates Project Moonshot’s testing toolkit and its benchmarking and evaluation tests. The result is that LLM evaluations are more accessible and help scale the responsible use of generative AI, enabling practitioners to turn on and configure guard models to change the behavior and responses of LLMs.”

Project Moonshot delivers three core capabilities for AI practitioners and system owners:

  • Automated evaluation tools for generative AI solutions that easily integrate into CI/CD pipelines.
  • A benchmark repository allowing teams to run evaluations relevant to their applications by curating the right benchmarks.
  • A one-stop tool for AI red teaming, from jailbreaks to customized attacks.
  • “The development of Project Moonshot, one of the world’s first open-source tools to bring red teaming, benchmarking and baseline testing together in an easy-to-use platform, would not have been possible without the contribution of partners such as DataRobot,” said, Dr Ong Chen Hui, Chair of the Governing Committee at AI Verify Foundation. “Project Moonshot will provide developers with an intuitive toolkit to test their LLM applications. This new toolkit signals Singapore’s continued commitment to advance the global open-source efforts toward addressing generative AI safety concerns.”

    “We are proud to support our portfolio company, DataRobot, on its growth journey in Southeast Asia,” said Paul Ng, Chief Executive Officer, EDBI. “The company has not only expanded its footprint in Singapore but has also fostered collaborations that benefit the local innovation ecosystem, such as this partnership with IMDA. Project Moonshot provides local enterprises with the right tools to deploy generative AI technologies confidently. As a strategic investor, we are committed to creating value for our portfolio companies while enhancing Singapore’s innovation capabilities.”

    DataRobot is an IMDA accredited company and a member of the AI Verify Foundation which launched the world’s first AI Governance Testing Framework and Toolkit in 2022.

    To learn more about DataRobot’s latest AI observability and intervention capabilities, read our latest product announcement or visit datarobot.com.

    About DataRobot

    DataRobot is the enterprise AI platform leader, empowering organizations to accelerate AI from idea to impact. With over a decade at the forefront of AI innovation, we know what it takes to make a real difference – to your bottom line, to your business vision, and to the world around us. Our end-to-end AI platform allows your organization to quickly build, securely operate and confidently govern your entire AI landscape from a single, unified experience. Organizations across industries and geographies trust DataRobot to help solve their biggest challenges with AI, leveraging generative and predictive capabilities today while providing the flexibility to adapt to the innovations of tomorrow. Learn more at datarobot.com and connect with us on LinkedIn.

    About IMDA

    The Infocomm Media Development Authority (IMDA) leads Singapore’s digital transformation by developing a vibrant digital economy and an inclusive digital society. As Architects of Singapore’s Digital Future, we foster growth in Infocomm Technology and Media sectors in concert with progressive regulations, harnessing frontier technologies, and developing local talent and digital infrastructure ecosystems to establish Singapore as a digital metropolis. For more news and information, visit www.imda.gov.sg or follow IMDA on Facebook (IMDAsg) and Twitter (@IMDAsg).

    About EDBI

    Founded in 1991, EDBI is a leading Singapore-based global investor focusing on high-growth technologies across Information & Communication Technology, Emerging Technology and Healthcare sectors. With the aim of creating long-term value and enhancing capabilities of Singapore’s key industries, we partner with companies poised for expansion in Asia and beyond, leveraging our extensive network, resources, and expertise. Explore our portfolio of successful investments and discover how we can accelerate growth together, through Singapore. Learn more at www.edbi.com.

    Fonte: Business Wire

    If you liked this article and want to stay up to date with news from InnovationOpenLab.com subscribe to ours Free newsletter.

    Related news

    Last News

    Axyon AI: Italian Artificial Intelligence for Finance applications

    Axyon AI offers an AI platform specifically designed for asset management, with several interesting strengths for those approaching machine/deep learning…

    Italian Artificial Intelligence tackles medical emergencies at sea

    Mermaid-AI is a telehealth platform at sea based on a visor equipped with an AR, medical Artificial Intelligence algorithms, satellite communications…

    Gyala: a new "Made in Italy" cybersecurity

    With a proven track record in the defence field, Gyala now also brings its cybersecurity technologies to the wider enterprise audience

    ITALIAN PROJECT AWARDS 2023: the best IT projects of the year, awarded

    Now in its third edition, the initiative is targeted at the ICT professional world and honours projects based on innovative ideas and technologies, realised…

    Most read

    AHSG Announces Leadership Transition as CEO Mark Smith Joins Board of…

    AHSG, a technology-driven, healthcare workforce solutions company, today announced Mark Smith will be stepping down at the end of June as Chief Executive…

    Verituity Raises $18.8M to Accelerate its B2B and B2C Verified Payout…

    Verituity, a leading provider of intelligent, verified payouts solutions, announced the successful close of an $18.8 million funding round led by Sandbox…

    HubStar Launches H2O, a Revolutionary New Approach to Optimizing Occupancy…

    HubStar, a leader in dynamic workplace management technology, today announced the launch of H2O, the first ever hybrid occupancy platform designed to…

    SMILE Health 2024: CareQuest Innovation Partners and MATTER Announce Largest…

    CareQuest Innovation Partners, a company focused on validating and scaling transformative solutions to improve overall health through oral health for…

    Newsletter signup

    Join our mailing list to get weekly updates delivered to your inbox.

    Sign me up!