The risk of AI being used to create a bioweapon is a serious concern for pharma biosecurity after researchers found AI-designed toxins can evade DNA screening. Here’s what you need to know about the AI and bioweapons risk.
AI creating and posing a bioweapons threat has become a documented finding, now on record. As such, health leaders and the wider biotech industry can no longer treat the AI bioweapon risk as someone else's regulatory problem.
A Microsoft-led team investigating biosecurity found that AI-redesigned toxin variants slipped past the genetic screening software that the DNA synthesis industry relies onto block dangerous orders.
The supply chains, the AI design tools, and the same synthetic biology platforms are all widely used across the entirety of pharma.
Image
Posing As a “Bioterrorist”
Researchers at Microsoft, working with academic and industry biosecurity specialists, used generative protein-design tools, including the company's own EvoDiff model, to redesign known deadly toxins such as ricin, botulinum, and Shiga toxin.
The goal was not to create functional bioweapons but to test whether AI-generated variants could be ordered from commercial DNA vendors without triggering the screening software those vendors use.
Across roughly seventy-two toxins and three open-source AI packages, this “red-teaming” exercise generated tens of thousands of protein variants and tested them against widely used screening tools.
A significant share evaded detection, prompting the researchers to treat the result as the biological equivalent of a zero-day vulnerability, alerting the U.S. government and screening-software vendors before publication so that patches could be issued ahead of public disclosure.
Crucially, the exercise was conducted entirely in silico. No toxic proteins were physically synthesised, and the researchers deliberately withheld the specific design techniques that enabled evasion.
The finding that matters for pharma biosecurity is that a safeguard the industry has long treated as a reliable backstop is no longer accurately catching what AI tools can generate.
Image
AI Biosecurity is a Governance Issue: Stop “Made-to-Order” Bioweapons
Pharmaceutical and biotech organisations sit directly inside the affected pipeline and therefore will play a vital role in protecting against the threat AI poses to biosecurity.
Commercial gene-synthesis vendors serve not only drug discovery, but also vaccine development and cell and gene therapy programmes across the industry. The same protein-design and generative biology tools driving therapeutic innovation are structurally identical to those used in the Microsoft study.
Writing in Nature, biosecurity researchers Jaspreet Pannu, Anita Cicero, and Tom Inglesby of the Johns Hopkins Center for Health Security argue that AI-enabled research could cause significant harm if used to design pathogens with concerning new properties.
Closing the gap, they argue, requires regulation imposed on the life sciences sector from outside and a closer collaboration between governments, AI developers, and biosafety experts.
This has teeth for procurement and compliance teams specifically. If screening gaps sit at the DNA-synthesis chokepoint, then vendor due diligence, not just internal research governance, becomes a frontline control.
Find out how Quality-by-Design improves reliability and compliance in pharma and how you can maximise innovation through quality-based pharma development systems.
Biosecurity Modernisation
United States lawmakers introduced the Biosecurity Modernisation and Innovation Act of 2026 (S.3741) in January 2026, sponsored by Senators Tom Cotton and Amy Klobuchar.
The bill would direct the Department of Commerce to mandate nucleic acid synthesis screening industry-wide, replacing the voluntary framework that has governed the sector for more than a decade.
Existing federal guidance already requires screened DNA for federally funded research, following the 2023 Executive Order on AI, but coverage outside that funding stream remains inconsistent.
A meaningful share of the DNA synthesis market does not screen orders at all, underscoring why a voluntary baseline struggles to hold across a fragmented global vendor landscape.
In parallel, the National Academies of Sciences, Engineering, and Medicine published a 2025 consensus study assessing how AI-enabled biological design tools intersect with pandemic-scale biosecurity risk.
They too recommended closer coordination between AI developers and biosecurity authorities alongside continued investment in next-generation screening technology.
Altogether, policy and technical mitigation now have to move together.
As a result, there has been a strong industry and intelligence call for layered technical safeguards alongside emerging policy frameworks, rather than relying on any single control.
The AI tools relevant to biosecurity can be distinguished into two groups: Large language models, which can broaden access to existing biological knowledge, and biological design tools, which can generate genuinely novel sequences of DNA and structures of proteins.
The convergence of the two, rather than either alone, is what most expands both the capability and the accessibility of biological misuse of AI over time.
None of the available research suggests AI-enabled biological attacks are imminent.
It should be cautioned that disproportionate focus on screening software risks distracting from larger structural threats, including state-level biological weapons programmes, and it's confirmed that misuse attempts remain exceptionally rare.
The consistent message about the AI biosecurity risk is that the barrier is lower than it used to be with the advancement of AI capabilities in DNA and protein synthesis.
Image
What Pharma Leaders Should Do Now to Fend Against the AI Biosecurity Threat
Three actions translate directly into pharma board-level governance actions to protect against the AI biothreat risk:
Audit gene-synthesis vendor relationships. Confirm which suppliers screen orders against current sequence-of-concern databases, and require attestation as a procurement condition, not an assumption.
Treat AI design tools as dual-use from day one. Internal biosafety committees reviewing AI-assisted discovery programmes should explicitly assess misuse potential alongside therapeutic value, in line with the layered-safeguard approach the academic literature recommends.
Track S.3741 and its successors closely. Mandatory federal screening would reshape vendor qualification requirements industry-wide. Organisations that prepare compliance pathways ahead of enactment will face a far smoother transition than those that wait.
Generative Protein Design Poses Potential Biosecurity Threat
AI has not really made biological weapons easy to build; however, what research highlights is that it has made one specific safeguard, nucleic acid synthesis screening, measurably less reliable than the industry assumed, and pharmaceutical organisations sit close enough to that chokepoint that the gap deserves board-level attention rather than a footnote in the risk register.
At Pharmatica, we focus on the systems, strategies, and technologies shaping the future of pharmaceutical R&D, regulatory strategy, and manufacturing resilience. Our analysis sits at the intersection of policy, science, and operational reality, where governance decisions translate into measurable protection for patients, programmes, and reputations.
Pharmatica: Insight. Connection. Impact.
Frequently Asked Questions
What is the AI bioweapon risk in the context of pharmaceutical research?
The AI bioweapon risk refers to the possibility that AI-enabled tools used legitimately in drug discovery, such as generative protein design models, could also be used to design biological agents capable of evading existing safety screening, lowering the technical barrier to creating harmful biological materials.
Did the Microsoft study create an actual bioweapon?
No. The researchers conducted the exercise entirely in digital form and never synthesised any toxic proteins.
The study, published in Science, was designed to test whether AI-redesigned sequences could pass existing screening software, not to produce a functional biological agent.
Is DNA synthesis screening currently mandatory for vendors in the United States?
DNA synthesis screening is mandatory only for federally funded research, under guidance that followed the 2023 Executive Order on AI.
The proposed Biosecurity Modernisation and Innovation Act of 2026 (S.3741) would extend mandatory screening across the gene-synthesis industry, but as of mid-2026 this remains under Senate committee review rather than enacted law.
How should pharmaceutical companies respond to the AI biosecurity risk?
To respond to the AI biosecurity risk, leading guidance points to three priorities for pharma companies: Vendor screening verification, dual-use risk review embedded in AI-assisted research governance, and active engagement with emerging policy frameworks rather than waiting for finalised regulation.
Does AI biosecurity risk apply only to large pharmaceutical companies?
No. Academic literature, including the 2025 review in Frontiers in Bioengineering and Biotechnology, notes that the relevant AI design tools and synthesis vendors are widely accessible, meaning the governance burden extends to biotech start-ups, academic spinouts, and contract research organisations, not exclusively large incumbents.
Nicole (BSc Molecular Medicine, Honours Medical Biochemistry) has many years of pharmaceutical experience, having worked for top CROs and biopharma companies for more than a decade.
Did you enjoy the content?
3
Why not support
Nicole Dale
by giving this content a like
Anthropic's new drug discovery programme marks a strategic shift from sole AI software provider to active R&D participant. Here's what it means for pharmaceutical innovation.
Anthropic’s Gates Foundation Partnership and Healthcare AI
See how Anthropic's Gates Foundation partnership and Long-Term Benefit Trust could lead the way in shaping responsible AI governance across healthcare innovation.
AI in Healthcare: OpenAI and Epic Integration Connects EHRs
OpenAI and Epic integration brings AI healthcare into EHR workflows, connecting patient records with ChatGPT for Healthcare to advance research and patient care.
<p>Founded in 2004, Ametris (formerly ActiGraph) is a global digital health solutions provider transforming real-world patient data into validated clinical evidence. Our end-to-end platform combines advanced wearables, regulatory-aligned analytics, and expert scientific support across every phase of a clinical trial. We serve leading pharmaceutical, biotech, and public health research organizations worldwide, backed by two decades of experience and a collaborative, science-first approach.</p><p>In 2026, Ametris joined Signant Health, uniting wearable-derived digital outcome measures with industry-leading eCOA solutions to give sponsors a single partner for integrated evidence generation, combining continuous sensor data with patient-reported outcomes.</p>
Image
Clinical Development
<p><a href="https://www.medidata.com/en/">Medidata </a>has been powering smarter treatments and healthier people by supporting clinical trials through groundbreaking technological innovations for over 25 years. Medidata is a leader in AI-powered solutions across the entire trial lifecycle to accelerate clinical breakthroughs, reduce patient and site burden, and bring new therapies to market faster. Supported by one of the largest clinical datasets in the industry of more than 38,000 trials and 12 million patients, Medidata's <a href="https://www.medidata.com/en/experiences/study-experience/">Study</a>, <a href="https://www.medidata.com/en/experiences/patient-experience/">Patient</a>, and <a href="https://www.medidata.com/en/experiences/data-experience/">Data</a> Experiences are trusted by more than 1 million registered users across approximately 2,300 customers. A Dassault Systèmes brand (Euronext Paris: FR0014003TT8, DSY.PA), Medidata is headquartered in New York City and is recognized as a leader by Everest Group and IDC. Discover more at <a href="https://www.medidata.com/">www.medidata.com</a><strong>. </strong>Listen to our latest podcast, <a href="https://www.medidata.com/en/from-dreamers-to-disruptors-podcast/"><em>from Dreamers to Disruptors</em></a>,<strong> </strong>and follow us at @medidata-solutions on LinkedIn.</p>
Comments (0)