Deadline: 20-Jan-25
The AI Safety Fund (AISF) is requesting proposals for the Cybersecurity AI Research Fund Program to accelerate research efforts that identify potential safety threats that arise from the development and use of frontier AI models.
As AI is increasingly applied across domains, they are looking to develop strategies to avoid negative outcomes through funding research to identify and assess risks and improve the safe deployment of AI for the benefit of society.
The AI Safety Fund (AISF) seeks to support technical research that evaluates potential risks and develops safety measures for AI systems operating in cybersecurity contexts. This funding aims to promote responsible development of frontier AI models while establishing robust evaluation frameworks for security-related capabilities and safety measures.
Research Objectives
- Benchmarks and uplift studies to evaluate frontier AI models:
- Capability to identify and exploit novel security vulnerabilities
- Effectiveness at automating complex attack chains
- Ability to adapt and modify existing exploit code
Funding Information
- The AISF plans to fund research projects by academic labs, non-profits, independent researchers, and for-profit mission-driven entities across both Biosecurity and Cybersecurity topics in the range of $350- $600K.
Duration
- The research duration must be one year or less.
Eligibility Criteria
- The AISF makes grants for independent researchers affiliated with academic institutions, research institutions, NGOs, and social enterprises across the globe that aim to promote the safe and responsible development of frontier models by testing, evaluating, and/or addressing safety and security risks. The AISF seeks to fund research that accelerates the identification of threats posed by the development and use of AI to prevent widespread harm.
- The U.S. Department of the Treasury’s Office of Foreign Assets Control (OFAC) imposes restrictions on services and transactions with individuals or entities located in countries subject to comprehensive U.S. sanctions. As a result, due to applicable US sanctions, the AISF is unable to award grants to the following countries:
For more information, visit AISF.