TrojAI BAA Draft Funding Opportunity Description

Using current machine learning methods, an artificial intelligence (AI) is trained on data, learns relationships in that data, and then is deployed to the world to operate on new data. For example, an AI can be trained on images of traffic signs, learn what stop signs and speed limit signs look like, and then be deployed as part an autonomous car. The problem is that an adversary that can disrupt the training pipeline can insert Trojan behaviors into the AI. For example, an AI learning to distinguish traffic signs can be given just a few additional examples of stop signs with yellow squares on them, each labeled "speed limit sign." If the AI were deployed in a self-driving car, an adversary could cause the car to run through the stop sign just by putting a sticky note on it. The goal of the TrojAI program is to combat such Trojan attacks by inspecting AIs for Trojans. This Draft Broad Agency Announcement (BAA) is NOT a formal request for proposal. Proposals are NOT being requested or evaluated at this time. A Final BAA will be released at a later date for which interested parties may submit proposals. The Intelligence Advance Research Projects Activity (IARPA) is seeking interested parties to thoroughly review the Draft BAA Funding Opportunity Description and provide comments, questions, suggested changes, and feedback by February 24, 2019 . There will be a Proposers' Day related to this Draft BAA on February 26, 2019, as previously announced here: https://www.fbo.gov/notices/d4fb39c226972395a95bf084274c7987 IARPA does not anticipate posting responses to any comments, questions, suggested changes, and/or feedback received; however, all input will be considered in developing the Final BAA. Additionally, the Draft BAA Funding Opportunity Description is subject to change in the development of the Final BAA as a result of IARPA's consideration of the input received from interested parties in response to the Draft BAA as well as other considerations. Please submit all comments, questions, suggested changes, and feedback to the designated procurement email address: [email protected]