Bias Effects and Notable Generative AI Limitations (BENGAL) Targeted Super Seedling Research Topics

1/24/2024 – SAM.gov due date has been updated to 2/9/2024. 1/24/2024 – Questions and Answers (Q&A) Round #5 Posting and Amendment 005: BENGAL BAA Q&A (Round #5) answers to Questions 41 & 42 are attached. The BAA is amended to: 1) extend the due date for the proposals to February 9, 2024 4:00 PM EST and 2) incorporate the answer/change to Question #41 from the BENGAL Questions & Answers (Round 5). A full, updated BAA is attached. 12/20/2023 – Questions and Answers (Q&A) Round #4 Posting and Amendment 004: BENGAL BAA Q&A (Round #4) answers to Questions 15 – 40 are attached. The BAA is amended to: 1) incorporate the answers/changes for Question #21 from the BENGAL Q&A (Round #4) to BAA Section 4.2.1, Volume 1 – Technical & Management Proposal; 2) incorporate the answers/changes for Question #24 from the BENGAL Q&A (Round #4) to BAA Section 4.2.2, Cost/Price Proposal, Paragraph B; 3) correct BAA # on Appendix A. 1; and 4) provide Word document templates for the BENGAL BAA appendices. A full, updated BAA is attached. NOTE: Any remaining BENGAL BAA questions will be answered near-term. Offerors will receive White Paper responses NLT 30 days prior to the proposal due date. 12/4/23 - Round 3 QandAs are attached 11/30/23 - Round 2 QandAs are attached 11/29/23 - Amendment 003 : Round 1 Question and Answers (QandAs) are attached. The BAA is amended to: 1) extend the due date for the proposals to January 29, 2024 4:00 PM EST ; 2) formally incorporate the changes from the BENGAL QandAs (Round 1); 3) update Section 4, Application and Submission Information , list of the Non-Government entities that will have access to proposals, and 4) correct file name for Amendment No. 002 to read “IARPA-BAA-24-03” and issuance dates to reflect “2023” for Amendment Nos. 001 and 002. A full, updated BAA is attached. NOTE: The IARPA Distribution and Evaluation System (IDEAS) opened on November 29, 2023 for registration and subsequent submission of white papers starting on December 1, 2023. See Question #9 for clarification regarding the transmittal letter instructions for the White Papers and Proposals. 11/22/23 - Amendment 002: The BAA is amended for clarification, to revise the technical section, and to incorporate changes from Amendment 001. A full, updated BAA is attached. NOTE : The IDEAS system is not yet open for submission of white papers. It is anticipated that this will occur early next week. If there are any further delays we will issue a notice here. 11/20/23 - Amendment 001: The BAA is amended to revise the submission window for white papers to December 1, 2023 12:00PM EST through December 5, 2023 12:00PM EST and to add the requirement for a Quad Chart attachment to the proposal, see attached Amendment 001. ________________________________________ Original posting: White Papers (abstracts) Due Date: December 5, 2023 12:00 PM EST (Offerors are strongly encouraged to submit white papers before submitting a proposal). The submission window for white papers will open on November 27, 2023 12:00PM EST and close on December 5, 2023 12:00PM EST. The Intelligence Advanced Research Projects Activity (IARPA) invests in high-risk/highpayoff research programs that have the potential to provide our nation with an overwhelming intelligence advantage. IARPA seeks to develop new capabilities to enable the safe adoption and use of generative AI technologies to greatly enhance the effectiveness and efficiency of the Intelligence Community (IC). The goal of the BENGAL targeted super seedling is to understand LLM threat modes, quantify them and to find novel methods to correct threats and vulnerabilities or to work resiliently with imperfect models. IARPA seeks to develop and incorporate novel technologies to efficiently probe large language models to detect and characterize LLM threat modes and vulnerabilities. Performers will focus on one or more of the topic domains below, clearly articulate a taxonomy of threat modes within their domain of interest and develop technologies to serve as an analog to ‘virus scan’ software.