Study to Evaluate the Feasibility of Using Reading Achievement Levels Developed in 1992 for Reporting Results of the 2009 National Assessment of Educational Progress in Reading for Grades 4, 8 and 12 and to Draft Descriptions for Reporting 2009 Results

The National Assessment Governing Board is preparing to design and implement a study to evaluate the feasibility of using reading achievement levels developed in 1992 for reporting results of the 2009 National Assessment of Educational Progress (NAEP) in reading for grades 4, 8, and 12. The Governing Board intends to award a sole source contract to the Educational Testing Service (ETS) in accordance with Federal Acquisition Regulations Part 13, Simplified Acquisitions. This solicitation will be awarded in accordance with the authority of Federal Acquisition Regulations (FAR) 6.302-1(a)(2) as only one responsible source can provide the required services. The data to be used for this study are secure and not available to the public. As the incumbent contractor with the National Center for Education Statistics, ETS is authorized to conduct data analysis for the secure data collected for the reading assessment. The analyses required to compute the scaled data and to compute and locate the cut scores on the score scale are complex. The 2009 data collection design for reading at each grade includes an unusual data collection design called a braided design, which was designed and implemented by ETS to link score scales and maintain trend. ETS developed the methodology for scaling the data, and is therefore uniquely well-qualified and equipped to perform these analyses for the Governing Board study. The procedure of item anchoring and developing anchor descriptions was developed by ETS, and ETS has experience in implementing these studies. A high level of experience and expertise are needed for this work. Many of the tools and procedures to be used in this work were developed by ETS who has extensive experience in their application. No other company is known to have as much experience with this type of work, and in particular with NAEP. A small-scale preliminary study was conducted in April 2009 to evaluate the feasibility for grades 4 and 8, based on results of the 2008 field trial in reading. The data to be used in this study are for the 2009 operational NAEP at all three grades and will use a different criterion for anchoring items. Achievement levels are to be the primary method of reporting NAEP results, and reading NAEP results are to be reported within a year when a new framework has been implemented. Thus, there is an urgent need to implement this study quickly in order to avoid non-compliance with legislative requirements and Board policies governing NAEP reporting. Further, ETS regularly works with the committee of content experts for the reading NAEP who develop and review items, as well as provide additional advice on the reading assessment. The expert opinions of these groups are required for the anchoring study to be conducted for the Governing Board. In accordance with FAR Subpart 6.3-Other Than Full and Open Competition, and under the provisions of FAR 6.302-1, only one responsible source -- Educational Testing Service can provide the required services and within the timelines required for reporting the 2009 NAEP reading results. Organizations and persons may identify their interest and capability to respond to the requirement. This notice of intent is not a request for competitive proposals. However, all capability statements received within 15 days after publication of this synopsis will be considered by the Governing Board. The period of performance is from the date of contract award, anticipated to be approximately September 21 through August 31, 2010.