Texas Resource Review

The Texas Resource Review (TRR), formally Instructional Materials Quality Evaluation (IMQE) and Instructional Materials Portal (IMP), will provide Texas educators with free, transparent, and user-friendly information about the quality of materials.

Local education agencies (LEAs) can use this tool—similar to a Consumer Reports for instructional materials—to strengthen and improve the efficiency of their local review processes. By making it easier for LEAs to select high-quality instructional materials, TRR will help teachers focus their time and energy on what matters most—bringing lessons to life for all students.

TRR will launch in fall 2019.

Frequently Asked Questions are located at the bottom of this page.

The Impact of Instructional Materials

Teachers and students deserve the highest quality instructional materials that not only align to the TEKS but also reflect research-based instructional practices that provide teachers with the support they need to challenge their students and inspire them to learn and grow.

    • High-quality instructional materials allow students to engage deeper, and more meaningfully with standards
    • High-quality instructional materials lead to additional learning for students
    • High-quality instructional materials create a larger, more cost effective, impact on academic outcomes than many other initiatives 

    A Tool to Help Texas Educators

    In accordance with Texas Education Codes § 31.081 and § 31.082, TEA will facilitate the independent analysis of instructional materials to evaluate their quality. This process will complement and augment the established State Board of Education’s TEKS-alignment process. LEAs will also have more robust information to help them select the instructional materials that best meet their local needs. LEAs will continue to have complete autonomy to decide if and how they use the reviews as part of their local review and adoption processes.

    The online Texas Resource Review will:

    • Provide clear, transparent, and user-friendly information about the extent to which materials reflect research-based pedagogy and support the learning of all students
    • Leverage Texas-specific rubrics designed by local educators and other content experts to fit the Texas context and TEKS
    • Display easy-to-use reviews completed by teams of Texas educators with deep knowledge of content and pedagogy
    • Make it easy for LEAs to search for materials based on local needs
    • Increase the ease, efficiency, and accuracy of LEAs’ local review processes thereby reducing the burden on teachers and other review committee members

    How It Works

    • Publishers submit instructional materials for review
    • Materials go through the SBOE’s TEKS alignment process and the quality review process
    • Clear, transparent, user-friendly results published on the website

     

    Get Involved

     

    Give Feedback!

    Throughout the design and implementation of this project, TEA will collect  robust feedback from stakeholders including Texas educators, parents, publishers, and other members of the education community and public. Contact specialprojects@tea.texas.gov if you would like to get involved.

    Subscribe to a Listserv!

    Sign up for the Instructional Materials listserv (geared towards districts and charter schools) or the Review and Adoption listserv (geared towards publishers) to stay up-to-date on the project. Go to the Email Updates page to select the listservs you would like to subscribe to.

     

    Frequently Asked Questions

     

    Q1: What is the Texas Resource Review and what are the Instructional Material Reviews?

    Q2: What does it mean to evaluate the quality of instructional materials?

    Q3: How did the Texas Resource Review come about?

    Q4: When will the reviews be published?

    Q5: Once published, do districts have to use the information? 

    Q6: How does this impact local control?

    Q7: How does this align with the State Board of Education's Long Range Plan?

    Q8: How does the Texas Resource Review support the SBOE process? Are they different?

    Q9: Who has been involved in providing feedback opportunities?

    Q10: How many districts or people have been included in feedback opportunities?  

    Q11: What is the process for developing the rubrics?

    Q12: Who is conducting these reviews?

    Q13: What are the financial benefits to Texas?

    Q14: What resources are being devoted to this project?

    Q15: My district already uses certain programs or subscriptions. Does this project just replace that?

    Q16: Are there incentives or consequences related to this project?

    Q17: How is this different from other states who are doing similar projects?

    Q18: Will instructional materials for other grades and content areas be reviewed in the future? What about supplemental materials?

    Contact specialprojects@tea.texas.gov with additional questions related to the Texas Resource Review.

    Q1: What is the Texas Resource Review and what are the Instructional Material Reviews?

    A growing body of research demonstrates that the quality of instructional materials teachers use has a significant impact on student achievement. Local Education Agencies (LEAs) across Texas are eager to purchase the best materials for their teachers and students, but free information about the quality of materials can be unorganized, unreliable, and difficult to access. Additionally, reviewing instructional materials is a time-consuming process for the teachers who serve on their LEA's review committees.

    Written into statute in 2017 (Texas Education Code § 31.081 and § 31.082), TEA will conduct an independent analysis of each instructional material to evaluate its quality. An Instructional Material Review is a completed quality evaluation for a set of materials. By completing these reviews, TEA aims to support and strengthen LEAs' local review process by providing clear, transparent, and user-friendly information about the quality of instructional materials.

    The Texas Resource Review is a website, open to the public at no cost, where all completed reviews will be published. The website will be designed so instructional materials are easily comparable across specific quality indicators and will allow districts to sort materials based on their local needs and preferences.

    Q2: What does it mean to evaluate the quality of instructional materials?

    TEA will conduct an independent analysis of each instructional material to evaluate its quality. As a part of this process, the agency will ensure the definition of quality is transparently communicated via Texas Resource Review (TRR) rubrics that will be used to assess all instructional materials.

    The quality evaluation rubrics will be customized based on content area and grade band with some commonalities across all rubrics. For example, all quality evaluation rubrics will include the percentage of the Texas Essential Knowledge and Skills (TEKS) coverage as determined by the State Board of Education (SBOE) process, an assessment of supports for diverse learners, and a determination of how easy materials are for teachers to use in the classroom. However, the English language arts and reading (ELAR) evaluation rubrics have content-specific quality indicators related to the variety and complexity of texts, how students are required to respond to the texts, and whether materials support the development of foundational literary skills.

    Q3: How did the Texas Resource Review come about?

    This project is required by statute in SB 810, 85(R) and companion legislation in HB 3526, 85(R). These bills required TEA to develop and maintain a web portal that includes: a) general information (e.g., price, technology requirements, etc.) for each material on the SBOE list or submitted by a publisher, b) a quality evaluation of the material and the extent to which materials cover the TEKS, and c) a repository of open educational resources accessible at no cost, including state-developed materials. In addition, the agency is required to contract with a private entity to conduct an independent analysis of materials in the web portal. Through a competitive process, Safal Partners was identified to be the third-party evaluator for the purposes of the Instructional Material Reviews. An additional Request for Offer (RFO) was conducted and identified Mighty Citizen for IT work to build the actual web interface for the Texas Resource Review.

    Additionally, this initiative came about to increase districts’ access to high quality materials. A growing body of research demonstrates that the quality of instructional materials teachers use has a significant impact on student achievement. LEAs across Texas are eager to purchase the best materials for their teachers and students, but free information about the quality of materials can be unorganized, unreliable, and difficult to access. Additionally, reviewing instructional materials is a time-consuming process for the teachers who serve on their LEAs’ review committees. Smaller LEAs, especially, can find the process especially daunting without access to any third-party evaluation resources. The IMQE portal will make this process easier for LEAs by providing free, clear, transparent, user-friendly information about the quality of materials which can be used as part of their local adoption process if desired.

    Q4: When will the reviews be published?

    The agency is planning to publish the first set of reviews on the Texas Resource Review website in November 2019. 

    Q5: Once published, do districts have to use the information?

    LEAs will maintain complete local control over purchasing decisions. LEAs will continue to have complete autonomy to decide if and how they use the reviews as part of their local decision-making processes.

    Q6: How does this impact local control?  

    TEA believes deeply that LEAs are best positioned to decide which curricula best fit the needs of their teachers and students. The TRR portal is designed to complement and strengthen LEA’s local review process by providing clear and transparent information about the quality of curricula. The portal does not impact a district's ability to make their own local review and adoption decisions.

    Q7: How does this align with the State Board of Education's Long Range Plan? 

    The State Board of Education adopted a new Long-Range Plan for Public Education that establishes an overall goal of “access and equity so that all children receive what they need to learn, thrive, and grow.” To achieve this vision, one specific recommendation from the SBOE is that TEA “provide a greater array of no-cost or low-cost resources to support high-quality, aligned curriculum and instruction for all educators.”

    The Texas Resource Review directly addresses this recommendation. Quality instructional materials are an equalizer in the classroom, so increasing access to free information about quality materials will increase equity for students across Texas. Additionally, all quality reviews published on the TRR website will be free to access for all districts. This will increase equity for small and rural districts that have limited resources to review all instructional materials on their own.

    Q8: How does the Texas Resource Review Support the SBOE process? Are they different?

    The agency has engaged in ongoing conversations with the State Board of Education (SBOE) to ensure TRR will complement and augment the established SBOE’s TEKS-coverage review process. This is demonstrated in the TRR rubrics where the first measure of quality reflects the results of the SBOE’s review process to capture what percentage of standards are met. All materials reviewed for quality will also be reviewed through the SBOE’s TEKS-coverage review process, and the results of the SBOE process will be featured as a part of the quality reviews on the TRR website.  

    Q9: Who has been involved in providing feedback opportunities?

    TEA has received feedback from hundreds of stakeholders including but not limited to Texas teachers, district and campus administrators, SBOE members, regional education service centers, numerous Texas associations, and publishers.

    Q10: How many districts or people have been included in feedback opportunities?

    In preparation for the pilot, the agency conducted 24 presentations, 17 focus groups, and 46 individual phone calls, representing targeted outreach to over 400 stakeholders and 12 different organizations and associations. In addition, the rubric was sent out to multiple TEA email lists that included over 43,000 subscribers with a request for feedback. TEA requested all education service centers hold presentations and focus groups with all districts in their regions. TEA has also engaged in extensive outreach to solicit feedback in preparation for the full launch of the Texas Resource Review, and detailed numbers will be updated when available.

    Q11: What is the process for developing the rubric?

    The goal of the TRR rubrics is to provide LEAs with helpful information about the quality of instructional materials. The rubrics are customized based on content area and grade band with some commonalities across all rubrics. The ELAR rubric development processes occurred in three phases:

    • Phase I: Early Draft of ELAR Rubric TEA, in partnership with a third-party evaluator, developed a draft rubric specific to Texas and the TEKS. This rubric was initially shared with SBOE members, regional administrators and focus groups of Texas school districts. The rubric was then sent out to multiple TEA email lists that included over 43,000 subscribers with a request for feedback. Finally, it was shared with publishers for feedback.
    • Phase II: Updated Draft of ELAR Rubric Upon reviewing all feedback responses, TEA made enhancements to the draft rubrics to incorporate trends in feedback from stakeholders. Some examples of updates made to the pilot rubric, from which the full launch rubric development process was designed, are outlined in a memo that can be accessed here: /sites/default/files/IMQE%20Rubric%20Revisions%20Memo.pdf This version of the rubric will be used to complete quality reviews during the IMQE pilot and can be accessed here: /sites/default/files/IMQE%20ELAR%203-8%20Rubric%20FINAL.pdf  
    • Phase III: Final ELAR Rubric for Full IMQE Portal The agency conducted pilot reviews of ELAR 3–8 materials during a pilot in spring 2019. Throughout this process, educators completing the evaluations, pilot districts and pilot publishers provided additional feedback on how the agency can further enhance the rubric to meet the needs of Texas educators. The agency made final updates to the ELAR 3--8 rubric before its use to evaluate materials for the full launch of the Texas Resource Review. 

    Throughout the development process, the rubric has been designed specifically to align to the new ELAR TEKS, and the percent TEKS coverage will be reflected in the review. After instructional materials have been reviewed in ELAR, new rubrics will be developed for other TEKS subject areas and grade bands. The agency will collect feedback from Texas educators and stakeholders before finalizing all new rubrics used to review materials on the TRR.

    Q12: Who will be conducting these reviews?

    All reviewers will be Texas educators and use the rubric developed for Texas. Each review team will consist of five reviewers and at least two review team members will be current classroom teachers. Other reviewers may be Texas district and campus administrators that demonstrate an excellent understand of the TEKS, rigorous expectations for high-quality instructional materials, and a strong understanding of effective curriculum implementation. Additionally, Texas reviewers will be geographically representative of the state. Select reviewers will have expertise serving students with special needs, English learners, and classrooms with high percentages of students receiving free and reduced price lunch.

    All reviewers will go through a rigorous selection process and ongoing training to ensure that they have the knowledge and skills to write valid and reliable reviews that are helpful to Texas LEAs.

    Q13: What are the financial benefits to Texas?

    The Texas Resource Review, including all published quality reviews, will be available at no cost to districts across Texas. Feedback from some districts indicates that increased access to free, user-friendly information will help districts improve local review and adoption processes which for some of them may result in cost savings.

    Q14: What resources are being devoted to this project?

    Each district and open-enrollment charter school is entitled to a technology and instructional materials allotment (TIMA). The amount of the TIMA is determined biennially by the commissioner and is based on the legislative appropriation. In the 2018–2019 biennium (school years 2017-18 and 2018–2019), the allocation for each LEA was based on total enrollment and bilingual enrollment. A total of $1,008,997,073.19 was allocated directly to districts during this process.

    In addition to the amount allocated directly to districts, the Texas Legislature reserves a portion of funds to be used for statewide initiatives. Written into statute in 2017 (Texas Education Code § 31.0211), money in the state technology and instructional materials fund shall be used to pay the expenses associated with the instructional materials web portal developed under Section 31.081. In the 2018–2019 biennium, TEA has allocated an average of $2.5M per year to develop the IMP.

    Q15: My district already uses certain programs or subscriptions. Does this project just replace that?

    LEAs should use the resources that best meet their local needs. The goal of the Texas Resource Review is not to supplant other resources that LEAs find helpful but to ensure that all LEAs across Texas have access to valid and reliable information about the quality of instructional materials.

    Q16: Are there incentives or consequences related to this project?

    No. Using the reviews is completely optional. There are no incentives or penalties associated with using or not using the reviews.

    Q17: How is this different from other state who are doing similar projects?

    The Texas Resource Review is being developed specifically for Texas. The rubrics were created specifically for Texas educators based on the TEKS, and the reviews incorporate the SBOE’s TEKS alignment results into the quality rating. Finally, Texas educators serve on the review teams and complete evaluations. 

      Q18: Will instructional materials for other grades and content areas be reviewed in the future? What about supplemental materials?

    The Texas Resource Review is intended to be a continuous process where teams of Texas educators conduct quality reviews of materials that meet the needs of districts. Therefore, additional content areas, grade levels, and supplemental materials will likely be reviewed at a future date.

    The agency seeks to align the timing of quality reviews with the general adoption and purchasing timelines followed by most districts based on the proclamation schedule. For instance, the SBOE is expected to release its list of approved materials in November of 2019 for ELAR grades 9–12. TEA expects to release the ELAR, grades 9–12 quality reviews at the same time. This will allow LEAs to utilize both resources in their local adoption processes as they see fit.

    Note: The agency may not review all materials districts are interested in purchasing. However, the agency will prioritize the materials reviewed based on LEA preferences, so we recommend districts submit requests for the materials they would like to see reviewed.