Section 4: Data Collection & Reporting Procedures
4.1 Research & Evaluation Overview
The USU STARS GEAR UP Administrative Team's data and evaluation team provides guidance and oversight to each USU STARS GEAR UP Local Education Agency (LEA) on data collection, analysis, and submission efforts. The Administrative Team monitors data entry to ensure data entered in the USU STARS GEAR UP RGI database is complete, accurate, and non-duplicative. The Administrative Team reports annual progress on the project's performance to the U.S. Department of Education in an Annual Performance Report (APR) due April 15th each year. Diligent year-round work at the school and district level to consistently collect and submit data is vital to the USU STARS GEAR UP Administrative Team's ability to meet federal reporting requirements necessary for continued funding. In addition, the Administrative Team supports the implementation of data-driven decision making, ensuring that robust services and academic interventions are targeted to the individual students most in need of specific interventions. To assist schools and LEAs in the implementation of a data-driven program, the Administrative Team has staff that will assist in reviewing services and data outcomes.
The purpose of GEAR UP nationally is to support early college preparation and awareness activities for students in low-income schools. As defined by Congress in the Higher Education Act (HEA) and the reauthorized Higher Education Opportunity Act (HEOA), the overall GEAR UP goal is to significantly increase the number of students who are prepared to enter and succeed in postsecondary education.
USU STARS GEAR UP developed project objectives and performance measures that are designed around HEA/HEOA. USU STARS GEAR UP's objectives drive the project at the state, LEA, and school level. The external evaluator, RGI Corporation, will provide annual formative evaluation reports to equip staff with information about project implementation and student academic outcomes. These reports allow for ongoing data-driven decisions to be made by the Administrative Team and LEAs as the cohort progresses towards high school graduation and postsecondary education.
At the end of the project, the evaluator will conduct a summative, or final, evaluation that will assess the project's overall impact. The Administrative Team will submit the formative and summative evaluation reports to the U.S. Department of Education with the APR.
Activity Documentation
Data must be collected for all USU STARS GEAR UP activities using activity sign-in sheets provided by the Administrative Team. Site coordinators must store the files in two locations (electronic or hard copy files are allowable) for seven years after the end of the grant. Regular data audits include, but are not limited to:
Sign-in sheets and field trip forms reviewed to ensure documentation matches the service participation data entered into the RGI data system. Data collection and reporting procedures are further explained in this section.
RGI Corporation helps maintain student-level demographic, service, and outcome data required for federal performance reporting and continued funding. RGI is an online database and student tracking service where USU STARS GEAR UP site coordinators will enter student, parent/family, and teacher/professional activity data after sign-in sheets are collected. The sign-in sheets used to enter data into RGI will need to be filed by month and year. Hard copies must also be kept.
Annual Performance Report (APR)
The USU STARS GEAR UP Administrative Team is required to report annually to the U.S. Department of Education by April 15th. The APR is used to determine whether substantial progress has been made toward meeting objectives outlined by the project plan and determines continuation of funding at the state and local level. As required by the Government Performance and Results Act of 1993 (GPRA), the APR is also used to collect data on the performance of GEAR UP at the national level. Data elements may change annually.
These highlights are an opportunity for each LEA to showcase the great work they are accomplishing over the reporting period and to highlight their success through data. The information obtained through each LEA's APRs will be shared with the U.S. Department of Education in the federal APR completed by the USU STARS GEAR UP Administrative Team. One component of the federal APR is a profile of each partner LEA that outlines the schools served and number of students served by grade. In addition, the profile will include a narrative component provided by the district-level staff in the LEA APR.
4.2 Data Collection Plan & Timeline
Ongoing Data Collection
- Maintain accurate and up-to-date documentation of USU STARS GEAR UP student, parent/family, and teacher professional development services and activities.
- Ensure sign-in sheets are administered and collected at all USU STARS GEAR UP student, parent, and educator professional development events, and correctly store even if you are not present.
- Provide names and demographic information for any new USU STARS GEAR UP students.
- Monitor USU STARS GEAR UP students' withdrawals from and returns to school; update in RGI data system.
- Keep and file paper and/or electronic sign-in sheets.
Monthly by the 10th of the Month
- Review RGI Activities data entry web page to compare with sign-in sheets before submission.
- Submit your service activities in RGI for approval from your program coordinator.
- Submit your invoice for the previous month to USU STARS GEAR UP Administrative Team.
End of School Term
- Submit end of school-term data including course enrollment, completion, and final grades in RGI, at the conclusion of each school term. You may work with district/LEA data managers to gather this information.
Annual
- Fall:
- Participate in annual USU STARS GEAR UP data system trainings.
- Assist the USU STARS GEAR UP external evaluator in distributing and collecting surveys and other data collection procedures.
- LEA Annual Performance Report due to the USU STARS GEAR UP Administrative Team.
- Spring:
- Assist A-Team in obtaining any additional data items needed to complete the Annual Performance Report due to the U.S. Department of Education by April 15th
- Assist A-Team in obtaining any additional data items needed to complete the Annual Performance Report due to the U.S. Department of Education by April 15th
End of Spring Term (June 15)
- Final APR Course Grades (including incompletes). The final grades are used in the APR to determine number enrolled in the course and the number passing the course.
End of Summer (July 31)
- End of school year for APR reporting purposes
- All summer service activities
- Update student progress
- Summer enrichment make-up grades
- Students with 10 or more unexcused absences for school year (include summer)
Beginning of New School Year (August 1)
- This is when RGI promotes students to the next school year and new school (if applicable)
Second Week of August
- Review student enrollment and make applicable changes
- On-Line student and parent surveys accessible
Ongoing or As They Occur
- Enroll new students
- Include SSID, name, gender, grade, ESL, FRPL, IE, date of birth, enrollment date
- Exiting students
- Include exit code, exit date
- Student, parent, teacher APR service activities
- As soon after the event as possible
- Update progress
- Unexcused absences
- Took Explore and/or Aspire (scores)
- Took PSAT or PLAN (scores)
- Took SAT or ACT (scores)
- Completed FAFSA (date)
Beginning of Terms
- Add Courses
- Include course grading system
End of Terms
- Course completion
- Course grade
RGI Monthly Report
- Review for data completion and accuracy. Report provided to LEA. Report provided to LEA. They also look at demographic data for completeness
USU STARS GEAR UP Monthly Review
- Service activities reviewed on the 18th of each month
Standard Courses Reported in the APR
- Pre-Algebra
- Algebra I or equivalent (Secondary Math 1)
- Geometry (Secondary Math 3)
- Algebra II (Secondary Math 2)
- Calculus
- Chemistry
- Physics
- At least one advanced placement course
- Trigonometry (Secondary Math 3)
- Pre-Calculus
- Biology
- English & language arts
- At least one international baccalaureate class
- At least two years of math beyond Algebra I
For further instruction on data entry, please refer to the RGI manual.
4.3 Database Entries & Definitions
Database Entries & Definitions
The USU STARS GEAR UP database, RGI, is an online data tracking system designed to report student, parent/family, and teacher activities and services. Students are noted in RGI in terms of their participation, academic, and outcomes data. You should use the following USU STARS GEAR UP Student Service Definitions when determining the category to assign a particular student and/or parent/family activity. It is imperative that you follow these guidelines when entering data to ensure that services are correctly categorized, non-duplicated, and accurate. These guidelines are not only used to evaluate Utah's GEAR UP program, but also that of many other states.
Activities that meet more than one category definition can be split into time blocks that are recorded as separate activities. For instance, an afterschool club with 2 hours total time with different activities (Tutoring and Chess Club, for example) can be listed in RGI twice: 1) one hour Tutoring/Support Services and 2) one hour Rigorous Academic Curriculum.
GEAR UP Student Service Definitions
| Term | Description |
|---|---|
| Tutoring/Homework Assistance |
Tutoring/Homework Assistance services provide additional academic instruction designed to increase the academic achievement of students.
|
| Comprehensive Mentoring |
Comprehensive mentoring services are provided when GEAR UP staff, teachers, or other school staff identifies students who would benefit from an ongoing supportive relationship with a trained, caring adult or older student, i.e., “mentor.”
Mentoring programs may include:
|
| Financial Aid Counseling/Advising |
Financial Aid Counseling/Advising services assist students understanding and navigating the complexities of financial aid, including:
Virtual Financial Aid Counseling/Advising includes services that are provided via remote access through the internet or other means. |
| Counseling/Advising/Academic Planning/Career Counseling |
Counseling/Advising/Academic Planning/Career Counseling services span a spectrum of activities with individual students or small groups of students. Services are defined as follows:
Note: Data entry needs to indicate whether counseling/advising/academic planning/career counseling services are “in-person” or “virtual.” |
| Tracking Hours for Rigourous Academic Curricula |
Hours submitted into RGI under Rigorous Curricula should cover academic opportunities the school has been able to provide with the help of GEAR UP. These should not be classes or programs that existed at the school prior to GEAR UP's involvement. All rigorous curricula should have clear learning objectives taught in a purposeful sequence to build knowledge over time. Things that fit into this service category do not need to be exclusively in the classroom or cover the entire class semester, and USU STARS encourages schools to consider after school clubs, lessons of classes that have a GEAR UP supported component, or out of school experiences such as academic summer camps or workshops. All items listed as rigorous curricula should be approved by USU STARS during workplan creation or over the course of the academic year. Note: Courses that have been offered by schools prior to the introduction of GEAR UP that include honors, AP, and core math and English classes, will still be tracked in RGI thorugh course enrollment and completion, but student hours should not be added as a service. |
| College Visit/College Student Shadowing |
College Visit/College Student Shadowing services take place on college campuses. |
| Job Site Visit/Job Shadowing |
Job Site Visit/Job Shadowing services offer students exposure to the workplace in an occupational area of interest and reinforces the link between classroom learning, work requirements, and the need for postsecondary education. Students witness the work environment, employability and occupational skills in practice, the value of professional training, and potential career options. |
| Concurrent Enrollment |
USU STARS GEAR UP used federal funding to provide schools the opportunity to recruit and enroll more students in CE courses prior to their junior year of high school. Schools can track the hours of CE courses for students who used this opportunity to cover application costs, to be included in rigorous academic curricula. USU STARS understands that tracking these students specifically, could present a challenge for the school, so they can in the 2019/20 school year choose to not track and record these hours, although course enrollment and completion of CE classes will still need to be submitted. |
| Summer Programs |
Summer programs are services that include an experience over one or multiple days during the summer (or other non-school year time, i.e., for year round schools).
|
| Educational Field Trips |
Educational Field Trips are services during which students leave their school or travel to another location, and include an academic component that is linked to classroom activities. Here are some examples:
Educational field trips should be recorded by subject area (Mathematics, English/Reading, Science, Cultural, etc.). |
| Student Workshops |
Student Workshops are services that include interactive informational classroom-level or large- or small-group sessions that involve hands-on experience for each student in the workshop.
|
| Parent/Family Workshops Of College Prep/Financial Aid |
Workshops of college prep/financial aid services include a parent/guardian or adult family member's attendance with or without their child(ren) at a workshop that demonstrates how to assist their student with college preparation or financial aid information. |
| Parent/Family Counseling/Advising |
Counseling/advising services span a spectrum of activities that can include one-onone or small group advising for parents/guardians/adult family member designed to meet the specific needs of the individuals engaged in the activity. |
| Parent/Family College Visit |
College visit services take place on college campuses. A physical visit to a college campus by a parent/guardian, with or without a student, facilitated/supervised/led by GEAR UP staff, teachers, college representatives, or other school staff. |
| Family Events |
Family Events are services in which parents or families participate. These services involve USU STARS GEAR UP students and their families/guardians or just their parents/guardians. Family events include USU STARS GEAR UP activities that recognize the role of families in student success, and are not defined under a previous category. |
4.4 Course Data Building Guidelines
Additional information can be found in the RGI GEAR UP Database Manual.
4.5 Creating and Using Service Templates & Student Groups
Additional information can be found in the RGI GEAR UP Database Manual.