HE Provider HEAT-HESA Track Impact Report

Introduction

On an annual basis, HEAT submits complete records for students who are expected to be ready to enter higher education (HE), and have given permission to be tracked, to the Higher Education Statistics Agency (HESA) for longitudinal tracking into the HE population. The latest HEAT-HESA Track dataset included students expected to enter HE in the 2021/22 academic year or earlier. This report presents the key findings from the latest HEAT-HESA Track dataset, in particular for students who have taken part in outreach activities recorded by HE providers on HEAT¹.

By tracking learners who take part in outreach whilst at school or college, we can see whether they entered HE after 16-18 study. This informs our understanding of the contribution of outreach provision to attracting under-represented students into HE. Outreach provision is key to meeting the Office for Students’ (OfS) strategic objective, in particular regarding participation in HE: ‘All students, from all backgrounds, with the ability and desire to undertake higher education, are supported to access, succeed in, and progress from higher education’ (OfS, 2023a).

While the main focus of this report, and of widening participation work in general, is the Access stage of the student life cycle, the later stages of the student life cycle, Continuation and Degree Attainment are also explored. Tracking outreach recipients into the later student life cycle stages, such as Continuation and Degree Attainment, allows us to monitor their success once in HE, ensuring it is comparable with their peers.

This report is split into three sections presenting the latest findings on:

1. Access to HE within two years of outreach participants expected to enter HE in 2020
2. Continuation in HE of outreach participants who entered HE in 2021 on full-time first degrees
3. Degree Attainment of outreach participants who completed their full-time first degrees in 2021

Each section compares outcomes for outreach participants recorded on HEAT with the national average for all comparable learners. To further examine the impact of participating in outreach on progression to HE, sections (1) and (2) also include a quasi-experimental approach using closely matched comparison groups.

A note on previous HE Provider HEAT-HESA Track Impact Reports, Footnotes and References are listed at the end of this page.

Methodology

We used a quasi-experimental approach comparing outcomes of a group of students who participated in an intensive package of outreach to a closely matched comparison group of students who participated in none to minimal outreach. An intensive package of outreach is defined as ‘11+ hours of any activity and eight or more hours of a high intensity activity content (Activity Types: Summer School, HE Subject Insight, Mentoring, Skills & Attainment, Campus Visit)’. To be classed as ‘a least intensive package of outreach’ (i.e., none to minimal outreach), a student has received a maximum of one activity with low intensity content (Activity Types: General HE Information, Exhibition) or less than three contact hours overall.²

Comparison groups were created individually for Access and Continuation measures and matching was conducted using case-control matching in SPSS.  Matching variables were selected from the HEAT-HESA Track dataset based on:

• Research on factors impacting HE entry/continuation
• Student characteristics likely to be related to risks concerning equality of opportunity (informed by OfS, 2023b)
• Data availability³

It should be noted that the HEAT-HESA Track dataset is considered secondary data, i.e., this data has already been collected by the membership and additional data collection is not feasible. Therefore, key variables affecting HE progression such as student motivation and prior attainment⁴ could only be included using proxies. Due to the size of the membership and differences in targeting, delivery, and recording of student and activity data, other important factors, e.g., how students were targeted, could also not be taken into consideration.

Despite these limitations, the HEAT-HESA Track dataset provides the largest and most complete longitudinal tracking dataset of outreach participants available. The cohorts included in this analysis consist of over 190,000 students who have received outreach by HE providers within the HEAT community. Of all large outreach providers delivering Access interventions in England, 87% record their data on the HEAT system, enabling us to draw high-level trends about the efficacy of outreach delivery in England.

1. Access

Of all outreach participants recorded on HEAT who were expected to enter HE in 2020, 57.7% were found in the HE population by 2021. At national level, only 46.8% of young people entered HE within two years of being expected to do so, according to the Department for Education’s (DfE) latest Widening Participation in Higher Education statistics (DfE, 2023) (Figure 1). The higher proportion of outreach participants entering HE suggests that being in receipt of outreach interventions may contribute towards students’ likelihood of accessing HE.

Across all outreach participants included in the matched analysis, those in receipt of an intensive package of outreach entered HE at a rate of 71%, compared to only 58.5% of those in receipt of little or no outreach (Figure 2). The percentage point gap of 12.5 was found to be statistically significant and those engaged in intensive outreach were thus 1.2 times more likely to progress to HE within two years of being expected to enter.

Therefore, after controlling for factors known to affect progression to HE, rates of HE entry remain higher for students who have engaged in an intensive package of outreach when compared with those who have not. This allows us to be more confident in stating that the differences we observe can be attributed to outreach participation, rather than occurring as a result of other differences between the two groups.

The majority of the matched sample consisted of students who participated in outreach while at a secondary school. Among this group a particularly high HE entry rate of 72.9% was observed. The gap to a matched comparator group of school students who received little to no outreach was 11.3 percentage points, which was found to be statistically significant. This suggests that school students who engage in an intensive package of outreach have an increased likelihood of entering HE.

A smaller subsection of the matched group consisted of students who participated in outreach while at a FE college⁵. Of those in receipt of an intensive package of outreach, 63% entered HE, compared to only 45.5% of those in receipt of little to no outreach. The large gap between entry rates of FE students who participated in an intensive package of outreach to those who did not was found to be statistically significant and those in receipt of an intensive package of outreach in this subgroup were therefore 1.4 times more likely to enter HE than their counterparts in receipt of little to no outreach. This gap suggests that FE students may particularly benefit from participation in an intensive package of outreach.

It should be noted that the proportion of FE learners in the matched cohort is smaller than the proportion of learners who only participated while in secondary school or sixth form. FE learners may have had less time and opportunity to participate in outreach, in particular if only participating while at a FE college, which means they may be less likely to meet the threshold for an intensive package of outreach resulting in a smaller sample size for this analysis.

Return to Introduction

2. Continuation

Of all outreach participants tracked by HEAT who entered HE on full-time first degrees in 2020, 94.6% continued in HE after the first year, compared to 89.3% across all registered English HE providers according to the OfS’ Access and Participation Data Dashboard (OfS, 2023c) (Figure 3).

Once on course, outreach participants continue at a similar rate to the national average. The slightly higher proportion of outreach participants continuing in HE may tentatively suggest that being in receipt of an outreach intervention may not only increase access to HE but also provide encouraging support to students to improve their likelihood to continue in HE.

To explore the impact of participation in outreach on students’ continuation in HE further, we next apply a quasi-experimental matched cohort design to explore if there are statistically significant differences when comparing a group of students who participated in an intensive package of outreach to a closely matched group of students who participated in little or no outreach.

Across all outreach participants included in the matched analysis, those in receipt of an intensive package of outreach continued in HE at rate of 95%, compared to 94.1% of those in receipt of little or no outreach (Figure 4). A small, yet statistically significant, gap of 0.9 percentage points was observed.

While the participation in outreach in general appears to have a positive effect on the continuation in HE, the different levels of intensity of the package of outreach observed by a matched comparison group do not currently show a large effect on non-continuation.

It should be kept in mind that outreach activities are generally intended to ultimately increase Access to HE; however, one may argue that students making more informed decisions regarding going to HE, and having a better idea of what it is like to study in HE, may also positively impact whether they stay in HE after the first year. While improved continuation may be a byproduct of outreach activities, there are many other factors impacting on student continuation and underlying mechanisms have not been explored further for the purpose of this report.

Return to Introduction

3. Degree Attainment

Of all outreach participants tracked by HEAT who qualified for a full-time first degree in 2021, 85.9% achieved a First Class or Upper Second Class degree, compared to 78.1% across all registered English HE providers according to the OfS’ Access and Participation Data Dashboard (OfS, 2023c) (Figure 5). This suggests that outreach participants progress in HE similar to their peers.

It should be noted that Degree Attainment is not commonly an intended outcome of outreach interventions. Therefore, a matched comparison group design with groups in receipt of varying outreach packages was not applied. However, tracking outreach recipients into further student life cycle stages, such as continuation and degree attainment, allows us to monitor their success once in HE, ensuring it is comparable with their peers.

Return to Introduction

Copyright: Higher Education Statistics Agency Limited 2023. Neither the Higher Education Statistics Agency Limited nor HESA Services Limited can accept responsibility for any inferences or conclusions derived by third parties from data or other information supplied by the Higher Education Statistics Agency Limited or HESA Services Limited.