No Cover Image

Journal article 412 views 41 downloads

Governments harnessing the power of data to get ‘value for money’: a simulation study of England’s Office for Students B3 Proceed Metric

Alex Bradley Orcid Logo, Martyn Quigley

Studies in Higher Education, Pages: 1 - 14

Swansea University Author: Martyn Quigley

  • 63079.pdf

    PDF | Version of Record

    This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/),which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The terms on which this article has been published allow the posting of the Accepted Manuscript in a repository by the author(s) or with their consent.

    Download (2.17MB)

Check full text

DOI (Published version): 10.1080/03075079.2023.2196292

Abstract

The mass participation in higher education has led to greater spending by governments and students which has increased the focus on graduate outcomes. In England, the Office for Students (OfS) is planning to take regulatory action, using the Proceed metric, against universities and their courses whi...

Full description

Published in: Studies in Higher Education
ISSN: 0307-5079 1470-174X
Published: Informa UK Limited 2023
Online Access: Check full text

URI: https://cronfa.swan.ac.uk/Record/cronfa63079
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract: The mass participation in higher education has led to greater spending by governments and students which has increased the focus on graduate outcomes. In England, the Office for Students (OfS) is planning to take regulatory action, using the Proceed metric, against universities and their courses which do not have 60% of students with positive outcomes within 15 months of graduation. This study uses simulations to explore how effectively the Proceed metric can (a) identify the true population level of positive outcomes, (b) explore the precision of those estimates, and (c) accurately classify courses below the 60% threshold. The simulation varied: level of positive outcomes within the population (20–90%), sample size (40–1000), and the percentage of the population sampled (30–90%). The bias (difference between sample and population estimate), coverage probability (proportion of true population estimates within the intervals), and precision of confidence intervals (average range of confidence intervals) were calculated. Three main findings were (a) the Proceed metric is accurate in terms of bias and coverage probability, (b) the estimates lack precision, especially with small sample sizes, and (c) the imprecision will impact the Proceed metric ability to correctly classify courses below the 60% threshold. Governments seeking to collect graduate survey data and use it to regulate universities should make every effort to maximise sample size and should resist the temptation to regulate at a micro-level (i.e. courses) since classification will likely be inaccurate, especially for those just below the threshold.
Keywords: Employability, OfS, B3 regulations, proceed metric, graduate outcomes
College: Faculty of Medicine, Health and Life Sciences
Start Page: 1
End Page: 14

Similar Items