Wales’ vocational attainment gap

Gareth Rees questions a moral panic over our school performance

Something peculiar seems to have happened to education in Wales. Not long ago, there was widespread consensus that parliamentary devolution had allowed successive Welsh Governments to develop important and imaginative policies across the whole range of educational provision, from early years to the universities. These policies were celebrated not merely because they were distinctive from those in other parts of the UK, but rather because they were seen to be tailored specifically to the needs and aspirations of Welsh citizens.

IWA National Conference: Tuesday 21 February 2012

Enhancing vocational education for 14 to 16 year olds

WJEC headquarters, Llandaf

Professor Gareth Rees will be speaking at this conference  which addresses key questions critical to the development of Welsh vocational provision: how effective is the current system and should there be a distinctive vocational educational system in Wales? Other speakers include professor Geoff Hayward , School of education, University of Leeds, and Professor Bill Lucas, Centre for real World learning, University of Winchester. For more details and to book a place click here

However, more recently popular perception has shifted dramatically. Now, the emphasis is on the failure of Welsh schools – and increasingly other educational institutions – to provide adequate educational opportunities for our children and young people. It is said educational attainment is not reaching appropriate standards, to the detriment of individuals’ prospects, as well as those of the Welsh economy more widely.

It is unlikely that this change in the terms of the public debate reflects actual changes in educational provision or even in educational attainment. Indeed, levels of attainment have been rising year-on-year. What has happened is that political priorities in relation to education have shifted. Now the emphasis now is on what the post-devolution education system is actually delivering to Wales, and rightly so.

In this context it is instructive that the bench-marks against which Welsh educational performance have been judged are external ones. In particular, attention has been drawn to the OECD’s Programme for International Student Assessment (PISA), an international measurement of 15-year-olds’ performance on tests in reading, mathematics and science.

Wales’ results in the 2009 PISA round have not only been roundly criticised in the British media, but have also been highlighted by Leighton Andrews,  the Welsh Government’s Minister for Education and Skills, as demonstrating the need for a major overhaul of Welsh schools. As in many other countries, the PISA results for Wales are claimed to provide incontrovertible proof of educational failure and the need for fundamental change, irrespective of any local opposition.

It is undoubtedly the case that the PISA scores do tell an important story about the state of Welsh education. However, as with any measurement of educational attainment, the PISA scores have to be interpreted carefully. Certainly, the public debate in Wales gives no indication that there is a very substantial technical literature which is critical of the analytical approach on which PISA is based. This is not to argue that all the criticisms are correct, but rather to suggest that PISA results should not be seen as unambiguously definitive.

PISA’s strength is in providing a snap-shot of educational attainment and its correlations with selected aspects of a national educational system. It can tell you that you probably have a problem. However, because of the kind of survey that it is, it cannot tell you what the causes of the problem are nor how to solve it. To address these questions requires exploring other sources of data and analysis.

As one of the UK’s most eminent statisticians of education Professor Harvey Goldstein argues, rather than using PISA results to construct what are, in reality, dubious ‘league tables’ of educational performance, they should be seen “as a way of exploring country differences in terms of cultures, curricula and school organization”.

In the Welsh context, then, there should be no debate that educational performance could – and should – be much improved. However, the much remarked decline in PISA scores between 2006, when Wales first entered the Programme, and 2009 should not be taken to indicate an actual deterioration in the performance of Welsh schools. Given that each round of PISA assessment involves different groups of 15-year-olds, at least part of the – rather small – difference between the two measurement dates is attributable to differences between the two groups of pupils. This is especially the case since a larger number of schools and a wider cross-section of pupils agreed to participate in 2009.

Moreover, the PISA results need to be interpreted in the light of Wales’s very recent entry into the Programme. Unlike in most other countries, Welsh schools and their teachers have had little incentive to learn how to approach the PISA tests and, hence, to instruct their pupils how to do so. This will almost certainly change now that schools are being required to prepare young people specifically for these tests. But what will this really mean in terms of young people’s attainment and future prospects?

The crucial issue here is the extent of the ‘fit’ between what PISA requires and the GCSE curriculum. PISA seeks to measure qualities in pupils, especially capacities to interpret and apply information, which are different from those that are emphasised in GCSEs, where demonstrating the acquisition of knowledge is prioritised. And it is important to remember that it is on GCSE performance that schools have hitherto been judged and for which pupils actually acquire qualifications. What this highlights is the need for serious debate about what the school curriculum in Wales ought to be aiming for. Yet this is a debate that is in danger of being pre-empted because of the current preoccupation with PISA.

The critics of Welsh education will, of course, point out that schools in Wales do not fare much better if GCSE performance is taken as the basis of comparison with other parts of the UK and, in particular, England. This sort of ‘home international’ analysis is useful, as it not only avoids many of the technical difficulties associated with PISA, but also depends on qualifications which schools, teachers and pupils undoubtedly take seriously. Indeed, this sort of evidence has been used to question the quality of Welsh schools and to criticise particular policies, such as the abolition of Standard Assessment Tests.

It is true that, since the early part of the present decade, there has been a progressive widening of the shortfall between Wales and England in terms of the standard measure of attainment at the minimum school-leaving age, now known as the Level 2 Threshold. The latter is frequently described as the achievement of 5 A* to C grade GCSEs. In fact, its full definition is 5 A* to C grade GCSEs or equivalents. That is to say, the measure includes not only GCSEs, but also a wide range of vocational qualifications, the best known of which are BTECs.

This detail is significant because if we look at GCSEs alone then, on the basis of the Welsh Government’s data, the proportion of young people in Wales achieving the Level 2 Threshold is almost exactly equivalent to that in England. In 2009-10 it was 56 per cent in Wales compared with 56.3 per cent in England. Whilst there is an overall shortfall between Wales and England of some 12 percentage points, this is wholly accounted for by the fact that more young people in England attain the Level 2 Threshold through vocational qualifications.

These statistics put the performance of Welsh schools in a somewhat different light. On this evidence, it would appear that there is a problem of educational attainment in Wales. But it is a problem which relates very specifically to the provision of opportunities to pursue vocational qualifications. That this should be so is not entirely surprising. Historically, as access to secondary education has been widened – right back to the Intermediate Schools established in the 1890s – Welsh schools have been far more effective in providing an academic curriculum than they have in making available opportunities to pursue vocational options. Currently, it may well be that the lower levels of funding that go to Welsh schools compared with those in England are accentuating difficulties here, as vocational provision is more expensive than the academic equivalent.

This relative failure of vocational provision is likely to have the greatest impact on pupils from more educationally disadvantaged backgrounds, who are far less likely to be motivated by the academic curriculum. Indeed, it may be that this goes some way towards explaining the significant under-performance in Wales’s PISA scores at the lower end of the attainment range that was recorded in 2006, and again in 2009.

In this context, too, improving motivation through the imaginative development of vocational options may contribute significantly to the Welsh Government’s objective of improving the basic reading and mathematical literacy of young people. Moreover, reducing the numbers of low-achievers should not be seen as somehow restricting the development of high-achievers. Indeed, as societies as diverse as Finland and South Korea demonstrate, achieving the highest attainment levels is wholly consistent with relatively weak relationships between social background and educational achievement.

Public concern about Wales’s education system is entirely legitimate. However, evidence and analysis need to be approached in an open and enquiring way. Presently, the danger is that simplistic readings of PISA and other external bench-marking of Welsh educational performance are serving to close off debate, rather than open up new avenues for educational development.

Gareth Rees is a Professor in the School of Social Sciences at Cardiff University and Director of the Wales Institute of Social and Economic Research, Data and Methods (WISERD).

5 thoughts on “Wales’ vocational attainment gap

  1. I am not sure it is a good thing for Professor Rees to dissipate the “moral panic” with facts, what is so good about having GCSE results only the same as England – now about the worst-educated country in Europe? A bit of moral panic is necessary to blast the Welsh teaching profession out of their ineffable defeatism and complacency. Let’s get better! One takes the point about vocational training, however.

  2. Some questions from a layman: How concerned should we be about what Michael Gove is planning for vocational qualifications in England? The headlines say that he is planning to axe ‘soft subjects’ that allow schools to boost their places in English league tables. Might this reduce the gap between Wales and England at a stroke? If it does, might that simply give us false hope, if, at the same time, English vocational qualifications achieve a higher quality by adhering to four criteria that the English education department plans to set for accredited vocational courses – namely i) that they should offer pupils proven progression into a broad range of further qualifications or careers post-16, rather than narrowing students’ options; ii) that they are the size of a GCSE or bigger; iii) that they have a substantial proportion of external assessment and require students to use knowledge across their subject (something that PISA tests?); iv) that they have grades such as A*-G (those with simple pass or fail results will be excluded). How do these criteria compare with criteria currently used in Wales? Answers, please on not more than five sides.

  3. Unfortunately Wales, too, has some quite dubious subjects attracting GCSE level qualifications, Nail Technology and Equine management are not the sole preserve of the English qualifications system. We have Surf Science and Sky Diving. All these subjects are supposed to be moderated to establish how many hours tuition and study are necessary to attain a particular grade in the subject. The problem with this is that it is extremely difficult to make a cross over comparison between learning vocational skills and academic achievement. There are anomalies between the way that England and Wales measure qualifications; in Wales we are two years away from including 16 year olds in GCSE results. England has been doing this for a long time. On the whole I tend to agree with r Tredwyn; Welsh Education needs to panic more than a little, in particular it is at Primary level that the damage is being done and it was the relaxation of scrutiny of teaching outcomes that started the rot. Wales doesn’t need to look to England but I despair at the conservatism of the establishment that makes them afraid to look elsewhere.

Comments are closed.

Also within Politics and Policy