Praxis vlog #1

A brief introduction to praxis-education.com, a new professional development platform for teachers based around small-scale research inquiry

Previous readers of this occasional blog may recall that around a year ago, I shared a proposal for an idea I’d had. At the time, I struggled to explain my vision in a snappy way, and so this initial post carried the lengthy if functional title ‘A proposal for a research-based online platform for school-based practitioners, staffed by the education research community‘. (If you think this is wordy, be grateful you didn’t have to sit through one of my 25-minute ‘elevator pitches’, which one critical friend rather cruelly described as a ‘broken elevator pitch’).

Just prior to this, I’d posted another blog called ‘A one-word mission statement for the researchED movement‘. That word was ‘Praxis’, an Aristotelian notion that means something akin to ‘reflective action’ – the process of translating theory into action, if you like. Shortly thereafter, I put two and two together and realised that ‘Praxis’ was just the word I was looking for to sum up my vision for the platform.

This idea has met with considerable support, and I soon found myself having lots of meetings with acronyms (the NFER, the TDT, the DfE, the IoE et al). The IoE have been especially helpful, and this Saturday Chris Brown and I are co-presenting at the researchED conference, to share the story so far and to see whether people agree that this idea might just have some legs. (So far around 80 people have signed up to the community, which I have interpreted as being extremely encouraging, and toward the end of the summer term the first few inquiries started to roll in).

In an attempt to explain some of the thinking behind this site, I have made a series of 3 introductory vlogs. Here’s the first one, and #’s 2 and 3 will follow tomorrow and Friday – these will focus on providing a rationale for small-scale research inquiry as a basis for professional development, an idea which is increasingly but far from universally accepted within the profession. So far I have plans for 2 more vlogs: #4 will focus on ‘obstacles to teacher research becoming system-wide, and how these can be overcome’, and #5 will be a kind of tour of the site.

By its nature, whether or not this platform realises its potential is dependent on people engaging with it, providing feedback, and ideally signing up (it’s free!) and sharing their research inquiries. So whatever you think of this idea, please do share your thoughts.

Thanks!

The only way is ethics *

Here’s the first draft of a short guide to research ethics I’ve written for the Praxis site. (Praxis is going to develop a fair bit over the summer). Research ethics are important, but it can be a bit of a minefield for the novice researcher, so I’ve tried to keep things as simple as possible, hopefully without oversimplifying.** Please share any constructive criticism in the comments below…

Ethics
* Ethics is not the only way. Clearly, one can be unethical. But it is not advised.

This beginners’  guide to research ethics is aimed primarily at school-based practitioners carrying out small-scale research inquiries for the first time. School-based practitioners may not immediately appreciate the need to consider research ethics, since they may view professional development activities simply as a facet of their existing role as an employee of the school. However, as researchers it’s important to think about the ethical implications of our actions, and where necessary to take appropriate steps to minimise or mitigate against any negative consequences of our actions or inactions. This applies to school-based practitioners as well as external researchers.

ETHICAL ISSUES YOU MAY NEED TO CONSIDER

Informed consent 

  • Before embarking on a research inquiry, it may be necessary to obtain the informed consent of various stakeholders (e.g. head teacher, governors, parents/carers, pupils and/or staff). This will depend on the nature and scope of the inquiry. Also, there are different ways of acquiring consent. For example:
    • Active or passive? If the intervention is out of the ordinary, or carries clear ethical consequences – e.g. students being randomly assigned to a treatment or a control group – it might be necessary to gain written permission from the parents/carers of each pupil involved. Alternatively, it might be more appropriate simply to inform, and give them the opportunity to opt-out.
    • Written or verbal? Do you need to get permission in writing, or might a conversation or a phone call with a parent/carer be sufficient? Could a lack of consent cause problems down the line?

Openness and transparency

  • This is linked to consent. As a researcher, you should take steps to communicate as clearly as possible your intentions and motivations in carrying out a research inquiry, with all affected stakeholders.
  • It may be the case that your study design requires that pupils are not fully aware of the reasons for your actions, for example if you think this might influence their behaviour and thus bias the outcomes of your inquiry. In this case, the pupils and/or parents/carers should be debriefed after the event. However, it is difficult to foresee any circumstances in which it would be necessary to withhold your intentions from colleagues.

Permission to withdraw

  • All participants should be informed of their right to withdraw from a study at any point of their choosing. Equally, even where participants have already participated in data collection, they should have the right to withhold any data relating to them from any subsequent analysis and/or publication.
  • Obviously, this depends on context. If a timetabled lesson is the focus of an inquiry, this does not mean a pupil has the right to withdraw from the lesson! However they should have the right to withdraw any data which relates directly to them in any subsequent analysis and/or publication.

Data protection and confidentiality

  • Even if you do not intend to publish your data (but especially if you do!), you should take steps to ensure that individuals cannot be identified through your research, unless it is unavoidable (e.g. if they feature in video or photographs), in which case it should be done with the explicit written permission of both the pupil and their parent/carer.

Vulnerable individuals within schools

  • Researchers are often privy to sensitive information. While research participants should be assured of their right to anonymity and confidentiality, they should also understand that should any information come to light where a law has been broken, or somebody’s safety may be at risk, the researcher has an obligation to record any relevant information, and pass it on to the child protection officer as standard.

FOUR PRINCIPLES OF RESEARCH ETHICS

In addition to the practical steps outlined above, here are four guiding principles of research ethics which it may be useful to think about when planning a research inquiry

Justice 

As far as possible, the benefits and drawbacks of research inquiry should be distributed fairly among pupils and/or staff.

Beneficence 

The action or intervention being proposed should be done with the intent of benefiting pupils and/or staff.

Non-maleficence       

The action or intervention being proposed should bring no harm to pupils and/or staff. It is worth noting that ‘harm’ can include things like increased workload and embarrassment, as well as physical harm or mental anguish. School-based practitioners should consider carefully whether their research inquiry may lead to negative consequences for pupils and/or staff, either directly or indirectly.

Autonomy

Given the nature of school-based research, it may not be necessary to secure written consent from pupils in all circumstances. However, where research inquires carry consequences for colleagues, seeking consent is both principled and practical.


FURTHER READING

Should you wish to explore these issues further, here are some excellent guides to research ethics for beginners:

  • University of Strathclyde – Ethics in the Educational Research Context.
    This provides an excellent overview of research ethics, including a number of case examples and tasks with model answers, and links to even further reading!

** With thanks to Gary Jones, on whose blog some of this is based.

Should schools count the opportunity cost? (Spoiler: no)

This is an extended version of an article that appeared in the TES last year. 

Image: Pixabay

There are many ways to win an education debate, but one method has recently emerged as being more effective than all others. It involves the use of two little words. In the last few years, Opportunity Cost (OC) has been used by various teacher-bloggers to argue against increased demands on workload; against the teaching of skills as something distinct from subject knowledge; against group work; against the use of technology in the classroom; against ‘making posters and trailers, doing enquiry circles and opinion positioning, carousel group work and fun games’; against questioning; against Lesson Study; against assessing Shakespeare through ‘speaking and listening, role-play and drama’; and against providing students with immediate feedback on their work.

Since opportunity cost is a relative term, alternative practices are often simultaneously presented as more worthwhile – e.g. a knowledge-based curriculum, or a canon of challenging historical texts. In addition, there have been a number of attempts to argue specifically for the applicability of OC to the education debate.

Put simply, the language of OC is used to suggest that whenever you choose one way of doing something, there is a potential ‘cost’ as you could be doing something else that is a more effective use of time/efficient use of resources. On the surface, the idea is appealing – we all want to maximise the effectiveness of what we do, and so it is understandable that this idea has been adopted by those seeking to advance their favoured methods. But the more closely one looks at what OC actually is, the more problematic its increasing use as the Royal Flush of education debate becomes. Indeed, it could actually be damaging. Here’s why.

OC defined

OC is a fundamental concept in the field in microeconomics, and is linked to the idea of scarcity. Scarcity is the problem that arises when the unlimited wants of a population (e.g. nice food, a big house, Ferraris for all) are restricted by limited resources (e.g. labour, capital, time). Consequently, decisions must be made to allocate the resources in the most efficient manner possible. In essence, scarcity gives rise to compromise: in order to make more use of one resource, you must cut back elsewhere.

At this level, it is easy to draw parallels with education. Of course everybody wants our schools to develop core knowledge and soft skills; to produce world-beating academics, artists and athletes; to foster self-esteem and reduce social inequality and generally bring about a more harmonious state of world affairs. But there are only so many hours in the day (scarcity), and we teachers play a small but significant role in deciding how we should spend this time (opportunity). We also know that some practices are more effective at achieving certain ends than others (the cost). 

So what’s the problem?

To help decide how best to allocate resources in the context of scarcity, an economist might carry out an OC analysis – a systematic method for weighing up the pros and cons of two alternative courses of action. Here, we find OC precisely defined as ‘the value of the next best alternative foregone’ (i.e. not chosen). As summarised on Wikipedia: “Assuming the best choice is made, it is the ‘cost’ incurred by not enjoying the benefit that would be had by taking the second best choice available.”

Let’s look at a classic example of an OC analysis as it relates to education – the decision faced by 6th form leavers whether to go to University, or enter the workforce straight away. If they choose option A (University), then the OC is the value of option B (their wages over 3 years) added to the tuition fees and any additional student debt incurred as a result of having chosen option A.

Even in economics however, it is recognised that OC can be measured in a number of ways, ranging from tangible things like time and money, to aspects of our lives that are more difficult to measure – fulfilment, learning, social life etc. From here we start to get into questions of how you measure cost – what you measure, what you don’t measure and why. And before you know it, what may at first have seemed a straightforward, hard-headed comparison between two alternative courses of action soon becomes a multidimensional meditation on what you value as most important.

Image: Pixabay

The overbearing guest at the education debate

Until recently, on the rare occasion that OC was mentioned in educational circles, it was used in purely economic terms – the OC of smaller class sizes, for example. Here, the financial consequences of smaller class sizes mean that an OC analysis is entirely appropriate.

Similarly, in the debate on teacher workload, where the hours teachers spend doing various activities can easily be totted up, the notion of OC is well-suited to the task. Whenever a minister or school leader announces “what everyone should start doing next”, it is entirely reasonable to reply: “and what would you like us to do less of”?

However, many of the contexts in which OC has been applied in recent months relate to curriculum and pedagogy, and I for one am concerned that OC has started to make itself a little too at home in the education debate. Here are four reasons for politely but firmly ejecting this intruder from our classrooms.

1. The impossibility of implementation

As teachers, most choices we make carry an OC, whether we are aware of it or not. In economics, it is referred to as “the value of the best alternative foregone”; on this, we can all agree. This is also true for decisions we have already taken. As such, to argue against introducing a new idea on the basis of OC is to suggest that your practice is either already more effective than what is being suggested – or that you have a better idea up your sleeve. And if OC is going to have any meaning at all, you’re going to need some way of establishing that fact.

Suppose you wanted to calculate the OC relating to some aspect of your practice. Let’s choose something simple – whether to meet and greet your pupils at the door, say, or spend that time getting resources ready. First, you would have to make a decision about how you wanted to measure the ‘cost’ of each alternative. And that would depend on range of factors. When did you last see the class? Do you have lots of material to cover before an upcoming exam? Are there students you know will benefit from a kind word as they enter the room? Is ‘meet and greet’ a whole-school expectation… and so on. Not only does the decision whether to meet and greet at the door carry an OC – so do each of the factors that contribute to that decision.

Self-evidently, each of these factors are dependent on context. But in the examples listed at the top of this article, context is notable by its absence; rather, OC is increasingly being used as a prima facie argument against entire educational practices, regardless of context. This seems to me to represent a kind of pedagogical extremism, since it is intolerant to contextual differences. I don’t think this is as worrying as some other forms of extremism, but to quote one blogger’s critique of the admittedly reductive TES promo version of this article, it does strike me as “a bit silly”.

The attempt to apply the logic of OC to educational contexts is also extremely impractical. Ted Wragg once estimated that teachers make more than 1,000 evaluative decisions on any given school day; others have placed the value upwards of 3,000. To attempt to carry out a systematic cost-benefit analysis for even a fraction of these decisions would be absurd. What’s more, there would be a serious OC associated with spending so much time carrying out OC analyses. You would disappear into a hole of your own making before you could say scarcity.

2. The OC of limiting your repertoire

Aware of my secondary bias, I asked a primary colleague what she makes of the OC argument against doing ‘fun’ things like drama and role-play. She replied “direct instruction is obviously the most efficient way to get something across, but it only seems to work for about 70% of the kids. Some of them just don’t engage when you teach from the front of the room. But if you try different things, you can draw them in. Like with Alfie the other week, we were doing a writing task about knights and castles and he just wasn’t engaging in it at all. And so I spent some time getting him to imagine people climbing up the school walls, throwing things through the windows, and him wanting to protect his friends and family from the attackers. It did the trick, and he produced some of the best writing I’ve seen him do. Fun and games aren’t needed by everyone, and so to make everything seem ‘exciting’ would waste time – then again, you know you’ve got the 70% in the bag anyway, and it’s nice for them too…”

This highlights another problem with the OC argument, which is that it assumes that education is a zero sum game comprised of mutually exclusive courses of action, whereby gains in one area are offset by deficits elsewhere. This is clearly not the case – it is possible to have win-win scenarios. And even where win-wins are not possible and hard choices must be made, the question arises: what kind of teacher is most likely to be able to cater for the diverse needs of all the students in their care – one who is able to draw upon a range of strategies in response to a range of contextual demands, or one who dismisses entire pedagogical approaches and pursues only utilitarian practices – the greatest good for the greatest number – in the name of OC?

Image: Pixabay

3. Ideological objections

As we have seen, when OC calculations are applied to educational settings they quickly become subsumed by the values that teachers place on different courses of action within the context of their professional lives. As such, any reference to the notion of ‘cost’ as shorthand for the objective ‘worth’ or ‘impact’ of an educational practice is hopelessly simplistic, as it masks a dizzying array of assumptions that quietly undermine any such attempts at definitive closure.

In the example above, what mattered most in that moment – Alfie’s use of alliterative adverbials in the knights and castles writing task, or his sense of feeling cared for? And how might you measure the “cost” of the teacher’s decision to give 5 minutes of her lesson to engaging Alfie,  against the gains that might have been made elsewhere had she spent that time attending to one of the other students in her class?

Would advocates of OC suggest that it all boils down to the class’s value-added score for literacy perhaps? I’m not saying this is not a worthy cause, but should such things really be the basis of all educational decision making? How does this sit with the following scenario, shared by Tom Sherrington recently:

My best ever GCSE results from a class came after a mad cramming dash to the finish in a reduced-time situation where every lesson featured past-paper questions.  Teaching to the test to the max. It worked. A*s galore. Physics take-up at A-level – not good. Did they enjoy it? No. Were they better at Physics? No.

Do advocates of OC factor such things as ‘A-level take-up’ into their calculations I wonder – or does “teach to the test to the max” serve as a succinct mantra for the OC mindset? My suspicion is that the use of the term as it is currently employed within the education debate does not run so deep as to support or resist either of these interpretations.

Aside from the exceptions of class size and workload, the way in which OC is increasingly employed as an argument for rejecting entire educational practices – many of which practices are backed by compelling evidence as to their academic utility, when used effectively – suggests that this use of the term is not so much a practical cost-benefit analysis of competing alternatives, as a manifestation of ideology and values, combined with a selective reading of the research literature.

4. The risk of stagnation

In universities, there are essentially two kinds of research: that which responds to what has gone before, and that which seeks to break new ground. Since the one thing almost everybody does agree on is that there is ‘room for improvement’ in our education system, it is important that teachers do not feel cowed into limiting their repertoire in the name of OC.

Take the history of aviation throughout the 20th century – from the comically catastrophic early attempts at manned flight to there being half a million people airborne at any point in time – to see the short-sightedness in using OC as a reason for sticking only to tried and tested methods.

It should go without saying that we as a profession should continue to innovate and take risks, where appropriate – as well as trying to make educational ideas work better where their forerunners may have fallen short of realising their potential. Because the alternative to innovation is stagnation: and who would argue for that?

Image: Flickr (CC)

The opportunity cost of opportunity cost

A study by researchers from Georgia State University revealed that most PhD-level economists don’t really understand OC. If this is true of economists, it is even more so true of teachers. While the language of OC may masquerade as objective evaluation, in reality it is a divisive rhetorical device which is used to apply a binary yes/no filter across a range of complex, nuanced contexts. The OC of disregarding potentially useful strategies in the name of OC is vast. Thus, the logic of OC itself suggests that educationalists should desist from further use of this simplistic and unhelpful term, forthwith.

In the spirit of OC, I would like to suggest a more helpful alternative. Thankfully, teachers do have a handy tool for navigating our way through the jungle of decisions we face with every day. It’s called professional judgment. An alternative word for this is phronesis, an Aristotelian term meaning something akin to ‘practical wisdom’. If seeking to dismiss vast swathes of pedagogical practice in the name of OC represents one end of a scale, phronesis is its pragmatic counterpoint. One-size-fits-all approaches to education leave the majority wearing ill-fitting clothes. So let’s dispense with the rhetoric of OC, and work on cultivating phronesis instead.