Archive for the 'Higher Education' Category

European Institute of Innovation and Technology: Go!

Posted by Eric on September 15th, 2008

Excellence needs flagships! That is why Europe must have a strong European Institute of Technology, bringing together the best brains and companies and disseminating the results throughout Europe. That is how José Manuel Durão Barosso introduced the European Institute of Technology about two and a half years ago. Today was the inaugural meeting of the first Governing Board of the EIT.

The Board’s 18 high-level members, coming from the worlds of business, higher education and research all have a track record in top-level innovation and are fully independent in their decision-making. The Board will be responsible for steering the EIT’s strategic orientation and for the selection, monitoring and evaluation of the Knowledge and Innovation Communities (KICs).

After discussions on whether the European version of MIT would become a virtual institute, a brick and mortar institution or something in between… After a study claimed that a European Insitute of Technology was actually not necessary… After feasibility studies had been neglected….

After the decision for the establishment of the EIT was formally taken and published in the Official Journal of the European Union in April earlier this year… After its name was changed into European Institute of Innovation and Technology… After beautiful Budapest won the race and became the official location of the EIT eitin June… And after the EIT’s first Governing Board was officially appointed on 30th July 2008…

It is now time to get to work!

The only thing still missing is a real logo. As long as there is none, I’ll just keep on using the one I have been using for the last years. Looks familiar, doesn’t it?

Education at a Glance 2008

Posted by Eric on September 9th, 2008

Today the Organisation for Economic Cooperation and Development published its annual report ‘Education at a Glance’. Education at a Glance presents data and analysis on education; it provides a rich and up-to-date range of indicators on education systems in the OECD’s 30 member countries and in a number of partner economies. This years highlights are:

Meeting a rapidly rising demand for more and better education is creating intense pressures to raise spending on education and improve its efficiency. Recent years have already seen considerable increases in spending levels, both in absolute terms and as a share of public budgets: The total amount of public spending on educational institutions rose in all OECD countries over the last decade, on average by 19% between 2000 and 2005 alone, and in Greece, Hungary, Iceland, Ireland and Korea by more than twice that amount.

Another visible indication of the efforts governments are making can be seen in the fact that, over the last decade, the share of public budgets devoted to education grew by more than one percentage point – from 11.9% in 1995 to 13.2% in 2005.

The full report and links to the statistics can be found at the EAG 2008 website.

Can institutions be compared using standardised tests?

Posted by Eric on September 4th, 2008

At the EAIR conference in Copenhagen last month I attended an interesting presentation by Trudy Banta, a professor of higher education and vice chancellor for planning and institutional improvement at Indiana University-Purdue University. Her question was clear: Can institutions really be compared using standardised tests?

Policymakers seem determined to assess the quality of HEIs using standardised tests of student learning outcomes. Yet, Dr. Banta claims that such tests do not provide data for valid comparisons and on top of that, they measure other things than institutional performance:

Comparing test scores sounds easy, but are today’s standardised tests of generic skills capable of yielding data for valid comparisons? Twenty years of research conducted in the US using these tests indicates they are not.

It is however not the use of standardised tests as such that was criticized by Banta, but the use of such tests to compare institutions. Research in the US showed that the scores of such tests were highly correlated with the SAT scores (with correlations up to 0.9). It appeared that 81% of the variance between institutions could be explained by previous schooling. This means that the residual 19 percent is explained by a whole range of other factors (e.g. motivation, family situation, etc.), only one of them being institutional performance!

Bante therefore concludes that:

standardized tests of generic intellectual skills do not provide valid evidence of institutional differences in the quality of education provided to students.

Moreover, we see no virtue in attempting to compare institutions, since by design they are pursuing diverse missions and thus attracting students with different interests, abilities, levels of motivation, and career aspirations.

This provides food for thought for many national policy makers, but also for some international actors. I’ve written a few times about the OECD AHELO project. In this project, the OECD tries to differentiate between institutions on the basis of an assessment of the learning outcomes.

AHELO focuses on an assessment of students’ knowledge and skills towards the end of a three or four-year degree programme. The assessment will be based on a written test of the competencies of students, and will be computer delivered.

The feasibility study is expected to demonstrate the feasibility – or otherwise – of comparing HEIs’ performance from the perspective of student learning rather than relying upon research-based measures which are currently being used across the globe as overall proxies of institutional quality.

AHELOAHELO can thus partly be seen as a response to the research-biased rankings and league tables. They are presently working on a feasibility study. Whatever will be the result of this, it’s a sure thing that such a (near-)global assessment is going to be an enormously complex exercise. And therefore a very expensive one…

It’s reasonable to expect that results here also correlate strongly with prior learning, just as was the case in the US. Therefore PISA results might better explain AHELO results than institutional performance does. If the AHELO-assessment results only explains a few percentages of the variance between institutions, comparing higher education institutions will be impossible. And then all that money might better be spent otherwise. I would hope the OECD takes these American research findings into account in the feasibility study.

Classifying European Institutions for Higher Education

Posted by Eric on August 27th, 2008

I’m on my way back to The Hague, returning from the EAIR conference in Copenhagen. Although lots of interesting new studies and findings have been presented there (some of them I’ll discuss in later posts), I actually want to talk about a conference I visited last July in Berlin.

This conference (Transparency in Diversity – Towards a European Classification of Higher Education Institutions) presented the results from the second stage of the project Classifying European Institutions for Higher Education, a project that might turn out to have a major impact on European higher education policy. This project was initiated in 2005 (see this previous post) and is now supported by for instance the European Commission (DG Education) and the German Hochschule Rektorenkonferenz. It’s run by an international team led by Frans van Vught.

The project can be seen as a response to two trends (at least, that’s my interpretation). First of all, there is the emergence of the European higher education area, the objective of the Bologna process. If there’s one space, we need to know what types of institutions are occupying that space and hence, we need a classification or typology.

Secondly, there is the proliferation of ranking and league tables. As I’ve discussed many times before, these rankings present a very uni-dimensional view of the contemporary higher education institution. Basically they only look at the – science heavy – traditional research university. Through this they neglect the quality of a very wide range of other institutions which might be very good at the things they are supposed to do. Here one can think of mono-disciplinary institutions (e.g. colleges of fine arts; schools of economics and business), teaching oriented institutions (like the American liberal arts colleges) ore more professionally and vocationally oriented institutions (like the German and Austrian Fachhochschulen, the Dutch Hogescholen, etc.).

A multidimensional classification of European higher education institutions can on the one hand create more transparency in European higher education, while at the same time clarify which institutions can be compared with each other (so we can compare apples with apples and pears with pears). If you are interested in how they intend to do this, I suggest you have a look at the presentations of the conference. See Frans van Vughts presentation (PDF) to get a better idea about the background of the project and have a look at Frans Kaiser’s presentation (PDF) for the technical aspects of such a multidimensional classification.

What the classification will look like exactly is not yet clear. If it will remain limited to the web tool and the resulting radar graphs, I expect the effects to be rather limited. The question is whether the various stakeholders related to the project will ultimately define real categories of institutions (like the old Carnegie classification did). This however might give the project a more political character. Even though the project-team stresses that they will not create a hierarchical classification, it is interesting to see whether some categories will be perceived as more prestigious than others.

Nevertheless, the classification project seems to be widely supported by institutions throughout Europe and their representative organisations. The feeling that Europe needs to create more transparency is widely shared and at the same time, many institutions are looking for benchmarking opportunities with like-minded institutions. After all, comparisons with Harvard, Oxford and Yale are not very useful for most higher education institutions in Europe…

Interactive Higher Education Policy [or HigherEd 2.0]

Posted by Eric on August 21st, 2008

Both the Department of Education, Employment and Workplace Relations (DEST) of the Australian Commonwealth Government and the Department of Innovation, Universities and Skills (DIUS) of the British Government are looking for news to organise and coordinate their higher education sector. For this, they have started a similar initiative. Both are relying heavily on input from the field and the broader society to get new ideas, and probably to receive more support for their future polices. Yet, there are some differences as well.

In its Review of Higher Education, the Australian government has asked a small expert panel to write a Higher Education Discussion Paper. This Discussion Paper (PDF, 4 MB) was released in June and addresses a wide range of questions structured around nine key challenges and issues for higher education in Australia over the coming decades.

· Meeting labour market and industry needs
· Opportunities to participate in higher education
· The student experience of higher education
· Connecting with other education and training sectors
· Higher education’s role in the national innovation system
· Australia’s higher education sector in the international arena
· HE’s contribution to Australia’s economic, social and cultural capital
· Resourcing the system
· Governance and regulation

After this release, the Expert Panel invited the community to react to this paper and send in their submissions before 31 July. This has led to 300 submissions responding to the discussion paper. Responses have been submitted by interested individuals, Vice Chancellors, Leaders of intermediary organisations, student unions, etc. There’s also a range of HE experts and researchers that submitted their reactions, and even some HE bloggers (who of course are also experts; for instance Andrew Nortonsubmission 91 and Steven SchwartzSubmission 66). The Review Panel will provide its report on priority action by the end of October 2008, and final report by the end of the year. I’ll keep an eye on it…

In the UK,  the Secretary of State for DIUS, John Denham, claimed that the UK needs to decide what a world-class HE system of the future should look like and what it should seek to achieve. And he also is asking the public to participate in this Higher Education Debate. Denham first asked eight experts to present their advise and opinions on eight different themes:

· Part-time studies in Higher Education
· Demographic challenge facing Higher Education
· Teaching and student experience
· International issues in Higher Education
· Intellectual property and research benefits
· Academia and public policy making
· Research careers
· Understanding institutional performance

These contributions will lead to a formal public consultation on a policy framework for HE in the autumn. They however also form the input for discussions on these eight topics with the wider public. And the discussions are conducted…yes on a blog. On the Future of Higher Education Blog readers have the opportunity to comment on the opinions of the experts.

The Australian example has shown that there are plenty of HE stakeholders and experts willing to spend some time in drafting future HE plans (I feel sorry for all the staff at DEST that has to go through them all). In some ways their process resembles the consultation process of the European Commission (for instance here, for the EIT).

What the input of the English public will be remains to be seen. Until now, comments on the blog are only few – and not always very constructive contributions. However, the  discussion opportunity has only been online since July. 

Even though the outcomes of these processes are not yet clear, I welcome these new ways of policy making. Even though these new initiatives would fit well in the (consensus oriented) Dutch political culture, – to my knowledge – the use of the Internet in the process of policy making and formulation is still rare. Maybe an idea for Dutch higher education…?

The Financial Times featured an interesting article from business guru Charles Baden Fuller. Professor at the Cass Business School of the City University, London. He observes a decrease in the gap between management research between the US and other regions like Europe and Asia. Although he acknowledges the supremacy of the US in the field, he says that the US share of management research will fall below 50 percent the next few years:

Research output in management is still concentrated: less than 3 per cent of the world’s universities produce more than 70 per cent of global output. Of these 214 universities, 126 are in the US, 13 in Canada, 57 in Europe and 18 in Asia and elsewhere. But comparative world positions have been changing quickly. My research** reveals how the world’s academic business research output has become more dispersed.

While Wharton and Harvard are still the best by a margin, Europe now accounts for 25 per cent of international research output. Its best schools – London Business School, Rotterdam School of Management (Erasmus), Insead and Tilburg are in the global top 30. Asian schools – in China and Singapore especially – are further behind but their stock is rising even faster.

While some of the best US schools admit privately to being worried, publicly they stress their continued dominance – at least, according to their data. But their measurements overemphasise past successes, ignore current trends and importantly use narrowly based research measures, looking only at material published in US journals and ignoring the fact that important new ideas are increasingly being published in highly regarded, peer-reviewed non-US publications.

The interesting part is his explanation for the rise of European and Asian management research. He claims they are more innovative in their approaches and engage more in cross border comparative work than their Colleagues in the US. Another factor is that European and Asian researchers seem to focus more on micro issues where US academics emphasise macrostatistical trends.

I have always admired the US management research and think they have produced some of the most interesting and sophisticated social science studies in the past decades. Not just in the field of economics but especially in sociology where many of the recent breakthroughs have come out of business schools. At the same I indeed found them to be very US centric. I think this is related to their emphasis on macrostatistical trends. If the priority is on the cleanliness of data sets and the complexity of the modeling, than comparative studies are just a nuisance. But of course, social sciences can not be just about data and models, it’s also about reality. And the reality is after all becoming less tidy, more global and less US centred…

Last week, at Global HigherEd, Peter Jones reported on a forthcoming European Court of Justice (ECJ) ruling in the case of Jacqueline Förster v IB-Groep. This is one of a range of recent cases handled by the ECJ that might have substantial effects for higher education policies throughout Europe.

In a forthcoming paper for the European Journal of Education I identified the ECJ as one of the main actors in the institutionalisation of the European Higher Education Area. In earlier posts in this blog I discussed recent cases on the German medicine students in Austria and French students in Belgium. In both cases, the principle of non-discrimination plays an important role. The same was the case for the Grzelczyk Case and the Bidar Case, which can be seen as a predecessor of the Förster case.

The Grzelczyk judgment suggests that EU students are entitled to claim maintenance grants when they find themselves in the same situation as nationals of the host Member State. Before the Maastricht Treaty, the Court refused the right to obtain loans and grants while studying in another member state. The Bidar Case changed this. Here, the Court argues that it is legitimate for a host Member State to grant such assistance to students who have demonstrated a certain degree of integration into the society of that State (although the Court made clear that Member States have a right to protect themselves against ‘grant-tourism’).

This ‘certain degree of integration’ is now being tested in the Förster Case. German student Jaqueline Förster went to the Netherlands to study in 2000. She did the minimum number of hours of work in order to be eligible for the Dutch student support. This amount of work apparently provided a substantial enough degree of integration. The Dutch scholarship board initially granted the student aid to her but asked for a partial refund in 2005 because Förster had not worked in the second half of 2003. She took the case to court saying the move was discriminatory as Dutch students do not have to work (see also this article in EU Observer).

An additional issue came up in the Netherlands after Nuffic presented its annual mobility monitor. This showed that the outgoing number of students was lower for the Netherlands than the incoming students and that the largest source of incoming students was Germany. While at least 16,750 German students were enrolled in the Netherlands, only 2,100 Dutch students were enrolled in Germany. A few days later, the ‘Dutch equivalent of the Financial Times’ carried a headline saying that German students cost the Dutch government at least one hundred million Euros. Reason for this is of course the fact that – because of the non-discrimination principle – EU universities can not charge higher tuition fees for foreign EU students than they charge for their own students. Considering Dutch higher education is still heavily subsidised by the government, German students are indeed partially funded by Dutch tax payers money.

(more…)

Academic Networking

Posted by Eric on July 12th, 2008

Social networking has gone academic. The Web 2.0 principles were already introduced in the field of science and innovation by the iBridge Network. Facebook brought social networking to the university, but it’s main goal was not exactly academic in nature. LinkedIn brought social networking to the professional sphere. Recently there have been some initiatives that bring social networking to academic life: Researchgate and Graduate Junction.graduatejunction

The Graduate Junction was established by Daniel Colegate and Esther Dingley, graduate  students in respectively Chemistry and Education at the University of Durham, in the United Kingdom. They set up The Graduate Junction because they were – in their own words – frustrated by a feeling of isolation in their own research projects and wanted to know who, if anyone, was doing similar research. I have had a quick look at it and it looks good and has the potential to be a valuable tool for graduate students. Much of its success obviously depends on the number of participants it will attract. If I still were a student I would definitely sign up and become member of groups like this.

researchgate Researchgate targets a larger community. It is meant as a networking tool for all academics and researchers. It is set up by three students from Germany (one of them now being at Harvard). Two of them in Medicine, one in Computer Science. The concept is backed by a world wide network of experts and advisers. Researchgate has big aspirations. Next to a networking tool, it sees itself as the start of a more profound change where researchers take more and more control over their publications and research findings.

So where will all this lead? Well…my experiences with these new tools for – often conservative – academics have not always been positive. Nevertheless I’m positive about these new tools. Graduate Junction has the advantage that it targets a younger group of people and probably more open to these kind of innovations. In addition, I think that the need of these tools might be more substantial with graduate students than with researchers in general. This is simply because the ‘normal’ channels such as journals and conferences are not so readily available to them and don’t provide that many opportunities for direct interaction.

Researchgate on the other hand has a more professional look and already is backed by a large network of academics. It also seems to provide more advanced technological opportunities like importing endnote libraries and linking with databases such as PubMed. I would love to see a further expansion to enable more interaction and maybe new opportunities for open peer reviewing.

I hope both initiatives will succeed. It’s about time for the academic community to start using the technological opportunities available. Both might turn out to be great new opportunities for inter-organisational, interdisciplinary and international cooperation.

On the use of rankings and league tables

Posted by Eric on July 1st, 2008

Just before going to a meeting on rankings I saw this. It is from the proposed new immigration policy: Blueprint for a modern migration policy (pdf; in Dutch). As in so many other immigration countries, it contains a chapter on skilled migration. Here is a translation of the passage that surprised me:

Anticipating the implementation of the new migration system, the government will at the latest in the first half of 2009 introduce a regulation for highly skilled immigrants. On the basis of the regulation, foreigners can stay in the country for a maximum of one year to find a job as a ‘knowledge migrant’ or to start an innovative company.

The objective of the regulation connects well to the ambition of the innovation platform to attract 1000 extra knowledge migrants. It is also in line with the advice on knowledge migrants of the Commission on Labour Participation in its report ‘towards a future that works‘.

The target group consists of foreigners that are relatively young and received their Bachelor, Master or PhD degree not longer than three years ago. Migrants are eligible if they received their degree from a university that is in the top 150 of two international league tables of universities. Because of the overlap, the lists consists of 189 universities…

And guess what the two league tables are. Yes, the Shanghai ranking and the Times Higher Education Ranking. Now…this will mean that firms like this have influence on who is eligible to come and work in the Netherlands. Something is not right here…

Is the UK going Down Under?

Posted by Eric on June 18th, 2008

During my years in Sydney, the issue of language skills and foreign students has come up repeatedly. The claim was that the financial reliance on foreign students had forced Australian higher education to accept students that lack even the basic English language and communication skills.

Most critical on this issue is probably Bob Birrell, Director of the Centre for Population and Urban Research at Monash University in Melbourne. Last year he published a study finding that one in three overseas students which were granted permanent residency after graduating from an Australian university does not have good enough English to handle a professional job.

An analysis of government visa testing, the first of its kind, found 34 per cent of 12,116 graduating international students who received permanent residency in 2005-06 did not have the English standard needed to be admitted to university, let alone to be awarded a degree. For students from China, the fastest growing international student market for Australian universities, the proportion with poor English leapt to 43 per cent.

The question is of course: how did they get into an Australian university anyway? And even more: how did they ever get a degree? With respect to the second question, Birrell claims that universities dealt with the poor English language skills of their students by lowering teaching and assessment standards. On the question of how they get in, Birrell has another explanation.

Applicants for a higher-education student visa must score at band-six level, rated as “competent”, under the International English Language Testing System, if based overseas when they apply. But international applicants can avoid the testing by basing themselves in Australia earlier to complete either year 12 or an intensive language course. Dr Birrell found that about 40 per cent of overseas students followed this path.

Professor Peter Abelson – a visiting scholar at the University of Sydney at that time – summarised the issue correctly:

“These figures are a very stunning result, but not entirely surprising to people who are in tertiary education.”

Former Minister of Education, Julie Bishop, and former president of the Australian Vice-Chancellors Committee Gerard Sutton basically denied the problems. Sutton didn’t accept that there is a problem in universities in terms of soft marking of international students. Julie Bishop rejected claims that a large number of foreign students graduating from Australian universities have poor English skills:

“Australian universities only enroll foreign students once they have achieved international standards of language proficiency. This has been an extraordinary attack by Professor Birrell on our universities. International students must meet international benchmarks in English language in order to get a place at a university in Australia.”

The denial of the problem is astonishing. Yes of course, there is a lot of money involved and the stakes in international education are high. If the international student market would plummet, so would much of the Australian higher education sector. But denying the problem while more and more foreign graduates fail in their job search because of their language skills, does obviously not help in the long run.

And now the debate has moved up north…

(more…)

Metaranking

Posted by Eric on June 17th, 2008

After the proliferation of accreditation bodies in the 1990s and 2000s, the sector witnessed the appearance of meta-accreditation. Do we – after the proliferation of rankings in the past 10 years or so – witness the first meta-ranking?

It looks like it, however I must admit it’s slightly different. It won’t be a meta-ranker, but more an accreditor of rankings. I’m talking about the establishment of the IREG–International Observatory on Academic Ranking and Excellence:

On April 18, 2008 an important decision was reached by the International Ranking Expert Group (IREG) to consolidate its partnership arrangement with the   creation of the IREG-International Observatory on Academic Ranking and Excellence.

Bob Morse, director of data research of one of the first and one of the most influential rankings – US NEWS & World Report – is one of the Executive Committee members and he writes on his blog Morse Code:

The International Observatory, headquartered in Warsaw, will conduct reviews of various ‘academic rankings’ and measures of ‘academic excellence’ to assess how well they serve higher education stakeholders and the general public. The observatory will use the recommendations formulated in the Berlin Principles on Ranking of Higher Education Institutions. Members of the body also will meet at the request of various ranking agencies to review their particular methodology criteria and standards. Ranking entities that receive observatory approval will be able to declare themselves ‘IREG Recognized’.

Especially that last item seems to point to an accreditor of rankings. But then, what gives IREG the authority to declare a ranking recognized or not? Well… at least they have some ‘recognized’ persons in their Executive Committee. Next to Bob Morse there are Gero Federkeil (CHE, Germany), Liu Nian Cai (Shanghai Jiao Tong University) and Alex Usher (Education Policy Institute, Toronto, Canada). The Committee is chaired by Jan Sadlak, the Director of UNESCO-CEPES in Romania. I wonder how this all will develop. And I wonder who will first get the ‘IREG-disapproved stamp’. Plenty of candidates…

Peer reviewing as a hidden subsidy

Posted by Eric on May 29th, 2008

Even though I left academia recently, I try to keep in touch with the academic community and keep up with academic publications in the field. Because of this, I still accept most requests from journal editors to review their contributions. What annoys me however, is the fact that I do not have access to such journals anymore. My current employer has subscriptions on some journals, but definitely not on all the ones I am interested in. Considering the subscription fees of most journals I can’t blame them.

Today I read an interesting article in the Times Higher Education on the costs of publishing and… the actual costs of peer reviewing. It does make you wonder about the current system of peer reviewing, especially if you don’t have access to the articles you review. I used to agree with the observation of the THE that the advancement of the academy’s collective body of knowledge was reward enough for the time and effort put into peer review and therefore academics needn’t get paid for doing this. But now I see what we are missing out on, I am not so sure anymore:

But a new report has attempted to quantify in cash terms exactly what peer reviewers are missing out on. It puts the worldwide unpaid cost of peer review at £1.9 billion a year, and estimates that the UK is among the most altruistic of nations, racking up the equivalent in unpaid time of £165 million a year.

The report says there would be a “significant transfer” of funds to academics if peer reviewers were paid. But such a move would drive up journal prices, with the estimated “breakeven price” of a major discipline journal jumping 43 per cent, leaving libraries with a bigger bill.

My first reaction to this was that there must be other possibilities with all the new technologies available. And there are. The report also shows that a move to electronic-only publishing would bring a fall of about £1 billion (12 per cent) in global costs. A system of author-pays open access publishing could add another saving of £556 million. I don’t have to get paid to review articles. But some changes to the system would be appreciated.

Market share and competition

Posted by Eric on May 14th, 2008

In the Dutch weekly journal ESB (Economic and Statistical Reports), economists from the universities of Groningen and Rotterdam presented an interesting article. Their starting assumption is that high student evaluations will have a positive effect on the market share of universities. After all, if a programme in a particular university is highly ranked by students, more students will chose this particular university to attend that programme.

The authors collected six year of student evaluations where students rate their programmes on a scale of 1-10  (as published annually in the Dutch weekly magazine Elsevier). Market share for each programme/university combination was calculated by dividing the number of students in programme X in university Y by all students in the Netherlands in programme X. When the evaluation of the programme is compared with the market share, we get the following graph:

marketshare

On the basis of this finding (and the results of a simulation that they run), they present some interesting conclusions. I won’t go in details, but one of them is that there is no clear relation between evaluation and market share. Hence, students have other criteria than quality in the choice of where they will attend university (especially location, and in particular the distance to their place of residence).

In their discussion, the authors indicate that this shows that competition on the basis of quality is not really taking place in the Netherlands. One reaction could be that the government should enable universities to compete on the basis of price. In other words, universities should be able to set their own tuition fees. This is currently not allowed for Dutch and EU students and the government decided last week that this will not be possible in the near future.

I could pose an alternative hypothesis on the interpretation of the results. The results show that students don’t take quality of education into account in their decision-making process. This could indicate that students don’t purchase a service (a high quality education), but a product (a degree). Universities should therefore emphasise the quality of their degrees, not the quality of their education. If the value of the degree differs per university (reflected in the opportunities to enter the labour market in higher positions or on a higher remuneration), the students will take this into account. This then would mean that universities are better of improving their position in rankings, attracting more prestigious scholars (like Nobel laureates) and increase their budget for marketing. This will bring them a in a better competitive position. On the other hand… maybe economics doesn’t provide answers for everything…

Erjen van Nierop, Peter Verhoef, Philip Hans Franses. Studie Evaluaties en marktaandelen van universiteiten (subscription required). Economisch Statistische Berichten, 4 April 2008.

Counting what is measured or measuring what counts?

Posted by Eric on April 9th, 2008

The Higher Education Funding Council published a report on the impact of rankings in the United Kingdom. It is probably one of the most extensive studies on ranking today. The study was conducted by the Centre for Higher Education Research and Information (CHERI) and Hobsons Research and is based on a survey of 91 higher education institutions in the UK and six institutional case studies. hefce

The researchers looked at five rankings in particular, three national ones (Sunday Times Good University Guide, The Times Good University Guide, The Guardian University Guide) and two international rankings (Shanghai Rankings and the Times QS Ranking). The report itself and the background data are all available on HEFCE’s website.

Roughly, the study is divided into three parts. The first looks at rankings and their shortcomings in general. The second at the impact of rankings on universities in the UK. And the final part discusses alternative ranking methods such as the CHE ranking.

One of the most interesting questions posed in the first part is actually the same as the title of the report: counting what is measured or measuring what counts? In other words, are the criteria used in these league tables used because they are the most important determinants of quality or because those indicators are simply the ones that are (most easily) measurable? Not surprisingly, they find that:

The measures used by the compilers are largely determined by the data available rather than by clear and coherent concepts of, for example, ‘excellence’ or ‘a world class university’. Also the weightings applied do not always seem to have the desired effect on the overall scores for institutions. This brings into question the validity of the overall tables.

Several other points of critique – many of which have been discussed before, also in this blog – are confirmed in this part of the study. But the real value of the study is that it doesn’t stop here. It continues with an analyses of the survey and case studies to identify the ways in which these rankings actually shape policies. They find that institutions are indeed strongly influenced by league tables. One finding that I confirmed my expectations (see here and here) was about the link – and often contradiction – between league table criteria and other missions of the university:

League tables may conflict with other priorities. There is perceived tension between league table performance and institutional and governmental policies and concerns (e.g. on academic standards, widening participation, community engagement and the provision of socially-valued subjects). Institutions are having to manage such tensions with great care.

These are just a few quick observations. Read the full report! I will and probably post more about it at a later stage.

International Student Tribes and Territories

Posted by Eric on March 19th, 2008

As you might know, I changed countries and positions in the last month, hence my lack of posts (now and probably in the very near future). As some of you might know, I left academia to work at the Nuffic, the Netherlands Organisation for International Cooperation in Higher Education. This week I started in the department of studies of their Knowledge and Innovation Directorate. One issue I’m currently looking at is the way foreign students choose their preferred study destinations. Market research organisation i-Graduate seems to have found all my answers already… or hasn’t it?

The Guardian reports on a study that looks at what motivates international students to study abroad and what influences their choice of study. I haven’t seen the study and I can’t link to it because it is not available on their website, but looking at the article of the Guardian, it seems to be a case of over-simplification and over-generalisation. According to i-Graduate, the international student population can be divided into five tribes:

igraduate

(more…)

Get Adobe Flash playerPlugin by wpburn.com wordpress themes