Business News

Labor's idea of an Evaluator General could dramatically cut wasteful spending

  • Written by Peter Siminski, Associate Professor of Economics, University of Technology Sydney

The Australian federal government plans to spend A$500 billion[1] this year. With 188 federal agencies and departments[2], it funds everything from preschool to pensions, from the army to the arts[3].

This is before getting into state/territory and local governments with their own world of policies and programs, such as public transport and local parks.

Looking behind the curtain, it is striking how poorly Australian government programs are evaluated. There is little oversight into whether these programs are successful, waste money, or even do us harm.

Tucked away in a largely overlooked press release may be a solution. In November last year, the shadow assistant treasurer, Andrew Leigh, announced[4] Labor would establish an Evaluator General if they won the upcoming election.

image Shadow Treasurer Andrew Leigh’s proposed Evaluator General is a good start, but we have to get the details right. Joel Carrett/AAP[5]

The Evaluator General’s office will oversee high-quality evaluations of government programs in collaboration with other agencies.

As academics with long track records in evaluating government programs, we think this is a small, but good, step towards improving the evaluation culture in government. So long as we get the details right.

Poor evidence, poor performance

Government policy at all levels is poorly evaluated.

Consider education. Federal and state/territory governments’ spending per student increased from A$13,904 in 2008[6] to A$15,739 in 2016[7], adjusted for inflation.

Since 2000, though, Australia’s international rankings in reading, mathematics and science have dropped considerably, according to a government review[8] into Australian schools.

The Productivity Commission has identified how the problem of evaluation[9] has contributed to this. Schools collect data about student scores and the like, but this information is not used to evaluate whether programs are working. Because we don’t know what is or isn’t working, we can’t ensure the best programs are rolled out Australia-wide. It puts our kids at a disadvantage on the global stage.

Read more: Three things Australia's next education minister must prioritise to improve schools[10]

The same is true for other government priorities, including Indigenous policy.

More than a decade ago, federal and state governments committed to “Closing the Gap” between Indigenous and non-Indigenous Australians on a host of health, education and employment measures. In 2017 governments spent about A$33.4 billion on Indigenous-specific programs, according to the Productivity Commission[11]. Yet the most recent Closing the Gap report has found[12] little or no progress on a majority of goals, including child mortality, student attendance and life expectancy.

The lack of evidence[13] is almost certainly getting in the way of closing the gap. In 2016, there were 1,082 Indigenous-focused programs from government and non-government agencies, 92% of which had never been evaluated[14]. The few evaluations conducted were not high-quality for the most part.

Read more: How to get a better bang for the taxpayers' buck in all sectors, not only Indigenous programs[15]

A new hope

An Evaluator General could fix this. With a A$5 million annual budget, the office would work with departments to evaluate the effectiveness of government programs.

The research would be widely available and that, in theory, should empower policy makers to implement evidence-based programs.

The proposed Evaluator General’s office would lie within the Treasury. There is a strong case[16] for greater independence, but pure independence is a myth since government controls the purse strings.

Perhaps the Treasury is the best option at the moment. It is comforting that there is precedence. Chile, for example, has had its evaluation unit firmly in the Ministry of Finance for more than two decades.

All that glitters is not gold

It would be a little ironic if we did not evaluate the Evaluator General. So let’s dig deeper.

image While the policy seems commonsense on the surface, it is the details that could trip Labor up. Jens Johnsson/Unsplash[17]

Labor says the Evaluator General will use randomised controlled trials (RCTs) to evaluate programs. Such trials are generally seen as the gold standard in evaluation. They involve individuals being randomly assigned to one of two groups. One group receives the treatment being trialled. The other group – the control group – does not. We then compare outcomes between the two groups.

Consider a job training program. With a randomised controlled trial, one group of people is randomly assigned training, while another is not. Everything else about the trainees and non-trainees are the same. So we would then compare unemployment rates for the two groups to see if the training worked.

Without question, Australia should invest more in randomised controlled trials to learn about the impact of economic and social policies.

But they are also expensive. Randomised controlled trials usually need new data to be collected, which makes them quite expensive.

The Evaluator Generals $5 million budget will not go far if evaluation is based exclusively on the use randomised controlled trials. There are, however, “second-best” tools the Evaluator General should be able to use.

Natural (quasi) experiments can be powerful in telling us if policies are effective. Natural experiments mimic RCTs, except that assignment to treatment is usually not completely random, and they more readily draw on existing survey and administrative data.

For example, a policy maker may decide on a new training program for young people aged less than 20. Unemployed people aged 19 years and 11 months are essentially the same as those who have just turned 20. So we can compare the outcomes of these two groups to find out the effect of the program. There is no need to design a whole new experiment. This means natural experiments are usually cheaper and quicker to conduct than RCTs.

Our own work with quasi-experimental evaluations of welfare quarantining[18], military conscription[19] and the legal drinking age[20] shows they can be effective.

The data is on our side

Ultimately, any evaluation relies on data. Garbage data in, garbage results out.

Even with an Evaluator General, we will still be a long way off from having a strong evaluation culture. Too often governments hope, pray, and shoot policy into the wind. Anything besides evaluating.

But Labor’s proposal would be a small step in the right direction. It represents an increased focus on quality evaluation.

Equipped with the right tools, and with help from experts in evaluation, we could increasingly have policy that we know actually works.


  1. ^ A$500 billion (www.budget.gov.au)
  2. ^ 188 federal agencies and departments (www.directory.gov.au)
  3. ^ the arts (www.screenaustralia.gov.au)
  4. ^ announced (www.andrewleigh.com)
  5. ^ Joel Carrett/AAP (photos-cdn.aap.com.au)
  6. ^ 2008 (docs.acara.edu.au)
  7. ^ 2016 (acara.edu.au)
  8. ^ review (docs.education.gov.au)
  9. ^ the problem of evaluation (www.pc.gov.au)
  10. ^ Three things Australia's next education minister must prioritise to improve schools (theconversation.com)
  11. ^ the Productivity Commission (www.pc.gov.au)
  12. ^ found (ctgreport.pmc.gov.au)
  13. ^ The lack of evidence (www.pc.gov.au)
  14. ^ never been evaluated (www.cis.org.au)
  15. ^ How to get a better bang for the taxpayers' buck in all sectors, not only Indigenous programs (theconversation.com)
  16. ^ strong case (www.themandarin.com.au)
  17. ^ Jens Johnsson/Unsplash (unsplash.com)
  18. ^ welfare quarantining (ftp.iza.org)
  19. ^ military conscription (www.mitpressjournals.org)
  20. ^ legal drinking age (onlinelibrary.wiley.com)

Authors: Peter Siminski, Associate Professor of Economics, University of Technology Sydney

Read more http://theconversation.com/labors-idea-of-an-evaluator-general-could-dramatically-cut-wasteful-spending-115840

Business Daily Media Business Development

Bahrain Property Show 2018: How does it reflect the real estate market development in Bahrain

It is no secret that the Arabian Peninsula and the Gulf Cooperation Council (GCC) countries are currently going through a lot of pivotal changes. Such changes do not include economic or po...

News Company - avatar News Company

Di Jones real estate recognises high achievers

Di Jones celebrated its outstanding performers on Saturday (24 February 2018) evening at the Di Jones Real Estate Annual Awards.                               The black-tie Gala Dinner s...

Helen Hull - avatar Helen Hull

Five Reasons Melbourne Rules

If you are traveling in Australia and have left Melbourne off your destination list, then you are going to want to reconsider. Many people consider Melbourne to the best city in the world...

News Feature Team - avatar News Feature Team

Making Friends During Your Campsite Stay

Part of the excitement of vacation is meeting people who you would never otherwise encounter. Staying at a campsite isn’t just about taking in nature. It’s also about sharing the beauty of n...

News Feature Team - avatar News Feature Team

Have More Fun On Your Business Trips

Whether you are a traveling salesman or someone who finds themselves on the road more than in their office you probably are grateful for any tips you can get especially if they involve havin...

News Feature Team - avatar News Feature Team

Traditions of Rural Bali at Villa Sabana

A Privileged Insight into the Traditions of Rural Bali at Villa Sabana  Situated in the traditional village of Pererenan near Canggu, Villa Sabana is peacefully secluded in a semi-rural...

Linda Lim - avatar Linda Lim

Business Daily Media Business Reports

Di Jones real estate recognises high achievers

Di Jones celebrated its outstanding performers on Saturday (24 February 2018) evening at the Di Jones Real Estate Annual Awards.                               The bla...

Helen Hull - avatar Helen Hull

Eclipse Travel Expands Operations to New Zealand

Eclipse Travel, specialists in key adventure destinations such as Antarctica, the Arctic, Africa and Latin America, have announced today their expansion of operations to ...

Yvonne Kong - avatar Yvonne Kong

How medical professionals can benefit from an overall wealth management solution

As a health care professional, you have made it your life's work to focus on the care and health of the general public. While this kind of work can be extremely rewarding...

News Feature Team - avatar News Feature Team

Why Pinterest Should Be Part of Your Marketing Strategy

Pinterest is a growing social media platform that can deliver significant traffic to your website and new followers to your brand. With it’s steady growth and outrageous ...

Greg Nunan - avatar Greg Nunan

The top reasons why gyms fail

Steve Grant is a Business Coach and Founder of GymHub.com.au   Every month thousands of new trainers walk out of their 6-month course with the qualifications needed ...

Steve Grant - avatar Steve Grant

WHITE LABEL NOBA’s Winter 2016 season: Earth + Country

Taking cues from the warm winter colours of tobacco and caramel, and combining them with the strength of navy and the embracing lightness of whites and creams; and then...

Kath Rose - avatar Kath Rose

Former Etihad boss brings substantial event insight to PMY Group Board

Paul Sergeant PMY Group, the architects of the digital insurgency occurring at major venues across Australia and New Zealand, are delighted to welcome 35 year even...

Annie Konieczny - avatar Annie Konieczny

More training for coffee making than property sales: REINSW

Sydney 9 May 2016. An overhaul of education and training standards for the real estate profession must take place to help prevent illegal activities, according to the Rea...

Helen Hull - avatar Helen Hull