Defining a baseline for ongoing evaluation of NSW’s energy efficient product and service markets.

Client: NSW Office of Environment and Heritage

The challenge

The NSW government committed to deliver a suite programs under the NSW Governments Energy Efficiency Action Plan (EEAP) to transform the NSW energy efficient product and services markets.

The program evaluation team were tasked with coming up with a detailed evaluation framework to analyse the effectiveness of the programs. But with no clear definition of the market or defined elements to be transformed, there was no baseline which transformation could be assessed against.

Common Capital was engaged to define a baseline for the ongoing evaluation strategy of these new programs.

Our approach

Our aim with this project was to provide the NSW Office of Environment and Heritage with a tangible defined baseline and a realistic ongoing approach for evaluation, including budgetary and time constraints for obtaining future data.

We worked closely with OEH to understand the policy, operational and evaluation context of the programs. The project involved extensive research to conceptualise an approach for defining, segmenting and prioritising the market including desktop and interview-based review of international policy and economic approaches to define and measure markets and market transformation.

 We combined significant program evaluation experience with knowledge of the energy efficiency market to clearly define what was meant by the energy efficient product and services market, and what its parameters were.

Analysis of data availability was conducted through both desktop research and interviews with national and international governments, market research, and industry stakeholders. Our aim was to understand what data existed, if it could be obtained, and identify future data partners.

We developed a costed and prioritised research plan based on available budget and program priority needs. We recommended a mix of quantitative and qualitative approaches, suitable for practical short-term requirements and longer term research goals.

The outcome

OEH was able to use our analysis to prioritise funding and evaluation research. They focussed on two discreet segments of the market that they expected their programs to have the greatest impact on and have successfully grown baseline data for those segments. They have also been able to build on the relationships and stakeholder engagement we established through this initial research.