The accuracy of benefit-cost analyses (BCAs) in transportation : an ex-post evaluation of road projects

Abstract

Ex-post evaluations of benefit-cost analyses (BCAs) of transportation projects are scarce in the literature. If conducted frequently, they could reveal the extent to which objectives are achieved and may give inputs that can improve the quality of ex-ante BCAs. We first explain the usefulness of ex-post BCA evaluations of transportation projects, depending on which planning phase a project is in. We then perform ex-post BCAs on 27 Norwegian road projects that have been in service for at least 5years and compare the results with the ex-ante BCAs that were presented to the decision-makers. We use two different measures of aggregating the magnitudes of accuracy; the Mean Percentage Error (MPE) and Mean Absolute Percentage (MAPE). Using MPE, we find that: (1) ex-ante BCAs underestimate the actual net present value (NPV) by 50% on average and, the NPV per dollar invested by a mere 0.14% points on average; (2) the traffic level and traffic growth rates areoften underestimated ex-ante, leading to an underestimation of the benefits and; (3) construction costs are underestimated by 5% on average, which is too small to offset the observed underestimation of benefits. By default, MAPE shows higher values of inaccuracies implying that one should not be indifferent as to the measure used. Overall, the Norwegian exante BCAs perform fairly well. We urge that the authorities concerned must improve their traffic forecasts and construction cost estimates to assure that the ex-ante objectives are met. The upkeep of ex-ante data is essential to enable ex-post evaluation which, ceteris paribus, will enhance the transparency and credibility of BCA as an appropriate decision-making tool. Keywords: ex-post evaluation, benefit-cost analyses (BCA), road projects, Norway

The accuracy of benefit-cost analyses (BCAs) in transportation : an ex-post evaluation of road projects