Ex-post Evaluation of Urban Development Projects in the EU
P Burgess, Arup, UK
This paper describes the results and lessons learned from an ex-post evaluation of urban development projects part-financed by the European Investment Bank (EIB). One of the primary responsibilities of the EIB?s Operations Evaluation Department (EV) is to carry out independent ex-post evaluations on projects, which have been financed by the Bank. Projects are grouped, typically by themes or objective, with reference to issues of current relevance to the European Investment Bank. The lessons learned improve operational performance, accountability and provide transparency. EV?s independent evaluation reports take due account of the analytical criteria used for project appraisal and cover the quality, effectiveness and relevance of EIB operations, as well as the strategies, policies and procedures that relate to them.
This ex-post evaluation study concerned urban development projects financed by the Bank (urban transport and urban renewal) in the EU over the period 1988 to 1995. In 1988 the Bank?s eligibility criteria were extended to cover urban operations throughout the EU. From 1988 to 2001, individual loan signatures for investment in urban development in the EU totalled about 18 EUR billion, while allocations from global loans reached a total of about EUR 7 billion.
The general objective of the evaluation was to assess the quality, effectiveness and relevance of EIB operations related to urban development, as well as the strategies, policies and procedures that relate to them. The evaluation identified the net impact of EIB loans on the projects, the quality and contribution of the ex-ante evaluations and project follow-up. The evaluation covered 21 projects in six countries (Spain, Portugal, Italy, France, Germany and the UK). It focussed on:
* Integration of the project in the local planning: Were the key objectives of the plan as foreseen initially being achieved? Was adaptation of the plan necessary and was the project adapted accordingly? The main issue was to assess the impact of the project in terms of its contribution to sustainable urban development. As the objectives are often not quantified and the impact of the project cannot be isolated from other actions foreseen in the context of the same plan, careful consideration was given to indicators and benchmarks. In addition, the potential impact of the project on the global policy of the city and, in particular, on the strategic planning for its development in the near future were analysed.
* Project performance (implementation, operation, environmental issues, etc.): For urban transport the impact of the project on mobility patterns in the urban area were analysed. For urban renewal, indicators from the project, among which are land prices, were studied.
* Value added by the Bank, mainly as seen by promoters, impact of finance provided, EIB loan conditions, and EIB expertise on the project.
A draft Synthesis Report, summarising the results of the 21 evaluations was produced in January 2003 and discussed at an internal EIB workshop in February 2003. Following incorporation of comments, a final version will be posted on the Bank?s web site later in 2003.
4. Target Audience
This presentation will focus on the lessons learned from the 11 transport projects covered in the study. The results included the development of a multi-criteria assessment framework, recommendations on when a ?lighter? appraisal may be appropriate and how to customise appraisal to programme loans financing a number of small projects. This paper illustrates some new approaches to applied transport economics. A fuller description of the presentation will be given after the Synthesis Report is available.
Association for European Transport