This Special Study evaluates 61 of the 122 advisory and operational technicalassistance (AOTA) projects that the Bank had financed in Indonesia as of end-1995.
Indonesiais one of the largest recipients of AOTA from the Bank. AOTAs to Indonesia cover a wide rangeof sectors and subsectors and 32 recipient agencies. The Study followed a participatoryevaluation methodology and thus also reflects user perceptions.Difficulties were posed in the assessment of the effectiveness of AOTAs by(i) the broad generality in the objectives of several AOTAs and the lack of specificity in them; (ii)the multiplicity of such objectives and the absence of their prioritization and weightage; (iii) thelack of baseline data, measures of effectiveness in the attainment of objectives, and ofobjectively verifiable indicators of success; and (iv) the considerable passage of timesubsequent to the completion of some AOTAs leading to loss of corporate memory, and tooverlay by subsequent developments. The Study has had to be based on the best judgementpossible under the circumstances.The Study categorizes the AOTAs in the sample studied into two broadcategories: (i) AOTAs that provided a technical output such as studies and plans,recommendation on policies and regulations, and systems and manuals; and (ii) institutionalstrengthening and capacity building AOTAs that involve the effective transmission of systems,processes, and capacities that would enable independent production of the requisite outputs byrecipient agencies. The Study found that 75 percent of the AOTAs in the first category were atleast partly successful. By contrast, only 41 percent were partly successful or better in achievingsustainable institutional development, a process that is more complex, more demanding, andtime-consuming than the provision of technical outputs.AOTAs in all executing agencies were partly successful in terms of their technicaleffectiveness, but in terms of effectiveness in institution building, they ranged from partly successfulto unsuccessful. AOTAs for all sectors were partly successful in terms of technical effectiveness,though the level of success was lower in the energy sector; conversely, the level of success interms of institutional strengthening was low in all sectors except energy. All major activity groupsunder the AOTAs had some success in technical terms except monitoring and evaluation, but theonly major activity group that enjoyed some success in institutional strengthening was upgradingstatistical information services.In terms of program focus, AOTAs to Indonesia fall into five thematic categories:development/sectoral planning, organizational development, policy reform, environmentalmanagement, and privatization. AOTAs in the first two categories were rated as partly successful,and those in the other three were rated unsuccessful. In terms of contribution to Indonesia'sdevelopment management capacity, relatively greater success was achieved by AOTAs instrengthening policy formulation and the development and enforcement of the legal framework.The success of AOTAs in the mobilization, allocation, and management of finances andinvestment planning capacities was low. The success level of AOTAs in the other areas fell in
In addition, 13 ongoing AOTAs were evaluated only for design. Two TAs were canceled before anydisbursements were made.