1.The Commission shall regularly monitor the implementation and impact of the ISA2 programme for the purpose of assessing whether its actions continue to meet the identified needs. The Commission shall also explore synergies with complementary Union programmes.
2.The Commission shall report annually to the ISA2 Committee, the responsible committee or committees of the European Parliament, the Council and the Committee of Regions on the implementation and results of the ISA2 programme.
The Commission shall monitor regularly the implementation and re-use of interoperability solutions across the Union, as part of the rolling work programme established pursuant to Article 9(1).
3.The Commission shall carry out an interim evaluation of the ISA2 programme by 30 September 2019 and a final evaluation by 31 December 2021 and shall communicate the results of those evaluations to the European Parliament and to the Council by the same dates. In that context, the responsible committee or committees of the European Parliament may invite the Commission to present the results of the evaluations and to answer questions raised by their members.
4.The evaluations referred to in paragraph 3 shall examine, inter alia, the relevance, effectiveness, efficiency, utility, including, where relevant, business and citizen satisfaction, and the sustainability and coherence of ISA2 programme actions. The final evaluation shall, in addition, examine the extent to which the ISA2 programme has achieved its objectives such as the re-use of interoperability solutions across the Union, paying particular attention to the needs expressed by the European public administrations.
5.The evaluations shall assess the performance of the ISA2 programme against the achievement of the objectives laid out in Article 1(1) and compliance with the principles set out in point (b) of Article 4. The achievement of the objectives shall be measured in particular in terms of the number of key interoperability enablers and through the number of supporting instruments for public administrations delivered to and used by European public administrations. Indicators for measuring the result and impact of the ISA2 programme shall be defined in the rolling work programme.
6.The evaluations shall examine the benefits of the actions to the Union for the advancement of common policies, identify potential overlaps and examine coherence with areas for improvement and verify synergies with other Union initiatives, in particular with the CEF.
The evaluations shall assess the relevance of the ISA2 programme's actions to local and regional authorities to improve interoperability in public administration and the effectiveness of delivery of public service.
7.The evaluations shall contain, where applicable, information regarding:
(a)the quantifiable and qualifiable benefits that the interoperability solutions deliver by linking ICT with the needs of end-users;
(b)the quantifiable and qualifiable impact of the interoperable ICT-based solutions.
8.Completed or suspended actions shall remain subject to the overall programme evaluation. They shall be monitored regarding their position in the interoperability landscape in Europe and evaluated in terms of user uptake, utilisation and re-usability.