- Who are the potential users of RBME system in your organization?
My organization is an educational and consultancy venture, which provides staff of international development and diplomatic institutions, as well as local professionals with training on language and cultural diversity. It also deals with organization of cultural events and implementation of the language diversity projects, including their design and promotion.
Our managers, instructors, customers and donors are all potential RBM&E users.
The given sample matrixes – Monitoring and Evaluation logframes – could be prepared directly for/by each type of users, i.e. stakeholders. Head management would quarterly bring the logframes together in one document, thus making the whole intervention process and stakeholders’ activities transparent and increasing their accountability.
- Monitoring tracks as following: all users accomplish monitoring basing on the logframe structure from their perspectives.
- Resources available.
Budget, instructors/consultants, equipment, other facilities involved in the professional development/communication project.
- Preparatory work. Implementation.
Project design, programme, schedule, plans, consultations, contracts, agreements, etc.
- Services delivered.
Project implementation, i.e. training courses, classes, sessions, publication projects, tests, events or workshops have been conducted.
- Objectives achieved.
Stakeholders’ assumptions fulfilled.
Summarized quantity and quality of a project – Evaluation Matrix – is prepared separately by the same users: managers, customers, donors, instructors/other experts responsible for the intervention implementation.
- NB! This field is for evaluation stage, not monitoring. Higher objectives. Stakeholders conduct analyses of goals achieved and working process improved.
- Evaluation is provided by managers, accountants, instructors, customers and donors.
Managers, experts, customers and donors evaluate the project efficiency. Resources availability: budget, experts, equipment, other facilities involved in the training/communication process. Schedules, agreements have been implemented on time and quality requirements fulfilled.
- Preparation. Implementation.
Managers’ and customers’ feedbacks on quantity and quality of the services provided. Accountancy reports on budget spent economically and budget plan having been implemented.
- Achievements. Lessons learned.
Effectiveness of the objectives achieved. Beneficiary Contact Monitoring Indicators are used by customers and managers to evaluate quality of the courses/consultancy/workshops, etc.
Donors and accountants evaluate efficiency of the investments consumption.
- Higher objectives. Stakeholders’ analyses of goals achieved and functionality mechanisms improved.
E.g.: Staff efficiency is improved through training courses provided; a communication project for publication materials on cultural diversity acceptance is published and disseminated. Thus, society awareness in diversity acceptance increased.
The Head manager prepares a document on the cumulative results, quarterly and annually. The documents are transparent and accessible for all stakeholders.
All participants of the project evaluate initial assumptions, risks and changes made through the intervention; lessons learned; sustainability of the impact.
- What are their interests and incentives in pursuing the M&E system?
In a private organization, which implements educational projects, the given Logframe Matrix can be used by instructors, managers, accountants and donors, and customers to be filled in from the initiation stage to the end of the project. Objectively Verifiable Indicators and Means of Verification enable to paint a realistic picture based on the results of intervention.
Training managers gain incentives from a structured traceability of the course implementation throughout all stages, from preparation for the classes/workshops, budget management, bearing in mind the assumptions and taking into account potential risks.
Donors and accountants‘ interests and incentives lie in the processing of the financial side of investment, implemented in a transparent manner, having also tools for the layout assumptions and risks, their preparedness and response.
Instructors/other experts monitor and evaluate, having obtained techniques and tools for a structured, transparent communication, tracing and for evaluation of the classes and workshops conducted.
Customers‘ interests and incentives lie in the overall clarity of the project monitoring and evaluation through the indicators agreed, means of verification, common structure and terminology. Thus, having tools for proper analysis and reporting. – Irina Solonkova, Moldova.
Reference note: the Logframe Matrixes used are provided as a part of UNPAN Course Results Based Monitoring and Evaluation.