This job ad expired, as it has been posted over 15 days ago. Please do not apply for this job, as it is likely that employer already recruited some candidate. We advise to return to the home page and browse through available vacancies
1
applicant
Consultants for the evaluation of two training programmes
at UNHCR in Budapest, Hungary (Published at 07-05-2012)
Consultants for the evaluation of two training programmes, Budapest
Closing Date: Thursday, 10 May 2012
Consultants for the evaluation of two training programmes, Budapest
UNHCR Budapest Felvinci út 27 Budapest, Hungary Tel: (+36-1) 336-3060 Fax: (+36-1) 336-3080Terms of Reference ME & CCLP – Evaluation of the Impact of Short Blended Learning The UNHCR Global Learning Centre (GLC), Budapest (Hungary), is seeking applications from interested and qualified consultants for the conduct of an evaluation of two training programmes.
Background In line with a new mandate issued in the 'Unifying Learning in UNHCR' of 2008 and since GLC became operational in 2010, learning in UNHCR is undergoing a major overhaul in critical areas such as design, development, delivery, assessment, reporting and governance. GLC mandated objectives require to ensuring learning is linked to protection and operational priorities of the organization; ensuring learning activities are coordinated and adopt a multi-functional team approach; increasing access and learning relevance to staff; increasing the quality of learning - including professionalising the learning function; establishing a link between career and learning; and offering learning focused on results and impact (RBM). The GLC Management, Leadership and Communication (ML&C) Unit has invested in short blended learning as an innovative approach to increase staff access to learning by keeping cost per capita relatively low compared with other more traditional forms of training (such as workshops and longer learning programmes), without compromising effectiveness, i.e., the quality and relevance of the learning experience and its results. Two cases in point are the Managing Effectively (ME) and the Core Competencies Learning Programme (CCLP), objects of this impact evaluation. The ME was launched in 2010 in English and since 2011 in French as well. It is a 3-month course targeting General Service staff (GS) and relatively junior professionals (P2/3 and NOs). It covers three sequential modules: Managing Yourself, Managing Others and Managing Projects. Each module lasts one month and comprises self-study materials, one on-line assessment and assignment, with the exception of Managing Projects) and a Webinar. Passing a final test is required for course completion and recording. The ME has a capacity of approximately 240 participants per year in 4 cohorts of 60 participants each, out of which one is conducted in French. Drop-out rate is relatively low (220 complete out of 240). It is noted that the next level in management training is the Management Learning Programme (MLP), catering for more senior positions. In light of the relatively high cost per capita of the MLP, it is reasonable to assume that without the ME, several colleagues would have not had access to management training due to budgetary constraints. The CCLP was launched in 2010. It is a suite of nine training modules covering core competencies: Basic Communication, Conflict Management, Project Management, Action Centered Leadership, Leadership, Team Building, Client Service, Cultural Orientation and Creativity. Each module takes approximately 2 months to complete and, with slight variations, is comprised of the following sequential elements: a kick-off initial Webinar, self-study activities (e.g., videos, short e-learning courses, articles and a forum), an optional midterm Webinar and a final component (e.g., a final Webinar, assignment or test). In 2011, approximately 460 participants enrolled. The CCLP is open to all staff and affiliated work force, including consultants.
Out of the nine modules, in 2010, GLC offered Project Management in English, in 2011 Basic Communication in English and French plus the Project Management in French, Conflict Management and Leadership. In 2012, Client Service, Creativity and Action Centered Leadership. Team Building was advertised but not offered due to low demand at that time. Cultural Orientation is under development.
Purpose The results of the evaluation will be used to determine the extent to which the ME and CCLP innovative models accomplish stated learning results and to inform future changes to the ME and CCLP courses, accordingly. The results should also be considered across GLC, in particular by GLC senior management and Heads of Units, in a view to determine the extent to which some of the existing more traditional training programmes could be re-designed taking into account elements of the ME and CCLP models.
Objectives The evaluation is intended to provide an assessment of the effectiveness and impact of the ME and CCLP on management knowledge and skills; and communication, conflict and leadership knowledge and skills of the participants, respectively.
Scope The evaluation will address the following key questions:
In relation to objectives, have participants learned new knowledge, skills and attitudes? What was learned and what was not? How appropriate and effective are current learning assessment and tests? In relation to objectives, have participants transferred learning on the job? What was transferred and what not? In particular, how did the course contribute to participants' change in behavior and/or performance? What factors enabled or constrained learning transfer? In relation to the objectives, was the content appropriate? What should be changed? In relation to the objectives, is the course timeframe appropriate? What topics should be changed in terms of duration and/or activities? What is the level of participants' satisfaction with the short blended programmes? In particular with the support and feedback received by tutors during the learning process; and with the use of relatively new delivery modalities such as Webinar, e-learning, videos and on-line assignments? What components were considered particularly effective and valuable? And vice versa, what was perceived as less effective and valuable? What is the cost of non-completion? And the causes of non-completion? What is the driver of participant's demand? What are significant differences between ME and CCLP evaluation results?
Methodology The evaluation will entail the following methods: 1. Desk review of relevant ME and CCLP course documentation, including: course reports and plans, training materials, available end-of course evaluations (Level 1), lists of participants and other relevant documentation. 2. Compilation and review of assessment results (Level 2): st a. ME test score results of 2011 and 2012 (1 cohort) b. Approximately 60 one/two-pager CCLP essay-type of assignments for the May/June 2012 cohort (i.e., 20 assignments x 1 module x 3 modules).
3.
4.
Pre-post course short knowledge test for CCLP cohort of May/June 2012 including participants of Conflict Management, Leadership and Project Management. Follow-up on-line questionnaire in English (and French only for Project Management) administered to st the total population of ME and CCLP participants of 2011 (with exception of 1 pilot cohort Project Management of 2011), including those who started but did not complete. Follow-up interviews in English with a randomly-selected sample of 10 participants who completed the ME course and 10 participants who completed a CCLP course. For each of the participants interviewed, the evaluation will seek feedback from the participant's supervisor or at least 1 more staff that knows and works with the participant with a view of cross-validating the three points of view. A total of 40 interviews are envisaged.
c.
The evaluation will also require the design, development, administration of the data collection tools as well as analysis of findings, drawing conclusions and formulating related recommendations for the future.
Evaluation team The evaluation will be conducted by an external evaluation consultant, under the overall management and supervision of the GLC Learning Solutions Officer (Evaluation). Staff of the ML&C Unit will facilitate access to staff, data and information relevant to the evaluation exercise.
Product The final product is a report presenting to GLC MLC Unit the findings, analysis, conclusions on learning effectiveness and impact of the ME and CCLP as well as related recommendations for continuous improvement of the courses.
Evaluation Timetable A total of 20-25 work days are estimated to conduct the evaluation. The evaluation will be undertaken between June and November 2012. The consultant has the flexibility to propose a detailed evaluation timetable within this time range.
Contract Arrangements This evaluation will be undertaken under a lump sum contract. The consultant will be expected to work from home and provide his or her own office space and working equipment. The consultant will take full responsibility for the conduct of the evaluation and the production of evaluation products. The consultant will manage his/her own travel arrangements. Consultant's profile The consultant should possess the following skills and experience: Essential:
Experience in the evaluation of learning programmes
Demonstrated experience in quantitative and qualitative data collection and analysis
Work or consultancy experience with a UN or major international agency or organisation
Good communication, negotiation and writing skills Desirable:
Evaluation in the humanitarian emergency sector
Experience of evaluation in UN or major international agency.
Design and facilitation of training
Payment Payment of fees will be in two installments, 30% of the total contract value will be paid upon signature of the contract and 70% upon submission of the final report and certification of satisfactory service. Travel The consultant is expected to undertake one travel to the GLC, Budapest (Hungary) at the initial stage of the evaluation to meet with relevant GLC staff, including relevant staff of the ML&C Unit who deliver the two training programmes, fine-tune the work plan as needed and start gathering data and information. The mission is estimated to last 2 to 3 days.
Submission of Applications Interested and qualified consultants must submit their application in MS Word format and include the following documentation: 1. 2. 3. 4. 5. 6. A proposal for how the evaluation will be implemented (max. 1 page double-sided) Curriculum vitae (max. 3 to 4 pages highlighting work experience and qualifications relevant to this evaluation) Full contact details of at least two references from among recent clients One sample evaluation report highlighting experience relevant to this evaluation A proposed detailed evaluation timetable A budget submission including a breakdown of person days and daily fees and one travel to GLC, Budapest (Hungary).
Please submit your application via email to Mr. Vincenzo Lionetti (lionetti@unhcr.org). Deadline for submissions is Thursday, 10 May 2012 (CET). Only applicants under serious consideration will be contacted.
Closing Date: Thursday, 10 May 2012
Consultants for the evaluation of two training programmes, Budapest
UNHCR Budapest Felvinci út 27 Budapest, Hungary Tel: (+36-1) 336-3060 Fax: (+36-1) 336-3080Terms of Reference ME & CCLP – Evaluation of the Impact of Short Blended Learning The UNHCR Global Learning Centre (GLC), Budapest (Hungary), is seeking applications from interested and qualified consultants for the conduct of an evaluation of two training programmes.
Background In line with a new mandate issued in the 'Unifying Learning in UNHCR' of 2008 and since GLC became operational in 2010, learning in UNHCR is undergoing a major overhaul in critical areas such as design, development, delivery, assessment, reporting and governance. GLC mandated objectives require to ensuring learning is linked to protection and operational priorities of the organization; ensuring learning activities are coordinated and adopt a multi-functional team approach; increasing access and learning relevance to staff; increasing the quality of learning - including professionalising the learning function; establishing a link between career and learning; and offering learning focused on results and impact (RBM). The GLC Management, Leadership and Communication (ML&C) Unit has invested in short blended learning as an innovative approach to increase staff access to learning by keeping cost per capita relatively low compared with other more traditional forms of training (such as workshops and longer learning programmes), without compromising effectiveness, i.e., the quality and relevance of the learning experience and its results. Two cases in point are the Managing Effectively (ME) and the Core Competencies Learning Programme (CCLP), objects of this impact evaluation. The ME was launched in 2010 in English and since 2011 in French as well. It is a 3-month course targeting General Service staff (GS) and relatively junior professionals (P2/3 and NOs). It covers three sequential modules: Managing Yourself, Managing Others and Managing Projects. Each module lasts one month and comprises self-study materials, one on-line assessment and assignment, with the exception of Managing Projects) and a Webinar. Passing a final test is required for course completion and recording. The ME has a capacity of approximately 240 participants per year in 4 cohorts of 60 participants each, out of which one is conducted in French. Drop-out rate is relatively low (220 complete out of 240). It is noted that the next level in management training is the Management Learning Programme (MLP), catering for more senior positions. In light of the relatively high cost per capita of the MLP, it is reasonable to assume that without the ME, several colleagues would have not had access to management training due to budgetary constraints. The CCLP was launched in 2010. It is a suite of nine training modules covering core competencies: Basic Communication, Conflict Management, Project Management, Action Centered Leadership, Leadership, Team Building, Client Service, Cultural Orientation and Creativity. Each module takes approximately 2 months to complete and, with slight variations, is comprised of the following sequential elements: a kick-off initial Webinar, self-study activities (e.g., videos, short e-learning courses, articles and a forum), an optional midterm Webinar and a final component (e.g., a final Webinar, assignment or test). In 2011, approximately 460 participants enrolled. The CCLP is open to all staff and affiliated work force, including consultants.
Out of the nine modules, in 2010, GLC offered Project Management in English, in 2011 Basic Communication in English and French plus the Project Management in French, Conflict Management and Leadership. In 2012, Client Service, Creativity and Action Centered Leadership. Team Building was advertised but not offered due to low demand at that time. Cultural Orientation is under development.
Purpose The results of the evaluation will be used to determine the extent to which the ME and CCLP innovative models accomplish stated learning results and to inform future changes to the ME and CCLP courses, accordingly. The results should also be considered across GLC, in particular by GLC senior management and Heads of Units, in a view to determine the extent to which some of the existing more traditional training programmes could be re-designed taking into account elements of the ME and CCLP models.
Objectives The evaluation is intended to provide an assessment of the effectiveness and impact of the ME and CCLP on management knowledge and skills; and communication, conflict and leadership knowledge and skills of the participants, respectively.
Scope The evaluation will address the following key questions:
In relation to objectives, have participants learned new knowledge, skills and attitudes? What was learned and what was not? How appropriate and effective are current learning assessment and tests? In relation to objectives, have participants transferred learning on the job? What was transferred and what not? In particular, how did the course contribute to participants' change in behavior and/or performance? What factors enabled or constrained learning transfer? In relation to the objectives, was the content appropriate? What should be changed? In relation to the objectives, is the course timeframe appropriate? What topics should be changed in terms of duration and/or activities? What is the level of participants' satisfaction with the short blended programmes? In particular with the support and feedback received by tutors during the learning process; and with the use of relatively new delivery modalities such as Webinar, e-learning, videos and on-line assignments? What components were considered particularly effective and valuable? And vice versa, what was perceived as less effective and valuable? What is the cost of non-completion? And the causes of non-completion? What is the driver of participant's demand? What are significant differences between ME and CCLP evaluation results?
Methodology The evaluation will entail the following methods: 1. Desk review of relevant ME and CCLP course documentation, including: course reports and plans, training materials, available end-of course evaluations (Level 1), lists of participants and other relevant documentation. 2. Compilation and review of assessment results (Level 2): st a. ME test score results of 2011 and 2012 (1 cohort) b. Approximately 60 one/two-pager CCLP essay-type of assignments for the May/June 2012 cohort (i.e., 20 assignments x 1 module x 3 modules).
3.
4.
Pre-post course short knowledge test for CCLP cohort of May/June 2012 including participants of Conflict Management, Leadership and Project Management. Follow-up on-line questionnaire in English (and French only for Project Management) administered to st the total population of ME and CCLP participants of 2011 (with exception of 1 pilot cohort Project Management of 2011), including those who started but did not complete. Follow-up interviews in English with a randomly-selected sample of 10 participants who completed the ME course and 10 participants who completed a CCLP course. For each of the participants interviewed, the evaluation will seek feedback from the participant's supervisor or at least 1 more staff that knows and works with the participant with a view of cross-validating the three points of view. A total of 40 interviews are envisaged.
c.
The evaluation will also require the design, development, administration of the data collection tools as well as analysis of findings, drawing conclusions and formulating related recommendations for the future.
Evaluation team The evaluation will be conducted by an external evaluation consultant, under the overall management and supervision of the GLC Learning Solutions Officer (Evaluation). Staff of the ML&C Unit will facilitate access to staff, data and information relevant to the evaluation exercise.
Product The final product is a report presenting to GLC MLC Unit the findings, analysis, conclusions on learning effectiveness and impact of the ME and CCLP as well as related recommendations for continuous improvement of the courses.
Evaluation Timetable A total of 20-25 work days are estimated to conduct the evaluation. The evaluation will be undertaken between June and November 2012. The consultant has the flexibility to propose a detailed evaluation timetable within this time range.
Contract Arrangements This evaluation will be undertaken under a lump sum contract. The consultant will be expected to work from home and provide his or her own office space and working equipment. The consultant will take full responsibility for the conduct of the evaluation and the production of evaluation products. The consultant will manage his/her own travel arrangements. Consultant's profile The consultant should possess the following skills and experience: Essential:
Experience in the evaluation of learning programmes
Demonstrated experience in quantitative and qualitative data collection and analysis
Work or consultancy experience with a UN or major international agency or organisation
Good communication, negotiation and writing skills Desirable:
Evaluation in the humanitarian emergency sector
Experience of evaluation in UN or major international agency.
Design and facilitation of training
Payment Payment of fees will be in two installments, 30% of the total contract value will be paid upon signature of the contract and 70% upon submission of the final report and certification of satisfactory service. Travel The consultant is expected to undertake one travel to the GLC, Budapest (Hungary) at the initial stage of the evaluation to meet with relevant GLC staff, including relevant staff of the ML&C Unit who deliver the two training programmes, fine-tune the work plan as needed and start gathering data and information. The mission is estimated to last 2 to 3 days.
Submission of Applications Interested and qualified consultants must submit their application in MS Word format and include the following documentation: 1. 2. 3. 4. 5. 6. A proposal for how the evaluation will be implemented (max. 1 page double-sided) Curriculum vitae (max. 3 to 4 pages highlighting work experience and qualifications relevant to this evaluation) Full contact details of at least two references from among recent clients One sample evaluation report highlighting experience relevant to this evaluation A proposed detailed evaluation timetable A budget submission including a breakdown of person days and daily fees and one travel to GLC, Budapest (Hungary).
Please submit your application via email to Mr. Vincenzo Lionetti (lionetti@unhcr.org). Deadline for submissions is Thursday, 10 May 2012 (CET). Only applicants under serious consideration will be contacted.
Recent jobs at UNHCR
-
07 Jun
Internships with UNHCR
UNHCR,
London, UK -
28 Jan
Internship
UNHCR,
Brussels, Belgium -
18 Dec
Senior Administration and Finance Associate, G7
UNHCR,
Bucharest, Romania