Deadline: 29-Sep-22
UNICEF has announced the applications for Institutional Consultancy-Evaluation of Differentiated Models of Care for Adolescents Living with HIV in Botswana.
Botswana is among a few countries in Southern Africa with the highest HIV prevalence globally. Women and young people are disproportionately affected by HIV.
Evaluation Purpose, Objectives and Scope
- The main purpose of the assignment is to evaluate the effectiveness of a multi-pronged intervention package on clinical, psychosocial and behavioural outcomes of a cohort of AYPLHIV on ART living in six districts in Botswana (Selibe-Phikwe, Boteti, Serowe, Kweneng East, Tutume and Ghanzi) conceptualised and implemented from January 2018 to June 2022 with a 24-month follow up period.
- The evaluation will be a summative evaluation to assess if the outcomes of the intervention were achieved in the targeted districts where the intervention was conducted. This evaluation will coincide with the end of the intervention as supported by UNICEF and as a result there is need to generate evidence on its contribution to improved outcomes of AYPLHIV on ART.
- The primary user of the evidence generated from the evaluation will be the Government of Botswana through MoH and NAHPA, as the evaluation will inform learning on the effectiveness of the intervention, guiding future replication and/or national scale up of the intervention. This will also inform healthcare workers on how to improve outcomes of AYPLHIV who are on treatment and support.
- It will also provide valuable evidence on the role caregivers can play in improved outcomes of AYPLHIV. Findings from the evaluation will also be used by development partner, other non-governmental organisations and the wider HIV community using peer approaches to support AYPLHIV. The evaluation will also consider the effect of gender, geographical location, and income status on the intended outcomes of the package of interventions. In particular, the evaluation objectives are as follows:
- Assess the extent to which the multi-pronged intervention package improved clinical, psychological and behavioural outcomes of AYPLHIV in the targeted districts; achieved intended and unintended results; identify indicative causes and analyse key dynamics that contributed to results achievement,
- The feasibility of scaling up and sustaining the intervention package within Botswana,
- Assess the relevance of the intervention for adolescents, young people, caregivers and providers and the programming environment.
- To assess the resources and costs involved in implementing the package of interventions over the life cycle of the programme in relation to results achieved.
- And to assess the gender, equity/inclusion and child rights aspects and implications of the project through a gender and equity analysis.
Evaluability and Methodology
- As part of the design and planning of this package of interventions, a protocol to evaluate the impact was developed and a study conducted to ascertain baseline measures. The protocol has since been amended to cater for the different delivery modalities accounting for COVID-19 pandemic. The primary evaluation question posited by the protocol considers what effect the package of interventions had on the improvement of clinical, psychosocial and behavioural outcomes of AYPLHIV on ART. This protocol will be shared with the consultants during the inception phase.
- Evaluation design: The evaluation will be based on a mixed-method design that is gender sensitive and socially inclusive, using both qualitative and quantitative methods. A quasi experimental design is preferred for this evaluation and will utilize a representative sample of AYPLHIV on ART in the six targeted districts. Evaluators are expected to review the existing protocol and assess the feasibility and appropriateness of the proposed design and make recommendations on what would be the most appropriate as part of their inception report. The approach undertaken will consider budgetary constraints, logistical feasibility, and access to beneficiaries of the intervention package.
- From the evaluation questions, the evaluators will propose an evaluation matrix which will include for each question, appropriate data collection methods and tools and analyses required. Based on UNICEF’s data quality standards, all data collection and analysis will be disaggregated by key demographic characteristics (age, sex, location) and if possible, by vulnerability, including disability.
Qualification Requirements
- UNICEF and the Government seek an institution with team members that have the following qualifications:
- Demonstrable experience in designing and conducting evaluations including cost analysis studies;
- Ability to analyse and synthesize information from a broad range of sources;
- Evaluation design: the team should consist of members with demonstrated skills and expertise required to design, plan and conduct mixed-method evaluations, potentially using quasi-experimental techniques that are gender-sensitive and socially inclusive;
- Skills in quantitative and qualitative data collection and analysis, drawing findings from multiple sources and handling potential contradictions between datasets.
- Primary research: gender-sensitive design, management and implementation of primary quantitative and qualitative research in potentially challenging project environments, such as during the COVID-19 pandemic Statistical analysis: the team should have capacity for statistical modelling and analysis of impact data; highly proficient user of SSS or STATA; and qualitative data analysis techniques, including the use of software e.g. ATLAS.ti, NVivo or equivalent where needed
- Relevant subject matter knowledge and experience: knowledge and experience required in conducting evaluation against the OECD DAC Criteria, research about children, gender, equity, and child rights to ensure that the evaluation design and research methods are as relevant and meaningful as possible given the aims and objectives of the project and the context in which it is being delivered;
- Experience in conducting evaluating HIV and adolescents’ programmes will be an added advantage;
- Familiar with adolescents’ and young people’s issues;
- Evaluation management: the team has experience managing complex evaluation (impact and process) and research process from end to end.
- Country experience: it is particularly important that the team has the appropriate country knowledge /experience and language proficiency (Sesotho and English) required to conduct the research
- Able to work in a multicultural environment;
- Excellent spoken and written fluency in English required; the team must also include an expert able to communicate in Setswana; knowledge of other local languages in the area desired;
- Excellent analytical, research and report writing skills;
- Effective communication and relationship-building skills
- Team composition: a gender-balanced and culturally diverse team that makes use of national/regional evaluation expertise is an asset
- Information management: design and manage sex- and equity-disaggregated data and information systems capable of handling large datasets
- Safety considerations: ensuring the whole evaluation process adhere to best practice for research, including the implementation of safeguarding policy and procedures to ensure safety and protection of participants. Note that all bidders are expected to be able to show that they have a safeguarding policy in place during the research activities.
- Experience working with/in the UN or other international development organizations in the social sector is an asset.
For more information, visit https://procurement-notices.undp.org/view_notice.cfm?notice_id=95758
