A Forthcoming Book
Artificial Intelligence and Evaluation
From Algorithms to Evidence
Using GenAI in Evaluation Practice
Edited by Kerry Bruce, Valentine Gandhi, and Steffen Bohni
Curated by International Evaluation Research Group (INTEVAL)
Editors
Steffen Bohni Nielsen
Steffen Bohni Nielsen is Director General at the Danish National Research Centre for the Working Environment, NFA and a member of the Danish National Research and Innovation Council. He is a member of INTEVAL and has published extensively in the field of evaluation. He served as co-editor on the AI and Evaluation book published by Routledge earlier this year.
Kerry Bruce
Kerry Bruce has over 30 years of experience in directing and researching development projects worldwide. She has designed and carried out large and complex analyses, project-level studies and brings proven quantitative and qualitative skills from her academic and applied background in public health.
Valentine Gandhi
Valentine J Gandhi, is a senior Evaluation, Innovation and Tech4Good specialist, with over 20 years of interdisciplinary experience at both field and policy level. He is the founder of the Tech for Good think tank The Development CAFÉ , and a Co hosts the EvalEdge Podcast for European Evaluation Society.
Our Recent Collaboration
Artificial Intelligence & Evaluation
Emerging Technologies and Their Implications for Evaluation
The Book Chapters
CHAPTER 1
The Transformation of Evaluation Practice: From Algorithms to Evidence
Steffen Bohni Nielsen, Kerry Bruce, Valentine J Gandhi
CHAPTER 2
Threading the Needle: Making Evaluation Affordable and Participatory for Grassroots Nonprofits
Sadie Paschke
CHAPTER 3
Scoping evaluation with GenAI: A case study of the partnership principle in Poland
Marlena Stępień
CHAPTER 4
From Supporting Evaluators to Evaluating AI: A Human-Centered Approach to Developing EvalAssist, an AI-for-Good Augmentation Tool for Evaluation Design
Lauren Damme, Ph.D.
CHAPTER 5
Designing with Generative AI: Using GPT-4 to Build a Monitoring, Evaluation and Learning Framework
Geordie Fung
CHAPTER 6
From Ritual to Reflex: Reimagining Results Measurement with Generative AI
Lisandro Martin, Stephen Porter, Vasundhara Jolly, Alexander Lehner, Federico Hernan Tiberti, Rijak Grover, Jonathan Stöterau, Medha Nair
CHAPTER 7
Playing to Plan: Using a GenAI-Powered Chatbot Game to Support Logic Model Development in a City Government Context
Xinru Yan
CHAPTER 8
Harnessing Generative AI for Data Structuring and Geospatial Analysis in Evaluation
María Alejandra Lucero Manzano
CHAPTER 9
Balancing Innovation and Rigor at World Bank Independent Evaluation Group: Thoughtful Integration of Artificial Intelligence for Evaluation
Harsh Anuj, Estelle Raimondo, Hannah Den Boer
CHAPTER 10
Integrating Generative AI into Thematic Analysis: A Structured Approach for Large-Scale Document Review in Evaluation
Lauren Ropp, Azra K. Nurkic, PhD
CHAPTER 11
Bridging Complexity with Intelligence: The Role of Generative AI in a Mixed-Methods Evaluation of SDG1 in Sub-Saharan Africa
Hailemichael Taye Beyene, PhD
CHAPTER 12
Using AI for interviewing in a challenging context
Silva Ferretti, Steve Powell
CHAPTER 13
How to Train a Work Horse. Using Generative AI for Labelling Data
Steffen Bohni Nielsen, Amanda Sutter, Isabelle Bourgeois, Bianca Montrosse-Moorhead, Sebastian Lemire
CHAPTER 14
Sifting for Gold: Mining Relevant Content in a Large Document Collection
Joachim Sandnes, Ove Haugland Jakobsen, Tom Næss
CHAPTER 15
Harnessing Generative AI for Geospatial Analysis in Environmental Evaluations
Anupam Anand, Geeta Batra
CHAPTER 16
Automating Partnership Principle Assessment: Using Generative AI to Analyze Stakeholder Participation in European Operational Program Governance
Igor Lyubashenko
CHAPTER 17
Elevating Local Voices: Qualitative Analysis Reimagined
Trevor Smith, Kathryn Kraft
CHAPTER 18
Generative AI for Protocol-Dirven Structured Analysis in Evaluations
Indran A. Naidoo, Anoop Sharma, Steven Jonckheere, Hannah den Boer
CHAPTER 19
Experimenting with AI Tools in CGIAR Science Group Evaluations: A Candid Assessment of Adoption by Learning
Lea Corsetti, Edwin Asare, Diana Cekova
CHAPTER 20
AIDA - Assessment for Development Analytics
Richard Jones, Davor Djosan, Anish Lal Pradhan
CHAPTER 21
ChatGPT x GBA+: Using GenAI to Apply Evaluative Criteria: Assessing Reports Against Canada's GBA+ Framework
Savita Bailur
CHAPTER 22
Human in the loop: AI-supported evaluation in Hungary
Diana Kun
CHAPTER 23
Reviewer 0: Using Generative AI as the Evaluator’s First Line of Feedback
Steffen Bohni Nielsen
CHAPTER 24
Beyond the Radar: Addressing Undeclared AI Use in Evaluation Practice
Steve Jacob
CHAPTER 25
Enhancing Evaluation Dissemination & Reporting with Generative AI
Nishank Vashney
CHAPTER 26
Leveraging Self-Hosted AI Solutions for Data-Secured Research and Evaluation
Salvador Bustamante Aragonés
CHAPTER 27
Leveraging Generative AI to Transform Evaluation Reports into Engaging Multi-Media Products
Jade Lamb, Meredith Feenstra, Kerry Bruce, Shereen Bahn
CHAPTER 28
Podcasting findings. Using Generative Artificial Intelligence to tailor dissemination to diverse stakeholders
Niels Brandt Petersen, Rikke Thoning Solaas, Sara Kabel Pedersen, Steffen Bohni Nielsen
CHAPTER 29
Bridging Evaluation and Official Statistics Through GenAI: The EQUA Platform
Francesco Mazzeo Rinaldi, Giovanni Giuffrida, Vincenzo Miracula
CHAPTER 30
Where Methodological Automation Ends and Judgement Begins: Evaluation in the Generative Artificial Intelligence Era
Bianca Montrosse-Moorhead, Tahirah David
CHAPTER 31
Artificial Intelligence in Evaluation Practice: Uses, Good Practice, and Emerging Competencies
Tessie Catsambas
CHAPTER 32
Artificial Intelligence and the Ethics and Practice of Evaluation
Ananda Millard, Tom Ling
CHAPTER 33
FRAME: A Practical Framework for Responsible AI in Monitoring and Evaluation
Valentine J Gandhi, Kerry Bruce, Steffen Bohni Nielsen
CHAPTER 34
GenAI and the Evolution of Evidence in Evaluation
Kerry Bruce, Valentine J Gandhi and Steffen Bohni Nielsen