External Program Evaluation
Our mixed-methods evaluation designs incorporate both quantitative and qualitative data to help agencies better understand a program’s processes, outcomes, and impact.
Our approach begins with an evaluation assessment to clarify program goals, questions, and relevant data. Using logical models and theories of change, with influence from design strategy, we can then develop an evaluation plan.
The Evaluation Assessment helps identify the goals of an evaluation. We then customize each evaluation design based on contextual factors (e.g., resources, timeline, data availability). Most studies use a mixed-methods approach that may include interviews, focus groups, structured observations, document analysis, surveys, case studies, and statistical analysis of relevant data.
Important insights always emerge from rigorous process evaluations. A process evaluation studies how a program is implemented. Many variables can influence program outcomes and process evaluations help uncover important factors that might be less apparent or have an indirect effect on a program’s effectiveness.
Impact evaluation methods are at the center of City Flourish’s work. Based on contextual factors, we can design an evaluation that could include a retrospective study with past data to longitudinal studies that measure impact over time.
Survey Design and Management
City Flourish provides a variety of services to help you with your research:
- Sample design: We help agencies define, contact, and manage their desired demographic group.
- Survey design: We will assist you in developing questions that will yield more reliable and unbiased responses.
- Survey management: We can administer, track, and manage the survey process in each stage: design & planning, IRB coordination, data collection, analysis, and reporting.
- Data collection and administration: City Flourish’s security program protects data using the latest guidelines from the federal government.
City Flourish offers Impact Workshops to help agencies expand their capacity to measure program outcomes and impact. Workshops cover three main areas: Impact frameworks, data strategy, and communications strategy.
Impact frameworks help to develop and assess program logic models and primary considerations for program monitoring and evaluation.
Data strategy covers metric development, data management models, and introduces a roadmap and benchmarks toward evidence-based practices.
Communications strategy introduces and assesses primary approaches and tools for reporting and data visualization.
Impact Workshops are offered a few times a year for individuals and for organizations on an individual basis.The workshop covers:
- Theoretical frameworks
Intro. to impact evaluation, logic model development and assessment, and primary methods for monitoring and evaluation
- Program Design
Methods for asset & needs assessment and logic model development and feedback.
- Evaluation Design
Monitoring and evaluation plan and data strategy. In this section, we introduce the data maturity model, data integration and management solutions.
Capacity building methods that engage all stakeholders, reporting and storytelling strategies and tools, and internal program evaluation methods.
Process and outcome evaluations.
Engage stakeholders in strategy revision.
Key strategies for cultivating a participant-centered and outcome-oriented culture.