15 Nov
|
The Brenda Strafford Foundation
|
Calgary
15 Nov
The Brenda Strafford Foundation
Calgary
The Evaluation Analyst designs and delivers evaluation, performance measurement, and learning activities that show what is working, for whom, under what conditions, and with what impact across The Brenda Strafford Foundation (BSF). The role turns quantitative and qualitative data into clear, decision-relevant insight that strengthens initiatives, supports accountability to funders and partners, and drives continuous improvement.
Working for the Dr. Barrie Strafford Centre for Learning, Innovation and Quality (CLIQ), across Aging, Children & Youth, Health, Violence Prevention, and the BSF corporate team, the Analyst partners with portfolio teams, community and academic partners, participants, and subject matter experts to develop practical evaluation approaches, collect and analyze data, and communicate findings in accessible, decision-relevant ways. The Analyst also serves as the evaluation lead for inhouse programs establishing the measurement approach, data collection, and reporting needed to demonstrate each program’s reach, progress, and outcomes.
The Analyst works closely with the Manager, Analytics & Digital Transformation so that evaluation data is captured through productive, well-designed processes, and contributes to a culture of curiosity, learning, and evidence-informed action.
Key Responsibilities
Evaluation Design & Implementation
- Develop evaluation frameworks, including logic models, theories of change, evaluation questions, indicators, data collection plans, and reporting frameworks.
- Select and apply developmental, formative, summative, process, outcome, implementation, and impact evaluation approaches suited to each initiative’s maturity and purpose.
- Co-design evaluation activities with staff, partners, participants and communities so that measures are meaningful, feasible, and low-burden.
- Develop surveys, interview and focus-group guides, observation tools, data extraction templates, and other data collection instruments.
- Coordinate evaluation workplans, including ethics and privacy requirements, recruitment, consent, data collection, analysis, validation, and reporting.
- Develop and maintain an overarching CLIQ evaluation framework that links initiative-level results to BSF’s strategic priorities, goals, objectives, and tactics, and to overall BSF impact.
Programs Evaluation & Performance Measurement
- Lead the design and implementation of the program’s evaluation plan, including its logic model, performance indicators, targets, and reporting schedule, aligned to program objectives and funder requirements.
- Define and track participants, projects, and cohort-level measures, such as reach, engagement, milestones achieved, readiness progress, partnerships formed, and adoption or implementation outcomes.
- Gather participants and partners’ feedback through surveys, interviews, and check-ins to assess experience, value, and barriers, and recommend practical program improvements.
- Prepare programs progress and outcome reports, dashboards, and success stories for funders, partners, leadership, and the wider innovation community.
- Assess equity of access and reach, and document lessons learned to inform how the program is scaled, sustained, or adapted.
Data Management, Analysis & Visualization
- Collect, organize, clean, validate, analyze, and interpret quantitative and qualitative data from multiple sources.
- Conduct descriptive and trend analyses, thematic analysis, and other fit-for-purpose analytical work using methods appropriate to each evaluation question.
- Build dashboards, scorecards, charts, infographics, and summaries that make findings understandable and actionable.
- Maintain documented data definitions, methods, assumptions, limitations, and quality checks, in line with privacy and data governance requirements.
- Identify data gaps, inconsistencies, biases, and risks, and recommend practical improvements.
- Work with the Manager, Analytics & Digital Transformation and technology partners to digitize and automate evaluation-related processes such as intake, data collection, and reporting, and use usage and performance data to measure efficiency, data quality, and adoption.
Research & Evidence Support
- Conduct literature reviews, rapid evidence reviews, environmental and jurisdictional scans, and ecosystem or service mapping in line with the CLIQ Evidence, Analysis and Gathering (EAG) Framework and Evaluation Framework.
- Support applied research, innovation trials, human-centred design, and quality-improvement projects.
- Assist with research protocols, ethics submissions, partner agreements, data collection, analysis, and knowledge products.
- Monitor relevant trends and evidence, and summarize implications for CLIQ initiatives and investment decisions.
Impact Reporting & Organizational Learning
- Monitor initiative milestones, execution measures, outcomes, and impact indicators, and support timely reporting.
- Prepare evaluation reports, funder reports, executive summaries, briefing notes, presentations, and recommendations.
- Facilitate reflection and sense-making sessions that help teams interpret findings and decide next steps.
- Work with the Knowledge Mobilization & Engagement Specialist to translate findings into accessible products for varied audiences.
- Support grant applications by developing measurement approaches, evidence statements, targets, and relevant data.
Capacity Building & Collaboration
- Provide practical guidance to staff and partners on evaluation design, data collection, interpretation, and use.
- Develop templates, guidance, and tools that improve consistency and reduce evaluation burden.
- Build respectful relationships with participants and partners, applying trauma-informed, culturally responsive, and inclusive approaches.
- Represent CLIQ on committees, working groups, collaboratives, and external forums related to evaluation, analytics, quality, and innovation.
- Contribute to shared team priorities and take on related analytical, research, and project
Qualifications
Education
- Bachelor’s degree in evaluation, data science, social science, health science, public health,
statistics, health informatics, psychology, sociology, economics, research methods, or a related discipline.
- Master’s-level education, specialized evaluation training, or progress toward the Canadian Evaluation Society Credentialed Evaluator (CE) designation is an asset.
Experience
- Two to five years of relevant experience in program evaluation, applied research, performance measurement, analytics, quality improvement, or social impact measurement.
- Hands-on experience collecting and analyzing both qualitative and quantitative data.
- Experience developing evaluation plans, logic models, indicators, surveys, interview guides, and reporting products.
- Experience conducting interviews, focus groups, consultations, or other participatory data collection.
- Experience preparing clear reports, presentations, data visualizations, and recommendations for non-technical audiences.
- Experience evaluating innovation, cohort-based, or capacity-building programs, or health, aging, or technology-adoption initiatives, is an asset.
- Experience in healthcare, continuing care, community services, nonprofit, education, international development, or research environments is an asset.
- Experience supporting grant-funded initiatives, privacy or ethics processes, or multi-partner projects is an asset.
- Experience supporting digital transformation, such as digitizing intake or data collection, workflow automation, or data system implementation, is an asset.
Knowledge, Skills & Attributes
- Sound knowledge of qualitative and quantitative research and evaluation methods, and familiarity with Canadian Evaluation Society competencies and program evaluation standards.
- Proficiency with Excel and familiarity with Power BI, Tableau, SPSS, R or comparable analytical tools.
- Strong analytical reasoning, accuracy, curiosity, and attention to detail.
- Familiarity with healthcare data environments, electronic medical record systems, data interoperability, and API-enabled data integration is an asset.
- Ability to explain technical findings in plain language and tailor communication to different audiences.
- Excellent organization and ability to manage multiple projects and deadlines.
- Strong interpersonal, facilitation, listening, and collaborative problem-solving skills.
- Understanding of privacy, confidentiality, research ethics, data quality, equity, and culturally responsive evaluation.
- Ability to work independently while seeking guidance appropriately and contributing positively to a collaborative team.
Working Conditions
- Primarily office and computer-based work, with regular virtual and in-person meetings.
- Occasional travel, evening events, or schedule flexibility may be required based on project and partner needs.
- Work involves managing multiple priorities, deadlines, and stakeholder relationships in a dynamic environment.
Pay: From $75,000.00 per year
Benefits:
- Company events
- Dental care
- Disability insurance
- Employee assistance program
- Extended health care
- Flexible schedule
- Life insurance
- Mileage reimbursement
- On-site parking
- Paid time off
- RRSP match
- Vision care
- Work from home
Work Location: Hybrid remote in Calgary, AB T2R 1J9
📌 Evaluation Analyst (Calgary)
🏢 The Brenda Strafford Foundation
📍 Calgary