Manager of Program Evaluation/Project Manager at Massachusetts General Hospital(MGH)

Posted in Other 12 days ago.

Location: Boston, Massachusetts

Job Description:

IMPORTANT: This position is fully remote. To be considered for this position, you must submit either a cover letter or a sample of your work. Examples of work samples include a survey you've designed, a data report you've created, or another relevant piece of work.


Think:Kids is a program in the Department of Psychiatry at Massachusetts General Hospital. Think:Kids teaches Collaborative Problem Solving (CPS), a revolutionary, evidence-based approach for helping children who struggle with social, emotional and behavioral challenges. At Think:Kids, we train clinicians, parents, and educators across the world to implement CPS in homes, outpatient clinics, residential programs, and schools. We do this through three main avenues: online trainings and classes available to the public, site-wide implementation, and an individual certification program.

Think:Kids seeks a motivated and energetic Manager of Program Evaluation to manage all aspects of evaluation across the organization. The Manager of Program Evaluation will be responsible for designing data collection tools and procedures to assess the quality and effectiveness of each of our programs, implementing those procedures, and reporting the data to key stakeholders (internal and external). The Manager of Program Evaluation will be a part of the Think:Kids operations team but will regularly collaborate with the Think:Kids academic research team. This position is fully remote.


Evaluation Design & Collection

Evaluation design and collection responsibilities include:

  • Assessing and recommending data collection software/platforms

  • Designing and/or selecting evaluation metrics and survey instruments

  • Engaging external partners to test feasibility and acceptability of data collection tools

  • Operationalizing all data collection procedures

  • Partnering with internal and external stakeholders to ensure data collection occurs accurately and on time

Evaluation tools will be designed to asses:

  • Program reach (demographics, volume of activity, adults and kids reached)

  • Client and customer satisfaction

  • Prospective client implementation readiness

  • Fidelity of implementation & implementation outcomes

  • Training curriculum and trainer effectiveness

  • Impact

Evaluation monitoring and reporting

  • Develop reports for and lead meetings with external CPS implementation sites to review implementation progress and outcomes and use results for data-driven decision making

  • Support CPS implementation sites with all collection of evaluation data

  • Formulate and complete vigorous timetables to meet contracts' deadlines, deliverables, and contracted budgetary restrictions

  • Develop and disseminate reports for CPS Certified Trainers (staff and broader community) to help them monitor their effectiveness

  • Monitor trends in each area of the program (public trainings, implementation, and certification) and make strategic recommendations regarding service adaptations to improve program effectiveness and impact.

  • Report service information collected internally at Think:Kids to support the Think:Kids Management Team in maintaining alignment with strategic goals and allocation of resources (e.g., quantity and range of services provided; distribution of trainings across staff and certified community)

Other projects and responsibilities as the need arises


  • Master's degree or doctorate in a related evaluation field

  • Ability to make independent, effective decisions

  • Knowledgeable about best practices in program evaluation

  • Knowledgeable about data collection methods

  • Strong data visualization skills with a focus on communicating information to stakeholders with minimal data & evaluation background

  • Strong observational, analytical and critical thinking skills to be able to review trends, information, and outcomes and use this information to tell a story to stakeholders.

  • Strong communication skills to be able to provide clear and concise written and verbal reports that outline your findings and highlight the reasoning behind suggested changes.

  • Strong ability to understand the context of a program and how it affects program planning, implementation, outcomes, and evaluation.

  • Able to independently organize work while working on numerous evaluation projects; prioritizing tasks; planning ahead; following through to complete assignments in a timely, complete, and accurate manner.

  • Ability to work collaboratively across multiple teams and find creative ways to meet the needs of multiple stakeholders.

  • Strong database management and overall computer skills; experience with Tableau a plus

  • Demonstrated problem-solving skills

EEO Statement

Massachusetts General Hospital is an Equal Opportunity Employer. By embracing diverse skills, perspectives and ideas, we choose to lead. Applications from protected veterans and individuals with disabilities are strongly encouraged.
More jobs in Boston, Massachusetts

Forward Air

Forward Air

Hilton Global
More jobs in Other

SolarWinds Worldwide LLC

SolarWinds Worldwide LLC

OCLC, Inc.