EVALUATION & SURVEY ANALYST

Position Title:                                   EVALUATION & SURVEY ANALYST

Department:                                      COMMUNITY ANALYTICS & RESEARCH (CAR)

Location:                                            TOLEDO OFFICE/ HYBRID

FLSA Job Status:                             PART-TIME,  EXEMPT

Pay Range:                                         $45,000 – $55,000

    Reports to:                                    VP, RESULTS & ANALYTICS

STATEMENT OF THE JOB:

The Evaluation & Survey Analyst will assist in, validating, comparing, reporting and analyzing  evaluation and survey data in order to assist the Community Impact team and partnering agencies with advanced analytics and other data products. The Evaluation & Survey Analyst will receive instruction on how to fill requests from this office to provide insight from the VP, Results & Analytics. This position will help maintain evaluation reports and registries while also completing ad hoc analysis as needed. This data will be extracted from operationally based systems and requires a strong understanding of querying data for items such as mapping, budgets, performance, evaluation,  population identifiers, test scores, health rankings and other dimensions of program performance. Additionally, the Evaluation & Survey Analyst will assist in identifying opportunities to improve reporting in support of both outside agencies and internal programs that track indicators of quality, costs and outcomes. The Evaluation & Survey Analyst will need subject matter knowledge of evaluation and surveys as well as statistical methods for the completion of complex assignments.

ESSENTIAL FUNCTIONS: 

Analytics: (30%)

  • Develop analysis and evaluations of reports including:
    • Evaluating reports regarding performance, utilization, quality of program and student measures against results from peer institutions
    • Assist in conducting analyses on cost performance and facilitate assessment of program practice patterns
    • Validation of data quality and reasonableness in reports and/or analyses of services prior to distribution.
    • Input of data visualization opportunities and report formats and graphical representations of data intended for broad audiences.
  • Assist in evaluation analysis by supporting the creation of complex algorithms to data which are extracted and integrated across multiple sources.
  • Work with database and business systems analysts to analyze products and programs, including definition of data requirements, data capture and storage, and analyses required to measure and evaluate performance.
  • Support translation of program and business needs into analytical solutions
  • Communicate and collaborate with other departments and agencies to address problems with data quality.
  • Help create mechanisms to extract and reorganize data from existing systems for storage and reporting in departmental databases.
  • Maintain supporting documentation of measurement methods and algorithms, data sources and reporting processes.
  • Follows all appropriate data quality and security guidelines.

Evaluation & Survey Analysis: (70%)

  • Create and update evaluation and research methods/ approaches.
  • Develop and define standard evaluation measures.
  • Create data collection instruments and ensure quality, completeness and compliance in line with developed guidance.
  • Develop process and procedure manuals for ongoing program evaluation
  • Gather and analyze historical performance and evaluation data and intervention approaches to identify and implement continuous improvement.
  • Assist in mining and scrubbing existing evaluation reports and data from multiple databases.
  • Research public and private evaluation and survey methodologies to assess aggregately aligned approaches for community.
  • Conduct rigorous quantitative and qualitative analysis .
  • Assess viability of evaluation and research practices.
  • Detailed analysis of evaluation and survey methodologies and program outcomes.
  • Keep detailed records on all actions, processes and procedures for change management and adjustment of evaluative techniques.
  • Coordinate with the VP to determine timing of development efforts and key milestones.
  • Work with VP and IT staff to identify and automate tools that deliver routine performance information.
  • Ensure adherence to quality standards and contribute to improvement efforts.
  • Review reports and analysis, write findings. Test datasets.

 ADDITIONAL RESPONSIBILITIES:

  • Work with VP to create training materials and organizational documentation.
  • Work collaboratively with data science team, community impact, and directly with programs
  • Identify and apply for grant opportunities
  • Actively seek continuous improvement opportunities
  • Actively participate and lead in local evaluation and measurement initiatives and activities
  • Safeguard proprietary processes and methodologies
  • Develop training and development materials
  • Conduct training and development sessions for large and small groups
  • Develop Results Based Accountability (RBA) efficiencies
  • Develop and execute project plans
  • Present reports and progress to stakeholders
  • Additional duties as deemed necessary.

 QUALIFICATIONS AND EXPERIENCE:

  • Masters Degree (Quantitative Field) with an advanced degree (Biostatistics, Public health, Computer Science, Economics, Engineering, Informatic, Evaluation & Measurement) preferred.
  • And at least 4 yrs/ experience in the following:
  • Complex evaluation assessment and analysis
  • Implementation of rigorous evaluation methodologies and frameworks
  • Experience developing and implementing proprietary methodologies
  • Experience with Data Warehouse and BI systems
  • Experience collecting business requirements from clients and transforming requirements into reports and analyses.
  • Program management, development, measurement, or administration
  • Or, a comparable combination of education and experience.

 KNOWLEDGE / SKILLS / ABILITIES:

  • Expertise assisting in producing analytic products.
  • Knowledge of evaluation & measurement methodologies, approaches, best practices and application
  • Research methodology expertise and successful implementation
  • Ability to consistently meet deadlines in a fast paced and changing environment with multiple competing tasks and priorities.
  • Support proficiency in the use of analytic and reporting tools such as Microsoft Excel, Tableau, ANDAR and any newly introduced systems.
  • Strong customer service skills and commitment to excellent customer service.
  • Ability to independently establish objectives, project plans and milestone goals.
  • Strong analytical and problem-solving skills.
  • Good verbal, written and visual presentation skills.
  • Ability to anticipate requests and needs in advance and plan accordingly.
  • Skills to work effectively across internal functional areas in ambiguous situations.

To apply:  send resume and cover letter to [email protected]

We’re an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.