Job Specification

Purpose :

To plan, coordinate and conduct research studies to support, monitor and evaluate the effectiveness of education in Ontario, and EQAO's assessment initiatives.

To provide statistical and research expertise and advice to support the development of policy and assessment program initiatives aimed to improve the relevance and effectiveness of education in Ontario.

Key Responsibilities :

1. Research and Analysis
As senior statistical research expert, plans and coordinates complex statistical, analytical quantitative and qualitative research studies to examine a variety of factors that contribute to student achievement and entrance to the Ontario College of Teachers (OCT)

Leads research and analytical studies including reviewing literature and performing environmental scans, defines research objectives and deliverables, defines target population and determines data collection processes and analytical techniques.

Leads the work of the Research Review Committee (RRC) at EQAO which includes determining agency-wide membership, standards, and agendas, and overseeing progress of action items to advance the agency's research activities.

Leads the development and preparation of logic models, business cases and requests for submissions and RFPs to secure research funding and partnerships to support school improvement planning and student achievement in elementary, secondary, and post-secondary education.

Leads research activities including data collection and analyses, preparation and management of data to support policy and program development and implementation of the agency's initiatives.

Leads the planning, design, implementation and interpretation of advanced, complex statistical data analyses applying techniques and methodologies such as multivariate inferential statistics (i.e. hierarchical linear modelling, data reduction techniques) using SPSS and/or SAS.

2. Advice, Expertise and Consultation
As senior research expert in the agency, provides guidance in the evaluation and compliance of research proposals according to agency priorities, standards and guidelines.

Provides technical leadership and guidance to policy and project staff across the agency on research methodology and techniques, as well as new research developments in the education community.

Prepares annual accountability report to the EQAO Board of Directors; monitors and reports on research-related performance metrics (e.g., number of data requests) and contributes to the Annual Report. Promotes new research undertakings to the EQAO Board of Directors.

Represents the agency on inter-ministry and inter-government committees, conferences and forums; develops and sustains positive relationships and networks with education stakeholders.

Prepares summaries of findings and analytical reports, briefing and other research reports; and presents to senior management including the Chief Assessment Officer and Chief Executive Officer to support informed decision-making process.

Knowledge / Skill :

Knowledge of and skills in:
Theories, principles, and methodologies of research, and statistical analysis techniques to design, conduct and consult on research projects and issues and to interpret statistical information.

Provincial and agency strategic direction and legislation with respect to Ontario's educational systems and assessment initiatives, to assess the impact of findings on policy/program development.

Education and social trends (provincial, national and international), related public policy directions and issues, education stakeholders and their issues to target research and provide expert/strategic statistical advice.

The decision-making and accountability framework of the agency, including Results-based Planning process, assessment monitoring and reporting to support the accurate reporting data for which the agency is the data steward.

Project management techniques to plan and lead research studies and provide direction and guidance to project teams and to manage external research consultants.

The principles and methods of quantitative and qualitative research and analysis methodologies, including the use of computer systems and software (e.g. SPSS and SAS) to undertake analysis of trends, system modelling, and evaluation of best practices, options, costs, and impacts.

Oral and written communications to conduct meetings, present research at national and international presentations, provide recommendations, prepare reports, options papers, briefing materials, to represent the agency/province on intergovernmental task forces.

Standards software programs and tools and statistical software packages for data management and analysis.

Interpersonal / Influencing Skill :

Interpersonal and relationship skills to develop and build partnerships with internal/external stakeholders and to develop and sustain positive relationships with education stakeholders.

Leadership skills to provide leadership and project management to assigned project team members.

Consultation skills to conduct research studies and to promote the agency's initiatives aimed at improving the relevance and effectiveness of education in Ontario.

Presentation skills to communicate research and analytical results and interpret technical information in a manner that will be easily understood by nontechnical audiences.

Advisory, facilitation and collaboration skills to work with other branches, ministries, governments, and academics to develop and implement research projects and to provide advice to senior management and other stakeholders on agency initiatives.

Negotiation skills to resolve issues with external research service providers.

Analyzing / Problem Solving Skill :

Analyzing and problem-solving skills to:
Identify prioritize, and lead research, managing a number of competing priorities concurrently.

Plan and coordinate the collection and analysis of data from various sources, while ensuring data accuracy, integrity and validity.

Access research needs and estimate costs, monitor financial performance and productivity.

Evaluate directions, trends, and polices using multiple sources of information to identify research requirements, develop options and make recommendations.

Conducts advanced, complex statistical analyses such as multivariate inferential statistics (i.e. hierarchical linear modelling, data reduction techniques) using SPSS and/or SAS to advance research priorities and the use of EQAO data and insights in the education community.

Analyze the advantages/disadvantages of various policy and program proposals, preparing reports and making recommendations to senior management.

Decision Making / Responsibility :

Responsible for:
The design and management of statistical and research studies, including the selection of methods, the assignment of tasks, the development of timeframes, the training and supervision of team members.

The quality of analysis, reports and conclusions provided to senior managers, and their relevance for policy and operational decision-making and to meet accountability and reporting requirements.

Providing senior managers with critical reviews of externally completed statistical and research projects and proposals.

Has latitude to determine research scope and methodologies; and to recommend changes to policy development and implementation of agency research initiatives.

Decisions are guided by agency strategic directions and procedures.

Contacts / Stakeholder :

Agency senior management to submit reports, recommendations and to interpret statistical/research findings; to make presentations on technical issues; to provide expert advice.

Counterparts in own and other branches to exchange information, collaborate on research projects, and to coordinate research/data collection.

Statistics Canada to facilitate the transfer of information and data.

Stakeholders in the education community (schools, school boards, Faculties of Education), employer and community sectors, researchers, and suppliers of data to collect information, to share information/knowledge, to collaborate on joint projects and resolve research issues.

External research service providers to negotiate and monitor work plan, timelines and budget of research studies/activities.

Guidance / Supervision :

Provides statistical and research advice and expertise to agency staff and senior management policy and program development and implementation.

Provides guidance and supervision to analysts/and project teams when leading/coordinating research projects.

Demands / Pressures :

Work Demands :

Frequently required to respond to requests within short deadlines where time pressures result in the need to work beyond normal work hours for response to information requests.

Frequently required to deal with deadlines which are subject to change without notice, priorities that are not anticipated or contentious issues which arise unexpectedly and require turnaround for issues management.

Mental / Sensory :

Continuous requirement to concentrate when reading materials, analyzing documents and research, and when drafting reports, briefing notes and policy related materials.

Regularly required to give instructions to project team members and analysts involved in statistical or research projects.

Conditions / Environment :

Work is performed in a typical office environment.