Job Specification

Position Title:
Director, Research and Evaluation
Job Code:
M1104H - Administrative Services71
Job ID:

Purpose :

To lead and direct the planning, development, implementation and evaluation of research and evaluation and data analysis frameworks for the division by creating an integrated strategy for all programs/initiatives that aligns with and supports overall organizational goals and objectives.

To provide expertise and strategic leadership across the division on research and analytical services and statistical methods which support the review and assessment of divisional programs, operations, service delivery, outcomes and decision-making, and builds organizational competency and rigor.

To identify research, evaluation, learning and impact trends and needs by applying research methods and activities to address needs of various stakeholders such as ministry, sponsors, educators, management, etc.

Key Responsibilities :

1. Manages the planning, design and implementation of the integrated and comprehensive analytics and information management framework to build the division's capacity for evidence informed decision making through centralized control and management of consistent, and quality program and financial data in support of the division's priorities and mandate for the direct and third-party delivery of its programs.

2. Ensures methods, processes, tools, and information /data standards, data sets and information management and analytics operational policies and best practices are developed and the groundwork for program analysis and planning is established. Monitors compliance with policies and practices to ensure data control and consistency.

3. Manages the collection, dissemination, and presentation of all quantitative and qualitative information analysis and evaluation of provincial program and financial related data including the assessment of the effectiveness of the reporting of program achievements/outcomes and divisional strategic outcomes and strategic advice regarding their impact on overall strategic directions.

4. Provides leadership of concurrent project teams, working groups and committees comprised of staff (e.g., program area, information technology specialists in the I&IT Cluster, and other internal stakeholders) and external parties (e.g., service providers, external consultants, institutional review board members, and other external stakeholders) to plan and manage the selection, implementation and maintenance of research and evaluation frameworks, tools and products to enable the division to more effectively analyse and report on overall programs and plans for related division initiatives.

5. Leads the research and development of reports and presentations to senior management and internal departments, identifying trends and labour market analyses, interpreting results, and recommending appropriate action to ensure program/performance analyses support executive and management decision making and planning. Develops and implements strategies to leverage labour market and other high level analytics available through other ministry sources and external sources (e.g. third party research) to drive critical division decision-making.

6. Manages the interpretation and provision of integrated program analytics valuation, measurement, outcome and assessment expertise, consultative advice and information across the division to ensure consistency and rigour in provincial reporting and evaluation of program effectiveness, and leadership on future program and performance indicator design for new and existing initiatives.

7. Prepares and/or manages the development and presentation of detailed rationales and action plans for proposed initiatives. In partnership with other Directors/Managers, provides analysis, strategic planning advice and recommendations to the executive team on managing risks, resolving issues, responding to opportunities and improving performance of projects. Provides leadership and expertise on program analytics and evaluation interpretation to support the development of option papers, recommendations for appropriate action and implementation plans for divisional senior management decision making. Prepares strategic business cases, feasibility assessments, Cabinet/Management Board submissions, briefing notes and responds to information requests.

Managerial Responsibilities
1. Develops and oversees organization strategic plans and provides advice and expertise to executive levels on issues impacting the organization, OPS and ministry service deliverables.

2. Controls financial resources and reporting, develops the multi-year budget and resource plans. Leads business, financial, and results-based planning processes for Ministry programs/operations and services.

3. Builds organizational capacity through effective human resources development by authorizing recruitment activities, labour relations management, talent management, organizational design and succession planning.

4. Establishes and maintains strong working relationships with key partners and stakeholders to ensure timely and accurate information flow and identification of issues; presents and advocates the ministry's position at various forums

5. Responsible for the overall compliance with legislative statutes, collective agreements, government and ministry policies, directives, guidelines and commitments related to programs and services.

Qualifications :

Not applicable.

Factors :

Knowledge :

Ministry strategic corporate directions, multi-year business and results based planning processes, and ministry service delivery models, to lead and manage a significant ministry program area, to determine program objectives and resource requirements and to ensure alignment of programs and projects with corporate strategic goals.

Government and ministry financial, administrative and procurement policies and directives to plan and manage fiscal and material resources. This includes reviewing and approving budgets, managing facilities, assets, and contract service providers, leading long range fiscal planning, providing regular financial reporting, and ensuring compliance with financial protocols, audit principles, directives and guidelines.

Human resources theories, principles, policies and collective agreements to develop organizational capacity which includes succession planning, talent management, organization and job design and labour relations management.

Project management principles and methodologies to oversee and guide the overall delivery of mandates and strategies.

Data science, statistical (quantitative and qualitative), methods to lead and manage the research, analysis, and evaluation of divisional program operations and service delivery; to identify gaps, costs, impacts and issues; to establish best practices, and provide evidence based recommendations.

Knowledge of database analysis and modelling; cross-sectional and longitudinal, descriptive and inferential statistical methods; research methods; socio-economic/demographic analysis techniques; survey methods; and data visualization best practices to provide program delivery.

Knowledge of modern web application development and digital design to guide the development and deployment of modern data analysis communication and mobilization products that allow clients to engage in their own analytics.

Knowledge of vendor management and government procurement principles, practices and methods, to authorize project contracts. OPS and I&IT and research procurement policies and practices associated with the development of technical specifications for purchasing and service management in order to arrange acquisition of technical and analytical products and services.

Knowledge of data management principles, practices, concepts, systems, applications, and data transformation processes, and related technology, to articulate business needs for systems development; and to ensure the data maintenance of statistical and labour market data holdings for the division is in compliance with legislation, policies, data management technology and process requirements, and best practices.

Program Responsibility :

Responsible for leading and managing the planning, development and implementation of analytical frameworks, strategies, plans, applications, and solutions for the division.

Responsible for providing expert and consultative advice and analytical support to clients and related stakeholders on data analysis needs identification, systems planning, implementation, and performance management.

Responsible for planning and managing the maintenance of all analytical, labour market, and inter- ministerial/inter-jurisdictional data holdings for the division to ensure that divisional areas and related stakeholders have access to accurate and timely data to support evidence-based decisions making.

Responsible for planning and managing access to and release of data for internal and external clients to ensure that access is appropriately controlled, and information is released in accordance with applicable legislation (e.g. privacy), standards, agreements, and controls.

Analytical Thinking :

Evaluates client programs and business requirements to develop and implement analytical strategies, frameworks, and services that support business program delivery, respond to evolving needs and opportunities, and position the design, development, and implementation of appropriate analytical ecosystems.

Analyzes trends and emerging information and data issues to identify operational requirements, assess risks and impacts on client program delivery, and recommend options to mitigate risks.

Assesses changes in technological innovations and service initiatives to identify opportunities for improvements or innovations to existing analytical plans and technologies that meet client program requirements.

Analyzes access and release provisions for clients and their data-sharing partners to meet legislative, contractual requirements, and resolve data-related problems.

Researches, analyzes, and costs solutions to identifying best options with clients who have widely varying needs and generate agreement on new requirements that maintain the reliability and validity data holdings from all sources, and ensure that new data sources are integrated and compatible with existing standards and best practices.

Analyzes existing analytical processes, polices, strategies to assist division with evidence based decision making

Analyzes data analysis requirement of division to determine related solutions, strategies, plans, and applications and forecast solutions that meet stakeholder business needs e.g. determining statistical software needs for division's varying levels of analytical maturity, determining enterprise data visualizations options for the division and working with the I&IT Cluster to build the infrastructure required to build and implement a new analytical environment for the division to meet current needs.

Analyzes complex and multi-faceted issues impacting the development, implementation, and maintenance of statistical methodologies and reporting practices to resolve or refer problems and issues related to data interpretation, analysis, planning and budgeting.

Planning / Coordinating :

Leads and manages multi-year strategic business /program/service plans including the deployment of resources (human and financial) to deliver programs and services.

Coordinates and leads the planning and implementation of organizational development and complex change initiatives for the program, service, project or initiative.

Plans, designs and implements an integrated and comprehensive analytics and information management framework to build the Division's capacity for evidence informed decision making through centralized control and management of consistent, and quality program and financial data.

Plans and coordinates various projects related to analytics in compliance with project management policies and programs to meet client requirements.

Plans and manages consultation processes with program stakeholders in relevant sectors and jurisdictions and ensures the integration of stakeholder interest in divisional analysis and development of divisional analytical products

Plans and coordinates the implementation of analytical strategies, plans, applications, and solutions that meet divisional needs.
Plans and coordinates procurement of external supplier resources and manages the ongoing supplier relationship to meet OPS procurement policies and requirements.

Leadership/Guidance :

Develops, builds and leads organizational capacity through positive and values based leadership, inclusive and engaged teams, and partnerships. Frames program vision and strategy for services, programs or operations.

Determines human resources and organizational needs for optimal performance and delivery of results and alignment with ministry objectives; leads talent management and succession planning; mentors employees; sets goals and performance standards.

Exercises managerial and strategic leadership accountability and authority in the areas of organizational design, recruitment and retention, talent management, labour relations and compensation related matters.

Independence of Action :

Reports to a senior level, Director or higher and works within broad parameters and the strategic ministry/branch mandate, legislation, and strategic goals and directions.

Exercises considerable independence and judgment in the development of program/service plans including delivery/implementation to meet government and ministry strategic business objectives and priorities and in the provision of advice and recommendations to the Executive Committee, which is considered authoritative, and informs policy and program decisions.

Develops and delivers data analysis, access, and release strategies, plans, operational policies, and standards to deliver a consistent open data and analytical framework across all divisional programs.

Negotiations agreements and service offerings from vendors, researchers, and other stakeholders

With minimal guidance, determines optimum system solutions to meet user analytical requirements for the division within time, budgetary, and other constraints

Provides advice and expertise to executive levels on analytical or open data issues identified as impacting ministry service delivery and program direction and proposes mitigation strategies and communication approaches to address identified risks.

Interpersonal/Communication :

Represents the Ministry/Division and contributes relevant data quality and analytics subject matter expertise as a member of committees and task forces so as to ensure effective access, utilization, research and analysis of divisional data holdings.

Chairs or participates on senior level corporate committees, work groups, special projects and initiatives, related to design, development, and analysis of ministry programs and release of ministry data.

Provides strategic advice to client management and staff on opportunities arising from emerging information technology trends and issues to provide analytical expertise for planning, tool development and support, and direct analytical projects in compliance with corporate policies, directions, and priorities.

Participates on cross-jurisdictional government committees, and contacts peers in the broader public sector and other jurisdictions to identify contentious issues, exchange information, resolve problems, and agree on protocols and solutions.

Assesses products and services with technology vendors, suppliers, and consultants to negotiate the acquisition of goods and services, oversee the quality of deliverables, and obtain information on technological developments.

Consults with external counterparts and clients to manage risks and ensure smooth solution implementation.

Develops, maintains, and manages relationships with clients at all levels to establish and manage expectations; anticipate, identify and resolve conflicts and/or issues within and between projects or functional areas.

Maintains currency of analytical trends and best practices with academic, community, and industry sources and peers in other jurisdictions to incorporate into divisional analytical strategies and plans.

Contacts business partners in the broader public and private sectors to discuss issues with impact on divisional analytical strategies, business and fiscal plans.

Builds key horizontal relationships and leads and manages partnership negotiations and consultation processes, with a view to developing and fostering key linkages across the OPS and with other sector stakeholders, and identifying analytical issues and priorities.

Physical Effort :

Most of the time is spent in an office environment with frequent opportunity to move about.

Sensory Effort :

Requires visual attention and concentration (i.e. reading without interruption) to review jurisdictional reviews, program evaluation outcomes, data science journals and industry white papers to develop research and analysis plans.

Working Conditions :

Work is performed in a typical office environment.

You must enable JavaScript in your browser to access full functionality on the OPS Careers website.

Vous devez activer JavaScript dans votre navigateur pour avoir accès à toutes les fonctionnalités du site Carrières dans la FPO.

Ontario Logo / Logo de l'Ontario
This site is maintained by the Government of Ontario
Ce site est mis à jour par le gouvernement de l'Ontario

Privacy | Important Notices
Confidentialité | Avis importants

© Queen's Printer for Ontario, 2007
© Imprimeur de la Reine pour l'Ontario, 2007