Chief Assessment Officer

Position Title: Chief Assessment Officer

Department: Assessment Services (formerly Evaluation & Research)

Reports to: Chief Administrative Officer

FLSA Status: Exempt

Effective Date: March 2024

Status and location:  Full-time and Hybrid

Position Summary

Provides strategic leadership, management, and vision to lead the development, implementation, and continuous improvement of ABEM’s assessment programs. These activities include assessment development, administration, scoring, and outcome reporting. Provide leadership to the Assessment team to ensure ABEM’s assessments are efficiently and effectively managed and that ABEM’s assessments are valid, reliable, and fair.

Essential Duties and Responsibilities

The essential functions include, but are not limited to the following:

1. Leads the development, administration, analysis, scoring, and reporting of certification, continuing certification, in-training, and subspecialty assessments.
   
   
2. Directs and contributes to all ABEM evaluation of assessment activities, including the assessment of item, case, and assessment of psychometric performance. Directs and contributes to examination-related evaluations, surveys, scientific presentations, and related technical publications. Implements improvements to assessment activities on a regular basis.
   
   
3. Develops new implementation models and structures for initial and continuing certification assessments, especially new subspecialties, and focused practice designations. Builds collaborative, cross-organizational teams to develop new approaches.
   
   
4. Contributes to the Strategic Framework by developing content to support strategic priorities. Suggests and contributes to new strategic initiatives and operational activities.
   
   
5. Leads the development and implementation of policies and procedures for ABEM assessments and processes.
   
   
6. Addresses physician concerns and complaints about assessments and scoring in collaboration with Certification Services leadership.
   
   
7. Oversees and is responsible for the budget for assessment programs and activities. Authorizes expenditures and assists with financial matters in accordance with established organizational policies and procedures.
   
   
8. Participates in Board and subcommittee meetings as the lead staff for assigned committees. This includes managing materials for committee meetings, including writing background summaries and other agenda materials.
   
   
9. Contributes to ABEM's collective leadership as part of the senior leadership team, collaborating on strategic priorities, financial performance, work plans, and workplace culture. Establishes credibility within the organization and with the Board of Directors as an effective leader.
   
   
10. Promotes collaboration between the assessment team and other ABEM teams, fostering mutual respect.
    
    
11. Cultivates relationships with external organizations, business partners, and vendors to support assessment operations. Maintains connections with relevant medical organizations., such as the American Board of Medical Specialties and its related committees, other ABMS boards, and other significant organizations in Emergency Medicine.
    
    
12. Supervises direct reports, providing training and development opportunities, feedback, mentoring, and coaching. Creates a positive work environment and ensures team effectiveness and collaboration.
    
    
13. Staffs Oral Exam administrations and other meetings as assigned.
    
    
14. Performs other duties as needed or assigned.

Minimum Qualifications (Knowledge, Skills, and Abilities)

• Master’s degree required. Ph.D. preferred.

• Seven to ten years of related experience and a minimum of four years in leadership and supervision.

• Complex reasoning, problem-solving, creativity, initiative, and highly developed analysis skills and abilities.
  
  
• Fundamental understanding of psychometric and project management principles.
  
  
• Demonstrated leadership abilities, encompassing team building, motivation, feedback delivery, and conflict resolution.
  
  
• Proven ability to lead strategic planning processes, facilitating discussions, synthesizing input, and guiding decision-making towards actionable strategies.
  
  
• Excellent interpersonal skills for effective communication, collaboration, and relationship-building across all organizational levels and with diverse stakeholders.
  
  
• Familiarity with project management and quality improvement methodologies such as LEAN and Six-Sigma.
  
  
• Adaptability and willingness to support evolving work environments.

• Effective oral and written communication skills for presenting complex information concisely.
  
  
• Strong problem-solving, analytical, and critical-thinking skills, enabling sound decision-making based on accurate analysis.
  
  
• Commitment to maintaining professionalism and confidentiality regarding sensitive matters and organizational information.
  
  
• Self-directed, organized, and capable of managing multiple priorities under deadline pressure with attention to detail.
  
  
• Knowledge of organizational policies ensuring accountability and transparency in stakeholder relationships.
  
  
• Proficient negotiation skills.
  
  
• Ability to comprehend and analyze business periodicals, professional journals, technical procedures, and compliance requirements.
  
  
• Ability to travel up to 20 percent of the time (ten weeks or less per year)
  
  

Physical Demands and Work Environment

The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this position. Reasonable accommodations may be made to enable individuals with disabilities to perform these functions.

While performing the duties of this position, the employee is regularly required to talk or listen. The employee frequently is required to use hands or fingers, handle or feel objects, tools, or controls. The employee is occasionally required to stand, walk, sit, and reach with hands and arms. Specific vision abilities required by this position include close vision, distance vision, and the ability to adjust focus. The noise level in the work environment is typically low to moderate.

*This document does not create an employment contract, implied or otherwise, other than an “at will” relationship.