Psychometrician

Salesforce

Salesforce

Multiple locations
Posted on Friday, May 31, 2024

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.

Job Category

Employee Success

Job Details

About Salesforce

We’re Salesforce, the Customer Company, inspiring the future of business with AI+ Data +CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower you to be a Trailblazer, too — driving your performance and career growth, charting new paths, and improving the state of the world. If you believe in business as the greatest platform for change and in companies doing well and doing good – you’ve come to the right place.

Love helping others thrive and have the best careers of their lives? Our Salesforce Certification team ensures our Salesforce customers and partners are enabled and certified to work with Salesforce products.

As a member of the Salesforce Certification team, you will be responsible for psychometrically evaluating role-based and product-based certifications and assessments and making recommendations on exam health, maintenance, and retirement decisions. You will manage end-to-end exam evaluation and will be responsible for assessing the certification program’s health. You will identify, collaborate with, and maintain relationships with key experts and stakeholders across the company. You will work closely in a team environment to ensure that certifications are aligned with the appropriate enablement and resources. You will contribute to the overall growth of the certification program through your involvement in projects focused on continuous improvement.

Job Responsibilities

This role is invaluable in designing and implementing assessment tools that accurately evaluate candidate suitability and employee potential. Below are examples of outputs we would expect of a Salesforce Psychometrician.

  • Health checks/Diagnostics: Conduct routine analyses across the entire portfolio based on quarterly volume, identify potential issues, and recommend solutions or process adjustments based on results: general item statistics (exam health check), including distractor analysis, forms analysis, etc.

  • Validity and Reliability Analysis: Conduct extensive analyses to evaluate the validity and reliability of assessments. Strong candidates would be familiar with statistical techniques, such as factor analysis, item response theory, and classical test theory, to assess validity and reliability.

  • Quality Assurance: Oversee the ongoing maintenance and improvement of assessment instruments, monitoring their performance, identifying potential flaws or biases, and implementing revisions as needed to enhance their validity, reliability, and fairness.

  • Norming and Standardization: Establish norms and standards for interpreting test scores. Analyze exam data to establish score distributions, percentile ranks, and other benchmarks that facilitate meaningful comparisons and decision-making.

  • Build multiple equated forms (based on project criteria) and coordinate clear deliverables and reports to the relevant Exam Services team members to inform exam publishing. Include a specific number of simulations.

  • Generate scaled scoring tables to manage score equating confidentially.

  • Conduct special data forensic analyses towards the invalidation of scores when applicable, protecting the brand while ensuring the validity of the overall program.

  • Conduct ad hoc or custom analyses as needed to identify problems and/or review fairness and flag potential bias or other issues that might be cause for concern.

  • Compile summary reports of exam data with actionable items

  • Monitor the quality, performance, consumption, and value of certifications and assessments by gathering feedback from and presenting solutions to stakeholders. Respond to feedback from exam candidates and contribute to the overall growth of the certification program and community

  • Assist with activities related to customer-focused Salesforce events, such TrailheadX, Dreamforce, and World Tour events.

Experience:

We aim to hire a seasoned Senior Psychometrician with a strong background in I/O psychology or Education Measurement, or with extensive experience in developing and implementing psychometric assessments in corporate settings. This individual should ideally have:

  • A Ph.D. or equivalent advanced degree in Psychology, Measurement, or a related field.

  • Proven expertise in psychometric theory, test development, and validation methodologies.

  • Demonstrated proficiency in statistical analysis software (e.g., SPSS, R) and familiarity with relevant industry standards and guidelines (e.g., Standards for Educational and Psychological Testing).

  • Strong communication and collaboration skills to work effectively with cross-functional teams and stakeholders.

  • Experience in project management and the ability to drive initiatives from conception to implementation.

  • A track record of staying abreast of emerging trends and best practices in psychometrics and applying them to enhance organizational effectiveness.

  • Advanced understanding of certification exam delivery platforms and various methods of delivery (e.g., fixed forms, LOFT, CAT, etc).

  • Effectively communicate complex statistical concepts and results to non-technical stakeholders.

  • Project management skills with the ability to manage multiple tasks, priorities, and deadlines.

  • Ability to collaborate and communicate efficiently with certification teams, including Development, Operations, Marketing, Help, and Security.

  • Attention to detail and accuracy in all work.

  • Experience conducting data forensics work for certification/credentialing programs.

*LI-Y

Accommodations

If you require assistance due to a disability applying for open positions please submit a request via this Accommodations Request Form.

Posting Statement

At Salesforce we believe that the business of business is to improve the state of our world. Each of us has a responsibility to drive Equality in our communities and workplaces. We are committed to creating a workforce that reflects society through inclusive programs and initiatives such as equal pay, employee resource groups, inclusive benefits, and more. Learn more about Equality at www.equality.com and explore our company benefits at www.salesforcebenefits.com.

Salesforce is an Equal Employment Opportunity and Affirmative Action Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status. Salesforce does not accept unsolicited headhunter and agency resumes. Salesforce will not pay any third-party agency or company that does not have a signed agreement with Salesforce.

Salesforce welcomes all.