You are applying for a position through Medix, a staffing agency. The actual posting represents a position at one of our clients.
Job Summary
Our client is seeking an IT Auditor to focus on the critical evaluation of AI models within a healthcare context. This role involves testing AI outputs, creating detailed grading rubrics, and ensuring models adhere to complex healthcare standards for terminology, compliance, and workflow logic.
Responsibilities / Job Duties
- AI Model Evaluation & Rubric Creation: Test prompts on active AI models, analyze output accuracy, and build detailed grading rubrics to evaluate model performance against complex healthcare standards.
- Domain Validation: Ensure AI models handle domain-specific terminology, documentation rules, compliance standards, and workflow logic safely and accurately.
- Independent Execution: Work self-sufficiently using provided AI tools, detailed project instructions, and support resources.
Minimum Education and Experience Qualification Requirements
Education
- Bachelor’s/Master's Degree or PhD strongly preferred (or equivalent advanced practical domain experience).
Qualifications
- Exceptional grit, attention to detail, stamina for deep analytical work, and the ability to work independently without hands-on supervision.
- Consistent availability to dedicate 10+ hours per week.
- Depth in at least one setting or specialty: acute care and med surg, emergency, critical care, primary care and family medicine, pediatrics, obstetrics, behavioral health, geriatrics and long term care, perioperative, oncology, pharmacy.
- Working understanding of adjacent settings, enough to know what those workflows involve and how they are run, so you can assess work outside your own unit and point out what was done correctly or incorrectly.
- Reads and writes clinical documentation at a practitioner level and grounds decisions in current guidelines and the patient context rather than habit.
Experience
- Active or recent clinical license: RN, NP, PA, MD or DO, PharmD, or an allied health license with independent clinical judgment (for example respiratory therapy, physical therapy, midwifery). Licensed candidates may be asked to verify licensure.
- Hands-on practitioner: currently do (or recently did) the work yourself at an individual contributor level, not solely in a managerial capacity.
Additional Requirements
- This position involves zero direct patient care, shift work, or on-call duties.
- Must possess your own reliable laptop/computer with high-speed internet access.
Schedule / Shift
Fully remote, flexible work. Can work any hours and any days as long as candidate can commit to 10+ hours per week (ideally more).
Benefits
- Paid Sick Leave (Medix provides paid sick leave according to state and local sick leave ordinances).
- Health Benefits / Dental / Vision (Medix offers 6 different health plans: 3 Major Medical Plans, 2 Fixed Indemnity Plans (Standard and Preferred), and 1 Minimum Essential Coverage (MEC) Plan. Eligibility for health benefits is based on verifying that an average of 30 hours per week during the first 4 weeks of the work assignment has been met. If you meet eligibility requirements and take action to enroll, you will be covered no earlier than 60 days into your assignment, depending on plan selection(s)).
- 401k (Eligible on the first 401k open enrollment date following 6 consecutive months on assignment. 401k Open Enrollment dates are 1/1, 4/1, 7/1, and 10/1).
- Short Term Disability Insurance.
- Term Life Insurance Plan.
*We will consider for employment all qualified Applicants, including those with criminal histories, in a manner consistent with the requirements of applicable federal, state, and local laws, including the City of Los Angeles' Fair Chance Initiative for Hiring Ordinance (FCIHO), Los Angeles Fair Chance Ordinance for Employers (ULAC), The San Francisco Fair Chance Ordinance (FCO), and the California Fair Chance Act (CFCA).
Medix Overview:
With over 20 years of experience connecting organizations with highly qualified professionals, Medix is a leading provider of workforce solutions for clients and candidates across the healthcare, scientific, technology, and government industries. Through our core purpose of positively impacting lives, we’re dedicated to creating opportunities for job seekers at some of the nation's top companies. As an award-winning career partner, Medix is committed to helping talent find fulfilling and meaningful work because our mission is to help you achieve yours.
Any required state or Joint Commission training is compensated at the state or local minimum wage rate.
*As a job position within our Allied division, a successful completion of a background check may be required as a condition of employment. This requirement is directly related to essential job functions including but not limited to: providing direct patient care, accessing medical and confidential records, accessing and administering prescription medication or other drugs, working within a clinical setting, handling sharp instruments, conducting medical procedures, and working within departments that care for vulnerable populations, such as, minors, elderly and those with physical or mental disabilities. Due to these job duties, this position has a significant impact on the business operations and reputation, as well as the safety and well-being of individuals who may be cared for as part of the job position or who may interact with staff or clients.