AI Governance & Evaluation Analyst

%3Cb%3EWHY UT SOUTHWESTERN?%3C/b%3E%3Cbr%3E%0AWith over 75 years of excellence in Dallas-Fort Worth, Texas, UT Southwestern is committed to excellence, innovation, teamwork, and compassion. As a world-renowned medical and research center, we strive to provide the best possible care, resources, and

benefits

for our valued employees. Ranked as the No. 1 hospital in Dallas-Fort Worth according to %3Ci%3EU.S. News %26 World Report%3C/i%3E, we invest in you with opportunities for career growth and development to align with your future goals. Our highly competitive

benefits

package offers healthcare, PTO and paid holidays, on-site childcare, wage, merit increases and so much more. We invite you to be a part of the UT Southwestern team where you’ll discover a culture of teamwork, professionalism, and a rewarding career!%0A%3Cbr%3E%3Cbr%3E%3Cb%3EJOB SUMMARY%3C/b%3E%3Cbr%3E%0AThe responsible Artificial Intelligence (AI) Governance %26 Evaluation Analyst supports UT Southwestern%27s AI governance program by managing the review, evaluation, and monitoring of AI use cases across healthcare, research, education, and administrative functions.

The role

works closely with project teams, subject matter experts, governance committees, and institutional partners to ensure AI systems are reviewed, documented, monitored, and deployed responsibly. %3Cbr%3E%3Cbr%3E%3Cp%3E%3Cb%3EBENEFITS%3C/b%3E%3Cbr%3E%0AUT Southwestern is proud to offer a competitive and comprehensive

benefits

package to eligible employees. Our

benefits

are designed to support your overall wellbeing, and include%5C:%3C/p%3E%0A%3Cul%3E%0A %3Cli%3EPPO medical plan, available day one at no cost for full-time employee-only coverage%3C/li%3E%0A %3Cli%3E100% coverage for preventive healthcare-no copay%3C/li%3E%0A %3Cli%3EPaid Time Off, available day one%3C/li%3E%0A %3Cli%3ERetirement Programs through the Teacher Retirement System of Texas (TRS)%3C/li%3E%0A %3Cli%3EPaid Parental Leave Benefit%3C/li%3E%0A %3Cli%3EWellness programs%3C/li%3E%0A %3Cli%3ETuition Reimbursement%3C/li%3E%0A %3Cli%3EPublic Service Loan Forgiveness (PSLF) Qualified Employer%3C/li%3E%0A %3Cli%3E%3Ca href=%22http%5C://jobs.utsouthwestern.edu/

benefits

/#top%22 target=%22_blank%22%3ELearn more about these and other UTSW employee

benefits

!%3C/a%3E%0A %3C/li%3E%0A%3C/ul%3E%3Cbr%3E%3Cbr%3E%3Cb%3E%3Cb%3EEXPERIENCE AND EDUCATION%3C/b%3E%3C/b%3E%3Cbr%3E%0A%3Cbr%3E%3Cb%3ERequired%3C/b%3E%3Cul%3E%3Cb%3E%3Cli%3EEducation%3C/b%3E%3Cbr%3EMaster%27s Degree in Public Health, Biomedical Informatics, Data Science, Computer Science, Engineering, Research Administration, or a related field. %3Cbr%3E%3C/ul%3E%3Cul%3E%3Cb%3E%3Cli%3EExperience%3C/b%3E%3Cbr%3E5 years of professional experience in AI/ML, healthcare operations, clinical informatics, research administration, data analytics, technology governance, compliance, quality, program management, or a related area. %3Cbr%3E%0A Experience coordinating complex projects, reviews, or governance processes involving multiple stakeholders. %3Cbr%3E%3C/ul%3E%3Cb%3EPreferred%3C/b%3E%3Cul%3E%3Cb%3E%3Cli%3EEducation%3C/b%3E%3Cbr%3EPhD or other advanced degree in a related field. %3Cbr%3E%3C/ul%3E%3Cul%3E%3Cb%3E%3Cli%3EExperience%3C/b%3E%3Cbr%3E Experience in healthcare, academic medicine, research, life sciences, or other regulated environments. %3Cbr%3E%0A Experience with AI governance, AI evaluation, validation, assurance, vendor review, digital health, or lifecycle monitoring. %3Cbr%3E%0A Familiarity with responsible AI frameworks and standards such as NIST AI RMF and ISO 42001 preferred. %3Cbr%3E%3C/ul%3E%3Cbr%3E%3Cb%3E%3Cb%3EJOB DUTIES%3C/b%3E%3C/b%3E%3Cul%3E %3Cli%3EAI Governance %26amp; Case Management%0A%3Cul%3E%0A%3Cli%3EManage intake, triage, tracking, and documentation of AI use cases.%3C/li%3E%0A%3Cli%3EGuide teams through governance requirements and review processes.%3C/li%3E%0A%3Cli%3ECoordinate reviews, approvals, monitoring activities, and reassessments.%3C/li%3E%0A%3Cli%3EMaintain accurate, complete, and audit-ready records.%3C/li%3E%0A%3Cli%3EEscalate high-risk or complex issues when appropriate.%3C/li%3E%0A%3C/ul%3E %3C/li%3E%0A%3Cli%3EAI Evaluation %26amp; Assurance%0A%3Cul%3E%0A%3Cli%3ECoordinate AI evaluations using approved standards and methodologies.%3C/li%3E%0A%3Cli%3ECollect and organize evidence related to performance, safety, fairness, privacy, security, and reliability.%3C/li%3E%0A%3Cli%3ESupport validation, testing, monitoring, and assurance activities.%3C/li%3E%0A%3Cli%3EDocument findings, mitigation plans, and monitoring requirements.%3C/li%3E%0A%3Cli%3ETrack post-deployment performance and report significant issues.%3C/li%3E%0A%3C/ul%3E %3C/li%3E%0A%3Cli%3EGovernance Committee Support%0A%3Cul%3E%0A%3Cli%3EPrepare agendas, case summaries, and review materials.%3C/li%3E%0A%3Cli%3ECoordinate meetings, reviewers, and subject matter experts.%3C/li%3E%0A%3Cli%3EDocument decisions, action items, and follow-up activities.%3C/li%3E%0A%3Cli%3ECommunicate outcomes and track completion of required actions.%3C/li%3E%0A%3C/ul%3E %3C/li%3E%0A%3Cli%3EPortfolio %26amp; Vendor Oversight%0A%3Cul%3E%0A%3Cli%3EMaintain records of AI systems, vendors, approvals, risk classifications, and monitoring requirements.%3C/li%3E%0A%3Cli%3ECoordinate AI-related vendor due diligence with relevant departments.%3C/li%3E%0A%3Cli%3EMonitor changes to AI systems and ensure reassessment when necessary.%3C/li%3E%0A%3Cli%3EMaintain templates, evidence repositories, and governance documentation.%3C/li%3E%0A%3C/ul%3E %3C/li%3E%0A%3Cli%3EGenerative %26amp; Agentic AI Governance%0A%3Cul%3E%0A%3Cli%3ESupport governance activities for large language models, foundation models, multimodal AI, and agentic AI systems.%3C/li%3E%0A%3Cli%3EReview information related to model performance, oversight, access controls, guardrails, and testing.%3C/li%3E%0A%3Cli%3ETrack model changes and document limitations and monitoring requirements.%3C/li%3E%0A%3C/ul%3E %3C/li%3E%0A%3Cli%3EPartnership %26amp; Stakeholder Support%0A%3Cul%3E%0A%3Cli%3EServe as a primary point of contact for assigned AI initiatives.%3C/li%3E%0A%3Cli%3EWork collaboratively with clinical, research, technical, compliance, legal, privacy, and operational teams.%3C/li%3E%0A%3Cli%3EProvide guidance, training, consultations, and office-hour support.%3C/li%3E%0A%3Cli%3EPromote consistent governance practices across the organization.%3C/li%3E%0A%3C/ul%3E %3C/li%3E%0A%3Cli%3EReporting %26amp; Continuous Improvement%0A%3Cul%3E%0A%3Cli%3EMonitor governance metrics, workload, review timelines, and stakeholder experience.%3C/li%3E%0A%3Cli%3EPrepare dashboards, reports, and presentations for leadership.%3C/li%3E%0A%3Cli%3EIdentify process improvements and support development of procedures, templates, and training materials.%3C/li%3E%0A%3Cli%3EStay informed on emerging AI technologies, regulations, and industry standards.%3C/li%3E%0A%3C/ul%3E %3C/li%3E %0A%3C/ul%3E%3Cp style=%22margin-top%5C:0pt; margin-bottom%5C:0pt; font-size%5C:9pt%22%3E%3Cspan style=%22font-family%5C:Verdana%22%3E%26#xa0;%3C/span%3E%3C/p%3E%0A%3Cp style=%22margin-top%5C:0pt; margin-bottom%5C:0pt; font-size%5C:9pt%22%3E%3Cspan style=%22font-family%5C:Verdana; font-weight%5C:bold%22%3EKnowledge, Skills and Abilities%3C/span%3E%3C/p%3E%0A%3Cul%3E%0A%3Cli%3EStrong organizational, project coordination, and documentation skills.%3C/li%3E%0A%3Cli%3EAbility to communicate complex technical and regulatory information clearly.%3C/li%3E%0A%3Cli%3EStrong relationship-building, facilitation, and customer service skills.%3C/li%3E%0A%3Cli%3EAbility to manage multiple priorities and deadlines.%3C/li%3E%0A%3Cli%3EWorking knowledge of AI technologies, including machine learning and generative AI.%3C/li%3E%0A%3Cli%3EAbility to handle confidential information with discretion.%3C/li%3E%3C/ul%3E%3Cp style=%22margin-top%5C:0pt; margin-bottom%5C:0pt; font-size%5C:9pt%22%3E%3Cspan style=%22font-family%5C:Verdana%22%3E%26#xa0;%3C/span%3E%3C/p%3E%0A%3Cb%3ESalary Information%3C/b%3E%3Cbr%3E%0A%0ASalary is commensurate with education, skills, and relevant experience.%3Cbr%3E%3Cbr%3E%0A%3Cb%3E%3Cb%3ESECURITY AND EEO STATEMENT%3C/b%3E%3C/b%3E%3Cbr%3E%3Cbr%3E%3Cb%3ESecurity%3C/b%3E%3Cbr%3EThis position is security-sensitive and subject to Texas Education Code 51.215, which authorizes UT Southwestern to obtain criminal history record information.%3Cbr%3E%3Cbr%3E%3Cb%3EEEO%3C/b%3E%3Cbr%3E%0AUT Southwestern Medical Center is committed to an educational and working environment that provides equal opportunity to all members of the University community. As an equal opportunity employer, UT Southwestern prohibits unlawful discrimination, including discrimination on the basis of race, color, religion, national origin, sex, sexual orientation, gender identity, gender expression, age, disability, genetic information, citizenship status, or veteran status.%3C/br%3E