AI Governance and Evaluation Executive

%3Cp%3E%3Cstrong%3EWHY UT SOUTHWESTERN?%3C/strong%3E%3Cbr%3EWith over 75 years of excellence in Dallas-Fort Worth, Texas, UT Southwestern is committed to excellence, innovation, teamwork, and compassion. As a world-renowned medical and research center, we strive to provide the best possible care, resources, and

benefits

for our valued employees. Ranked as the No. 1 hospital in Dallas-Fort Worth according to %3Ci%3EU.S. News %26amp; World Report%3C/i%3E, we invest in you with opportunities for career growth and development to align with your future goals. Our highly competitive

benefits

package offers healthcare, PTO and paid holidays, on-site childcare, wage, merit increases and so much more. We invite you to be a part of the UT Southwestern team where you’ll discover a culture of teamwork, professionalism, and a rewarding career!%26nbsp;%3Cbr%3E%3Cbr%3E%3Cstrong%3EJOB SUMMARY%3C/strong%3E%3Cbr%3EThe AI Governance and Evaluation Executive is the program and operations leader responsible for implementing, scaling, and continuously improving UTSW%27s enterprise approach to responsible AI governance and evaluation. Reporting to the CAIO, this role executes the governance and evaluation roadmap and adoption plan across the health system, research and academic mission, biomedical education, and administrative and business functions. *** The leader in this role converts enterprise direction into annual priorities and repeatable workflows for intake, classification, evaluation, review, vendor assessment, deployment conditions, monitoring, reassessment, and stakeholder support.

The role

maintains enterprise portfolio visibility, drives reuse and consistency, and coordinates cross-functional execution and works closely with Compliance, Information Security, and Information Technology Services on AI risk management, while those functions retain formal ownership of their respective risk-management domains.%26nbsp;%3Cbr%3E%3Cbr%3E%26nbsp;%3C/p%3E%3Cp%3E%3Cstrong%3EBENEFITS%3C/strong%3E%3Cbr%3EUT Southwestern is proud to offer a competitive and comprehensive

benefits

package to eligible employees. Our

benefits

are designed to support your overall wellbeing, and include%5C:%3C/p%3E%3Cul%3E%3Cli%3EPPO medical plan, available day one at no cost for full-time employee-only coverage%3C/li%3E%3Cli%3E100% coverage for preventive healthcare-no copay%3C/li%3E%3Cli%3EPaid Time Off, available day one%3C/li%3E%3Cli%3ERetirement Programs through the Teacher Retirement System of Texas (TRS)%3C/li%3E%3Cli%3EPaid Parental Leave Benefit%3C/li%3E%3Cli%3EWellness programs%3C/li%3E%3Cli%3ETuition Reimbursement%3C/li%3E%3Cli%3EPublic Service Loan Forgiveness (PSLF) Qualified Employer%3C/li%3E%3Cli%3E%3Ca href=%22http%5C://jobs.utsouthwestern.edu/

benefits

/#top%22 target=%22_blank%22%3ELearn more about these and other UTSW employee

benefits

!%3C/a%3E%3C/li%3E%3C/ul%3E%3Cp%3E%3Cbr%3E%3Cbr%3E%3Cstrong%3EEXPERIENCE AND EDUCATION%3C/strong%3E%3Cbr%3E%3Cbr%3E%3Cstrong%3ERequired%3C/strong%3E%3C/p%3E%3Cul%3E%3Cli%3E%3Cstrong%3EEducation%3C/strong%3E%3Cul%3E%3Cli%3EMaster%27s Degree in Public Health, Biomedical Informatics, Data Science, Computer Science, Engineering, Research Administration, or a related field.%26nbsp;%3Cbr%3E%26nbsp;%3C/li%3E%3C/ul%3E%3C/li%3E%3C/ul%3E%3Cul%3E%3Cli%3E%3Cstrong%3EExperience%3C/strong%3E%3Cul%3E%3Cli%3E8 years of progressively responsible experience in AI, digital health, healthcare operations, technology governance, clinical informatics, data analytics, research administration, compliance, or a related field.%26nbsp;%3C/li%3E%3Cli%3E4 years leading people, programs, or complex cross-functional initiatives.%26nbsp;%3C/li%3E%3Cli%3EDemonstrated experience operating cross-functional governance, evaluation, assurance, or enterprise programs.%26nbsp;%3C/li%3E%3Cli%3EDemonstrated experience implementing enterprise roadmaps, operating models, or new capabilities, and translating priorities into measurable outcomes.%26nbsp;%3Cbr%3E%26nbsp;%3C/li%3E%3C/ul%3E%3C/li%3E%3C/ul%3E%3Cp%3E%3Cstrong%3EPreferred%3C/strong%3E%3C/p%3E%3Cul%3E%3Cli%3E%3Cstrong%3EEducation%3C/strong%3E%3Cul%3E%3Cli%3EPhD or additional advanced degree in a related field.%26nbsp;%3Cbr%3E%26nbsp;%3C/li%3E%3C/ul%3E%3C/li%3E%3C/ul%3E%3Cul%3E%3Cli%3E%3Cstrong%3EExperience%3C/strong%3E%3Cul%3E%3Cli%3EExperience in an academic medical center, integrated health system, life sciences organization, or similarly complex regulated environment.%26nbsp;%3C/li%3E%3Cli%3EExperience with AI/ML evaluation, deployment, governance, responsible AI, or assurance.%26nbsp;%3C/li%3E%3Cli%3EExperience evaluating AI vendors and coordinating due diligence.%26nbsp;%3C/li%3E%3Cli%3ETechnical fluency across LLM ecosystems, MLOps, retrieval and vector technologies, AI APIs and integrations, lifecycle monitoring, and incident-response interfaces sufficient to engage technical teams and assess governance evidence.%26nbsp;%3C/li%3E%3Cli%3EExperience building or scaling a new team or function and managing tools, vendors, contracts, or external resources.%26nbsp;%3C/li%3E%3Cli%3EFamiliarity with generative AI, LLMs, multimodal models, foundation models, and agentic AI.%26nbsp;%3C/li%3E%3Cli%3EWorking knowledge of healthcare AI evaluation and lifecycle monitoring, including quantitative methods and model cards.%26nbsp;%3C/li%3E%3Cli%3EFamiliarity with NIST AI RMF, ISO/IEC 42001, and related responsible AI frameworks or standards.%26nbsp;%3Cbr%3E%26nbsp;%3C/li%3E%3C/ul%3E%3C/li%3E%3C/ul%3E%3Cp%3E%3Cbr%3E%3Cstrong%3EJOB DUTIES%3C/strong%3E%3C/p%3E%3Cul%3E%3Cli%3E%3Cstrong%3ELead Governance and Evaluation Operations and Roadmap Execution%3C/strong%3E%3Cul%3E%3Cli%3EIndependently run the day-to-day enterprise Responsible AI Governance and Evaluation program on behalf of the CAIO.%3C/li%3E%3Cli%3ETranslate program strategy into an annual operating roadmap, including priorities, dependencies, resource needs, adoption activities, and measurable program outcomes.%3C/li%3E%3Cli%3EOperationalize AI policies, standards, workflows, decision rights, review pathways, and documentation requirements.%3C/li%3E%3Cli%3ECoordinate governance across institutional and domain-specific structures including work with UTSW executives and senior leadership.%3C/li%3E%3Cli%3EPrioritize work based on institutional value, risk, dependencies, and capacity, and surface tradeoffs for decision.%3C/li%3E%3Cli%3EEnsure governance is risk-proportionate, timely, consistent, and designed to enable responsible innovation.%3C/li%3E%3Cli%3EIdentify complex, novel, or high-consequence cases requiring escalation to the CAIO or appropriate governance body.%3C/li%3E%3C/ul%3E%3C/li%3E%3Cli%3E%3Cstrong%3EManage End-to-End Governance Workflow%3C/strong%3E%3Cul%3E%3Cli%3EOperate overall intake, triage, AI risk classification, evaluation, multidisciplinary review, decision, deployment conditions, monitoring, and reassessment workflows.%3C/li%3E%3Cli%3ECoordinate enterprise governance committee agendas, case materials, decisions, action items, and follow-up.%3C/li%3E%3Cli%3EMaintain authoritative records of approvals, conditions, exceptions, reassessments, and governance precedents.%3C/li%3E%3Cli%3EDevelop expedited and standardized pathways for low-risk or well-understood AI uses.%3C/li%3E%3Cli%3ECreate and maintain reusable review patterns, templates, evidence packages, evaluation assets, and precedents that improve consistency and reduce duplicate work.%3C/li%3E%3Cli%3EProvide clear guidance, consultation, education, and stakeholder support to promote early and ongoing engagement and adoption of governance requirements.%3C/li%3E%3Cli%3ETrack service levels, bottlenecks, and outstanding governance actions and drive closure.%3C/li%3E%3C/ul%3E%3C/li%3E%3Cli%3E%3Cstrong%3EOperationalize AI Evaluation and Assurance%3C/strong%3E%3Cul%3E%3Cli%3EImplement evaluation requirements proportionate to AI risk, intended use, and deployment context.%3C/li%3E%3Cli%3ECoordinate and ensure assessment of performance, reliability, safety, bias, security considerations, and unintended consequences as applicable.%3C/li%3E%3Cli%3ECoordinate independent evaluation of consequential AI systems as appropriate.%3C/li%3E%3Cli%3ELead assessment of vendor evidence and claims and identify when supplemental local testing or independent evaluation is required.%3C/li%3E%3Cli%3EFacilitate prospective validation, simulation, and other assurance activities as warranted.%3C/li%3E%3Cli%3ETranslate evaluation findings into governance conditions, remediation actions, monitoring requirements, and escalation.%3C/li%3E%3Cli%3EConnect evaluation plans and findings to measurable outcomes where appropriate.%3C/li%3E%3C/ul%3E%3C/li%3E%3Cli%3E%3Cstrong%3ESupport Governance of Generative and Agentic AI%3C/strong%3E%3Cul%3E%3Cli%3EEnsure application of governance and evaluation practices to foundation models, LLMs, multimodal models, and agentic AI.%3C/li%3E%3Cli%3ECoordinate review of tool and data access, identity and authorization, human oversight, autonomous actions, memory, agent-to-agent interactions, observability, guardrails, testing, and fail-safe mechanisms.%3C/li%3E%3Cli%3EEnsure UTSW maintains practical governance approaches across commercial frontier models, institutionally hosted models, open-weight models, and internally developed AI.%3C/li%3E%3Cli%3EConvert emerging model and agent capabilities, research, and standards into practical review criteria, test protocols, and playbooks.%3C/li%3E%3C/ul%3E%3C/li%3E%3Cli%3E%3Cstrong%3ECoordinate AI Portfolio, Vendor and Adoption Operations%3C/strong%3E%3Cul%3E%3Cli%3EMaintain enterprise visibility of AI systems, vendors, accountable owners, intended uses, risk classifications, evaluation status, and monitoring obligations.%3C/li%3E%3Cli%3ECoordinate vendor due diligence and evidence collection with Procurement, Legal, Compliance, Information Security, IT, Data, and domain teams, supporting build-buy-partner decisions without assuming ownership of procurement or technical architecture.%3C/li%3E%3Cli%3ETrack portfolio priorities, review readiness, dependencies, decisions, and open conditions and prepare concise materials for decision forums.%3C/li%3E%3Cli%3EResponsible for continuous adoption through training, guidance, communications, and integration of governance requirements into business, research, clinical, and technology workflows.%3C/li%3E%3Cli%3EPromote common methods, reusable evidence, and standard controls to reduce duplication and improve enterprise consistency.%3C/li%3E%3C/ul%3E%3C/li%3E%3Cli%3E%3Cstrong%3EPartner on AI Risk Management%3C/strong%3E%3Cul%3E%3Cli%3EWork directly with Compliance and Information Security to identify and assess AI-related risks and to incorporate AI considerations into their established enterprise risk-management processes.%3C/li%3E%3Cli%3ELead coordination of AI governance requirements, evidence, mitigations, and escalation with the risk-owning functions and other control partners.%3C/li%3E%3Cli%3EPartner with other senior leaders to help translate risk findings into governance decisions, deployment conditions, monitoring requirements, remediation plans, and reassessment triggers.%3C/li%3E%3Cli%3EStay current on emerging AI regulatory requirements, standards, and professional guidance relevant to UTSW.%3C/li%3E%3C/ul%3E%3C/li%3E%3Cli%3E%3Cstrong%3EEnable Domain Governance%3C/strong%3E%3Cul%3E%3Cli%3EServe as a central operating leadership partner to domain leaders and governance groups.%3C/li%3E%3Cli%3EEngage stakeholders early so governance and evaluation requirements are built into planning, procurement, research, development, implementation, and operations.%3C/li%3E%3Cli%3EHealth System%5C: clinical and operational AI, patient-facing tools, predictive models, generative AI, ambient AI, and autonomous workflows.%3C/li%3E%3Cli%3EResearch %26amp; Academic%5C: basic, translational, and clinical research AI, research data, scientific AI, external models, AI-enabled experimentation, and biomedical education.%3C/li%3E%3Cli%3EAdministrative/Business%5C: workforce productivity, finance, HR, revenue cycle, procurement, communications, operations, and automation.%3C/li%3E%3C/ul%3E%3C/li%3E%3Cli%3E%3Cstrong%3EBuild and Lead the Governance Team%3C/strong%3E%3Cul%3E%3Cli%3ELead and oversee UTSW AI Governance Stewards and other governance staff supporting enterprise and domain workflows; define roles, structure, decision rights, and ways of working.%3C/li%3E%3Cli%3EDevelop practical expertise in AI governance, evaluation operations, assurance, and responsible AI.%3C/li%3E%3Cli%3EBuild strong working relationships with institutional partners.%3C/li%3E%3Cli%3ECreate reusable playbooks, templates, review criteria, and operating procedures.%3C/li%3E%3Cli%3EResponsible for overall management of assigned budgets, governance and evaluation tooling, contracts, and external resources within approved plans.%3C/li%3E%3C/ul%3E%3C/li%3E%3Cli%3E%3Cstrong%3EMeasure Program Performance%3C/strong%3E%3Cul%3E%3Cli%3EMaintain a balanced program scorecard including governance cycle time; enterprise portfolio coverage; adoption of standard pathways; reuse of evaluation assets; use-case volume and risk distribution; evaluation and vendor-review completion; backlog and dependency status; closure of conditions and mitigations; monitoring findings; incidents and near misses; measurable outcomes; and stakeholder experience.%3C/li%3E%3Cli%3EUse relevant data to improve throughput, consistency, adoption, and institutional confidence.%3C/li%3E%3C/ul%3E%3C/li%3E%3Cli%3E%3Cstrong%3ELeadership and Decision Support%3C/strong%3E%3Cul%3E%3Cli%3EAdvise the CAIO on governance operations, evaluation findings, emerging issues, and institutional AI governance maturity.%3C/li%3E%3Cli%3ERepresent the Office of the CAIO in designated governance forums and working groups.%3C/li%3E%3Cli%3EFacilitate multidisciplinary and/or complete organizational decisions and resolve operational barriers to responsible deployment.%3C/li%3E%3Cli%3EEscalate significant or unresolved governance concerns and risk findings to the CAIO and applicable risk-owning functions.%3C/li%3E%3Cli%3ERecommend additional evaluation, mitigation, monitoring, conditions, or reassessment when warranted.%3C/li%3E%3Cli%3EPrepare executive-level reporting on priorities, performance, dependencies, unresolved issues, resource needs, and decisions required.%3C/li%3E%3Cli%3EExplain complex AI, governance, and evaluation concepts clearly to technical and nontechnical audiences.%3C/li%3E%3C/ul%3E%3C/li%3E%3C/ul%3E%3Cp style=%22font-size%5C:9pt;margin-bottom%5C:0pt;margin-top%5C:0pt;%22%3E%3Cspan style=%22font-family%5C:Verdana;%22%3E%26nbsp;%3C/span%3E%3C/p%3E%3Cp style=%22font-size%5C:9pt;margin-bottom%5C:0pt;margin-top%5C:0pt;%22%3E%3Cspan style=%22font-family%5C:Verdana;%22%3E%3Cstrong%3EKnowledge, Skills and Abilities%3C/strong%3E%3C/span%3E%3C/p%3E%3Cul%3E%3Cli%3EAbility to translate enterprise direction into priorities, tradeoffs, repeatable workflows, and measurable program performance.%3C/li%3E%3Cli%3EAbility to move work across matrixed organizations without relying on command-and-control authority.%3C/li%3E%3Cli%3EAbility to work comfortably with AI scientists, engineers, clinicians, researchers, and vendors.%3C/li%3E%3Cli%3EUnderstands when deeper evaluation or stronger controls are warranted.%3C/li%3E%3Cli%3EAbility to treat governance stakeholders as partners and designs for timely, usable experiences.%3C/li%3E%3Cli%3EAbility to evolve governance as models, agents, regulations, and institutional use cases change.%3C/li%3E%3Cli%3EStrong project and program management and organizational leadership skills.%3C/li%3E%3Cli%3EAbility to translate complex technical, clinical, regulatory, and ethical issues into practical workflows and decisions.%3C/li%3E%3Cli%3EExcellent communication, facilitation, negotiation, and stakeholder-management skills.%3C/li%3E%3C/ul%3E%3Cp style=%22font-size%5C:9pt;margin-bottom%5C:0pt;margin-top%5C:0pt;%22%3E%3Cspan style=%22font-family%5C:Verdana;%22%3E%26nbsp;%3C/span%3E%3C/p%3E%3Cp style=%22font-size%5C:9pt;margin-bottom%5C:0pt;margin-top%5C:0pt;%22%3E%3Cspan style=%22font-family%5C:Verdana;%22%3E%3Cstrong%3EPHYSICAL REQUIREMENTS/WORKING CONDITIONS%3C/strong%3E%3C/span%3E%3C/p%3E%3Cp style=%22font-size%5C:9pt;margin-bottom%5C:0pt;margin-top%5C:0pt;%22%3E%3Cspan style=%22font-family%5C:Verdana;%22%3E%26nbsp;%3C/span%3E%3C/p%3E%3Cp style=%22font-size%5C:9pt;margin-bottom%5C:0pt;margin-top%5C:0pt;%22%3E%3Cspan style=%22font-family%5C:Verdana;%22%3E%3Cstrong%3EPhysical Requirements%3C/strong%3E%3C/span%3E%3C/p%3E%3Cul%3E%3Cli%3ETalking%3C/li%3E%3C/ul%3E%3Cp style=%22font-size%5C:9pt;margin-bottom%5C:0pt;margin-top%5C:0pt;%22%3E%3Cspan style=%22font-family%5C:Verdana;%22%3E%26nbsp;%3C/span%3E%3C/p%3E%3Cp style=%22font-size%5C:9pt;margin-bottom%5C:0pt;margin-top%5C:0pt;%22%3E%3Cspan style=%22font-family%5C:Verdana;%22%3E%3Cstrong%3EWorking Conditions%3C/strong%3E%3C/span%3E%3C/p%3E%3Cul%3E%3Cli%3EOffice Setting%3C/li%3E%3C/ul%3E%3Cp style=%22font-size%5C:9pt;margin-bottom%5C:0pt;margin-top%5C:0pt;%22%3E%3Cspan style=%22font-family%5C:Verdana;%22%3E%26nbsp;%3C/span%3E%3C/p%3E%3Cp%3E%3Cstrong%3ESalary Information%3C/strong%3E%3Cbr%3ESalary is commensurate with education, skills, and relevant experience.%3Cbr%3E%3Cbr%3E%3Cstrong%3ESECURITY AND EEO STATEMENT%3C/strong%3E%3Cbr%3E%3Cbr%3E%3Cstrong%3ESecurity%3C/strong%3E%3Cbr%3EThis position is security-sensitive and subject to Texas Education Code 51.215, which authorizes UT Southwestern to obtain criminal history record information. To the extent this position requires the holder to research, work on, or have access to critical infrastructure as defined in Section 117.001(2) of the Texas Business and Commerce Code, the ability to maintain the security or integrity of the critical infrastructure is a minimum qualification to be hired and to continue to be employed in the position.%3Cbr%3E%3Cbr%3E%3Cstrong%3EEEO%3C/strong%3E%3Cbr%3EUT Southwestern Medical Center is committed to an educational and working environment that provides equal opportunity to all members of the University community. As an equal opportunity employer, UT Southwestern prohibits unlawful discrimination, including discrimination on the basis of race, color, religion, national origin, sex, sexual orientation, gender identity, gender expression, age, disability, genetic information, citizenship status, or veteran status.%3Cbr%3E%26nbsp;%3C/p%3E