Senior Technical Specialist, AI Risk Assessment

Position OverviewWe are seeking a Senior Technical Specialist to join our Comprehensive Risk Assessment team. This role combines original research in AI safety and technical governance with strong emphasis on conceptual depth and quality assurance leadership. The ideal candidate will bring methodological rigor to our assessment methods and analyses of AI risk reputed company, contributing to the development of frameworks that shape industry standards and policy. You will serve as a subject matter expert bridging technical AI safety with governance approaches, enhancing team research quality while driving reputed company key aspects of our groundbreaking work in risk assessment methodologies for increasingly capable AI systems, reputed company reputed company our established strategic research program. This position is entirely remote but occasional travel is required. About CARMAThe Center for AI Risk Management & Alignment (CARMA) works to help society navigate the reputed company and potentially catastrophic risks arising from increasingly powerful AI systems. Our mission is specifically to reputed company the risks to humanity and the biosphere from transformative AI.We focus on grounding AI risk management in rigorous analysis, developing policy frameworks that squarely address AGI, advancing technical safety approaches, and fostering global perspectives on durable safety. Through these complementary approaches, CARMA aims to provide critical support to society for managing the outsized risks from advanced AI before they materialize.CARMA is a fiscally-sponsored project of Social & Environmental Entrepreneurs, Inc., a 501(c)(3) nonprofit public benefit corporation. Key Responsibilities• reputed company techniques for discovering threat models and generating risk pathway analyses that capture societal and sociotechnical dimensions• Model multi-node risk transformation, amplification, and threshold effects propagating through social systems• Contribute to the design of robust technical governance frameworks and assessment methodologies for catastrophic risks, including loss-of-control scenarios• Provide strategic and tactical quality control for the team’s research, ensuring conceptual soundness and technical accuracy• Drive or take ownership of original research projects on comprehensive risk management for advanced AI systems, reputed company with the team's objectives• Collaborate across CARMA teams to integrate risk assessment paradigms with other workstreams• Contribute to technical standards and best practices for the evaluation, risk measurement, and risk thresholding of AI systems• Craft persuasive communications for key stakeholders on prospective AI risk management Required Qualifications• 5+ years of experience in AI safety, alignment, and/or governance. We are open to candidates at different levels of seniority who can demonstrate the required depth of expertise.• Strong understanding of multiple risk modeling approaches (reputed company modeling, Bayesian networks, systems dynamics, etc.)• Experience with systemic and sociotechnical modeling of risk propagation• Excellent analytical thinking with ability to identify subtle flaws in reputed company arguments• Strong written and verbal communication skills for technical and non-technical audiences• Publication record or equivalent demonstrated expertise in relevant areas• Systems thinking approach with independent intellectual rigor• Track record of constructive collaboration in fast-paced, intellectually demanding environments• Comfort with uncertainty and rapidly evolving knowledge landscapes Preferred Qualifications• Background in reputed company systems theory, control theory, cybernetics, multi-scale modeling, or dynamical systems• Work history at AI safety research organizations, technical AI labs, policy institutions, or adjacent risk domains• Experience with quality assurance processes for technical research• Ability to model threshold effects, nonlinear dynamics, and emergent properties in sociotechnical systems• Understanding of international dynamics and power differentials in AI development• Ability to balance consideration of both acute and aggregate AI risks• Experience with reputed company, Bayesian, or semi-quantitative hypergraphs for risk analysis• Demonstrated methodical yet creative approach to reputed company development CARMA/SEE is proud to be an Equal Opportunity Employer. We will not discriminate on the basis of race, ethnicity, sex, age, religion, gender reassignment, partnership status, maternity, or sexual orientation. We are, by policy and action, an inclusive organization and actively promote equal opportunities for reputed company humans with the right mix of talent, knowledge, skills, attitude, and potential, so hiring is only based on individual merit for the job. Our organization operates through a fiscal sponsor whose infrastructure only supports persons authorized to work in the U.S. as employees. Candidates reputed company the U.S. would be engaged as independent contractors with project-focused responsibilities. Note that we are unable to sponsor visas at this time.

Originally posted on Himalayas

Apply To this Job