Software Development Test Engineer (SDET), AI & Automation

免费注册后解锁"你的匹配分 vs 高分画像"与个人技能缺口。

Description Keeper Security is hiring a Senior Software Development Engineer in Test (SDET), AI Automation to join our AI team and help build a modern, automated approach to quality across AI-powered products and services. This is a 100% remote position, with an opportunity to work a hybrid schedule for candidates based in the El Dorado Hills, CA or Chicago, IL metro areas. Keeper’s cybersecurity software is trusted by millions of people and thousands of organizations globally. Keeper is published in 23 languages and sold in over 150 countries. Join one of the fastest-growing cybersecurity companies and help establish scalable quality engineering practices for AI-driven systems operating in security-sensitive environments. About Keeper Keeper Security is one of the fastest-growing cybersecurity software companies that protects thousands of organizations and millions of people in over 150 countries. Keeper is a pioneer of zero-knowledge and zero-trust security built for any IT environment. Its core offering, KeeperPAM®, is an AI-enabled, cloud-native platform that protects all users, devices and infrastructure from cyber attacks. Recognized for its innovation in the Gartner Magic Quadrant for Privileged Access Management (PAM), Keeper secures passwords and passkeys, infrastructure secrets, remote connections and endpoints with role-based enforcement policies, least privilege and just-in-time access. Learn why Keeper is trusted by leading organizations to defend against modern adversaries at KeeperSecurity.com. About the Job As a Senior SDET, AI Automation, you will serve as an embedded quality engineering partner within Keeper’s AI team. You will work alongside engineers and Product throughout design and development to define test strategy, establish acceptance criteria and build automated coverage as AI-powered capabilities are being developed. This role requires experience testing both traditional deterministic software systems and non-deterministic AI/ML systems. Traditional application behavior can often be validated against consistent expected outputs, while AI models may produce different but acceptable results across models, prompts and inputs. You will help design testing approaches that account for this variability while still establishing measurable quality, reliability and safety standards. You will build automation frameworks, develop deterministic and probabilistic validation strategies, integrate testing into CI/CD workflows and help Keeper move toward continuous quality engineering rather than end-of-cycle QA. Responsibilities Partner directly with AI engineers, Software Engineers and Product Managers during design and development to define test strategy, acceptance criteria and automation requirements Design and maintain automated testing frameworks for AI-powered applications, backend services, APIs and supporting software systems Develop testing strategies for both deterministic software behavior and non-deterministic AI/ML outputs Define measurable evaluation criteria, tolerances and quality thresholds for AI model and LLM-driven functionality Build automated regression, integration, API and end-to-end coverage alongside feature development Develop test harnesses and evaluation workflows for prompts, models, agents, tool-calling workflows and AI-integrated applications Validate AI behavior across different models, prompts, inputs and system configurations Develop automated test utilities using languages such as Python, Java, JavaScript/TypeScript, Rust or similar technologies Integrate automated validation and quality gates into CI/CD pipelines using GitHub Actions, Jenkins, GitLab CI or similar platforms Build and maintain test datasets, mocks, fixtures and synthetic data required for repeatable AI and software validation Analyze model and application failures to distinguish defects, expected model variability, data issues and test instability Evaluate AI outputs for reliability, consistency, safety and alig

职位描述：Keeper Security 正在招聘一名高级软件开发测试工程师（SDET），AI 自动化方向，加入我们的 AI 团队，帮助为 AI 驱动的产品和服务构建现代化的自动化质量保障方法。这是一个 100% 远程职位，对于位于加州 El Dorado Hills 或伊利诺伊州芝加哥都会区的候选人，有机会采用混合办公模式。Keeper 的网络安全软件受到全球数百万用户和数千家组织的信赖。Keeper 已发布 23 种语言版本，并在 150 多个国家销售。加入一家增长最快的网络安全公司之一，帮助为在安全敏感环境中运行的 AI 驱动系统建立可扩展的质量工程实践。关于 Keeper Keeper Security 是增长最快的网络安全软件公司之一，保护着 150 多个国家的数千家组织和数百万用户。Keeper 是面向任何 IT 环境构建的零知识和零信任安全领域的先驱。其核心产品 KeeperPAM® 是一个支持 AI 的云原生平台，可保护所有用户、设备和基础设施免受网络攻击。Keeper 因其在 Gartner 特权访问管理（PAM）魔力象限中的创新而受到认可，通过基于角色的执行策略、最小权限和即时访问来保护密码和通行密钥、基础设施机密、远程连接和端点。了解为什么领先组织信任 Keeper 来防御现代对手，请访问 KeeperSecurity.com。关于该职位 作为高级 SDET，AI 自动化方向，你将在 Keeper 的 AI 团队中担任嵌入式质量工程合作伙伴。你将在设计和开发过程中与工程师和产品团队并肩工作，在 AI 驱动能力开发过程中定义测试策略、建立验收标准并构建自动化覆盖。该职位要求具备测试传统确定性软件系统和非确定性 AI/ML 系统的经验。传统应用行为通常可以对照一致的预期输出进行验证，而 AI 模型在不同模型、提示和输入下可能会产生不同但可接受的结果。你将帮助设计测试方法，以考虑这种可变性，同时仍建立可衡量的质量、可靠性和安全标准。你将构建自动化框架，开发确定性和概率性验证策略，将测试集成到 CI/CD 工作流中，并帮助 Keeper 迈向持续质量工程，而不是周期末 QA。职责 在设计和开发过程中直接与 AI 工程师、软件工程师和产品经理合作，定义测试策略、验收标准和自动化需求 为 AI 驱动的应用、后端服务、API 和支持性软件系统设计并维护自动化测试框架 为确定性软件行为和非确定性 AI/ML 输出制定测试策略 为 AI 模型和 LLM 驱动功能定义可衡量的评估标准、容差和质量阈值 在功能开发过程中同步构建自动化回归、集成、API 和端到端覆盖 为提示、模型、代理、工具调用工作流和 AI 集成应用开发测试工具和评估工作流 跨不同模型、提示、输入和系统配置验证 AI 行为 使用 Python、Java、JavaScript/TypeScript、Rust 或类似技术开发自动化测试工具 使用 GitHub Actions、Jenkins、GitLab CI 或类似平台将自动化验证和质量门禁集成到 CI/CD 流水线中 构建并维护可重复 AI 和软件验证所需的测试数据集、模拟对象、测试夹具和合成数据 分析模型和应用故障，以区分缺陷、预期模型可变性、数据问题和测试不稳定性 评估 AI 输出的可靠性、一致性、安全性和对齐

⚑ 岗位信息收录自公开招聘页（Himalayas），以雇主官网为准