Copy of Senior Python Developer (AI Evaluation & Benchmarking)

免费注册后解锁"你的匹配分 vs 高分画像"与个人技能缺口。

An enterprise client is seeking experienced Senior Python Developers to help build the next generation of Artificial Intelligence systems. This opportunity support the client who is a leading AI platform that enables organizations to build intelligent applications through high-quality human feedback, AI evaluation, and model alignment.
The selected consultants will contribute to AI research by designing programming benchmarks, evaluating AI-generated code, and helping improve the performance, reasoning, and reliability of frontier AI models. This is an excellent opportunity for experienced software engineers who enjoy solving complex technical problems while contributing to the future of Generative AI.

This opportunity is ideal for senior software engineers with strong Python expertise who enjoy writing high-quality code, reviewing technical solutions, and working on AI-related projects.
What You'll Do:
Design and develop coding benchmarks used to evaluate frontier AI models.
Analyze AI-generated code for correctness, reliability, efficiency, and edge cases.Build and maintain scalable data pipelines that support AI evaluation workflows.
Create structured programming scenarios to test reasoning, debugging, and code quality.
Work with large codebases and multi-language software environments.
Collaborate with teams focused on improving how AI models understand, generate, and evaluate software.
Write clean, maintainable, and well-tested Python code following software engineering best practices.

Requirements:
4+ years of professional software engineering experience (required).
Expert-level proficiency in Python.
Experience working at a high-growth technology company or top-tier software organization.
Proficiency in at least one additional programming language such as JavaScript, Go, C++, or similar.
Experience with CI/CD pipelines and automated testing frameworks such as pytest, Mocha, or JUnit.
Strong understanding of software engineering best practices, debugging, and code quality.
Excellent analytical and problem-solving skills.
Nice to Haves:
Experience with AI/ML evaluation, model benchmarking, or Generative AI.
Background in security engineering.
Significant contributions to open-source software projects.
Experience working with large-scale distributed systems or enterprise software platforms.

Fully remote contract opportunity.
Compensation ranges from $80–$100 USD per hour .
Expected workload is 10–39 hours per week , depending on project needs.
Weekly payments for approved work completed during the previous week.
Work volume may fluctuate throughout the duration of the engagement.
Hiring Process:
Submit your proposal.
Complete a short qualification form provided by the client.
Qualified candidates will receive an Upwork contract offer and onboarding instructions.
After accepting the contract, candidates will gain access to the client's evaluation.
Candidates who successfully pass the evaluation will be invited to a technical interview with the client.

一家企业客户正在寻找经验丰富的资深Python开发人员，帮助构建下一代人工智能系统。此机会为支持该客户，该客户是一家领先的AI平台，使组织能够通过高质量的人类反馈、AI评估和模型对齐来构建智能应用。
入选顾问将通过设计编程基准、评估AI生成的代码，并帮助提升前沿AI模型的性能、推理能力和可靠性，为AI研究做出贡献。对于喜欢解决复杂技术问题并为生成式AI的未来做出贡献的经验丰富的软件工程师来说，这是一个绝佳的机会。

此机会非常适合具有深厚Python专业知识、喜欢编写高质量代码、审查技术解决方案并从事AI相关项目的资深软件工程师。
您将做什么：
设计并开发用于评估前沿AI模型的编程基准。
分析AI生成的代码的正确性、可靠性、效率和边缘情况。构建并维护支持AI评估工作流的可扩展数据管道。
创建结构化编程场景，以测试推理、调试和代码质量。
在大型代码库和多语言软件环境中工作。
与专注于改进AI模型理解、生成和评估软件方式的团队合作。
遵循软件工程最佳实践，编写干净、可维护且经过充分测试的Python代码。

要求：
4年以上专业软件工程经验（必需）。
专家级Python熟练度。
曾在高增长科技公司或顶级软件组织工作的经验。
精通至少一种额外编程语言，如JavaScript、Go、C++或类似语言。
具有CI/CD管道和自动化测试框架（如pytest、Mocha或JUnit）的经验。
对软件工程最佳实践、调试和代码质量有深入理解。
出色的分析和解决问题的能力。
加分项：
具有AI/ML评估、模型基准测试或生成式AI经验。
具有安全工程背景。
对开源软件项目有重要贡献。
具有大型分布式系统或企业软件平台工作经验。

完全远程合同机会。
薪酬范围为每小时80–100美元。
预计工作量为每周10–39小时，具体取决于项目需求。
对上一周完成的已批准工作按周付款。
在工作期间，工作量可能会有所波动。
招聘流程：
提交您的提案。
完成客户提供的简短资格表。
合格候选人将收到Upwork合同邀请和入职说明。
接受合同后，候选人将获得客户评估的访问权限。
成功通过评估的候选人将被邀请参加客户的技术面试。

⚑ 岗位信息收录自公开招聘页（ATS 官方），以雇主官网为准