Senior Software Engineer - Machine Learning (Remote US)

Senior Software Engineer, Machine Learning

As a Senior Software Engineer, Machine Learning, you will design, build, and evolve core AI capabilities for an enterprise AI platform. You will integrate foundation models into production systems, develop reusable AI capabilities, and improve their quality, reliability, and performance. You will work with cross-functional teams to transform advances in AI into secure, scalable, production-ready capabilities.

US Citizenship or Greencard is required due to US Government contract requirements.

Responsibilities

• Design, build, and maintain core AI capabilities.
• Develop reusable capabilities for model integration, reasoning, multimodal understanding, structured generation, evaluation, and foundational AI functionality.
• Optimize AI systems through experimentation, quantitative evaluation, context engineering, and iterative refinement.
• Build backend services, APIs, and distributed AI systems.
• Deploy scalable AI services with cross-functional partners.
• Prototype emerging AI techniques and translate successful experiments into production capabilities.
• Debug production failures and improve latency, reliability, observability, and operational performance.
• Apply advances in AI engineering, foundation models, and applied machine learning.
• Optimize systems for performance, latency, reliability, scalability, and cost.
• Contribute to a collaborative engineering culture.

Required Skills and Qualifications

• Bachelor’s or Master’s degree in Computer Science, Machine Learning, or a related technical field, or equivalent practical experience.
• 5+ years of experience building production software systems.
• Strong software engineering skills with Rust, Python, or similar programming languages.
• Experience building scalable backend services, distributed systems, APIs, or data-intensive applications.
• Experience integrating large language models or other foundation models into production applications.
• Ability to design, evaluate, and improve AI systems through experimentation and quantitative evaluation.
• Familiarity with structured outputs, tool calling, context engineering, multimodal systems, or AI workflows.
• Strong understanding of testing, observability, reliability, and maintainability.
• Ability to own technically ambiguous projects from design through production.
• Excellent communication and collaboration skills.
• Growth mindset and willingness to learn, adapt, and collaborate.

Preferred Skills and Qualifications

• Experience building reusable AI capabilities or shared AI services.
• Familiarity with deploying, optimizing, or serving open-source foundation models.
• Knowledge of evaluation frameworks, benchmarks, or datasets for AI applications.
• Experience with Kubernetes, cloud-native infrastructure, or distributed systems.
• Experience developing production software in Rust.
• Familiarity with retrieval-augmented generation, multimodal AI, AI agents, or model orchestration.
• Domain expertise in complex AI systems such as multimodal reasoning, long-running inference workflows, AI agents, or model orchestration.

Equal Opportunity Statement

Legion provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to protected characteristics under applicable law.