Principal Core Infrastructure Engineer

Job Description
As a Principal Core Infrastructure Engineer (AI/ML Forward Deployed Infrastructure Engineer), you will play a critical role in designing, implementing, and maintaining the infrastructure that supports our customers AI and machine learning initiatives. You will work closely with customer technical teams (data scientists, software engineers, and Infra/IT professionals) and internal cloud services team to ensure their AI/ML solutions are deployed efficiently, securely, and at scale. Your expertise will be crucial in optimizing our infrastructure for performance, reliability, and cost-effectiveness. In this hands‐on technical role you'll troubleshoot issues for proof of concept (POC) and production deployments. ResponsibilitiesLead the design and architecture of AI/ML infrastructure, considering performance, scalability, and security. Implement and maintain AI/ML infrastructure, ensuring efficient and reliable operations. Collaborate with customer technical teams to understand their AI/ML requirements and provide tailored solutions. Work closely with our cloud services team to integrate AI/ML solutions into our cloud platform. Ensure the secure deployment of AI/ML models and data, adhering to industry best practices. Monitor and optimize AI/ML infrastructure performance, identifying and resolving bottlenecks. Provide technical guidance and mentorship to junior engineers, fostering a culture of knowledge sharing. Stay updated with the latest AI/ML technologies and trends, driving innovation within the team. Document and communicate infrastructure designs, ensuring clear and concise documentation. Engage with customers and stakeholders to gather feedback and ensure their satisfaction with our AI/ML offerings. QualificationsExperience in scripting and automation using tools like Ansible, Terraform, Python and/or Kubernetes. Experience with containerization technologies (e.g., Docker, Kubernetes) and orchestration tools (like Slurm, PBS, etc.) for managing distributed systems. Solid understanding of networking concepts, security principles, and best practices. Excellent problem-solving skills, with the ability to troubleshoot complex issues and drive resolution in a fast-paced environment. Strong communication and collaboration skills, with the ability to work effectively in cross-functional teams and convey technical concepts to non-technical stakeholders. Strong documentation skills with experience documenting infrastructure designs, configurations, procedures, and troubleshooting steps to facilitate knowledge sharing, ensure maintainability, and enhance team collaboration. Strong Linux skills with hands‐on experience in Oracle Linux/RHEL/CentOS, Ubuntu, and Debian distributions, including system administration, package management, shell scripting, and performance optimization. Preferred QualificationsStrong proficiency in at least one of the programming languages such as Python, Rust, Go, Java, or ScalaProven experience designing, implementing, and managing infrastructure for AI/ML or HPC workloads. Understanding machine learning frameworks and libraries such as TensorFlow, PyTorch, or sci-kit-learn and their deployment in production environments is a plus. Familiarity with DevOps practices and tools for continuous integration, deployment, and monitoring (e.g., Jenkins, GitLab CI/CD, Prometheus).
Strong experience with High-Performance Computing/GPU systemsADDITIONAL INFORMATIONCore ResponsibilitiesYou should also have a demonstrated ability to think strategically about business, products, and technical challenges. Strategic Thought LeadershipYou should also have a demonstrated ability to think strategically about business, products, and technical challenges. Business ExperienceUnderstand the challenges in working with large customers. Planning & ExecutionManages and coordinates moderately complex tasks, monitoring timelines and deliverables to ensure timely completion and adherence to requirements for a moderately sized project or initiative. Efficiently delegates, monitors, and prioritizes work across multiple projects, providing technical oversight and adjusting plans to address shifts in resources or timelines. Collaboration & PartnershipCollaborates across the organization to align on expectations and achieve shared objectives. Leverages understanding of business leaders, stakeholders, and/or customers to ensure proposed solutions meet their needs. Supports inclusivity by actively seeking and listening to diverse perspectives, ensuring others feel heard and respected. Problem SolvingIdentifies and addresses moderately complex issues by analyzing a wide range of data and/or information to identify solutions in accordance with standard practices. Proactively escalates unresolved or critical issues with a thorough assessment and suggests potential solutions. Reviews, contributes to, and documents problem solving strategies. Continuous LearningPursues learning opportuniti