Platform Engineer

Required Skills & Experience

• Strong communication skills with ability to lead across time zones and coordinate with onshore teams
• Expert-level experience with AWS services: EC2, S3, IAM, VPC, Glue, Athena, EMR, Secrets Manager, CloudWatch
• Strong experience with infrastructure-as-code (Terraform preferred, CloudFormation acceptable)
• Experience with production monitoring, alerting, and incident response at scale
• Experience with cost monitoring and optimization in AWS environments
• Experience with containerization (Docker) and CI/CD pipelines (GitLab CI preferred)
• Proficiency with Linux-based operating systems and shell scripting
• Experience managing and mentoring engineering teams
• Demonstrated ability to make independent technical decisions and triage production issues without escalation
• Understanding of data pipeline architectures (batch and streaming) and common failure modes

Nice to Have Skills & Experience

• Experience with Apache Spark (Scala preferred) for distributed data processing
• Experience with Apache Kafka or similar streaming platforms
• Experience with Airflow or similar workflow orchestration platforms
• Experience with graph databases (AWS Neptune, Neo4j)
• Familiarity with AI/ML infrastructure requirements (model serving, token cost monitoring, artifact management)
• Experience in the telecommunications industry or other large-scale network operations environments
• Experience with LLM/agent deployment infrastructure and observability
• AWS certifications (Solutions Architect, DevOps Engineer, or similar)

Job Description

An Insight Global client’s Infrastructure Intelligence and Analytics (IIA) team builds and operates a data platform and AI agent infrastructure that powers proactive network monitoring and autonomous investigation capabilities. The Platform Engineer VI serves as the offshore lead for platform engineering, responsible for production support during offshore hours, data pipeline health, cost optimization, and building and leading the offshore platform engineering team. This role requires the seniority to make independent architectural and operational decisions without escalating to onshore leadership during their shift.

Production Support and Operations

• Own production support during offshore hours. Serve as first responder for infrastructure incidents, pipeline failures, and agent downtime.
• Monitor data pipelines feeding agents and anomaly detection models. Ensure upstream data is landing on time and in expected format.
• Triage and resolve production issues independently. Escalate to onshore only for decisions requiring architectural changes or cross-team coordination.
• Maintain and improve monitoring dashboards for pipeline health, agent availability, and data freshness.

Cost and Resource Optimization

• Build and maintain cost dashboards covering AWS infrastructure spend, AI compute/token costs, and third-party service costs.
• Monitor token consumption across deployed agents. Identify cost anomalies and recommend optimization strategies.
• Optimize resource utilization across compute, storage, and networking. Right-size infrastructure based on usage patterns.
• Support pilot cost modeling: measure cost per user, project total cost at scale, and provide data for expansion decisions.

Data Availability and Pipeline Health

• Ensure agents are getting the data they need. Monitor data availability, freshness, and quality for all sources feeding the IIA Data Lake.
• Handle upstream data availability issues: identify when sources stop landing, coordinate with upstream data owners for resolution.
• Support data pipeline backfills and recovery when issues are detected.
• Coordinate with data engineering team on pipeline health checks and SLA monitoring.

Leadership

• Lead and grow the offshore platform engineering team. Mentor junior engineers and establish operational standards.
• Define and enforce runbooks, escalation procedures, and operational best practices for the offshore team to follow during production support.
• Coordinate across time zones with onshore platform engineers, data engineers, and data scientists to ensure smooth handoffs.
• Participate in architectural decisions and provide input on infrastructure design based on operational experience.
• Perform other duties as required.

This is a fully remote position and will pay between 30-40 LPA