Data Engineer IV

Duties

WHAT YOU'LL DO

You will be a crucial contributor to the Digital Risk Office GRC Platforms & Products Group within our Tech Ecosystem and will be responsible for the delivery of capabilities required by the group's stakeholders. This includes technical architecture, design, development and maintenance of the group's solution portfolio (custom, COTS and SaaS) in adherence with industry best practices.

You will actively collaborate with team members, product teams in different portfolios and stakeholders alike.

You will be an active learner: tinkering with new products and services, using unfamiliar technologies, and encouraging continuous research inside

Key Responsibilities

• Design, build, and maintain scalable and efficient data pipelines to move data between cloud-native databases (e.g., Snowflake) and SaaS providers using AWS Glue, Lambda, and Python.
• Implement and manage batch and event based ETL/ELT processes ensuring seamless data integration, transformation, and delivery across systems.
• Ensure adherence to information security, compliance, and data governance standards.
• Maintain and enhance data environments including data lakes, data warehouses, and distributed data systems.
• Utilize GitHub for version control, code collaboration, and CI/CD integration.
• Enhance existing solutions, develop new capabilities, resolve defects, and provide production support for ETL workloads using AWS native services.
• Troubleshoot and resolve production data pipeline issues efficiently; participate in on-call rotations as needed.
• Maintain clear and comprehensive technical documentation for data pipelines and deployment processes.
• Leverage GenAI-powered development tools (e.g., GitHub Copilot, Cursor AI) to accelerate coding, automate test generation, and perform AI-driven code review.
  
  

Primary Skills

• Strong development experience with Python and PySpark for ETL orchestration.
• Excellent command of AWS Glue, AWS Lambda, and related serverless data services.
• Experience working on Snowflake or similar Data Warehouse platforms.
• Advanced SQL skills, including optimization and complex query building.
• Hands-on experience with CI/CD pipelines using GitHub Actions.
• Proficiency in Agile methodologies and iterative delivery.
• Experience using Terraform (IaC) for infrastructure provisioning on AWS.
• Strong understanding of non-functional aspects including performance, scalability, and reliability of data systems.
• Well-versed in data governance, compliance, and application security practices.
• Experience in event-driven and distributed data architectures.
• Familiarity with observability and monitoring tools (e.g., CloudWatch, Datadog, or equivalent) for production data pipelines.
• Strong communication and interpersonal collaboration skills for stakeholder alignment and teamwork.
  
  

Secondary Skills

• Ability to work independently while contributing effectively to a distributed team.
• Strong analytical skills to interpret complex business processes and translate them into data-driven solutions.
• Comfortable working with global teams across multiple time zones.
• Passion for emerging technologies and staying updated with industry trends.
• Familiarity with Jira, GitHub, and project collaboration tools.
  
  

Competencies / Experience

• Demonstrated problem-solving ability with a track record of delivering complex data engineering solutions end-to-end.
• Ownership mindset — takes initiative, drives tasks to completion, and holds themselves accountable for outcomes.
• Experience mentoring and coaching junior engineers, including leading code reviews and knowledge-sharing sessions.
• Effective cross-team collaboration, working with product managers, analysts, QA, and stakeholders to align on goals.
• Awareness of risk management and compliance considerations relevant to enterprise data systems in regulated environments.
• Comfortable navigating ambiguity and adapting to shifting priorities in a fast-paced environment.
  
  

Skills

Experience Summary

Skill / Technology - Experience Level

• Python / PySpark – 5+ years
• AWS Glue (Crawler, Data Catalog) – 2+ years
• Snowflake (preferred) or similar Data Warehouse – 5+ years
• PL/SQL – 5+ years
• CloudFormation / Terraform – 2+ years
• CI/CD (GitHub Actions) – 2+ years
• AWS Services (S3, SNS, Secrets Manager, Athena, Lambda) – 2+ years
• Business Intelligence Tools (Power BI, Tableau) – 2+ years
• Event-driven Architecture / Streaming – 2+ years
• GenAI Development Tools (GitHub Copilot, AI-assisted testing) – 1+ years
• Observability (CloudWatch, Datadog, or equivalent) – 1+ years
• Jira, GitHub – Familiarity required
  
  

Why Join Us

• Be part of the Product Group — a high-impact team that builds and operates the data solutions powering risk management, early warning, and service excellence capabilities.
• Work with cutting-edge technologies across cloud computing, data engineering, and GenAI-augmented development workflows.
• Solve complex, real-world data challenges at the intersection of data engineering and enterprise risk — directly influencing how the Firm identifies, monitors, and mitigates risk.
• Grow your career in an environment that values continuous learning, engineering excellence, and collaborative innovation across global teams.
  
  

Ideal Candidates

Ideal candidates have 5+ years of experience, strong problem-solving skills, familiarity with modern data engineering practices including GenAI-assisted development, and are eager to contribute to the success of our SERSD Product Group. If you meet the qualifications and are excited about this opportunity, we encourage you to apply!

Education

Bachelor's degree in quantitative field like Computer Science, Engineering, Statistics, Mathematics or related field required. Advanced degree is a strong plus