Azure Data Engineer

Company: Onedata Solutions

Website: Visit Website

LinkedIn: Visit LinkedIn

Business Type: Enterprise

Company Type: Service

Business Model: B2B

Funding Stage: Series B

Industry: Information Technology

Salary Range: ₹ 12-18 Lacs PA

Job Description

We are looking for an experienced Azure Data Engineer with 7+ years of hands-on experience in designing, developing, and maintaining scalable data solutions on Microsoft Azure. The ideal candidate should have strong expertise in Azure Data Factory, Azure Databricks, Azure Data Lake, SQL, PySpark, and ETL/ELT pipelines, along with experience in data warehousing and cloud-based data architecture. The candidate should be capable of building robust data pipelines, optimizing data workflows, and supporting business intelligence and analytics initiatives.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Azure Data Factory (ADF) and Azure Databricks
• Implement ETL/ELT processes for structured and unstructured data from multiple sources
• Work extensively with Azure Data Lake Storage (ADLS), Azure Synapse Analytics, and Azure SQL Database
• Develop and optimize PySpark and Spark SQL workflows in Databricks
• Perform data transformation, cleansing, validation, and enrichment processes
• Build and maintain data models for reporting, analytics, and business intelligence solutions
• Collaborate with business stakeholders, data analysts, and architects to understand data requirements
• Ensure data quality, governance, security, and compliance standards are maintained
• Monitor and troubleshoot data workflows and optimize performance for large-scale data processing
• Support migration of on-premises data platforms to Azure Cloud environment
• Create technical documentation and maintain best practices for data engineering processes
  
  

Technical Skills

• Strong hands-on experience in Microsoft Azure Cloud Platform
• Expertise in Azure Databricks with strong PySpark experience
• Experience with Azure Data Factory (ADF)
• Good knowledge of Azure Data Lake Storage (ADLS Gen2)
• Experience in Azure Synapse Analytics
• Strong SQL skills with performance tuning experience
• Experience with ETL/ELT pipeline development
• Understanding of Data Warehousing concepts
• Experience with Delta Lake, Spark optimization, and partitioning strategies
• Exposure to CI/CD pipelines, DevOps, and deployment automation
• Knowledge of Power BI is an added advantage
• Familiarity with Git, version control, and Agile methodology
  
  

Soft Skills

• Strong analytical and problem-solving skills
• Good communication and stakeholder management
• Ability to work independently and in team environments
• Strong debugging and troubleshooting capability
  
  

Preferred Qualifications

• Bachelor’s degree in Computer Science, Engineering, IT, or related field
• Microsoft Azure certifications are preferred
• Experience working in enterprise-scale data environments
• Exposure to big data technologies is an added advantage
  
  

Nice to Have

• Experience in Snowflake, Kafka, or Airflow
• Exposure to Machine Learning data pipelines
• Knowledge of real-time streaming solutions using Azure Event Hub or Stream Analytics
  
  

Notice Period Preference

Immediate joiners or candidates with short notice period preferred.