Data Engineer - Azure - Experienced Associate/Senior Associate/Manager

2-8 years, Full Time
Mumbai/Bangalore

Role Summary

We are seeking skilledData Engineers with prior experience on Azure data engineering servicesand SQL serverto join our team. As a Data Engineer, you will be responsible for designing and implementing robust data infrastructure, building scalable data pipelines, and ensuring efficientdata integration and storage.


Responsibilities

  1. Design, develop, and maintain scalable data pipelines and use Azure Data Factory and Azure Stream Analytics
  2. Collaborate with data scientists and analysts to understand data requirements and implement solutions that support analytics and machine learninginitiatives.
  3. Optimize data storage and retrieval mechanisms to ensure performance, reliability, and cost-effectiveness.
  4. Implement data governance and security best practices to ensure compliance and data integrity.
  5. Troubleshoot and debug data pipeline issues, providing timely resolution and proactive monitoring.
  6. Stay abreast of emerging technologies and industry trends, recommending innovative solutions to enhance data engineering capabilities.


Qualifications

  1. Proven experience as a Data Engineer or in a similar role.
  2. Experience in designingand hands-on development in cloud-based (AWS/Azure) analytics solutions.
  3. Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, Azure App Service, Azure Databricks, Azure IoT, Azure HDInsight + Spark, Azure Stream Analytics
  4. Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code is essential.
  5. Experience in SQL server and procedures.
  6. Thorough understanding of Azure Infrastructure offerings.
  7. Strong experience in common data warehouse modelling principles including Kimball, Inmon.
  8. Experience in additional Modern Database terminologies.
  9. Working knowledge of Python or Java or Scala is desirable
  10. Strong knowledge of data modelling, ETL processes, and database technologies
  11. Experience with big data processing frameworks (Hadoop, Spark) and data pipeline orchestration tools (Airflow).
  12. Solid understanding of data governance, data security, and data quality best practices.
  13. Strong analytical and problem-solving skills, with attention to detail.