Source description
About the role
We are seeking a highly skilled and hands-on Data Engineer with 6+ years of experience in designing, developing, and maintaining scalable cloud-based data platforms. This is an individual contributor role focused on building robust data pipelines, optimizing data processing, and delivering analytics-ready datasets using Microsoft Azure technologies.
The ideal candidate should possess strong expertise in Azure data services and SQL, along with practical experience in developing batch data pipelines and exposure to streaming technologies. You will collaborate with architects, analytics teams, QA, DevOps, and business stakeholders in a global delivery environment. Job Description: Role: Data Engineer Experience: 6 - 8 Years Location: Bangalore ·
Key Responsibilities Data Engineering & Development • Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF) / Azure Databricks / Azure Data Lake Storage. • Develop high-performance SQL-based data transformation workflows. • Build and optimize analytics-ready data models for reporting and business intelligence. • Process and manage large-scale structured and semi-structured datasets. • Implement best practices for data modeling, partitioning, schema evolution, and data validation. Platform & Operations • Support deployment, execution, and maintenance of Azure data pipelines across development, testing, and production environments. • Monitor pipeline performance, data quality, and platform health. • Troubleshoot production issues, perform root cause analysis, and implement preventive solutions. • Ensure Azure security, scalability, reliability, and cost optimization best practices are followed. Collaboration & Delivery • Work closely with architects, business analysts, QA, DevOps, and analytics teams to understand business requirements. • Translate business needs into scalable Azure-based data solutions. • Participate in code reviews, technical documentation, and engineering best practices. • Contribute effectively within Agile delivery teams supporting global clients.
Mandatory Skills
Azure Cloud & Data Engineering • Hands-on experience in delivering Azure-based data engineering solutions. • Strong expertise in any 2 of the below: o Azure Data Lake Storage o Azure Data Factory (ADF) o Azure Databricks o Azure Synapse Analytics • Experience designing cloud-native data lakes and analytical data platforms. • Good understanding of batch data processing and basic streaming concepts. SQL (Mandatory) • Strong proficiency in SQL. • Experience writing complex queries, joins, aggregations, window functions, and performance-optimized transformations. • Hands-on experience working with large datasets in Azure Synapse and Databricks. • Strong understanding of data modeling, data transformations, and query performance tuning. Good to have : Strong understanding of Microsoft Fabric
Location: Bangalore Brand: Bcoe Time Type: Full time Contract Type: Permanent
More at Dentsu