Senior Data Specialist - R01566949

Senior AWS Data Specialist

Experience: 7 – 12 Years Location: Bangalore | Hyderabad | Pune | Chennai | Gurgaon Company: Brillio

About Brillio

Brillio is a leading digital technology consulting and solutions company focused on delivering transformative outcomes for enterprises through cloud, data, AI, and digital engineering solutions.

Role Overview

We are looking for a highly skilled AWS Data Engineer with strong expertise in designing, developing, and maintaining large-scale cloud-native data platforms. The ideal candidate should have extensive experience with AWS data services, Spark-Scala, ETL development, real-time streaming, and data warehousing solutions.

Required Technical Skills

AWS Services

Athena

SNS

SQS

CloudWatch

Macie

Kinesis

CloudFormation

EMR

OpenSearch

DynamoDB

Amazon API Gateway

AWS SCT (Schema Conversion Tool)

Redshift

AWS DMS

Data Engineering & Big Data

Apache Spark (Scala)

Oozie

ETL/ELT Development

Data Modeling

Batch & Real-Time Data Processing

Data Warehousing Concepts

Programming

Scala

SQL

Python (Good to Have)

Key Responsibilities

Design, build, and maintain scalable data pipelines using AWS native services.

Develop high-performance data processing applications using Spark and Scala.

Build and optimize ETL/ELT frameworks for large-scale structured and unstructured datasets.

Implement real-time streaming solutions using Amazon Kinesis.

Design and manage data warehouses using Amazon Redshift.

Perform data migration and modernization projects using AWS DMS and SCT.

Create and manage workflow orchestration using Oozie.

Implement Infrastructure as Code (IaC) using AWS CloudFormation.

Configure monitoring, logging, and alerting using CloudWatch.

Manage data security, governance, and compliance using AWS Macie.

Develop API-based integrations using Amazon API Gateway.

Optimize performance, scalability, reliability, and cost of AWS workloads.

Collaborate with architects, business stakeholders, and cross-functional engineering teams to deliver cloud-native data solutions.

Required Qualifications

Bachelor's degree in Computer Science, Information Technology, Engineering, or related discipline.

7+ years of overall experience in Data Engineering and Cloud Data Platforms.

Minimum 4+ years of hands-on AWS Data Engineering experience.

Strong expertise in Spark-Scala development.

Experience building enterprise-grade data lakes and data warehouses.

Excellent SQL and performance tuning skills.

Experience working in Agile/Scrum environments.

Preferred Qualifications

• AWS Certified Data Analytics – Specialty.

• AWS Certified Solutions Architect Associate/Professional.

• Experience with AWS Glue, Airflow, or Databricks.

• Exposure to CI/CD, DevOps, and Infrastructure Automation.

• Knowledge of data governance and security best practices.

• Good to Have

• Docker/Kubernetes

• Machine Learning data pipelines

• Data Quality Frameworks

• Data Catalog & Metadata Management

• Event-driven architecture and streaming platforms