Data Engineer

Data Engineer – Data and AI Tribe Responsibilities Design, architect and maintain secure data platform with focus on optimal data warehousing and modelling, data processing and storage Assess and work with the right infrastructure and data technologies based on stakeholder requirements, ensuring highly available and scalable data capabilities Implement and maintain optimized workflows, ETL / ELT processes, and pipelines Produce visualization and insights on ingested data and be able to communicate results with non-technical stakeholders Work with colleagues such as Product Owner, Data Analysts, Software Engineers, and tech leads on implementing solutions involving end to end data ingestion, storage, and consumption

Qualifications

Proficiency and experience in programming languages such as Python Expertise in SQL / RDBMS and NoSQL databases Extensive experience in design and implementation of data warehousing and data handling processes (ingestion, transformation, modelling, and storage). Experience with MS SQL / SQL Server , Oracle Databases Expertise in cloud platforms and technologies. Experience with Azure and its products such is a plus. Expertise in cloud platforms and technologies (Azure, AWS, GCP) is a plus but not required Experience with streaming platform setup and consumption such as Kafka, Flink Experience with consumption from other storages for streaming such as S3, Spark Experience in containers and container orchestration platforms such as Docker and Kubernetes Experience in CI / CD and Devops, scripting languages such as shell and automation Experience with software quality and data pipeline testing ETL concepts and tools. Preferably a degree in the related fields of Computer Science Strong problem solving and solutions engineering mindset Experience in working and coordinating remotely