Source description
About the role
Equifax is seeking a skilled and motivated Data/Platform Engineer to support our cloud initiatives. This role offers an exciting opportunity to contribute to the efficiency of our operations, spending approximately 60% of your time on building and maintaining robust data pipelines and ensuring data quality within our Google Cloud Platform (GCP) environment, and 40% on Python-based web development tasks supporting data integration and application functionalities. You will work closely with cross-functional teams to develop and implement data solutions that support operational excellence.
What you’ll do
-
Design, develop, and maintain robust data integrations from various source systems into our Google Cloud Platform (GCP) environment.
-
Design, develop, and maintain web application components and APIs using Python (particularly Django or similar frameworks), including backend and frontend development tasks, to support data access, integration, and visualization needs.
-
Implement and continuously optimize query performance in BigQuery to ensure timely and efficient data retrieval for ETL/ELT processes and analytical purposes.
-
Collaborate with cross-functional teams to understand their data requirements for ETL/ELT and reporting purposes and translate them into effective data models and BigQuery solutions.
-
Monitor the health and performance of GCP infrastructure components and data solutions using tools like Datadog, ensuring expected behavior and reliability.
-
Respond to and help troubleshoot alerts and incidents surfaced via monitoring systems and PagerDuty to minimize downtime and ensure data integrity.
-
Utilize Git for version control and participate in CI/CD pipelines for data pipeline deployments.
-
Stay current with best practices and emerging technologies in data integration, BigQuery optimization, and data quality management relevant to supporting applications in a cloud environment.
-
What experience you need Bachelor’s degree in Computer Science, Software Engineering, Information Technology, or a related subject.
-
3+ years of practical experience in data engineering or related fields, with a strong focus on Python and SQL (writing complex queries and optimizing performance).
-
2+ years of experience employing Python web development frameworks, such as Django, is required, along with a comprehensive understanding of backend, frontend, and full-stack development principles.
-
2+ years of hands-on experience with Google Cloud Platform (GCP) or Amazon Web Services (AWS) for data engineering tasks.
-
1+ years of experience with cloud infrastructure monitoring tools (e.g., Datadog, GCP Cloud Monitoring) and incident alerting platforms (e.g., PagerDuty).
-
What could set you apart Conceptual understanding or at least 1 year of experience with Machine Learning concepts and their potential application in data processes.
-
Proven experience developing and deploying Full Stack applications using Python and Django, including handling frontend components (e.g., using Django templates, integrating with simple JS, or potentially a lightweight frontend library if applicable).
-
Familiarity with containerization technologies (e.g., Docker) and orchestration (e.g., Kubernetes) within a GCP context.
-
Experience automating incident response procedures.
-
Primary Location: CRI-Sabana
-
Function: Function - Data and Analytics
-
Schedule: Full time
More at Equifax