Job Description
We are looking for an experienced GCP Data Engineering Lead to lead a team of 10 engineers and design, develop, and optimize scalable data engineering solutions on Google Cloud Platform (GCP).
Key Responsibilities
• Lead and mentor onshore and offshore data engineering teams.
• Design and optimize ETL/ELT pipelines using Dataflow, Apache Beam, Dataproc, Spark, and Pub/Sub.
• Manage BigQuery, Cloud Storage, Data Fusion, and Cloud Composer.
• Establish coding standards, code reviews, CI/CD, and monitoring practices.
• Optimize data pipeline performance, query efficiency, and cloud costs.
• Implement data quality, governance, metadata, and lineage solutions.
• Collaborate with data architects, analysts, and data scientists to support analytics and AI initiatives. Required
Skills:
• Strong experience with GCP data engineering services, including BigQuery, Dataflow, Dataproc, Pub/Sub, and Composer.
• Proficiency in SQL, Python, and Java/Scala.
• Experience with Apache Spark, Apache Beam, distributed systems, and real-time data processing.
• Hands-on experience with Terraform, Git, CI/CD, and infrastructure as code.
• Experience leading onshore and offshore data engineering teams, preferably managing 10 engineers.
• Valid/relevant GCP certification, such as Qualified Data Engineer.
• Exposure to Vertex AI or multi-cloud environments.
📌 GCP Senior Data Engineer (Canada)
🏢 Aptino
📍 Canada