30 Jul
|
Cognizant
|
Canada
Job Title: GCP Data Engineer (Airflow / Dataproc / Spark)
Location: Remote
Experience: 6+ Years (Preferred)
Employment Type: Full-Time
Job Summary
We are seeking a highly skilled GCP Data Engineer with strong hands-on expertise in Apache Airflow, Google Cloud Dataproc, Apache Spark (PySpark), and Advanced SQL/RDBMS concepts . The ideal candidate will be responsible for developing, maintaining, optimizing, and supporting large-scale data pipelines and ETL processes on the Google Cloud Platform (GCP).
Candidates should be comfortable working in a fast-paced environment with stringent SLAs and operational support responsibilities.
The required technical stack aligns with skills commonly found in internal GCP Data Engineering profiles involving Airflow, Dataproc, Spark, SQL, and CI/CD practices.
Key Responsibilities
Build scalable batch and near real-time data processing solutions using Dataproc, Spark, and PySpark on GCP.
- Develop, maintain, and enhance data pipelines using Apache Airflow for workflow orchestration and scheduling.
- Design and optimize complex SQL queries,
stored procedures, and data transformations across relational database platforms.
- Monitor production workloads, troubleshoot failures, perform root cause analysis, and ensure SLA adherence.
- Support and maintain existing data platforms as part of a KTLO environment.
- Implement data quality checks, validation frameworks, and monitoring mechanisms.
- Collaborate with cross-functional teams to understand requirements and provide rapid issue resolution.
- Participate in release management and deployment activities using CI/CD pipelines.
- Perform performance tuning of Spark applications, ETL jobs, and SQL queries.
- Contribute to documentation, operational runbooks, and knowledge-sharing initiatives.
Required Skills
Mandatory
- Solid hands-on experience with:
- Apache Airflow / Cloud Composer
- Google Cloud Dataproc
- Apache Spark / PySpark
- Google Cloud Platform (GCP)
- Advanced SQL and RDBMS Concepts
📌 Sr GCP Data Engineer (Canada)
🏢 Cognizant
📍 Canada