23 Sep
|
Querentia
|
Calgary
Data Engineering Lead
Possible 3 Month CTH
Role Name: Data Eng Lead_SOW176
Work Site: Calgary, CA Onsite
Start Date: Immediate Availability
Role Summary
We are seeking a Data Engineering Lead with deep expertise in data engineering and distributed data platforms. The role will focus on building and supporting highly available data capabilities, including both batch/distributed and real-time data pipelines.
The successful candidate will be responsible for developing fault-tolerant and adaptive data pipelines, leading complex technical implementations, optimizing distributed queries, and driving permanent resolutions to software and business process issues.
Key Responsibilities
- Demonstrate deep knowledge of the data engineering domain to build and support:
- Batch and distributed data processing
- Real-time data pipelines
- Highly available data platforms
- Data and technology capabilities
- Build fault-tolerant, self-healing, adaptive, and highly accurate data computational pipelines.
- Provide technical consultation and lead the implementation of complex data engineering programs.
- Develop and maintain comprehensive documentation for assigned systems and projects.
- Tune queries processing billions of rows of data within distributed query engines.
- Perform detailed root cause analysis (RCA) to identify permanent resolutions to software and business process issues.
- Support ongoing optimization, reliability, and performance improvements across data engineering capabilities.
Required Skills & Experience
- Deep expertise in data engineering and distributed data processing.
- Experience designing and supporting batch, distributed, and real-time data pipelines.
- Strong understanding of highly available and fault-tolerant data architectures.
- Experience building self-healing and adaptive data pipelines.
- Strong experience with distributed query engines and large-scale data processing.
- Proven ability to optimize queries across datasets containing billions of rows.
- Strong technical leadership and consultation skills.
- Experience leading complex technical implementations.
- Solid troubleshooting and root cause analysis capabilities.
- Excellent documentation and communication skills.
📌 Data Engineering Lead (Calgary)
🏢 Querentia
📍 Calgary