28 Aug
|
Ku0026K Global Talent Solutions
|
Ontario
28 Aug
Ku0026K Global Talent Solutions
Ontario
Position: Data Integration Engineer (ETL Pipeline & Lineage Specialist)
Location: Onsite (4days/week)- Toronto, ON
Job type: Full time/Permanent hiring
We are seeking a skilled Data Integration Developer to design, develop, and maintain robust data pipelines and enterprise infrastructure that ensure high data quality, strict traceability, and regulatory compliance.
In this role, you will design automated ETL/ELT solutions using industry-standard tools and write optimized scripts deploying Python, Unix/Linux utilities, and complex multi-database SQL .
You will take direct ownership of data lineage tracking, version control via Git/GitHub, and database operations (DDL, DML, DQL, DCL) to construct a highly transparent, governed, and scalable cloud-native data architecture.
Key Responsibilities:
- Develop ETL Pipelines: Design, implement, and maintain high-throughput ETL data solutions to securely move and transform massive enterprise data assets across systems.
- Govern Data Lineage: Track, document, and map comprehensive source-to-target data lineage, ensuring compliance with strict regulatory and governance frameworks.
- Optimize Database Operations: Build and fine-tune complex SQL queries across Oracle, SQL Server, and PostgreSQL using structured DDL, DML, DQL, and DCL commands.
- Automate Infrastructure:
Author scalable automation scripts and custom scheduling tools utilizing Python to eliminate manual data operations and pipeline latency.
- Manage Version Control: Control product codebases using Git/GitHub, proactively leading branching strategies, code reviews, and structural merges.
- Administer Unix Environments: Navigate, deploy, monitor, and troubleshoot backend production files and scheduled batch jobs within Linux/Unix environments.
- Enforce Quality Assurance: Program automated data validation checks and structural reconciliation boundaries to guarantee data integrity across the pipeline lifecycle.
- Integrate Cloud Warehouses: Connect and orchestrate data execution paths flowing through modern public cloud ecosystems ( AWS, Azure, or GCP ).
Required Skills:
- Primary: Data Integration, ETL Framework Architecture, Python Data Scripting, Multi-Database SQL Optimization, Data Lineage & Traceability mapping.
- Tools/Frameworks: Informatica, Talend, Apache Airflow, Git/GitHub, Unix Shell Scripting (Bash), Pandas/NumPy.
- Database/Cloud: Oracle Database, Microsoft SQL Server, PostgreSQL, AWS/Azure/GCP cloud platforms, Relational Schema Models.
- Nice-to-Have: Data Quality tools (Great Expectations), CI/CD deployment pipeline exposure, Agile development experience, data catalog alignment.
📌 Data Integration Engineer (ETL Pipeline & Lineage Specialist) (Ontario)
🏢 Ku0026K Global Talent Solutions
📍 Ontario