25 Sep
|
HCLTech
|
Canada
Join us as a Senior Big Data Platform Engineer, focusing on Netezza and AWS. This role emphasizes the development and support of advanced data pipelines in a high-energy enterprise setting. We are seeking a Senior Engineer with deep expertise in Big Data technologies, including Netezza, Kafka, and Spark Streaming.
This position involves leading data migrations to AWS and supporting data architecture modernization efforts. You will collaborate closely with teams to implement ETL processes and maintain optimal data workflows. Key Responsibilities:
Design and support scalable data pipelines leveraging AWS technologies
Spearhead migration projects transitioning from On-Prem to AWS
Implement ETL processes using tools such as SSIS
Manage AWS services, focusing on EMR, S3, and Airflow
Build real-time data workflows using Spark Streaming Requirements:
Extensive experience with Netezza, Airflow, and AWS EMR
Robust competency in Big Data tools and architectures
Skilled in data ingestion and SQL optimization
Ability to troubleshoot and ensure system reliability
Experience working in cross-functional teams Apply your skills in data engineering and cloud technology to help us innovate.
📌 Senior Big Data Platform Engineer Role Toronto (Canada)
🏢 HCLTech
📍 Canada