AWS Data Engineer – Data Warehouse & Netezza Migration
Location: Toronto; Hybrid 2 days a week in office
Must-Have Skills
· Amazon S3 (Data Lake)
· AWS Glue (ETL)
· AWS Lambda
· Amazon Redshift
· AWS Step Functions
· AWS IAM & CloudWatch
· IBM Netezza
Role and Responsibilities
· Required to have strong data warehouse technical knowledge.
· Must have knowledge in Bank and financial domain (Minimum 5+ years of experience).
· Design, develop, and maintain scalable data pipelines and workflows on AWS Build and manage data lakes and data warehouses (e.g., S3, Redshift).
· Develop ETL/ELT processes using tools like AWS Glue, Lambda, or Spark Solid solution.
· Knowledge in AWS Cloud and hands on experience with ETL process (like Kafka message processing, batch interface data injection and other business layer process).
· Optimize data ingestion, transformation, and loading processes.
· Work with stakeholders to understand and deliver data requirements.
· Ensure data quality,
governance, and security compliance.
· Monitor and troubleshoot data pipelines and workflows Automate deployments using CI/CD pipelines Improve performance, cost optimization, and scalability.
· Coordinate with clients, data users and key stakeholders to understand feature requirements needed merge them to create reusable design patterns.
· Data onboarding using the developed frameworks Understand and make sense of available code in Netezza to design a best way to implement its current features in AWS Data Lake.
· Unit test code and aid with QA/SIT/Perf testing Migration to production environment
Good to have
· AWS Certifications (Solutions Architect / Data Analytics)
· Experience with Airflow (or Managed Workflows for Apache Airflow - MWAA)
· Exposure to Snowflake, Databricks, or Delta Lake
📌 AWS Data Engineer – Data Warehouse & Netezza Migration (Toronto)
🏢 Astra North Infoteck
📍 Toronto
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.