30 Jul
|
LanceSoft
|
Toronto
Pay Range: CAD 50-55/hr
Netezza Experience is Mandatory
Key Responsibilities
- Design, develop, maintain and support scalable data pipelines using ETL tools and AWS technologies
- Lead and support data platform migration initiatives (On-Prem to AWS Cloud)
- Develop and manage ETL/ELT processes using tools like SSIS or similar
- Implement and manage AWS services such as EMR, S3, EC2, Redshift, Glue, and Airflow
- Build and optimize data workflows and orchestration pipelines using Airflow
- Experience with CICD pipeline using Python, Git.
- Perform data ingestion, transformation, and validation from multiple data sources
- Optimize SQL queries for performance and scalability
- Monitor system performance, troubleshoot issues, and ensure system reliability
- Collaborate with cross-functional teams including developers, architects, and infrastructure teams
Required Technical Skills
Cloud Technologies
- Strong experience in AWS Cloud services:
o EMR, EC2, S3, VPC, RDS, Redshift o AWS Glue, IAM, CloudWatch, CloudFormation o Airflow (or AWS Managed Workflows)
Databases
- Experience working with:
o Working on Netezza o SQL-based systems: SQL Server and PostgreSQL o Data warehouses: Netezza , Redshift
ETL Tools
- Hands-on experience with:
o In any ETL tools (like SSIS, Datastage, informatica etc)
Programming & Scripting
- Robust proficiency in:
o SQL o Shell scripting
- Valuable to have:
o Python
Operating Systems
- Strong experience in Unix/Linux environments
Key Qualifications
- 10+ years of experience in Data Engineering / AWS / Platform Engineering
- Hands-on experience in ETL tools and AWS
- Experience in data migration projects
- Robust understanding of data warehousing concepts and ETL design patterns
- Expertise in query optimization and performance tuning
- Experience supporting production data platforms
- Bachelor’s degree in Computer Science, Engineering, or related field
Preferred Qualifications
- Experience in Banking / Financial Services domain
- Experience with data lake architecture and governance
- Knowledge of DevOps tools and CI/CD pipelines
- Experience in platform engineering and framework development
Soft Skills
- Excellent problem-solving and analytical skills
- Robust communication and collaboration abilities
- Ability to work independently and lead initiatives
- Experience mentoring team members
Nice to Have
- Experience with tools like Ansible, Git, JIRA
- Exposure to NoSQL databases (HBase, MongoDB)
- Experience in data masking and security frameworks
📌 Senior AWS Data Engineer (Toronto)
🏢 LanceSoft
📍 Toronto