01 Aug
|
Envision Technology Solutions
|
Toronto
01 Aug
Envision Technology Solutions
Toronto
- Design, develop, maintain and support scalable data pipelines using Big Data and AWS technologies
- Lead and support data platform migration initiatives (On-Prem to AWS Cloud)
- Develop and manage ETL/ELT processes using tools like SSIS, Pentaho, or similar
- Implement and manage AWS services such as EMR, S3, EC2, Redshift, Glue, and Airflow
- Build and optimize data workflows and orchestration pipelines using Airflow
- Work with real-time streaming technologies such as Kafka and Spark Streaming
- Perform data ingestion, transformation, and validation from multiple data sources
- Optimize SQL queries for performance and scalability
- Monitor system performance, troubleshoot issues, and ensure system reliability
- Collaborate with cross-functional teams including developers, architects, and infrastructure teams
________________________________________
Required Technical Skills:
Cloud Technologies
- Solid experience in AWS Cloud services:
o EMR, EC2, S3, VPC, RDS, Redshift o AWS Glue, IAM, CloudWatch, CloudFormation o Airflow (or AWS Managed Workflows)
Databases
- Experience working with:
o Netezza Experience is Mandatory *****
o SQL-based systems: SQL Server and PostgreSQL o Data warehouses: Teradata, Redshift, Netezza
ETL Tools
- Hands-on experience with:
o SSIS
Programming & Scripting
- Strong proficiency in:
o SQL o Shell scripting
- Good to have:
o Python
Operating Systems
- Strong experience in Unix/Linux environments
________________________________________
Key Qualifications:
- 6 years of experience in Data Engineering / Big Data / Platform Engineering and Netezza experience is Mandatory
- Hands-on experience in AWS and Hadoop ecosystems
- Experience in data migration projects (e.g., Hadoop to AWS, DB migrations)
- Strong understanding of data warehousing concepts and ETL design patterns
- Expertise in query optimization and performance tuning
- Experience supporting production data platforms
- Bachelor’s degree in Computer Science, Engineering, or related field
📌 Data Engineer with Netezza (Toronto)
🏢 Envision Technology Solutions
📍 Toronto