30 Jul
|
Tech Talent International
|
Greater Toronto Area
30 Jul
Tech Talent International
Greater Toronto Area
Tech Talent International (TTI) supplies technical talent to a variety of clients ranging from Fortune (phone hidden) companies to startups, small and mid-sized organizations in Canada/US. We are currently hiring a Data Platform Engineer - Netezza for our consulting client in the Toronto area.
Role: Senior Machine Learning Engineer
Type: Contract
Rate Range: $55/hr C2C (40 hrs /week)
Duration: 12 months + potential extensions
Location: Hybrid (2/3 days from home) downtown Toronto, ON, Canada
Toronto, ON
Hybrid (2 days per week in-person at Toronto office preferred)
Skills: Data WarehouseDigital : Microsoft Power PlatformFivetran Data Engineering Platform
Experience: 10+ Years
Job Summary
We are seeking a highly skilled Senior Platform Engineer with extensive experience in Big Data technologies, AWS Cloud, and data platform engineering. The ideal candidate will have strong expertise in designing, developing, and supporting scalable data pipelines and distributed systems, along with hands-on experience in Big Data ecosystem tools, AWS services, and real-time data processing.
This role involves working on data platform modernization, cloud migrations, Data Warehousing and ETL in a fast-paced enterprise setting.
________________________________________
Key Responsibilities
- Design, develop, maintain and support scalable data pipelines using Big Data and AWS technologies
- Lead and support data platform migration initiatives (On-Prem to AWS Cloud)
- Develop and manage ETL/ELT processes using tools like SSIS, Pentaho, or similar
- Implement and manage AWS services such as EMR, S3, EC2, Redshift, Glue, and Airflow
- Build and optimize data workflows and orchestration pipelines using Airflow
- Work with real-time streaming technologies such as Kafka and Spark Streaming
- Perform data ingestion, transformation, and validation from multiple data sources
- Optimize SQL queries for performance and scalability
- Monitor system performance, troubleshoot issues, and ensure system reliability
- Collaborate with cross-functional teams including developers, architects, and infrastructure teams
________________________________________
Required Technical Skills
Cloud Technologies
- Strong experience in AWS Cloud services:
o EMR, EC2, S3, VPC, RDS, Redshift o AWS Glue, IAM, CloudWatch, CloudFormation o Airflow (or AWS Managed Workflows)
Databases
- Experience working with:
o Netezza Experience is Mandatory *****
o SQL-based systems: SQL Server and PostgreSQL o Data warehouses: Teradata, Redshift, Netezza
ETL Tools
- Hands-on experience with:
o SSIS
Programming & Scripting
- Strong proficiency in:
o SQL o Shell scripting
- Good to have:
o Python
Operating Systems
- Strong experience in Unix/Linux environments
________________________________________
Key Qualifications
• 10+ years of experience in Data Engineering / Big Data / Platform Engineering and Netezza experience is Mandatory
- Hands-on experience in AWS and Hadoop ecosystems
- Experience in data migration projects (e.g., Hadoop to AWS, DB migrations)
- Strong understanding of data warehousing concepts and ETL design patterns
- Expertise in query optimization and performance tuning
- Experience supporting production data platforms
- Bachelor’s degree in Computer Science, Engineering, or related field
________________________________________
Preferred Qualifications
- Experience in Banking / Financial Services domain
- Experience with data lake architecture and governance
- Knowledge of DevOps tools and CI/CD pipelines
- Experience in platform engineering and framework development
________________________________________
Soft Skills
- Excellent problem-solving and analytical skills
- Strong communication and collaboration abilities
- Ability to work independently and lead initiatives
- Experience mentoring team members
________________________________________
Nice to Have
- Experience with tools like Ansible, Git, JIRA
- Exposure to NoSQL databases (HBase, MongoDB)
- Experience in data masking and security frameworks
📌 Data Platform Engineer - Netezza (Greater Toronto Area)
🏢 Tech Talent International
📍 Greater Toronto Area