16 Apr
|
IT Connex
|
Toronto
Apply on Kit Job: kitjob.ca/job/2fsss1
Overview
We are seeking a highly skilled Software Developer with strong data engineering expertise with 10+ years experience to design, build, and optimize scalable data solutions. This role focuses on developing robust data pipelines, performing complex transformations, and supporting enterprise-level data platforms using Python and AWS technologies.
Key Responsibilities
- Design, develop, test, and maintain data pipelines using Python and AWS services (Glue, Step Functions, Lambda, S3)
- Build and optimize data transformation processes for structured and unstructured data
- Develop and maintain data models for relational databases and data repositories
- Create reusable code, modules, and frameworks to improve efficiency and scalability
- Review and enhance existing code, providing guidance to junior developers
- Translate business requirements into effective technical solutions across cloud and on-prem environments
- Support full lifecycle development including design, testing, deployment, and production support
Must-Have Skills & Experience
- Strong hands-on experience with Python (including Pandas and PySpark) (10+years)
- Experience working with XLSX, CSV, JSON, and various data sources
- Solid understanding of ETL processes and data pipeline development
- Experience with AWS services such as Glue, Step Functions, Lambda, and S3
- Hands-on experience with Informatica IDMC (Intelligent Data Management Cloud) or similar ETL tools
- Strong SQL skills and experience with data modeling (relational & dimensional)
- Experience with cloud data warehousing (e.g., AWS Redshift or equivalent)
- Familiarity with Linux environments and data processing automation
Nice-to-Have
- Experience with data visualization/reporting tools
- Knowledge of Agile/Scrum or Waterfall methodologies
- Experience in public sector environments
- Exposure to change management and incident management processes
Soft Skills
- Solid communication and stakeholder engagement skills
- Excellent problem-solving and analytical abilities
- Ability to work independently and collaboratively in a team environment
Apply on Kit Job: kitjob.ca/job/2fsss1
📌 Sr, Data Engineer (Toronto)
🏢 IT Connex
📍 Toronto