06 Nov
|
vTech Solution
|
Ontario
06 Nov
vTech Solution
Ontario
Job Summary:
The Senior Software Developer - ETL is responsible for designing, developing, and maintaining scalable and reusable data pipelines and integration solutions that support enterprise AI, analytics, and data initiatives. This role focuses on improving data accessibility, operationalizing data architecture, and accelerating data onboarding for advanced analytics and machine learning workloads in a hybrid work environment based in Toronto, ON.
Responsibilities:
- Design, develop, test, and maintain ETL/ELT pipelines and data integration solutions across diverse enterprise data sources.
- Build reusable data pipelines, services, and integration components to support AI and analytics use cases.
- Ingest, transform, and prepare structured and unstructured data for analytics, AI, and machine learning workloads.
- Implement data architecture, modeling, and integration patterns according to enterprise standards.
- Integrate data across cloud platforms, databases, applications, APIs, and enterprise systems.
- Design solutions ensuring scalability, reliability, performance, monitoring, and maintainability.
- Implement data quality and validation controls to enhance data reliability for downstream consumers.
- Collaborate with Data Architects, AI/ML Engineers, Data Scientists, product teams, and stakeholders to translate requirements into production solutions.
- Optimize existing pipelines and integration processes to reduce duplication and expedite onboarding of new data sources.
- Support deployment, troubleshooting, documentation, and continuous improvement of enterprise data solutions.
Required Skills:
- Proven experience designing and developing scalable ETL/ELT data pipelines and integration solutions.
- Strong programming skills in Python and SQL with expertise in modern data engineering frameworks.
- Hands-on experience with cloud-based data platforms, particularly Azure data and AI ecosystem.
- Knowledge of data modeling, data quality,
metadata management, lineage, security, and governance.
- Experience integrating data from databases, APIs, file-based sources, and enterprise applications.
- Ability to support AI, machine learning, advanced analytics, and business intelligence data platforms.
- Excellent analytical, troubleshooting, communication, and collaboration skills.
Desired Skills:
- Familiarity with Azure Machine Learning and Microsoft Foundry/Azure AI Foundry platforms.
- Experience with feature engineering, model training/testing, inference, and ML pipeline integration.
- Understanding of Generative AI workloads and related data requirements.
- Background in software engineering best practices for building reliable and maintainable data solutions.
- Experience working in hybrid work environments and cross-functional teams.
Rated Criteria:
- Scalable ETL/ELT Pipeline Development - 30 Points
- Cloud Data Platform Expertise (Azure) - 25 Points
- Python and SQL Programming Skills - 15 Points
- AI/ML Data Integration and Support - 15 Points
- Data Quality, Governance, and Security Implementation - 10 Points
- Collaboration and Communication Skills - 5 Points
Total: 100 Points Deliverables:
- Production-ready, scalable ETL/ELT pipelines and data integration components.
- Reusable data services supporting AI, ML, and analytics workloads.
- Documentation of data architecture, pipeline design, and integration patterns.
- Validated and quality-controlled data sets for downstream consumption.
- Optimized and maintainable data solutions aligned with enterprise standards.
Must Haves:
- Extensive hands-on experience with scalable data pipelines for AI/ML and Generative AI workloads.
- Advanced expertise in Python, SQL, ETL/ELT, APIs, and cloud-based data platforms.
- Solid knowledge of Azure data and AI ecosystem including Azure Machine Learning and Azure AI Foundry.
- Ability to develop production-grade, reliable, and maintainable data solutions.
Public Sector Experience:
Preferred
📌 Senior ETL Software Developer (Ontario)
🏢 vTech Solution
📍 Ontario