29 Aug
|
Confiar Services
|
Toronto
29 Aug
Confiar Services
Toronto
Senior Azure Data Engineer
Location: Toronto, Canada
Duration: Long Term Contract
We are looking for a Senior Azure Databricks & Python Developer with strong experience in data engineering, business intelligence, and Python-based API development. The ideal candidate will design and develop scalable data solutions using Azure Databricks and build robust APIs using Python.
Responsibilities
- Design, develop, and maintain scalable data solutions using Azure Databricks.
- Develop and optimize data processing pipelines using Python, PySpark, and SQL.
- Build, develop, and maintain REST APIs using Python.
- Integrate APIs with data platforms, databases, and cloud services.
- Develop data models and support Business Intelligence (BI) reporting and analytics requirements.
- Work with Azure services to build reliable and scalable data solutions.
- Optimize Databricks jobs, notebooks, queries, and data pipelines for performance.
- Implement data quality, validation, monitoring, and error-handling processes.
- Collaborate with BI developers, data engineers, software engineers, and business stakeholders.
- Follow best practices for coding, testing, deployment, security, and documentation.
Required Skills
- Strong hands-on experience with Azure Databricks.
- Robust Python programming experience.
- Strong experience building REST APIs using Python.
- Strong knowledge of Business Intelligence (BI) concepts and reporting solutions.
- Experience with PySpark and SQL.
- Experience with Azure cloud services and data engineering technologies.
- Knowledge of data modeling, ETL/ELT, and data integration.
- Experience with API integration, testing, and troubleshooting.
- Strong problem-solving and communication skills.
Preferred Skills
- Experience with Azure Data Factory, Azure Synapse, ADLS, and Azure SQL.
- Experience with Power BI or other BI platforms.
- Knowledge of FastAPI, Flask, or Django REST Framework.
- Experience with CI/CD and Git-based development.
- Knowledge of cloud-based data architecture and modern data engineering practices.
📌 Azure data engineer (Toronto)
🏢 Confiar Services
📍 Toronto