02 Nov
|
Aigrev.
|
Canada
Job Title: Senior Azure Data Engineer – ADF, Databricks, Snowflake & AI Integration
Location:
Canada (Remote) Employment Type: Full-Time Contract
Experience:
10+ Years
Working Hours
Pacific Standard Time (PST) Business Hours
Job Description
We are looking for a highly experienced Senior Azure Data Engineer with strong expertise in Azure Data Factory (ADF), Azure Integration Services, Databricks, Apache Spark, Snowflake, and AI technologies to support an Enterprise Data Hub (EDH) initiative. The ideal candidate will have extensive experience designing, developing, and implementing enterprise-grade data engineering and integration solutions, along with hands-on experience in cloud data platforms, distributed processing, and AI-driven data engineering.
Key Responsibilities
- Design, develop, and maintain enterprise data pipelines using Azure Data Factory (ADF).
- Build and manage integrations using Azure Integration Services.
- Work with Azure Logic Apps, Service Bus, Event Grid, and API Management.
- Design and develop scalable data processing solutions using Databricks and Apache Spark (PySpark).
- Build, optimize, and maintain data pipelines and data models in Snowflake.
- Develop and optimize ETL/ELT pipelines and enterprise data integration workflows.
- Implement data ingestion, transformation, and processing across structured and semi-structured data sources.
- Apply AI tools and techniques to improve data engineering productivity and automation.
- Explore opportunities to integrate generative AI and AI capabilities into data processing and integration workflows.
- Troubleshoot and resolve complex data pipeline, performance, and integration issues.
- Collaborate with architects, developers, and business stakeholders to deliver scalable enterprise data solutions. Required Skills & Qualifications
- 10+ years of experience in data engineering, data integration,
or related technical roles.
- Strong hands-on expertise in Azure Data Factory (ADF).
- Extensive experience with Azure Integration Services, including:
- Azure Logic Apps
- Azure Service Bus
- Azure Event Grid
- Azure API Management
- Strong hands-on experience with Databricks and Apache Spark, including PySpark.
- Experience designing and developing data engineering solutions using Snowflake.
- Robust SQL skills and experience with enterprise data integration architectures.
- Experience with ETL/ELT development, data transformation, and pipeline optimization.
- Practical knowledge of AI technologies and AI-powered development tools.
- Understanding of AI-assisted data engineering, automation, and workflow optimization.
- Experience with Azure DevOps, CI/CD, and source control.
- Strong analytical, troubleshooting, communication, and problem-solving skills. Preferred Qualifications
- Experience working on Enterprise Data Hub (EDH) or enterprise data platform initiatives.
- Knowledge of Azure AI services, Generative AI, or AI-enabled data integration.
- Experience integrating Databricks, Snowflake, and Azure data services.
- Experience designing scalable, secure, and reliable cloud data architectures.
- Knowledge of data governance, data quality, metadata management, and data security.
- Relevant Microsoft Azure, Databricks, or Snowflake certifications are an advantage. Work Requirements
- Must be based in Canada.
- Must be available for a full-time contract engagement.
- Must be able to work remotely during Pacific Time business hours.
- Must have excellent communication and collaboration skills for working with distributed teams.
How to Apply
Interested candidates should share their updated resume along with the following details:
- Current location in Canada
- Work authorization status
- Availability to start
- Expected hourly contract rate Pay: From $40.00 per hour Work
Location:
Remote
📌 Job Title: Senior Azure Data Engineer – ADF, Databricks, Snowflake (Canada)
🏢 Aigrev.
📍 Canada