06 Aug
|
ITProFound
|
Winnipeg
06 Aug
ITProFound
Winnipeg
ITProFound is a Global employer serving the USA, INDIA and Canada. The company develops Software Products and solutions, as well as Project Implementation, besides staff augment to the direct clients.Job DescriptionSoftware Developer - ETL - SeniorJob ID:RQ11258 - Software Developer - ETL - SeniorDuration:1 year + extensionType:OnsiteJob Description:MUST HAVES:10+ years experience in designing and developing scalable Medallion Data Lakehouse architectures.Expertise in data ingestion, transformation, and curation using Delta Lake and Databricks.Experience integrating structured and unstructured data sources into star/snowflake schemas.Building, automating, and optimizing complex ETL/ELT pipelines using Azure Data Factory (ADF), Databricks (PySpark, SQL, Delta Live Tables), and dbt.Implementing orchestrated workflows and job scheduling in Azure environments.Solid knowledge of relational (SQL Server, Synapse, PostgreSQL) and dimensional modeling.Advanced SQL query optimization, indexing, partitioning,
and data replication strategies.Experience with Apache Spark, Delta Lake, and distributed computing frameworks in Azure Databricks.Working with Parquet, ORC, and JSON formats for optimized storage and retrieval.Strong understanding of cloud security, RBAC, and data governance.Proficiency in Python (PySpark), SQL, and PowerShell for data engineering workflows.Experience with CI/CD automation (Azure DevOps, GitHub Actions) for data pipelines.Implementing data lineage, cataloging, metadata management, and data quality frameworks.Experience with Unity Catalog for managing permissions in Databricks environments.Expertise in Power BI (DAX, data modeling, performance tuning).Experience in integrating Power BI with Azure Synapse and Databricks SQL Warehouses.Familiarity with MLflow, AutoML, and embedding AI-driven insights into data pipelines.#J-18808-Ljbffr
📌 Expert Etl Software Migration Specialist (Winnipeg)
🏢 ITProFound
📍 Winnipeg