21 Sep
|
Insight Global
|
Canada
21 Sep
Insight Global
Canada
Elevate data processes as a Databricks ETL Developer supporting a Capital Markets Client Reporting initiative. Utilize solid data engineering skills to build scalable pipelines and reporting solutions within Azure.
In this role, you will be pivotal in modernizing and automating enterprise data processes for a strategic client. The successful candidate will leverage expertise in data pipelines, warehousing, and reporting-focused architectures. Familiarity with Medallion architecture and Delta Lake technologies is essential to thrive in this workplace.
Key Responsibilities:
Architect and implement data pipelines using Medallion architecture
Ingest data from APIs, flat files, and Databricks transfers
Apply Data Vault 2.0 and Kimball modeling techniques
Build real-time data pipelines with Structured Streaming
Enforce data quality and security policies
Requirements:
Hands-on experience with Azure ADLS Gen2 and Medallion architecture
Proficient in PySpark and Databricks SQL
Knowledge of Delta Lake ACID transactions
Experience with Databricks Workflows and Spark tuning
Background in Capital Markets or Financial Services
Contribute to cutting-edge data solutions within the Capital Markets with your ETL and data engineering skills.
J-18808-Ljbffr
📌 Databricks Etl Developer For Capital Markets Toronto (Canada)
🏢 Insight Global
📍 Canada