18 Sep
|
Insight Global
|
Ontario
18 Sep
Insight Global
Ontario
Elevate data processes as a Databricks ETL Developer supporting a Capital Markets Client Reporting initiative. Utilize strong data engineering skills to build scalable pipelines and reporting solutions within Azure.
In this role, you will be pivotal in modernizing and automating enterprise data processes for a strategic client. The successful candidate will leverage expertise in data pipelines, warehousing, and reporting-focused architectures. Familiarity with Medallion architecture and Delta Lake technologies is essential to thrive in this workplace.
Key Responsibilities:
• Architect and implement data pipelines using Medallion architecture
• Ingest data from APIs, flat files, and Databricks transfers
• Apply Data Vault 2.0 and Kimball modeling techniques
• Build real-time data pipelines with Structured Streaming
• Enforce data quality and security policies
Requirements:
• Hands-on experience with Azure ADLS Gen2 and Medallion architecture
• Proficient in PySpark and Databricks SQL
• Knowledge of Delta Lake ACID transactions
• Experience with Databricks Workflows and Spark tuning
• Background in Capital Markets or Financial Services
Contribute to innovative data solutions within the Capital Markets with your ETL and data engineering skills.
#J-18808-Ljbffr
📌 Databricks ETL Developer for Capital Markets (Ontario)
🏢 Insight Global
📍 Ontario