Required Skills.

• Robust hands-on experience with Data-bricks and Apache Spark (PySpark/Scala).

• Experience in SQL and data transformation techniques.

• Knowledge of ETL tools and data pipeline development.

• Experience working with cloud platforms (Azure/AWS/GCP)

• Strong Azure cloud background

• Understanding of data warehousing concepts.

• Strong problem-solving and analytical skills.

• Hands-on experience with Azure Data bricks or Delta Lake, in building ETL pipelines : batch (autoloader) and Spark structured streaming

• Knowledge of data modelling and performance tuning in Spark.

• Exposure to CI/CD pipelines and DevOps practices.

• Familiarity with data governance and security practices.





• Strong hands on working experience of Unity catalog:

• Hands on exposure to Creating end to end environments : creating catalogs, schemas, tables . materialized views, functions, volumes

• Experience in building SCD 1 and SCD2 (slowly changing dimensions ) on dimension tables

• Experience in building CDC (change data capture pipelines)

• Strong hands on experience with Lakehouse federation , creating foreign catalogs to get data from external sources

• Strong understanding of databricks partitioning , Liquid clustering

📌 Data Engineer (Toronto)
🏢 Nameless
📍 Toronto