25 Sep
|
ALLTECH CONSULTING SVC
|
Mississauga
25 Sep
ALLTECH CONSULTING SVC
Mississauga
Become a Data Pipeline Engineer leveraging Databricks, Python, and SQL for robust data solutions. This role involves close interaction with business analysts for effective data management.In this position, your main responsibility will be to build and optimize data pipelines for high-quality data processing. Your expertise in Spark programs and data architecture will ensure reliable integration and thorough monitoring of Databricks jobs, enhancing data governance throughout the cloud environment.Key Responsibilities:Build data pipelines ensuring quality and efficiencyDevelop and deploy Spark applications in DatabricksTroubleshoot and optimize job performanceImplement best practices in data security and managementReview code for optimal execution and complianceRequirements:5+ years of experience in Python codingExtensive SQL development expertiseProven experience in ETL with Databricks PysparkFamiliarity with cloud data warehouses like RedshiftArchitectural experience in enterprise data migrationsUtilize your skills in Python and SQL as a Data Pipeline Engineer in a team-oriented environment.
📌 Data Pipeline Engineer With Databricks Focus (Mississauga)
🏢 ALLTECH CONSULTING SVC
📍 Mississauga