Become a Data Pipeline Engineer leveraging Databricks, Python, and SQL for robust data solutions. This role involves close interaction with business analysts for effective data management. In this position, your main responsibility will be to build and optimize data pipelines for high-quality data processing.
Your expertise in Spark programs and data architecture will ensure reliable integration and thorough monitoring of Databricks jobs, enhancing data governance throughout the cloud workplace. Key Responsibilities:
Build data pipelines ensuring quality and efficiency
Develop and deploy Spark applications in Databricks
Troubleshoot and optimize job performance
Implement best practices in data security and management
Review code for optimal execution and compliance Requirements:
5+ years of experience in Python coding
Extensive SQL development expertise
Proven experience in ETL with Databricks Pyspark
Familiarity with cloud data warehouses like Redshift
Architectural experience in enterprise data migrations Utilize your skills in Python and SQL as a Data Pipeline Engineer in a team-oriented setting.
📌 Data Pipeline Engineer With Databricks Focus Mississauga
🏢 ALLTECH CONSULTING SVC
📍 Mississauga
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.