13 Aug
|
Maven Workforce
|
Toronto
13 Aug
Maven Workforce
Toronto
About the Role
We are seeking a talented Data Engineer with hands-on experience in building scalable data pipelines and modern cloud-based data platforms. The ideal candidate will have experience working with Python and big data technologies such as Apache Airflow, Apache Spark, and Apache Beam, along with strong knowledge of SQL and data warehousing concepts.
In this role, you will design and develop cloud-native data pipelines on Google Cloud, enabling reliable data processing and integration of machine learning models. You will work closely with data scientists, engineers, and cross-functional teams to build and expand our enterprise data platform while ensuring high performance, scalability, and reliability of data solutions
.
The position requires solid collaboration skills, experience working in agile development environments, and familiarity with CI/CD practices, cloud infrastructure, and modern data engineering tool s.
Responsibilit iesUse the latest technology to build data pipelines and integrate machine learning mod elsBuild and expand our data platf ormDevelop applications that run on a Google Cloud-based infrastructu re.
Qualificati ons:2+ years of experience in Big Data and Data Engineering, building enterprise-level applications in a public cloud, preferably Google C loudExperience building cloud-native data pipelines using Python, Apache Airflow, Apache Spark, and Apache B eam.Working knowledge of SQL and data warehousing concepts, including PostgreSQL and BigQu ery.Optionally, knowledge of Mongo and AlloyDB is a p lus.Comfortable using Azure DevOps or similar CI/CD tools,
Git.Experience with TDD, agile software development processes, and collaborating in multi-functional agile te ams.Communicate effectively with technical teams and non-technical stakehold ers.Bachelor's degree in Computer Science or related engineering discipline, or equivalent combination of education and experie nce.Optionally, experience building Docker images and deploying them to a Production environment.
Integrate
Docker container orchestration framework using Kubernetes by creating pods, config Maps, and deployments using Terraf orm.Optionally, experience with C#, .NET core, and microserv ices
📌 Data Engineer (Toronto)
🏢 Maven Workforce
📍 Toronto