Job Title: Big Data Developer

Location: Toronto, Canada

Start Date: Immediate

Employment Type: Contract

Job Summary

We are seeking an experienced Big Data Developer to join our team in Toronto. The ideal candidate will have robust expertise in Big Data technologies, Snowflake, ETL development, SQL, and Scala/Java programming . You will be responsible for designing, developing, and maintaining scalable data pipelines while ensuring data quality, security, and performance in a cloud-based environment.

Key Responsibilities

- Design, develop, and maintain scalable data ingestion pipelines using Big Data technologies.
- Build and optimize ETL processes and data integration frameworks.
- Develop robust data pipelines using Hadoop, Spark, Hive, and Snowflake.
- Ensure data quality, security, reliability, and platform performance.
- Write and optimize complex SQL queries, stored procedures, and database views.
- Integrate Snowflake with various data sources and Business Intelligence (BI) tools.
- Monitor, troubleshoot, and resolve issues related to data pipelines and platform operations.
- Collaborate with Agile cross-functional teams to deliver high-quality data solutions.
- Maintain technical documentation for data pipelines, transformations, and data models.
- Leverage GenAI tools to improve development efficiency and automate code generation where applicable.
- Follow DevSecOps best practices, CI/CD processes, and Infrastructure-as-Code standards.





Required Skills & Qualifications
- 5+ years of experience in Big Data and ETL development.
- Strong hands-on experience with:
- Hadoop
- Apache Spark
- Hive
- Snowflake
- Strong SQL development and data modeling expertise.
- Programming experience in Scala or Java .
- Experience with ETL tools such as:
- Informatica
- Talend
- Apache Airflow
- Experience with cloud platforms ( AWS preferred ).
- Understanding of API development.
- Knowledge of DevSecOps practices.
- Familiarity with Source Code Management (Git), CI/CD pipelines, and Infrastructure-as-Code.
- Excellent analytical, troubleshooting, and communication skills.

Preferred Skills
- Experience with Apache Airflow workflow orchestration.
- Knowledge of GitHub Actions or other CI/CD automation tools.
- Experience with Docker, Kubernetes, Containers, or OpenShift (OCP4).
- Shell scripting.
- Python or other scripting languages.
- Experience using Generative AI tools to improve developer productivity.

Education
- Bachelor's or Master's degree in Computer Science, Data Engineering, Information Technology, or a related field.

Key Skills
- Big Data
- Hadoop
- Apache Spark
- Hive
- Snowflake
- ETL Development
- SQL
- Scala
- Java
- AWS
- Apache Airflow
- Informatica
- Talend
- DevSecOps
- API Development
- Git
- GitHub Actions
- Docker
- Kubernetes
- OpenShift (OCP4)
- Python
- Shell Scripting
- CI/CD
- Data Modeling
- GenAI

📌 Big Data Developer (Toronto)
🏢 iTek People
📍 Toronto