Job Title: Big Data Developer

Location: Mississauga, ON
Work Model: Hybrid
Employment Type: Full-Time (FTE)
Experience: 10+ Years

Job Summary: We are seeking an experienced Big Data Developer with 10+ years of expertise in designing, developing, and optimizing large-scale data processing solutions. The ideal candidate will have strong hands-on experience with the Hadoop ecosystem, Spark, Scala, Kafka, SQL, and big data technologies, along with excellent analytical and problem-solving skills. This role requires collaborating with cross-functional teams to build scalable, high-performance data pipelines and support enterprise data initiatives.

Key Responsibilities

Design, develop, and maintain scalable big data applications and data pipelines.

Analyze complex business problems and translate requirements into technical solutions.

Develop high-performance data processing applications using Spark, Scala, Kafka, and Hadoop technologies.

Perform data analysis, data wrangling, and transformation on large-scale datasets.

Optimize application and query performance across big data platforms.

Troubleshoot production issues and provide timely resolution within the Cloudera Big Data ecosystem.

Develop and optimize SQL, Hive, and Impala queries for analytics and reporting.

Monitor, schedule, and maintain batch jobs using Autosys.

Utilize Splunk for application monitoring, log analysis, and troubleshooting.





Collaborate with business users, architects, and development teams to deliver high-quality solutions.

Follow industry best practices, coding standards, and SDLC processes.

Required Technical Skills

Strong experience with:

Apache Kafka

Apache Spark

Scala

SQL

Hive

Impala

Hadoop Ecosystem

Splunk

Autosys

Hands-on experience with Cloudera Big Data Platform.

Strong data analysis and data wrangling skills for processing high-volume datasets.

Experience in performance tuning, troubleshooting, and optimization of big data applications.

Good knowledge of Linux-based environments and shell scripting.

Experience working with distributed data processing systems.

Required Qualifications

10+ years of experience in Big Data Development.

Strong analytical and problem-solving abilities.

Excellent verbal and written communication skills.

Ability to interact directly with business stakeholders.

Self-motivated with a strong desire to learn new technologies.

Ability to work effectively in a fast-paced, global team workplace.

Flexible and capable of delivering high-quality solutions within tight deadlines.

Preferred Qualifications

Experience working in enterprise-scale data platforms.

Exposure to Agile/Scrum methodologies.

Experience in Banking or Financial Services domain is an advantage.

📌 Big Data Developer || Mississauga, ON (Hybrid) || Fulltime FTE
🏢 AceStack
📍 Mississauga