03 Aug
|
Ku0026K Global Talent Solutions
|
Mississauga
03 Aug
Ku0026K Global Talent Solutions
Mississauga
Position: Senior Big Data Engineer
Location: Hybrid- Mississauga, ON
Job type: Full time/Permanent Hiring
We are looking for a Senior Big Data Developer with solid expertise in Spark, Scala, Kafka, SQL, Hadoop, and Cloudera Big Data Ecosystem . The ideal candidate should have experience processing large-scale datasets , developing high-performance data pipelines, troubleshooting distributed data platforms, and supporting enterprise Big Data solutions. Hands-on experience with Spark, Scala, Kafka, Cloudera, and performance optimization is highly preferred.
Key Responsibilities
Design, develop, and maintain scalable Big Data applications using Spark, Scala, Kafka, SQL, Hive, and Hadoop .
Analyze, process, and transform large-volume datasets while ensuring data quality, accuracy, and performance.
Develop and optimize Spark jobs, Scala applications, and distributed data processing workflows.
Perform performance tuning, root cause analysis,
and troubleshooting across the Cloudera Big Data ecosystem .
Work with Hive, Impala, Hadoop, Splunk, and AutoSys to support enterprise data platforms and batch processing.
Utilize Linux environments to deploy, monitor, and support Big Data applications.
Collaborate with business users, architects, and cross-functional teams to analyze complex business and system requirements.
Support production deployments, issue resolution, and continuous improvements for enterprise Big Data solutions.
Required Skills Big Data: Spark, Scala, Kafka, Hadoop, Cloudera
Data Processing: SQL, Hive, Impala, Data Analysis, Data Wrangling
Monitoring & Scheduling: Splunk, AutoSys
Platform: Linux/Unix
Performance: Performance Tuning, Troubleshooting, Root Cause Analysis
📌 Senior Big Data Engineer Mississauga
🏢 Ku0026K Global Talent Solutions
📍 Mississauga