01 Aug
|
Ku0026K Global Talent Solutions
|
Mississauga
01 Aug
Ku0026K Global Talent Solutions
Mississauga
Position: Senior Big Data Engineer
Location: Hybrid- Mississauga, ON
Job type: Full time/Permanent Hiring
We are looking for a Senior Big Data Developer with strong expertise in Spark, Scala, Kafka, SQL, Hadoop, and Cloudera Big Data Ecosystem . The ideal candidate should have experience processing large-scale datasets , developing high-performance data pipelines, troubleshooting distributed data platforms, and supporting enterprise Big Data solutions. Hands-on experience with Spark, Scala, Kafka, Cloudera, and performance optimization is highly preferred.
Key Responsibilities
- Design, develop, and maintain scalable Big Data applications using Spark, Scala, Kafka, SQL, Hive, and Hadoop .
- Analyze, process, and transform large-volume datasets while ensuring data quality, accuracy, and performance.
- Develop and optimize Spark jobs, Scala applications, and distributed data processing workflows.
- Perform performance tuning, root cause analysis,
and troubleshooting across the Cloudera Big Data ecosystem .
- Work with Hive, Impala, Hadoop, Splunk, and AutoSys to support enterprise data platforms and batch processing.
- Utilize Linux environments to deploy, monitor, and support Big Data applications.
- Collaborate with business users, architects, and cross-functional teams to analyze complex business and system requirements.
- Support production deployments, issue resolution, and continuous improvements for enterprise Big Data solutions.
Required Skills Big Data: Spark, Scala, Kafka, Hadoop, Cloudera
Data Processing: SQL, Hive, Impala, Data Analysis, Data Wrangling
Monitoring & Scheduling: Splunk, AutoSys
Platform: Linux/Unix
Performance: Performance Tuning, Troubleshooting, Root Cause Analysis
📌 Senior Big Data Engineer (Mississauga)
🏢 Ku0026K Global Talent Solutions
📍 Mississauga