Seeking a Specialist with 5 to 7 years of experience in Scala and Apache Spark to design and implement scalable big data solutions within the Hadoop ecosystem
Job Description
Extensive handson experience with Apache Spark for largescale data processing and analytics
Proficient in big data technologies within the Hadoop ecosystem Strong programming skills in Scala for data engineering tasks
Deep understanding of distributed computing frameworks and performance optimization techniques
Experience with batch and realtime data processing pipelines Knowledge of data ingestion transformation and storage best practices
Familiarity with data quality assurance validation and troubleshooting in big data environments
Ability to work with complex data architectures and cloudbased big data platforms
Skilled in debugging and optimizing Spark jobs to ensure efficient resource utilization
Understanding of data security compliance and governance within big data solutions
Roles and Responsibilities
Design develop and maintain scalable and robust data pipelines using Apache Spark SparkSQL Scala and related big data technologies
Collaborate with cross functional teams to gather business requirements and translate them into technical solutions
Optimize Spark applications for performance scalability and cost efficiency
Lead the implementation of data processing workflows ensuring data quality and consistency
Provide technical mentorship and guidance to junior team members and peers
Participate in architectural reviews and recommend best practices for big data solution design
Troubleshoot and resolve complex issues in data processing pipelines within defined SLAs
Stay updated with emerging big data technologies and incorporate relevant advancements into existing systems
Ensure adherence to organizational standards for data security compliance and governance
LTM is an AI-centric global technology services company and the Business Creativity partner to the world’s largest and most disruptive enterprises. We bring human insights and intelligent systems together to help clients create greater value at the intersection of technology and domain expertise. Our capabilities span integrated operations, transformation, and business AI — enabling new ways of working, current productivity paradigms, and new roads to value. Together with over 87,000 employees across 40 countries and our global network of partners, LTM — a Larsen & Toubro company — owns business outcomes for our clients, helping them not just outperform the market, but to Outcreate it. Please also note that neither LTM nor any of its authorized recruitment agencies/partners charge any candidate registration fee or any other fees from talent (candidates) towards appearing for an interview or securing employment/internship. Candidates shall be solely responsible for verifying the credentials of any agency/consultant that claims to be working with LTM for recruitment. Please note that anyone who relies on the representations made by fraudulent employment agencies does so at their own risk, and LTM disclaims any liability in case of loss or damage suffered as a consequence of the same. Recruitment Fraud Alert - https://www.ltm.com/careers/recruitment-fraud-alert
📌 Specialist - Data Engineering (Mississauga)
🏢 LTM
📍 Mississauga
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.