Big Data Developer - Senior Level Position Overview

We are seeking an experienced Senior Big Data Developer to join Royal Bank of Canadas Data Engineering team. You will design| build| and optimize scalable data pipelines and infrastructure to support our enterprise data analytics and business intelligence initiatives.

Key Responsibilities

• Design and develop robust ETL/ELT pipelines using Spark| Hive| and Hadoop for large-scale data processing
• Architect and maintain Snowflake data warehouse solutions| including schema design and optimization
• Develop and manage infrastructure-as-code solutions using AWS services (S3| Glue| EMR| RDS)Build and deploy containerized applications using Docker/Kubernetes and OpenShift (OCP4)Implement CI/CD pipelines and version control best practices using Git Collaborate with data scientists and analytics teams to ensure data quality and accessibility Mentor junior team members and contribute to technical documentation Leverage Gen AI tools to enhance code quality and development efficiency

Required Qualifications

• 5+ years of hands-on experience with big data technologies (Hadoop| Spark| Hive)
• Advanced proficiency with Snowflake platform and data modeling
• Strong SQL expertise and database design knowledge
• Proven experience with AWS cloud services
• Programming experience in Scala| Python| or Java
• Knowledge of SCM| infrastructure-as-code| and CI/CD pipeline implementation
• Excellent problem-solving| communication| and self-directed work ethic

Preferred Qualifications

• Experience with orchestration tools (Apache Airflow)
• ETL tool expertise (Informatica| Talend)
• API development experience
• Containerization and Kubernetes expertise
• Scripting proficiency (Shell| Python)
• Understanding of Gen AI for code generation

What We Offer

• Competitive compensation and comprehensive benefits
• Opportunities for professional growth and technical leadership
• Collaborative| creative work environment
• Exposure to cutting-edge data technologies