Job Title:Big Data Developer – Spark, AWS, Airflow & SnowflakeCompany:Cogency Inc.Work Model:Hybrid – 4 Days OnsiteJob Type:Full-TimeJob SummaryCogency Inc. is seeking a skilledBig Data Developer / Data Engineerwith solid expertise inSpark, Snowflake, AWS, Airflow, Big Data technologies, and ETL. The successful candidate will design, develop, and optimize scalable data pipelines and ETL processes while ensuring data quality, security, reliability, and performance.The role involves working closely with cross-functional teams in an Agile environment to deliver robust data solutions supporting analytics, reporting, and business intelligence initiatives.Key ResponsibilitiesDesign, develop, and maintain scalabledata ingestion pipelines and ETL workflows .Build and optimize data pipelines, transformation frameworks, and processing workflows.Develop and optimizeApache Sparkapplications for large-scale data processing.Work withHadoop, Spark, and Hivewithin Big Data environments.Design and optimizeSnowflakedata solutions, data models, and SQL workloads.Develop complex SQL queries, stored procedures, transformations, and data models.Integrate Snowflake with enterprise data sources and BI/reporting platforms.Develop ETL workflows usingInformatica, Talend, Apache Airflow, or similar technologies.Build and manage workflow orchestration usingApache Airflow .Develop data solutions onAWS, leveraging services such as S3, Glue, and Lambda.Monitor, troubleshoot, and resolve data pipeline and platform performance issues.Implement data quality, integrity, security, and governance controls.Develop APIs and data integrations usingScala or Java .Implement CI/CD, DevSecOps, and Infrastructure-as-Code practices.Maintain technical documentation for data pipelines, transformations, and data models.Collaborate with Data Architects, Developers,



DevOps teams, Business Analysts, and other stakeholders.Participate in Agile ceremonies, code reviews, testing, deployment, and production support.LeverageGenAI and AI-assisted development toolsto improve developer productivity and code quality.Required Skills & Experience5+ years of experiencein Data Engineering, Big Data, or ETL development.Solid hands-on experience with:HadoopHiveSnowflakeStrong SQL and data modeling skills.Programming experience inScala or Java .Experience developing APIs and enterprise data integrations.Experience with ETL technologies such asInformatica, Talend, or Apache Airflow .Strong understanding of data ingestion, transformation, processing, and pipeline optimization.Experience working with cloud platforms, preferablyAWS .Understanding ofCI/CD, DevSecOps, and Infrastructure-as-Codepractices.Experience working in Agile delivery environments.Strong troubleshooting, analytical, and problem-solving skills.Excellent communication and collaboration skills.Preferred / Nice-to-HaveHands-on experience withAWS Glue, S3, Lambda, and other AWS data services.Strong experience withApache Airflowor similar orchestration platforms.Experience withGitHub Actions, Git, and automated testing .Knowledge ofPythonor other scripting languages.Experience with Shell/Bash scripting.Exposure toDocker, Kubernetes, or OpenShift .Experience with Infrastructure-as-Code tools such as Terraform.Experience with GenAI tools for code generation, code review, and developer productivity.EducationBachelor's or Master's degree inComputer Science, Data Engineering, Information Technology, or a related discipline .SnowflakeAWS CloudETL/ELT DevelopmentSQL & Data ModelingScala / JavaAPI IntegrationDevSecOps & CI/CDData Quality & GovernanceAgile DeliveryProblem Solving & Troubleshooting#J-18808-Ljbffr

📌 Big Data Developer (Winnipeg)
🏢 Cogency
📍 Winnipeg