29 Sep
|
CG Consulting Group
|
Toronto
29 Sep
CG Consulting Group
Toronto
Sr Data Engineer This is a global IT services firm position for a very large investment fund with global reach. Location: Downtown Toronto, near TTC and GO Train. Hybrid work: 4 days in office per week. Contract: 6 months, possible renewal. Rate: $60 to $80/hr B2B. Project description We are seeking a hands‑on Data Engineer to support the Total Fund Management Portfolio Management Technology team. This role focuses on building and optimizing large‑scale data processing systems in a cloud‑native environment. You are expected to independently design and deliver scalable data solutions with minimal oversight. This is not a role for someone who requires detailed task breakdowns or constant direction. Once objectives and constraints are transparent, you are expected to independently drive work to completion, proactively manage risks, and communicate progress effectively. Responsibilities Develop and optimize Spark‑based workloads in cloud environments. Work with large‑scale datasets using modern storage formats.
Collaborate with stakeholders to translate data requirements into robust engineering solutions. Ensure high performance, reliability, and maintainability of data platforms. Contribute to production readiness, including monitoring, documentation, and deployment. Skills Must have Minimum 5 years of experience in software. Strong Python with PySpark. Hands‑on experience with Apache Spark (preferably in cloud environments). Experience working with large‑scale data systems. Familiarity with columnar formats (Parquet) and modern table formats (Iceberg). Experience with Databricks. Prior consulting, advisory, or client‑facing delivery experience. Ability to operate effectively in ambiguous environments. Proven independent delivery without close supervision. Strong problem‑solving and continuous improvement mindset. Nice to have AWS data services (Glue, Lake Formation). Workflow orchestration tools (Airflow). Experience with distributed data processing architectures. Capital markets experience. #J-18808-Ljbffr
📌 Sr Data Engineer - C$60 - C$80 An Hour (Toronto)
🏢 CG Consulting Group
📍 Toronto