12 Oct
|
CoStar Group
|
Toronto
12 Oct
CoStar Group
Toronto
Responsibilities: Design, build, test, and maintain reliable, scalable data pipelines and data products.
Develop and optimize data transformations and orchestrations using SQL, Python, dbt, Airflow, Glue, PostgreSQL, and Snowflake.
Translate business requirements into maintainable technical designs and production-ready solutions.
Implement automated testing, data-quality checks, monitoring, failure handling, and recovery.
Optimize large-scale data workloads for performance, scalability, and cost.
Troubleshoot production issues and perform root-cause analysis across pipelines and databases.
Follow Git-based development, code review, CI/CD, and controlled release practices.
Ensure data products are documented, observable, governed, and supported by appropriate metadata and lineage.
Reduce technical debt, manual processes, and recurring operational issues through automation and improved design.
Collaborate with Product Management, Application Engineering and business stakeholders.
Basic Qualifications: 6+ years of skilled experience in data engineering or a closely related discipline.
Strong Python development skills for data pipelines, automation, integrations, and supporting data applications.
Advanced SQL skills and experience working with large-scale datasets.
Strong understanding of data modeling, database design, and data transformation patterns.
Experience with dbt, including model development, dependency management, testing, incremental processing, and production deployment.
Experience with Airflow, including DAG development, orchestration, dependencies, retries, failure handling, scheduling, and production operations.
Hands-on PostgreSQL experience, including complex SQL development, database design,
indexing, query optimization, and performance tuning.
Hands-on Snowflake experience in production data workloads context.
Experience working with AWS data services such as S3, RDS/Aurora, Glue, MWAA, IAM, and Cloud
Watch.
Experience implementing automated data validation and quality controls.
Experience with Git, pull requests, code review, conflict resolution and CI/CD workflows.
Demonstrated ability to troubleshoot complex production pipeline and data issues.
Understanding of monitoring, failure recovery, and production support practices.
Preferred Qualifications: Experience with Amazon Aurora PostgreSQL.
Experience working with datasets containing hundreds of millions or billions of records.
Experience with AWS Glue and Amazon MWAA.
Experience with geospatial data and PostGIS.
Experience with SQL Server.
Experience with Data
Hub or another metadata, lineage, or governance platform.
Experience with Grafana or comparable observability tooling.
Experience with database schema migration and version-control frameworks.
Experience working within controlled production release and change-management processes.
Strong hands-on engineering capability and ownership.
Ability to independently deliver complex data engineering solutions.
Strong analytical, troubleshooting,
and root-cause-analysis skills.
Ability to work effectively with large and complex datasets.
Strong focus on reliability, performance, scalability, and maintainability.
Ability to balance delivery requirements with engineering quality.
Strong written and verbal communication.
Ability to collaborate effectively with technical and non-technical stakeholders.
What's in it for you? When you join CoStar Group, you’ll experience a collaborative and innovative culture working alongside the best and brightest to empower our people and customers to succeed.
We offer you generous compensation and performance-based incentives.
CoStar Group also invests in your professional and academic growth with internal training and tuition reimbursement.
Our benefits package includes (but is not limited to): Comprehensive healthcare coverage: Medical / Vision / Dental / Prescription Drug Life, legal, and supplementary insurance Virtual and in person mental health counseling services for individuals and family Commuter and parking benefits 401(K) retirement plan with matching contributions Employee stock purchase plan Paid time off Tuition reimbursement On-site fitness center and/or reimbursed fitness center membership costs (location dependent) Access to CoStar Group’s Employee Resource Groups Complimentary gourmet coffee, tea, hot chocolate, fresh fruit, and other healthy snacks The final salary or hourly rate offered for this role will fall within the range set forth below based on a variety of factors, including but not limited to, geographic location, skills, and competencies.
Base Compensation: CAD $120,000-$150,000 (annually)
📌 Senior Data Engineer - Zonda - Toronto, Ontario
🏢 CoStar Group
📍 Toronto