22 Oct
|
RPIA Capital Management
|
Toronto
22 Oct
RPIA Capital Management
Toronto
The duties and responsibilities of the DataOps Engineer include but are not limited to:
We are currently seeking a full-time permanent DataOps Engineer to join our Technology team.
As a DataOps Engineer, you will design, build, automate, and operate the firm's modern cloud data platform. You will be responsible for delivering secure, scalable, and reliable data services that enable business intelligence, advanced analytics, machine learning, and application development across the organization.
Rather than focusing solely on database administration, this role emphasizes platform engineering, observability, and DevOps practices. You will work closely with software engineers, DevOps engineers, and business stakeholders to deliver self-service data capabilities while ensuring high standards of security, governance, and operational excellence.
The duties and responsibilities of the DataOps Engineer include but are not limited to:
Cloud Data Platform Engineering
- Design, implement, and maintain cloud-native data platforms supporting structured, semi-structured, and streaming data.
- Build scalable Lakehouse and data warehouse architectures.
- Develop reusable platform services for ingestion, transformation, storage, and consumption.
- Standardize data infrastructure across development, QA, and production environments.
DataOps & Platform Automation
- Build CI/CD pipelines for databases, data pipelines, and infrastructure.
- Automate provisioning, deployment, testing, and rollback.
- Automate non-production database seeding with sanitized production data.
- Develop automated validation and quality checks.
Data Engineering
- Build reliable ETL/ELT pipelines.
- Integrate data from databases, APIs, SaaS platforms, event streams, and cloud storage.
- Design CDC and incremental loading strategies.
- Optimize data movement for performance, reliability, and cost.
Database Engineering
- Design logical and physical data models.
- Optimize SQL performance and indexing.
- Configure high availability and disaster recovery.
- Monitor platform health and resolve bottlenecks.
Observability & Reliability
- Implement monitoring, alerting, and centralized logging.
- Define SLAs and reliability metrics.
- Perform root cause analysis and continuous improvement.
Platform Enablement
- Build reusable templates and engineering standards.
- Create documentation and operational runbooks.
- Mentor engineers and analysts on platform best practices.
Research & Innovation
- Evaluate Microsoft Fabric, Azure data services, Lakehouse architecture, streaming platforms, vector databases, and AI-ready platforms.
Cloud
Desired Technical Skills
- Azure SQL
- Azure Storage
- Azure Data Factory
- Microsoft Fabric
- Azure Synapse
- Azure Functions
- Azure Event Hubs
- Azure Key Vault
- Azure Monitor
Databases
- SQL Server
- Azure SQL
- PostgreSQL
- Snowflake
- Databricks SQL
Programming
- Python
- PowerShell
- C#
- SQL
- Bash
Automation
- Terraform
- Git
- GitHub Actions
- Azure DevOps Pipelines
Containers
- Docker
- Kubernetes
- Helm
Data Engineering
- Spark
- Delta Lake
- Parquet
- CDC
- Event-driven architecture
Monitoring
- Datadog
- Azure Monitor
- OpenTelemetry (OTel)
- Azure Log Analytics
Critical Competencies
- Service Excellence – Delivers reliable, scalable data platforms through robust engineering standards, automation, observability, and continuous improvement.
- Attention to Detail – Maintains accuracy across data models, pipelines, infrastructure, workflows, validations, documentation, and runbooks.
- Organization & Time Management – Balances platform, pipeline, database, support, and research priorities while coordinating dependencies and meeting timelines.
- Technical Proficiency – Applies strong knowledge of cloud data platforms, Lakehouse architectures, ETL/ELT, CDC, database engineering, CI/CD, infrastructure, monitoring, and Azure data services to improve systems and processes.
- Problem-Solving & Initiative – Identifies quality issues, bottlenecks, risks, and automation opportunities; resolves root causes with sustainable solutions.
- Communicat
📌 DataOps Engineer (Toronto)
🏢 RPIA Capital Management
📍 Toronto