25 Oct
|
LeverageTek Staffing Solutions
|
Vancouver
25 Oct
LeverageTek Staffing Solutions
Vancouver
LeverageTek is actively seeking a Data Engineer (Python / PySpark) for a 5-month contract with its Ottawa-based customer. Convert remaining Python code packages to PySpark, including testing, validation and integration into the nightly ETL pipeline. Review all existing business-owned code packages to identify and implement performance optimizations for nightly pipeline execution.
Write, validate and integrate code improvements to improve pipeline efficiency and accuracy. Document end-to-end ETL pipeline processes for package ingestion (time permitting). Collaborate with IT colleagues to support improvements to pipeline flow, automation and efficiency (time permitting).
Intermediate to Senior hands-on experience with Apache Spark (PySpark). Intermediate to Senior experience with Python, including code conversion and optimization.
Experience with GitLab or GitHub for version control and team-oriented development.
Experience with AWS EMR Clusters (asset).
Experience with Apache Airflow (asset).
Experience working within existing ETL pipeline architectures. Strong ability to work independently in a fully remote environment. Familiarity with AWS data services (S3, Glue, Redshift, Lake Formation) considered an asset.
Hourly Rate
Negotiable.
We are a trusted partner to leading private and public sector organizations and experts in talent solutions that create optimal business outcomes. Our roots are in technology, but we are also a proven leader in accounting and finance, sales and marketing, human resources, supply chain, and legal talent acquisition.
We offer contract and permanent staffing, executive search, talent mapping, management consultancy, and contractor payroll management.
We offer a welcoming and inclusive environment in service to one another, our customers, the candidates we represent, and the diverse communities we call home. LeverageTek is committed to employment equity and creating a diverse and inclusive workplace. We welcome applications from all qualified individuals regardless of race, religion, gender, national origin, age, disability, and marital status.
Accessibility accommodations are available upon request. LeverageTek is specialized recruiting professionals use their expertise and our proprietary AI to accelerate connections between top talent and leading companies, while ensuring all screening and hiring decisions remain with our expert human team. #
📌 Data Architect Data Analytics (Vancouver)
🏢 LeverageTek Staffing Solutions
📍 Vancouver