Python and PySpark expertise define this Data Engineering role, focused on AI applications, cloud platforms, and production-grade software engineering.
Build and operationalize data and AI solutions using Python, PySpark, SQL, REST APIs, and FastAPI. The work spans ETL/ELT, batch and streaming pipelines, data quality, metadata, lineage, observability, and DataOps practices. You will also support MLOps and LLMOps capabilities across delivery and production.
Key Responsibilities: Profile unfamiliar client data using Python, pandas, PySpark, and SQL
Build thin solutions with real client data and APIs
Implement automated tests, security controls, and error handling
Create evaluation datasets and measure ML or LLM quality




Measure adoption and business impact using agreed KPIs
Requirements: Experience in Data Engineering and production-grade software engineering
Hands-on Python, PySpark, SQL, REST APIs, and FastAPI expertise
Experience with ETL/ELT, streaming pipelines, and data quality
Knowledge of Git, Docker, Kubernetes, Airflow, and MLflow
Bachelor's degree in a related discipline
Apply Python, PySpark, data discovery, and production engineering skills across measurable AI and data solutions.

#J-18808-Ljbffr

📌 Senior Python PySpark Data Engineer (Ontario)
🏢 Atlantis IT Group
📍 Ontario