06 Nov
|
J2B Global
|
Mississauga
06 Nov
J2B Global
Mississauga
Senior Python Developer - Data Lineage & Gen AI
Full Time
Mississauga
Visa: PRCanadian CitizenOpen Work Permit
Job Summary: We are seeking a hands-on Python Developer to design and build scalable data lineage solutions that parse and analyze large, multi-language codebases to generate accurate, column-level data lineage. The role combines strong Python engineering, software architecture, data flow analysis, and hands-on Gen AI/LLM experience. The ideal candidate should have expertise in developing reusable libraries, executable applications, event-driven frameworks, design patterns, APIs, databases, and graph-based technologies. Required Technical Skills: - Strong Python development skills with expertise in object-oriented and functional programming. - Ability to develop core libraries, reusable components, and executable applications using Python. - Strong understanding of software architecture, event-driven frameworks, and design patterns. - Proficiency in data structures, algorithms, and complexity analysis. - Experience with Oracle Database, SQL, API development, and backend services. - Knowledge of Graph APIs, Graph Databases, graph algorithms, and traversal techniques. - Experience with data lineage, data flow analysis, AST-based parsing, and static code analysis. - Ability to parse and analyze source code across multiple programming and query languages. - Hands-on Gen AI/LLM experience, including prompt engineering, tool/function calling, and agent orchestration. - Understanding of Retrieval-Augmented Generation (RAG), vector databases, and semantic search. - Experience designing APIs, backend services, and basic front-end interfaces. - Knowledge of CI/CD, build automation,
testing, deployment, and production support. - Strong data manipulation and transformation skills. Key Responsibilities: - Design and develop Python-based engines to parse multiple programming and query languages and generate accurate, column-level data lineage. - Build reusable Python libraries and scalable components for code parsing, analysis, and dependency tracking. - Develop Gen AI/LLM-powered retrieval and assistant capabilities using lineage and metadata. - Build backend services, APIs, and interfaces to expose data processing and lineage insights. - Extend parsing and analysis capabilities to support current languages and frameworks. - Design and implement graph-based dependency and lineage tracing solutions. - Own build, testing, deployment, CI/CD, and production support across environments. - Write automated tests and maintain software quality throughout the development lifecycle. - Collaborate on architecture and design reviews and translate complex requirements into maintainable solutions. Engineering Expectations: - Follow clean architecture, separation of concerns, and reusable design principles. - Build deterministic, testable solutions with AI outputs grounded in verifiable data. - Optimize performance, memory usage, and algorithmic efficiency. - Design extensible systems that support new languages, data sources, and capabilities. - Implement robust error handling, fault isolation, and maintainable code. Nice to Have: - Knowledge of data governance, metadata management, and data cataloging. - Experience with long-running or asynchronous workloads. - Familiarity with infrastructure automation and deployment tools.
Refer
📌 Senior Python Developer - Data Lineage & Gen AI (Mississauga)
🏢 J2B Global
📍 Mississauga