The Senior Software Developer - ETL role focuses on designing, developing, and deploying advanced data transformation pipelines and semantic models within Azure environments. The position requires expertise in Power BI report development, Azure Databricks, and Data Lake technologies to deliver high-performance business intelligence solutions aligned with organizational KPIs.
Responsibilities:
- Analyze data and design semantic models for reporting consumption.
- Transform raw data into silver and gold layers for streamlined reporting.
- Design, develop, and deploy Power BI reports and dashboards ensuring accuracy, reliability, and performance.
- Review business requirements and translate them into technical specifications and tested applications.
- Develop detailed programming specifications, write code, and conduct unit testing.
- Troubleshoot and resolve technical issues during software operation and implementation.
- Develop data access queries and collaborate with data analysts on dashboard and reporting products.
- Support OLAP analytical software solutions and customized query applications for business data analysis.
Required Skills:
- 6+ years' experience with Azure technologies including Azure Databricks and Azure Data Lake Gen 2.
- Expertise in Power BI development and semantic modeling, including Direct Lake semantic models.
- Proficiency in Azure DevOps CI/CD pipelines.
- Strong skills in PySpark and Microsoft Fabric.
- Experience with Star Schema or Snowflake data modeling.
- Proficiency using Azure Data Factory within Microsoft Fabric for building complex, scalable data pipelines.
- Development of operational and analytical Power BI reports and paginated reports.
Desired Skills:
- Experience with Azure Data Factory (ADF) v2.
- Competency in building Lakehouses and Warehouses, including Medallion architecture (Bronze/Silver/Gold layers).
- Strong knowledge of data governance including data security (row-level and column-level) and data lineage tracking.
Rated Criteria:
- Azure Technologies Expertise (Databricks, Data Lake Gen 2) - 30 Points
- Power BI Development and Semantic Modeling - 25 Points
- Data Pipeline Orchestration and Ingestion (Azure Data Factory) - 15 Points
- PySpark and Microsoft Fabric Proficiency - 10 Points
- Data Architecture and Modeling (Star Schema, Snowflake) - 10 Points
- Public Sector Experience - 2 Points
- Education and Certifications - 3 Points
- Data Governance and Security Knowledge - 5 Points
Total: 100 Points Deliverables:
- Robust semantic data models for reporting layers (silver/gold).
- High-quality Power BI reports and dashboards meeting KPIs for accuracy and performance.
- Scalable and maintainable ETL pipelines using Azure Data Factory and Databricks.
- Technical documentation including system specifications and testing results.
- Resolved technical issues and support for BI software implementations.
Must Haves:
- Minimum 6 years' experience with Azure data technologies and Power BI.
- Ability to work onsite 5 days a week.
- Proven expertise in designing and deploying scalable data pipelines and semantic models.
- Robust programming skills in PySpark and experience with Microsoft Fabric.