- Design, develop, and maintain software solutions using Python .
- Developed Python and PySpark programs for data analysis. Strong Python experience developing a custom framework for generating rules (like a rules engine).
- Developed Python code to gather data from HBase and designed the solution to implement using PySpark. Used Apache Spark DataFrames/RDDs to apply business transformations and HiveContext objects to perform read/write operations.
- Develop back-end services, APIs, and integrate databases.
- Optimize applications for performance, security, and maintainability.
- Troubleshoot and resolve software defects and issues.
Required Skills: Solid proficiency in Python, Spark and PySpark .