Big Data Developer - Spark

Big Data Developer - Spark

12 Apr
Leading company

12 Apr

Leading company


Big Data Developer

- Application being built ingests data from one source to another
- Spark, scala, python
- Need an excellent communicator, can speak to the applications ARCHITECTURE
- Looking for a consultant type candidate. Someone that can view the whole picture and explain what is going on to stakeholders.
- Someone who can hold their own in meetings. Confident speaker.

What are the hours of work; please specify start/finish times: 37.5
Will overtime be required (Y/N): N
If yes, how much forecasted overtime:
Likelihood of extension:

Brief Project Description:
• IDP (Integrated Data Pipeline) is a project that has been set up, to make ingestion of data easier throughout the enterprise.

Team has developed a pipeline, using best-in-class technologies, such as Airflow and Spark.

Project Name: IDP

Daily Responsibilities:
• Working with team on the coding of the application. Also should be comfortable in leading meetings and working with customers.

List if they are nice to have or must have

What program/technology/software knowledge is essential for this role and in what capacity will the successful candidate be using it:

Must Have Skills:
• list all the must haves

Key Accountabilities:
- Produce high quality code which is functional and maintainable
- Interact with business sponsors to help gather requirements
- Participate in the development process for gathering requirements, implementing and releasing applications
- Assist the first line support team in supporting the suite of applications
- Impart knowledge and benefit of experience to other members of the team
Knowledge and Experience:
- Bachelor’s degree in Information Technology, Computer Science
- 7+ years experience developing large-scale, mission critical applications
- 5+ years of full development life cycle experience, from architecture through test and deployment and cross platform skills
- Deep experience with Big Data database footprint technologies such as: Hadoop / Hive or columnar databases like ParAccel, Vertica,Sybase IQ
- 3+ years experience in Big Data application development in the Financial Services industry
Skills and Competencies:
- Able to learn new programming languages quickly and efficiently
- Ability to communicate ideas and take on board the ideas of others
- Knowledge of business line and ability to produce high quality results
- Ability to seek improvements to all aspects of development process
- Knowledge in computing in general and ability to apply outside knowledge to our work
- Can deal with ambiguity and manage requests for change
- Comfortable in high pressure, deadline-oriented environment
- Ability to adapt quickly; function independently when required
- Ability to work effectively with people from outside the IT team
- Creative thinker, breakthrough innovative, ‘out of the box’ thinker
- Ability to learn new things and ask good questions
- Team player, cooperative with good interpersonal skills

Nice to Have Skills:
• Some sort of mainframe knowledge


. * The original job offer can be found in Kit Job:

Subscribe to this job alert:
Enter Your E-mail address to receive the latest job offers for: big data developer - spark
Publish a new Free Offer
Need to publish an offer? With more than 1 million unique users per month, you will find the ideal candidate for your company instantly, what are you waiting for!
Publish Now

Subscribe to this job alert