Big Data Developer - Spark

Big Data Developer - Spark

12 Apr
|
Leading company
|
Toronto

12 Apr

Leading company

Toronto

Big Data Developer

- Application being built ingests data from one source to another
- Spark, scala, python
- Need an excellent communicator, can speak to the applications ARCHITECTURE
- Looking for a consultant type candidate. Someone that can view the whole picture and explain what is going on to stakeholders.
- Someone who can hold their own in meetings. Confident speaker.


What are the hours of work; please specify start/finish times: 37.5
Will overtime be required (Y/N): N
If yes, how much forecasted overtime:
Likelihood of extension:

Brief Project Description:
• IDP (Integrated Data Pipeline) is a project that has been set up, to make ingestion of data easier throughout the enterprise.





Team has developed a pipeline, using best-in-class technologies, such as Airflow and Spark.

Project Name: IDP

Daily Responsibilities:
• Working with team on the coding of the application. Also should be comfortable in leading meetings and working with customers.

Certifications:
List if they are nice to have or must have

What program/technology/software knowledge is essential for this role and in what capacity will the successful candidate be using it:

Must Have Skills:
• list all the must haves
Spark
Airflow
Python
HDFS
MongoDB
RDBMS

Key Accountabilities:
- Produce high quality code which is functional and maintainable
- Interact with business sponsors to help gather requirements
- Participate in the development process for gathering requirements, implementing and releasing applications
- Assist the first line support team in supporting the suite of applications
- Impart knowledge and benefit of experience to other members of the team
Knowledge and Experience:
- Bachelor’s degree in Information Technology, Computer Science
- 7+ years experience developing large-scale, mission critical applications
- 5+ years of full development life cycle experience, from architecture through test and deployment and cross platform skills
- Deep experience with Big Data database footprint technologies such as: Hadoop / Hive or columnar databases like ParAccel, Vertica,Sybase IQ
- 3+ years experience in Big Data application development in the Financial Services industry
Skills and Competencies:
- Able to learn new programming languages quickly and efficiently
- Ability to communicate ideas and take on board the ideas of others
- Knowledge of business line and ability to produce high quality results
- Ability to seek improvements to all aspects of development process
- Knowledge in computing in general and ability to apply outside knowledge to our work
Attributes:
- Can deal with ambiguity and manage requests for change
- Comfortable in high pressure, deadline-oriented environment
- Ability to adapt quickly; function independently when required
- Ability to work effectively with people from outside the IT team
- Creative thinker, breakthrough innovative, ‘out of the box’ thinker
- Ability to learn new things and ask good questions
- Team player, cooperative with good interpersonal skills

Nice to Have Skills:
• Some sort of mainframe knowledge

___________________

. * The original job offer can be found in Kit Job:
https://www.kitjob.ca/job/9041311/big-data-developer-spark-toronto/?utm_source=html

Subscribe to this job alert:
Enter Your E-mail address to receive the latest job offers for: big data developer - spark
Publish a new Free Offer
Need to publish an offer? With more than 1 million unique users per month, you will find the ideal candidate for your company instantly, what are you waiting for!
Publish Now

Subscribe to this job alert