Data engineer (big data/data lake environments)

grote financiële instelling
  • Amsterdam Gustav Mahlerlaan 10, 1082 PP
  • Detachering
  • HBO, WO
  • 40 uur

You are going to work in the Data Analytics (DAAN) block which is a team that consists of an Agile scrum team with high skilled international development professionals. As IT Dev Engineer/data engineer you will participate in the scrum events of this team and will work on the development user stories/activities agreed upon on in the sprints.

In your daily work you have to interact with different people such as:

  • the PO, SM, IT Dev Engineers and BD-ers working in the CRM scrum team;
  • DBA, Middleware, Platform and Networking specialists
  • other people working in the AAC GRID such as other IT Dev. Engineers, Solution Engineers and the IT Engineering Lead. 

Based on your knowledge and expertise we expect you:

  • to operate in a fast-paced environment where you will be responsible for building Scala/Spark solutions between our source systems and big data environment;
  • to do Incident Management;
  • to do Problem solving with the development teams for the various challenges faced;
  • to present your proposals to both IT and Business in a clear and concise manner;
  • to test the solutions you develop and help the business to test what you have designed and developed;
  • to create and implement automated testing solutions;
  • to write and produce technical documentation, blogs and knowledgebase articles;
  • to work in an Agile working environment.

With the following results:

Results expected to be delivered by you:

  • developed designs that are discussed with the relevant people and the larger sized designs have been discussed in the design review board;
  • building the required solution;
  • test scenarios and test cases;
  • automated testing solutions;
  • solved incidents and problems;
  • documentation that corresponds to the guidelines;
  • active contribution iin the scrum ceremonies.

Relevant knowledge skills & competences:

We are looking for a professional with an IT background and preferably somebody who has above average experience in working in big data/data lake environments in the role of data engineer. We are looking for somebody with:

Must have

  • academic or HBO work and thinking level;
  • Good knowledge of Scala (1-3 years)
  • Functional approach in developing applications (Cats, ZIO, etc. or wish to use them in their code is a big plus)
  • Understanding the concept of system modularity
  • Good knowledge of Spark, experience in developing and maintaining code for Spark
  • Good working knowledge of Kafka
  • Understanding of CI/CD concepts
  • Experience in developing unit tests (practical knowledge of property based testing is a plus)
  • Big data Engineering experience

 Nice to have

  • Python knowledge
  • Knowledge of AWS
  • Knowledge of AWS CDK
  • Practical experience in building containerized applications (Docker, Kubernetes)

Soft skills

  • Team player
  • Actively taking ownership

Solliciteren

Inclusiviteit en diversiteit

Uiteraard staat deze vacature open voor iedereen die zich hierin herkent. We geloven dat diverse teams van belang zijn voor ons als lerende organisatie, die voorop wil blijven lopen in de wereld van werk. Want juist verschillen tussen mensen zorgen voor groei. Van collega's, klanten, kandidaten en daarmee van Yacht. Heb jij een uniek talent? We ontmoeten je graag.

Het sollicitatieproces

1  van 5

Je sollicitatie en cv worden doorgenomen door

2  van 5

Binnen 5 werkdagen ontvang je een reactie

3  van 5

Is er een match, dan plannen we een persoonlijke kennismaking

We onderzoeken samen jouw ambitie en mogelijkheden

4  van 5

Daarna word je (eventueel) voorgesteld bij onze opdrachtgever

Wanneer de klik er is, ga je starten bij je nieuwe uitdaging!

5  van 5

Afhankelijk van het soort dienstverband (interim, zzp of vast), ontvang je van ons een aanbod