Blog

Azure Big Data Engineer

Posted on: 2 August 2022

Apply with CV

Job intro


36 hours per week -

01-07-2022 till 30-06-2023 -

Possible extension


Organization


Rabobank Utrecht


Function


Imagine…

That your engineering skills are key to solving urgent business requirements, while impacting the experiences of thousands of customers every day. As a Big Data Engineer you develop complete and scalable solutions on Azure. Because data is key for our marketing strategy, you will make a difference by ensuring relevant data is provided to our marketing teams, fast.


Create an impact

Your goal will be delivering data in a secure, compliant and automated way, all the while meeting Security DevOps principles. You will do this by:


• Developing scalable and performant solutions in the Azure cloud, that process billions of records every day!

• You will be building and maintaining data pipelines, using Databricks (Pyspark) and Azure Data Factory

• In addition to that you will be setting up and maintaining your own CI/CD pipelines in Azure Devops


But most importantly: You are a sparring partner for your product owner, stakeholders and your own development team. Stakeholders include marketeers, UX designers, and even other data engineers. Your work isn’t only vital within your team. Your expertise is also of utmost importance in helping other teams by getting their data projects of the ground.

For your next project you can expect to work with Rabobank’s largest datasets. You will maintain data pipelines that ingest many GB’s of data every day from various sources (onprem and in the cloud) to the Enterprise Data Lake (EDL) on Azure. It is your team’s task to ensure that this data is properly prepared for use by our BI and marketing specialist.


With each other

At the tribe Digital Customer Processes we enable personalised and relevant communication with our customers. We create and maintain self-service communication channels, so that our internal stakeholders can reach the customer at the right time and in the right channel.


The squad works directly with business and marketers on a wide range of projects. We use the latest technologies.


You will be part of a DevOps squad that delivers end-to-end customer features for personal digital marketing features. The squad takes full responsibility for analysing, building, testing, operating and maintaining their features. We're looking for a senior Big Data Engineer who can work well within a squad, is pro-active and takes ownership for the features built.


Requirements


With your talents

Customer focus, innovative thinking, and persuasiveness are essential for your role of Big Data Engineer. In addition, it's important that you bring the following skills:


• Extensive experience on Pyspark, using Databricks

• Cloud experience (Azure)

• Experience with building CI/CD pipelines, more specifically in Azure DevOps

• Experience with scripting languages (Python/Bash)

• SQL + NoSQL experience (experience with Cosmos DB is a plus)

• Experience with streaming technologies (Spark structured streaming, Kafka (Axual), Azure Event Hubs/Azure Streaming Analytics) is a plus

• Experience with Azure Synapse is a plus


The competences we would like you to have:

• You like to work in an agile environment

• Eager to learn new techniques

• Enjoy to teach and share knowledge

• Good communication skills

• Strong collaboration with other roles in the Scrum team

• Drive to continuously improve

• Take ownership of the build, run and change process


Growing a better world together

You'll already be aware that Rabobank is a financial services provider for 7.1 million customers in 40 countries. But did you know that we aim to contribute to real change with our 'Growing a better world together' mission? We do so in countless ways, such as:


Together with the world Wildlife Fund, we’re helping to create a harmonious balance between nature and the agricultural sector in Brazil;

We make sizeable annual investments in the voluntary sector in the Netherlands. This allows us to support about 1,250 sport and cultural organisations that are a second home to many people.


Information

Sean Verhoef +31(0)20-3337629

Apply with CV