Data Engineer GCP Platform

Job description

For the cargo division of a major Dutch airline, we are looking for a Medior/Senior Real-time Data Engineer to help develop a modern, real-time data and reporting platform on Google Cloud Platform (GCP).

You will contribute to building a scalable, generic real-time data platform that supports critical cargo hub operations, including truck and ULD arrivals, offloads and shipment manifests. Key Responsibilities:

• Develop and maintain real-time data processing and event streaming pipelines.
• Build event refinement and event combination solutions for multiple business use cases.
• Migrate legacy operational reporting to the new real-time data platform.
• Further develop the Build-up Monitor from Proof of Concept to a production-ready MVP.
• Deliver robust, scalable and well-documented streaming solutions.

Requirements

• Medior/Senior experience as a Data Engineer, with a strong focus on real-time data processing.
• Strong programming skills in Java and/or Scala.
• Hands-on experience with Apache Spark, particularly Structured Streaming.
• Experience with Apache Kafka, including topics, producers and consumers.
• Experience with NoSQL databases.
• Hands-on experience with Google Cloud Platform (GCP).
• Able to work independently, take ownership and solve problems in a complex enterprise environment.
• Strong communication skills and the ability to operate with limited business support.
• Nice to Have: Experience in logistics, aviation or cargo operations.
• Nice to Have: Experience with operational reporting environments.

Lees volledige vacature

Wat gaat er gebeuren?

1

Application

After you apply, we will review your CV and compare it with other applications. If you are suitable, we will call you to discuss your experience, availability, and rate. If you are not suitable or less suitable than other applicants, we will politely decline your application.

2

Propose to customer

After checking suitability, availability and rate, we will recommend you to the client and you will usually receive a response from the client within 5 working days as to whether they are interested and would like to arrange an interview.

3

Interview

After the interview, the client may wish to conduct a second or, in some cases, a third interview. If the client decides to hire you, the start date and onboarding process will be determined.

4

Start / Onboarding

In order to get started, an onboarding procedure is initiated in which formalities are completed. This includes submitting personal details, passport and, if necessary, Chamber of Commerce registration in order to draw up a contract. In some cases, screening by an external agency commissioned by the client may be required. Once this has been completed, the assignment can begin!

Nog steeds vragen?

Neem contact op met

[phone removed]

[email removed]

LinkedIn profiel

Stuur mij een bericht