Archiviertes Projekt - Data Engineer (Realtime) - 6 months - 100 % Remote - Start June

For our end customer we are looking for a Data Engineer.

Scope:
In the context of developing a modular control center system, the data team provides systems and solutions to handle and provide master data as well as real time data from the clients electrical grid. The provided products of the product line include generic services and specific data products that are used by services in other modules and are enabler for user facing products like monitoring or control. Further, the whole product cluster uses a CIM-based data modelling approach and the data team supports other teams to provide services for monitoring and control of the power grid.

Tasks/Activity Description:
• Develop, maintain and use deployment pipelines (following infrastructure as code paradigm)
• Producing clean, efficient code based on specifications and guidelines
• Self steered pick up on the assigned software development track and incidents
• Analyze and test programs and products before formal launch
• Troubleshoot coding problems quickly and efficiently to ensure a productive workplace
• Actively seek ways to improve business software processes and interactions
• Preparation of training materials and delivery of training to other project team members in the use of software applications

Goal
• Design, develop, and maintain real-time data pipelines and streaming applications.
• Architect and implement streaming data ingestion processes from various sources, ensuring reliability, scalability, and low-latency processing.
• Optimize and tune performance of real-time data processing systems for efficiency and throughput.
• Implement monitoring, alerting, and logging solutions to ensure the health and reliability of real-time data infrastructure.

Offer requirements/profile requirements
• 5 years of experience in data engineering, with a focus on real-time data processing.
• Proficiency in programming languages such as Python, Java, or Scala.
• Strong experience with real-time data processing frameworks such as Apache Kafka, Apache Flink, or Apache Spark Streaming.
• Solid understanding of distributed computing principles and microservices architecture.
• Experience with on-premise Kubernetes platforms as well as with cloud and platforms such as AWS, GCP, or Azure.

Details:
• Start: June 2024
• Durations: 6 months (+extension)
• Capacity: 100 % / 40h per week
• Locations: Remote
• Language: German (B2) & Englisch (C1)

Telephone interviews with our customers can be arranged at short notice, with a quick decision afterwards.If you are interested in this project, please do not hesitate to contact me.