E.ON

Senior Hadoop Engineer (f/m)

Senior Hadoop Engineer (f/m)

Responsibilities

• Be part of E.ON's digital product development and ensure the designing, building, installing, configuring and supporting of Hadoop installations
• Buiding the designing, building, installing and configuring of streaming applications based on Hadoop components (Flume, Kafka, Spark, Storm) as well as NoSQL databases (HBase, MongoDB, Cloudera) for the Customer Solutions, Energy Networks and Renewables Business
• Pre-processing using Hive and Pig
• Designing and implementing data interfaces to streaming and CEP applications
• Translate complex functional and technical requirements into detailed design by ensuring security and data privacy aspects
• Close collaboration with architects, developers, product owners and other stakeholders to enable modern application development (enable continuous integration and deployment, DevOps)
• Understanding the competitive environment the Business operates in and knowing what delivers advantage from a digital business perspective
• Actively identify areas for improvement and contribute to proof-of-concepts to evaluate new technologies, frameworks and architectures to drive innovative ideas into the IT and business
• Teach younger Hadoop engineers and ensure knowledge transfer in building, monitoring and administration of complex Hadoop clusters based on best practices and standards

Qualifications

• University degree in engineering, computer sciences, information systems, economics or equivalent professional qualification
• Several years of work experience in Hadoop incl. the components HDFS, Hive, Pig, HBase, Knox, Ranger, Flume, Sqoop, Kafka, Spark, Storm, Ambari, Zookeeper, YARN
• Good knowledge of workflow / schedulers like Oozie and experience in scripting, writing high-performance, reliable and maintainable code
• Excellent knowledge of database structures, theories, principles and practices as well as agile methods like Kanban or Scrum
• Good aptitude in multi-threading and concurrency concepts
• Profound knowledge of digital core technologies (e.g. data management, data analytics, integration, process automation, mobile, social, API Management, DevOps, cloud)
• Ability to collaborate actively across cultural and organizational boundaries and take ownership of features; high ambition to follow and evaluate new trends and acquire new skills (out-of-the-box thinking)
• Good leadership skills
• Excellent English language skills (spoken and written), fluent German language skills preferable
• Willingness to undertake frequent business travel

Info