Data Engineer

We are looking for a sr. Data Engineer for a project in the energy sector. In this project you will continue to evolve customers cloud platform and do this by using the latest AWS technologies. You will join part of an agile development team using Python and Kotlin working in multiple sites and work with a high velocity streaming platform and design and implement workflows to mine and analyse the data.

You understand Agile development methodology and preferably have worked using Scrum, to follow continuous delivery principles, and have experience in building and maintaining delivery pipelines. You will know what it takes to build reliable and observable data pipelines. You work efficiently with people, are structured and transparent in approach, and are obsessive about simplifying complex issues and activities.

Your role:

Design and implement workflows to mine and analyse the data

Discuss and design data products/data area components with other internal teams

Develop data storage and data maintenance protocols

Define requirements in relation to Cloud infrastructure and CI/CD

Co-operate with DevOps, CloudOps, enterprise architecture and cybersecurity functions

Be generous with sharing and inspiring the rest of the team and be open to learning about the energy domain

Must have:

Bachelor's degree in Computer Science, Engineering, or equivalent work experience (4+ years)

Strong understanding of cloud platform engineering and data transport mechanisms (3+ years) to support scalable and resilient system architecture

Experience with data storage and data maintenance methods (3+ years)

Proven experience with streaming platforms, and working with streaming data (e.g. Kafka, Pulsar, Nats)

Experience with SQL, e.g. PostgreSQL and noSQL, e.g. MongoDB

Knowledge of Software Engineering principles: SOLID, clean-code

Strong written and verbal communication skills are vital for effective collaboration and articulation of complex ideas

Full professional proficiency in written and oral English

Nice to have:

Experience with data bricks is a big plus

Creative approach and being on top of emerging technologies

Experience with streaming databases like e.g. RisingWave, Materialize, Pathway

Experience with OCPP and IOT devices using e.g. MQTT, Modbus

Experience with in Machine Learning, MLOps e.g. AWS SageMaker

Electricity markets, flexibility markets

Chargers for electrical vehicles or home energy management

IT security, high availability, cybersecurity, maintenance and support

Experience with message brokers and microservice architectures

Experience in working in Agile environments

Good communication skills presenting complex technical concepts clearly & concisely

Enjoys working in a multilingual/multicultural environment

Start date: ASAP
Length: 3-4 months + possible extension
Location: Remote/Hybrid (Would be nice if you can visit the client in Sweden)
Language: English, bonuspoints for Swedish
More info tiina.hapuoja@witted.com