Data Engineer

We’re seeking an experienced Data Engineer to develop and optimize scalable data pipelines, ensuring the efficient processing, transformation, and storage of large structured and unstructured datasets. This role involves working closely with cross-functional teams to build robust solutions that meet performance, reliability, and scalability needs.

Key Responsibilities:
Design, develop, and maintain scalable data pipelines for ingesting, transforming, and managing large datasets.
Collaborate with teams to gather requirements and implement data solutions that align with business and technical objectives.
Optimize data infrastructure and workflows for efficiency, performance, and cost-effectiveness using cloud-native technologies and distributed computing frameworks.
Develop data models and schema structures to support analytics, reporting, and machine learning applications.
Implement monitoring, logging, and validation mechanisms to ensure data quality and system reliability.
Troubleshoot and resolve complex data-related challenges, including performance bottlenecks and inconsistencies.

Qualifications:
Around five years of experience in data engineering or a similar role.
Proficiency with cloud platforms such as AWS, Azure, or GCP.
Strong programming skills in Python and SQL.
Experience working in Linux-based environments, using version control, and automating CI/CD workflows.
Knowledge of data serialization, file formats, and data transfer protocols.
Familiarity with both SQL and NoSQL database technologies.
Background in building and optimizing data-intensive applications for distributed systems.
Hands-on experience with workflow orchestration tools and data transformation processes.
Solid understanding of data modeling techniques for both analytical and operational use cases.
Experience working with Kubernetes and/or serverless computing architectures.
Exposure to real-time data processing, time-series data, and IoT applications.
Competence in Python-based data analysis and visualization tools.

Language: English, Swedish is an asset
Location: Sweden, if you are a perfect match, other countries can be discussed
Duration: 9-12 months

More info tiina.hapuoja@witted.com
Please send your application in English