Job
- Level
- Senior
- Job Feld
- Data
- Anstellung
- Vollzeit
- Vertragsart
- Unbefristetes Dienstverhältnis
- Ort
- Bad Friedrichshall
- Arbeitsmodell
- Onsite
Job Zusammenfassung
In diesem Job entwickelst du leistungsfähige ETL-Pipelines für Analysen und Machine Learning, optimierst deren Performance und gewährleistest Datenqualität durch Validierung und Bereinigung in agilen Teams.
Job Technologien
Deine Rolle im Team
- Develop and operate productive ETL pipelines for reports, analysis and machine learning and ensure their quality and sustainability.
- Use your software development skills and set new standards for development and deployment.
- Optimize the performance of data engineering solutions and guarantee their scalability.
- Ensure data quality and consistency through data validation and cleansing.
- Monitor and fix errors in the data infrastructure to minimize downtime.
- Implement data security and privacy measures.
- Work in interdisciplinary agile teams with data scientists, data engineers, product owners and departments.
Unsere Erwartungen an dich
Qualifikationen
- Expertise developing in Python. Scala knowledge is a plus.
- Good command of Apache Airflow for workflow orchestration.
- Knowledge of the software development cycle and its best practices (e.g. CI/CD, DevOps, testing).
- Analytical skills, an eye for data quality, agile mindset, independence and hands-on mentality.
Erfahrung
- +4 years of industry experience as a Data Engineer.
- Experience developing large scale batch & streaming ETLs in spark, preferably in Databricks.
- Experience working in cloud environments, preferably GCP.
- Strong hands-on experience with modern, open-source table formats such as Apache Iceberg or Delta Lake to manage large-scale data lakehouse architectures.
- Proven track record managing data access controls, CLS, RLS and cataloging workflows. Experience with Unity Catalog is a plus.
- Hands-on experience working with containerized applications, preferably orchestrated in Kubernetes.
- Experience working with Google Pub/Sub is preferred.
Unser Angebot
- Join us and contribute to digital sovereignty in Europe.
- With us, you will work at the intersection of agility and security: You will benefit from fast decision-making processes, enjoy genuine creative freedom in your projects, and be able to build upon the stable foundation of the Schwarz Group.
Benefits
Work-Life-Integration
Themen mit denen du dich im Job beschäftigst
Job Standorte
Das ist dein Arbeitgeber
Schwarz Unternehmenskommunikation GmbH & Co. KG
Die Schwarz Gruppe, ansässig in Neckarsulm, ist ein bedeutender deutscher Mischkonzern und eine der größten Handelsgruppen in Europa. Sie betreibt über 13.900 Filialen unter den Marken Lidl und Kaufland und beschäftigt etwa 575.000 Mitarbeiter.
Description
- Unternehmenstyp
- Etablierte Firma
- Arbeitsmodell
- Full Remote, Hybrid, Onsite
- Branche
- Handel
Data Engineer
- Ort
- Bad Friedrichshall
- Arbeitsmodell
- Onsite
- Diversität
- Für alle Personen geeignet (m/w/d)
- Nur Englisch
- Nur Englisch erforderlich
