Senior Data Engineer

Neu

GlassDollar

Job

In dieser Position entwickelst du Datenpipelines für die Verarbeitung von Unternehmensdaten, führst Qualitätstests durch und betreust Entity Resolution-Projekte zur Verbesserung der Datenintegration und -nutzung.

Job-Zusammenfassung

Job-Technologien

Deine Rolle im Team

  • Ingestion and pipelines: vendor feeds, APIs and scraping jobs - scheduled, idempotent, monitored, with backfills and alerts when a feed stops or drifts.
  • Schema and data model: the Postgres schema and data dictionary as the source of truth, including migrations and the Hasura layer on top.
  • Entity resolution: matching and deduplicating companies across sources, with measurable precision and recall.
  • LLM extraction and classification: pipelines that turn unstructured sources into structured records, evaluated on labelled samples and tuned for cost per record.
  • Signals: funding, acquisitions, shutdowns, case studies and headcount as event pipelines with change detection and correct event dates.
  • Data quality and observability: automated tests and metrics for coverage, accuracy, freshness and completeness.
  • Data sources: you test vendors, APIs and scraping partners on real samples and give a clear recommendation on quality and cost per datapoint.
  • You join sprint planning and review, triage data errors reported by users and agents, and take datapoints from prototype to production yourself.
  • By day 90: every feed is monitored and alerting, relationship data is classified with measured precision, entity resolution has a baseline, 3-5 new datapoints are live in production, and our search benchmark has moved against a target you set in month 1.
  • Month 1: baseline and observability
  • Inventory every pipeline, vendor feed and scraping job; give each one an owner, runbook, monitoring and alerting.
  • Data dictionary v1 for the top 25 datapoints, with source, lineage and quality numbers.
  • Automated quality checks (coverage, freshness, nulls, duplicates) running on every load.
  • Quick win: Scale partnership data point collection.
  • Month 2: corporate-technology relationships
  • Model relationship types in the schema: mention, partnership, PoC, implementation, investment, acquisition.
  • Build an LLM classification pipeline for existing and incoming records; report precision on a labelled sample and cost per record.
  • Set a recall and lag baseline, then improve the relationship pipeline against it.
  • Integrate a live acquisition source and keep acquired companies out of recommendations.
  • Month 3: new datapoints, entity resolution and agents
  • Run 6-8 time-boxed datapoint experiments, each ending in ship, kill or park. Ship 3-5 to production.
  • Entity resolution v2: measurable matching across sources, with a review queue for uncertain cases.
  • Add provenance, confidence and freshness to the top 25 fields, and make customer data (lists, PoCs, notes) usable by agents with proper permissions.
  • Document the data platform: architecture, runbooks and on-call handover.

Unsere Erwartungen an dich

Qualifikationen

  • A senior data engineer who ships. You care about reliability and clean data models, and you understand what the data is used for. You'd rather put a rough datapoint live this week than a perfect one next quarter.
  • Must-haves
  • You've built and run production data pipelines end to end: orchestration (e.g. Airflow, Dagster or Prefect), monitoring, alerting and backfills.
  • Fluent Python: scrapers and enrichment services (requests or Playwright, pandas or polars), tested and production-ready.
  • Strong SQL on a production Postgres database: schema design, migrations, indexing and query performance.
  • Hands-on with LLMs for extraction and classification, measured on a labelled sample, with an eye on cost and latency.
  • Practical entity resolution and deduplication at scale.
  • Data quality testing (e.g. dbt tests, Great Expectations or your own checks).
  • Working knowledge of GDPR for company and people data.
  • Based in Berlin, or willing to relocate.
  • Nice to have
  • dbt, Docker and a major cloud (AWS or GCP); infrastructure as code.
  • Event or signal pipelines: change detection, event dating, alerting.
  • Vector search or embeddings for matching and retrieval.
  • GraphQL / Hasura.
  • German at reading level: DACH registers are a big part of our upside.
  • Working with data from providers such as PitchBook, Crunchbase, Dealroom or company registers.
  • Knowledge of the corporate innovation, VC or emerging technology ecosystem.

Erfahrung

  • 5+ years in data engineering (or backend engineering with a data focus), ideally with company, market or B2B data at a data business, marketplace or SaaS company.

Unser Angebot

  • Salary band: €80 - €110k
  • Real ownership of a core part of our product and its data platform.
  • Fast impact: your data shows up for corporate customers, in agent answers and in weekly company updates within weeks.
  • A small, senior team. Full-time, Berlin office.

Themen, mit denen du dich im Job beschäftigst

Job-Standorte

Karte der Job-Standorte
© OpenMapTiles, © OpenStreetMap contributors
  • Standort Berlin
    Deutschland

Das ist dein Arbeitgeber

Die GlassDollar GmbH, ansässig in Berlin, ist ein innovatives Unternehmen, das eine Softwareplattform entwickelt hat, um großen Firmen zu helfen, geeignete Startups und innovative Lösungen zu finden und umzusetzen. Diese Plattform ermöglicht die Bündelung von Startup-Daten und die effiziente Gestaltung von Innovationsprozessen. Seit ihrer Gründung im Jahr 2019 hat sich GlassDollar im Bereich der Corporate Innovation als Startup etabliert.

Unternehmenstyp
Startup
Arbeitsmodell
Onsite
Branche
Internet, IT, Telekom
  • GGW GroupHamburg

    • Easy Apply
    • Hybrid
    • Vollzeit

    Die Rolle Als Forward Deployed AI Engineer gehst du direkt in unseren Fachbereichen, verstehst die Abläufe und baust produktionsreife AI und Automatisierungs-Lösungen, die die Arbeitsweise der gesamten GGW-Gruppe grundlegend verändern werden. Du...

  • HUK-COBURG VersicherungsgruppeCoburg

    • Hybrid
    • Onsite
    • Vollzeit

    Hallo, lass uns WIR sagen! Wir - die HUK-COBURG Versicherungsgruppe - zählen zu den 10 größten in Deutschland. Vor über 90 Jahren gegründet sind wir mit über 13 Millionen Kund:innen heute der große Versicherer für Privathaushalte und der größte deutsche...

    • Java
    • Spring Boot
    • Apache Kafka
  • syracom AGWiesbaden

    • Easy Apply
    • 68k – 85k €
    • Hybrid
    • Onsite
    • Vollzeit
    • Senior

    Als Senior Software Engineer (m/w/d) übernimmst du eine zentrale technische Rolle in anspruchsvollen Kundenprojekten und entwickelst nachhaltige, skalierbare Softwarelösungen in komplexen Enterprise-Umgebungen. In deiner Rolle übernimmst du insbesondere...

    • SQL
    • TypeScript
    • Kubernetes
    • OpenShift
    • NoSQL
    • React
    • Java
    • Spring
    • JavaScript
    • Angular
    • +8

Senior Data Engineer

GlassDollar