Data Engineer (Databricks / Spark)

Remote
Fintech, Insurtech, Asset management, Wealth management, Compliance

We’re Techbar a tech services company led by seasoned delivery professionals and engineers.

We help startups, product companies, and digital businesses build and scale software teams through staff augmentation, dedicated squads, and full-cycle product delivery.

Role Overview

We are looking for a a Data Engineer to build modern lakehouse platforms and scalable analytics solutions for our clients. You will work with cloud-native data stacks, help design reliable ELT pipelines on Databricks, and support data-driven decision-making across multiple products.

Key Responsibilities

  • Design, build, and maintain scalable ELT/ETL pipelines on Databricks
  • Develop and maintain data transformations and analytics models using PySpark, Spark SQL, and Delta Live Tables
  • Work with the Databricks Lakehouse Platform and Delta Lake as the primary data platform
  • Optimize Spark jobs, cluster configuration, and pipeline performance
  • Collaborate with analytics, BI, and product teams to deliver reliable datasets
  • Implement data quality checks, monitoring, and testing (e.g., DLT expectations)
  • Work with orchestration tools (Databricks Workflows, Airflow, or similar)
  • Maintain documentation and data lineage using Unity Catalog
  • Apply medallion architecture (bronze/silver/gold) for reliable, layered data
  • Support analytics and reporting use cases
  • Improve data platform scalability and reliability

Required Skills and Experience

  • 5+ years of experience in Data Engineering or Analytics Engineering
  • Strong SQL skills and experience optimizing complex queries
  • Hands-on experience with Databricks (Spark, Delta Lake) or a similar lakehouse/big data platform
  • Experience with PySpark and Spark SQL for data modeling and transformations
  • Experience building data pipelines in cloud environments
  • Experience with orchestration tools (Databricks Workflows, Airflow, or similar)
  • Python for data processing and automation
  • Understanding of data modeling concepts (star schema, dimensional modeling, medallion architecture)
  • Experience working in Agile teams
  • Good English communication skills

Nice to have

  • Experience with Unity Catalog and data governance
  • Experience with Delta Live Tables and/or dbt on Databricks
  • Experience with modern data stack tools (Fivetran, Stitch, Airbyte, etc.)
  • Experience with streaming data pipelines (Spark Structured Streaming, Kafka)
  • Experience with BI tools (Power BI, Tableau, Looker, etc.)
  • Experience with data quality frameworks (Great Expectations or similar)
  • Experience with cloud platforms (AWS, Azure, or GCP)

We offer

  • Remote-first collaboration model
  • Long-term international projects
  • Competitive compensation
  • Career and professional growth opportunities
  • Work with modern data technologies and global clients

    Apply for this position

    Fill out the form below and we’ll get back to you shortly.