Data Engineer (Databricks / Spark)
We’re Techbar — a tech services company led by seasoned delivery professionals and engineers.
We help startups, product companies, and digital businesses build and scale software teams through staff augmentation, dedicated squads, and full-cycle product delivery.
Role Overview
We are looking for a a Data Engineer to build modern lakehouse platforms and scalable analytics solutions for our clients. You will work with cloud-native data stacks, help design reliable ELT pipelines on Databricks, and support data-driven decision-making across multiple products.
Key Responsibilities
- Design, build, and maintain scalable ELT/ETL pipelines on Databricks
- Develop and maintain data transformations and analytics models using PySpark, Spark SQL, and Delta Live Tables
- Work with the Databricks Lakehouse Platform and Delta Lake as the primary data platform
- Optimize Spark jobs, cluster configuration, and pipeline performance
- Collaborate with analytics, BI, and product teams to deliver reliable datasets
- Implement data quality checks, monitoring, and testing (e.g., DLT expectations)
- Work with orchestration tools (Databricks Workflows, Airflow, or similar)
- Maintain documentation and data lineage using Unity Catalog
- Apply medallion architecture (bronze/silver/gold) for reliable, layered data
- Support analytics and reporting use cases
- Improve data platform scalability and reliability
Required Skills and Experience
- 5+ years of experience in Data Engineering or Analytics Engineering
- Strong SQL skills and experience optimizing complex queries
- Hands-on experience with Databricks (Spark, Delta Lake) or a similar lakehouse/big data platform
- Experience with PySpark and Spark SQL for data modeling and transformations
- Experience building data pipelines in cloud environments
- Experience with orchestration tools (Databricks Workflows, Airflow, or similar)
- Python for data processing and automation
- Understanding of data modeling concepts (star schema, dimensional modeling, medallion architecture)
- Experience working in Agile teams
- Good English communication skills
Nice to have
- Experience with Unity Catalog and data governance
- Experience with Delta Live Tables and/or dbt on Databricks
- Experience with modern data stack tools (Fivetran, Stitch, Airbyte, etc.)
- Experience with streaming data pipelines (Spark Structured Streaming, Kafka)
- Experience with BI tools (Power BI, Tableau, Looker, etc.)
- Experience with data quality frameworks (Great Expectations or similar)
- Experience with cloud platforms (AWS, Azure, or GCP)
We offer
- Remote-first collaboration model
- Long-term international projects
- Competitive compensation
- Career and professional growth opportunities
- Work with modern data technologies and global clients