Description review
Databricks Developer
Delan Associates · United States · back to the listing
HR standards
58/100
needs work
Title ↔ description
86/100
strong
Reads as
Data Engineer
100% confident
How others title the same work
Large employers
- Data Engineer, Product Analytics Meta
- Senior Staff Data Engineer Mozilla
- Staff, Analytics Engineer, GTM Data Science & Analytics Twilio
- Senior Software Engineer - Data Platform Coinbase
- Senior Security Data Engineer Doordash
Startups
- Business Intelligence Engineer GoSats
- IPinfo.io | Data Engineer | REMOTE (Anywhere) | Full-time IPinfo.io
- Senior Data Engineer Camber
- Senior Data Engineer Instrumentl
- Cardog | Toronto, Canada or REMOTE | Full-time Cardog
What the listing never says
- No pay range published. Candidates cannot tell whether applying is worth their time. Pay transparency
- No location or timezone policy stated, so a candidate cannot tell where they may work from. Scope clarity
The listing, marked up
Nothing in the wording of this listing tripped a check. The scores above still judge how complete and coherent it is.
We are looking for a highly skilled Databricks Developer with expertise in building and managing modern data platforms using the Databricks Lakehouse architecture. The ideal candidate will have strong experience in PySpark, Python, SQL, Delta Lake, data modeling, data quality frameworks, and enterprise-scale data engineering solutions. The role involves designing, developing, and optimizing scalable data pipelines that support analytics, reporting, and AI/ML initiatives.
Key Responsibilities
Design and implement scalable data solutions using Databricks Lakehouse Architecture.
Develop and maintain data pipelines using PySpark, Python, and SQL.
Build and optimize ETL/ELT workflows for batch and near real-time data processing.
Implement Delta Lake features including ACID transactions, time travel, schema evolution, and data versioning.
Design and maintain enterprise data models to support reporting and analytics requirements.
Ensure data quality through validation, monitoring, reconciliation, and governance controls.
Develop and manage data catalogs, metadata management, and data lineage processes.
Collaborate with business stakeholders, architects, and analytics teams to gather and translate requirements into technical solutions.
Optimize Databricks workloads for performance, scalability, and cost efficiency.
Implement security, access controls, and governance best practices within the Databricks ecosystem.
Support troubleshooting, root cause analysis, and production issue resolution.
Contribute to data platform modernization and cloud migration initiatives.
Required Technical Skills
Databricks
Strong experience with Databricks Architecture and platform administration.
Hands-on expertise in Databricks Lakehouse Architecture.
Deep understanding of Delta Lake concepts and implementation.
Experience with Unity Catalog / Data Catalog and metadata management.
Knowledge of Databricks Workflows, Jobs, Clusters, and Performance Tuning.
Data Engineering
Strong proficiency in PySpark for large-scale data processing.
Advanced Python programming skills.
Expert-level SQL development and query optimization.
Experience in building robust ETL/ELT pipelines.
Strong understanding of data modeling techniques including:
Star Schema
Snowflake Schema
Dimensional Modeling
Data Vault (preferred)
Data Governance & Quality
Experience implementing data quality frameworks and validation checks.
Knowledge of data lineage, metadata management, and governance processes.
Experience with data reconciliation, profiling, and monitoring tools.
Cloud & Platform Experience (Preferred)
Azure Databricks
Azure Data Lake Storage (ADLS)
Azure Data Factory
Azure Synapse Analytics
CI/CD pipelines (Azure DevOps, GitHub Actions)
Qualifications
Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering, or a related field.
4-8 years of experience in Data Engineering and Analytics.
Minimum 3+ years of hands-on experience with Databricks and PySpark.
Experience working in Agile development environments.
Originally posted on Himalayas
Key Responsibilities
Design and implement scalable data solutions using Databricks Lakehouse Architecture.
Develop and maintain data pipelines using PySpark, Python, and SQL.
Build and optimize ETL/ELT workflows for batch and near real-time data processing.
Implement Delta Lake features including ACID transactions, time travel, schema evolution, and data versioning.
Design and maintain enterprise data models to support reporting and analytics requirements.
Ensure data quality through validation, monitoring, reconciliation, and governance controls.
Develop and manage data catalogs, metadata management, and data lineage processes.
Collaborate with business stakeholders, architects, and analytics teams to gather and translate requirements into technical solutions.
Optimize Databricks workloads for performance, scalability, and cost efficiency.
Implement security, access controls, and governance best practices within the Databricks ecosystem.
Support troubleshooting, root cause analysis, and production issue resolution.
Contribute to data platform modernization and cloud migration initiatives.
Required Technical Skills
Databricks
Strong experience with Databricks Architecture and platform administration.
Hands-on expertise in Databricks Lakehouse Architecture.
Deep understanding of Delta Lake concepts and implementation.
Experience with Unity Catalog / Data Catalog and metadata management.
Knowledge of Databricks Workflows, Jobs, Clusters, and Performance Tuning.
Data Engineering
Strong proficiency in PySpark for large-scale data processing.
Advanced Python programming skills.
Expert-level SQL development and query optimization.
Experience in building robust ETL/ELT pipelines.
Strong understanding of data modeling techniques including:
Star Schema
Snowflake Schema
Dimensional Modeling
Data Vault (preferred)
Data Governance & Quality
Experience implementing data quality frameworks and validation checks.
Knowledge of data lineage, metadata management, and governance processes.
Experience with data reconciliation, profiling, and monitoring tools.
Cloud & Platform Experience (Preferred)
Azure Databricks
Azure Data Lake Storage (ADLS)
Azure Data Factory
Azure Synapse Analytics
CI/CD pipelines (Azure DevOps, GitHub Actions)
Qualifications
Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering, or a related field.
4-8 years of experience in Data Engineering and Analytics.
Minimum 3+ years of hands-on experience with Databricks and PySpark.
Experience working in Agile development environments.
Originally posted on Himalayas