See how you compare in this market.
Check your market position →Use Carl on this page for the /agent?job_id= handoff.
Before you apply
- Data methodology — how we estimate salaries and index catalog listings.
- Market Research hub — deeper hiring & compensation trends (reports index).
- First indexed: 2026-08-17. This is when Catalitium indexed the listing — not necessarily the employer posting date. Roles may close or change without notice.
- Listings come from employers and partners; Catalitium does not verify every claim. Confirm compensation and requirements directly.
Job description
The ideal candidate should have experience working with large datasets, distributed data processing, and modern data engineering practices. Responsibilities
Design, develop, and maintain scalable data pipelines using Azure Databricks
Implement ETL/ELT workflows using PySpark, Spark SQL, and Python
Optimize Spark jobs for performance, cost, and scalability
Work with structured and semi-structured data (Parquet, Delta, JSON, CSV)
Build and manage Delta Lake tables (ACID, time travel, schema evolution)
Integrate Databricks with Azure Data Lake Storage (ADLS Gen2)
Develop complex queries and transformations using SQL
Collaborate with data scientists, analysts, and stakeholders to support analytics and ML use cases
Ensure data quality, validation, and monitoring
Follow best practices for security, access control, and governance in Azure
6+ years of experience in Data Engineering
Strong hands-on experience with Azure Databricks
Proficiency in Python for data processing
Strong knowledge of SQL (joins, window functions, performance tuning)
Hands-on experience with Apache Spark / PySpar...
Stay in the loop
Weekly digest for this catalog listing
Subscribe for weekly catalog highlights focused on Databricks Engineer - Senior/ Lead in IN, Remote — title and location filters, not a guaranteed perfect match. No spam.
Privacy-first. Unsubscribe anytime.
FAQ
- Is this salary estimate official?
- When shown, estimated pay is a Catalitium catalog signal blended with any employer-disclosed range — not an offer. Compare with salary tools.
- How do I track or match this role?
- Use Track in the Apply column to save progress locally, or Carl for a CV read on this role.
- Something wrong with this listing?
- Use Report a problem in the Apply column. Catalog freshness depends on ingest — we do not claim a continuous live ATS feed.
More at Blend360
Hiring? Post 3 jobs free · Solutions