Apply Now
Log in or sign up (free) to apply to this job.
About the role
🚀 Hiring: Data Engineer ( Azure )
⭐ Experience: 5+ Years
📍 Location: Pune, Bhopal, Jaipur, Gurgaon, Delhi, Banglore,
⭐ Work Mode:- Hybrid
⏱️ Notice Period: Immediate Joiners
(Only immediate joiners & candidates serving notice period)
Hiring: Databricks Data Engineer – Lakeflow | Streaming | DBSQL | Data Intelligence
We are looking for a Databricks Data Engineer to build reliable, scalable, and governed data pipelines powering analytics, operational reporting, and the Data Intelligence Layer.
🔹
Key Responsibilities
- Build optimized batch pipelines using Delta Lake (partitioning, OPTIMIZE, Z-ORDER, VACUUM)
- Implement incremental ingestion using Databricks Autoloader with schema evolution & checkpointing
- Develop Structured Streaming pipelines with watermarking, late data handling & restart safety
- Implement declarative pipelines using Lakeflow
- Design idempotent, replayable pipelines with safe backfills
- Optimize Spark workloads (AQE, skew handling, shuffle & join tuning)
- Build curated datasets for Databricks SQL (DBSQL) , dashboards & downstream applications
- Package and deploy using Databricks Repos & Asset Bundles (CI/CD)
- Ensure governance using Unity Catalog and embedded data quality checks
✅ Mandatory Skills (Must Have)
- Databricks & Delta Lake (Advanced Optimization & Performance Tuning)
- Structured Streaming & Autoloader Implementation
- Databricks SQL (DBSQL) & Data Modeling for Analytics
Skills required
databrickssparkazureci/cdsql