Lead Data Engineer
Logiczen · Bengaluru, India
- Salary: ₹21,00,000 / per annum
- Experience: 8–12 years
📋 Job Details at a Glance 📍 Location Bengaluru, India 👥 Experience 8–12 years 🎓 Qualification Bachelor's / Master's (CS, Engineering) or equivalent 📄 Job Type Full Time 💰 Budget ₹21,00,000 / per annum ⏱ Notice Period Immediate joiners preferred 🏢 Work Mode Work from Office (Bengaluru) 🛠 Category Technology · Data Engineering 🛠 Key Skills (Mandatory) SQL T-SQL Python Databricks Delta Lake Unity Catalog Apache Spark SCD CI/CD Airflow Azure Data Factory Lead Data Engineer — Bengaluru | Full-Time | ₹21,00,000 / per annum We are hiring a Lead Data Engineer for a full-time, 5-days work-from-office role in Bengaluru, India . This is a hands-on technical leadership role for professionals with 8–12 years in data engineering who can set Python and Databricks engineering standards, own Medallion pipelines, and mentor senior engineers. SQL, Python, and Databricks — strong hands-on experience is mandatory . Budget is up to ₹21,00,000 / per annum . Immediate joiners preferred . 📊 Role Difficulty: High | Competition Level: High | Fresher Friendly: No 📌 Work Mode: Bengaluru office — 5 days WFO . Remote / hybrid is not indicated for this requisition. You will build production Python ETL/ELT frameworks, design Bronze/Silver/Gold pipelines on Databricks (Delta Lake, Structured Streaming, Auto Loader, Unity Catalog), own dimensional modelling and advanced T-SQL, and drive orchestration, cost/performance, and mentoring outcomes. Job Role & Responsibilities As Lead Data Engineer, you will combine hands-on pipeline ownership with technical leadership across Python, Databricks, and modelling standards. Build production Python ETL/ELT pipelines, reusable packages, schema validation and testing frameworks (pytest, CI/CD). Write performant Python using OOP, generators, decorators and concurrency (multiprocessing/asyncio); profile, debug and optimize pipeline code. Set Python engineering standards for reviews, packaging/versioning, logging and exception handling. Design Bronze/Silver/Gold Medallion pipelines on Databricks using Delta Lake, Structured Streaming, Auto Loader and Unity Catalog. Own dimensional modelling (star/snowflake, SCD); write/review advanced T-SQL, MERGE/upsert logic and execution-plan-based tuning. Partner on ETL/ELT, orchestration and cost/performance decisions; mentor Data Engineers and Senior Data Engineers. Required Skills & Technical Competencies Must-Have Qualifications 8–12 years in data engineering, including 2+ years in technical leadership or mentoring. Strong Python: OOP, generators, decorators, concurrency, exception handling, pytest and production pipeline frameworks. Hands-on Databricks: Delta Lake (ACID, time travel, OPTIMIZE/ZORDER/VACUUM), Structured Streaming, Auto Loader and Unity Catalog. Spark performance tuning, data skew, cluster sizing/autoscaling and cost optimization. Dimensional modelling: star/snowflake, SCD Types 1/2/3, fact/dimension grain and conformed dimensions; working knowledge of Data Vault and Kimball/Inmon. Advanced T-SQL , indexing and query tuning; Medallion architecture and ETL/ELT and batch/streaming trade-offs. Orchestration using Databricks Workflows, Airflow or ADF on Azure or AWS. Good to Have PCEP/PCAP or equivalent Python certification; Databricks Certified Data Engineer Professional. Data governance/compliance (GDPR/HIPAA), FinOps and experience leading/mentoring 3+ engineers. Strong stakeholder communication and ability to explain technical trade-offs and own enterprise-scale design decisions. On your resume, highlight one Medallion pipeline on Databricks: Python ETL package + Delta Lake (OPTIMIZE/ZORDER) + Structured Streaming/Auto Loader + Unity Catalog + T-SQL MERGE/SCD with measurable latency, cost or reliability impact. Eligibility Criteria 8–12 years data engineering experience with 2+ years technical leadership or mentoring. Mandatory hands-on strength in SQL, Python, and Databricks . Proven ownership of Medallion / Delta Lake pipelines, dimensional modelling, and Spark performance/cost tuning. Able to work 5 days WFO from Bengaluru . Immediate joiners preferred — short notice periods will be prioritized. Bachelor's / Master's in Computer Science, Engineering or related field, or equivalent practical experience. Expected Deliverables & Success Measures Deliverables Production-grade Python ETL/ELT packages with pytest coverage and CI/CD. Bronze/Silver/Gold Databricks pipelines with Delta Lake, streaming/batch patterns and Unity Catalog governance. Documented dimensional models (star/snowflake, SCD) and tuned T-SQL / MERGE patterns. Engineering standards for reviews, packaging, logging, exception handling and mentoring outcomes. Indicative Success Measures Pipeline reliability and latency targets met for batch and streaming workloads. Measurable Spark / cluster cost optimization without sacrificing SLAs. Reusable Python packages and modelling patterns adopted by the wider DE team. Effective mentoring of Data Engineers and Senior Data Engineers with clearer review quality. Salary for Lead Data Engineer — Bengaluru 💰 Full-Time Budget ₹21,00,000 / per annum The budget for this role is up to ₹21,00,000 / per annum . Final offer depends on Databricks/Python depth, leadership evidence, interview performance, notice period, and CTC fit. Share Current CTC , Expected CTC (ECTC) , and notice period clearly when applying. Immediate joiners are preferred. Recommended Courses & Preparation Tips Recommended Focus Areas NexisGrow GetCertified — Strengthen Python / data / cloud credentials before applying. NexisGrow Resume Builder — Build an ATS-optimized Lead Data Engineer resume. Common Mistakes to Avoid ❌ Generic “SQL + Python” resumes — Show Databricks Delta Lake, Unity Catalog, Streaming/Auto Loader and Medallion ownership explicitly. ❌ No leadership evidence — Call out mentoring, standards ownership and design decisions. ❌ Ignoring WFO / notice — Confirm Bengaluru 5-days office readiness and joining timeline. ❌ Missing CTC / notice details — Include Current CTC, ECTC and notice period. Before You Apply — Checklist ✅ Confirm 8–12 years DE experience and 2+ years mentoring/tech leadership. ✅ Highlight SQL/T-SQL, Python (OOP/concurrency/pytest), Databricks (Delta, Streaming, Auto Loader, Unity Catalog). ✅ Add Medallion, dimensional modelling (SCD), Spark tuning and orchestration (Workflows/Airflow/ADF). ✅ Confirm Bengaluru WFO readiness and immediate / short notice preference. ✅ Add Current CTC and Expected CTC. Resume Tailoring & ATS Keywords ATS Keywords to Include Lead Data Engineer Python SQL / T-SQL Databricks Delta Lake Unity Catalog Structured Streaming Auto Loader Medallion Architecture Apache Spark Dimensional Modelling SCD Type 1/2/3 ETL / ELT pytest / CI/CD Airflow / ADF Kimball / Data Vault Resume Tips for This Role Lead with Lead/Senior DE title + 8–12 years + Databricks + Python + SQL in the first lines. Show one Medallion case study with Delta Lake features (time travel, OPTIMIZE/ZORDER/VACUUM) and cost/SLA impact. Quantify mentoring (team size), pipeline volume, latency, and FinOps/cost wins. State Current CTC, Expected CTC, notice period, and Bengaluru WFO readiness clearly. Build an ATS-optimized resume with NexisGrow Resume Builder . Pro Tip: Add one leadership bullet covering Python standards + Databricks Medallion design + Spark cost tuning + mentoring of 3+ engineers with a concrete delivery outcome. How to Apply Apply Now — Lead Data Engineer (Bengaluru) Open the official Apply channel on this NexisGrow listing and confirm the role title Lead Data Engineer . Prepare an updated resume highlighting SQL, Python, Databricks (Delta Lake, Streaming, Auto Loader, Unity Catalog), Medallion pipelines and mentoring. Include Current CTC , Expected CTC (ECTC) and notice period (immediate joiners preferred). Confirm you can work 5 days WFO from Bengaluru . Submit and track updates via your registered email. Early submission with complete CTC, notice and Databricks evidence is recommended. Apply Now — Lead Data Engineer (Bengaluru) NexisGrow.com does not charge any fees for job applications. Logiczen This full-time opening is for a Lead Data Engineer based in Bengaluru with mandatory office attendance ( 5 days WFO ). The focus is production Python ETL/ELT, Databricks Medallion / Delta Lake platforms, dimensional modelling, Spark performance/cost ownership and mentoring of data engineering talent. Role Details Industry IT / Data Engineering Location Bengaluru, India Connect With Us Apply Apply Now Budget ₹21,00,000 / per annum Frequently Asked Questions Interview · Role · Salary · Growth ? Who can apply for this Lead Data Engineer role? Eligibility Eligibility + Answer Professionals with 8–12 years in data engineering (including 2+ years mentoring/tech leadership) and strong hands-on SQL, Python and Databricks can apply. Bengaluru 5-days WFO readiness is required; immediate joiners are preferred. ? What is the salary budget? Salary Salary + Answer Budget is up to ₹21,00,000 / per annum. Share Current CTC and Expected CTC while applying. ? Is remote or hybrid allowed? Work mode Location + Answer No. The role is Bengaluru Work from Office — 5 days WFO. ? What skills are mandatory? Skills Skills + Answer Strong hands-on SQL, Python and Databricks are mandatory — including Delta Lake, Structured Streaming, Auto Loader, Unity Catalog, Spark tuning, dimensional modelling and advanced T-SQL. ? Is immediate joining required? Notice Notice + Answer Immediate joiners are preferred. Short notice periods will be prioritized during shortlisting. ? Is there any application fee on NexisGrow? Fees Fees + Answer No. NexisGrow.com does not charge any application or registration fees. 🔗 Explore More on NexisGrow Browse all Tech jobs Data Engineer jobs Databricks openings Python openings Bengaluru jobs Experienced / Lateral jobs Ready to Apply? Don't Miss This Opportunity! Apply only via the official channel. NexisGrow.com charges zero application fees. 👉 Apply Now — Official Link NexisGrow.com does not charge any application or registration fees. Beware of fraudulent offers. Naukri ki baat, NexisGrow ke saath • NexisGrow.com