Data Engineering Lead at Optum

Optum · Bengaluru, Karnataka, India

📋 Job Details at a Glance 📍 Location Bengaluru, Karnataka, India 🏢 Company Optum 👥 Experience 4+ years 🎓 Qualification 4+ years. Hands-on with Python, SQL, Azure, CI/CD, Spark, Airflow. Relevant technical / engineering background 📅 Eligible Batch 2023, 2024, 2025, 2026 📄 Job Type Full Time 💰 Salary Not Disclosed 🏢 Industry Technology 🛠 Key Skills Python SQL Azure Data Bricks Spark Airflow CI/CD Data Pipelines Data Engineering Lead at Optum — Full Details & How to Apply Optum is seeking a Data Engineering Lead in Bengaluru, Karnataka, India , with a specific requirement for hands-on experience in Python, SQL, Azure, and Spark to design and deploy scalable data pipelines . This role is part of Data Engineering Lead jobs in the technology sector, where technical precision directly supports health outcome optimization through data infrastructure. This Data Engineering Lead role focuses on building and optimizing data pipelines using Azure Databricks , Spark , and Airflow . The responsibilities involve managing data ingestion and transformation processes, ensuring reliability and scalability of pipelines. These technical tasks are critical to maintaining real-time data flows that support clinical decision-making and operational efficiency in health care environments. The job posting highlights that Optum is a global organization focused on delivering care through technology. The Optum recruitment process emphasizes technical expertise and engineering background, with a clear focus on data pipeline development. This role is embedded within a team that leverages technology to improve health outcomes, aligning with the company’s operational priorities. 2023, 2024, 2025, 2026 graduates are eligible. Candidates must have 4+ years. Hands-on with Python, SQL, Azure, CI/CD, Spark, Airflow. Relevant technical / engineering background and 4+ years experience . The salary is Not Disclosed . This role is not open to candidates without the required technical foundation. Applicants will gain hands-on experience with Python , SQL , Azure , Data Bricks , Spark , and Airflow . This role provides a direct path into enterprise-level data engineering, with opportunities to work on production-grade data pipelines . It serves as a foundation for progression into senior engineering or data architecture roles within large-scale technology-driven health organizations. 📊 Role Difficulty: Medium | Competition Level: Medium | Fresher Friendly: No NexisGrow.com features this opportunity as part of its curated tech job listings. All details are sourced from the official job posting. Apply online before the opportunity closes. This is a Bengaluru, Karnataka, India jobs opportunity with clear technical requirements and a defined skill set. Job Role & Responsibilities The Data Engineering Lead at Optum is responsible for designing and deploying scalable data pipelines using Azure Databricks and Python , ensuring end-to-end data flow from ingestion to analytics. This role directly impacts data quality , pipeline performance , and system scalability in a regulated healthcare technology environment. Design scalable data pipelines using Python and Azure Databricks to process structured and semi-structured data from diverse sources. Develop and test data ingestion and transformation workflows using Spark SQL and Python scripts for real-time and batch processing. Build and maintain data ingestion processes with Spark and SQL to ensure consistent data flow across enterprise systems. Create and maintain Airflow DAGs for orchestration, scheduling, and monitoring of data pipelines with defined error handling and retry logic. Support and maintain existing data pipelines using Python and SQL to ensure data quality and compliance with data governance standards. Document end-to-end data workflows and pipeline logic in structured formats to improve team knowledge sharing and onboarding efficiency. Optimize Spark and Python processing performance by analyzing execution metrics and tuning data partitioning strategies for scalability. Collaborate with Product Owners and Business Analysts to gather requirements and define sprint-level data needs using SQL and data modeling techniques. This role requires direct ownership of data pipeline performance , system reliability , and end-to-end data quality metrics, with measurable impact on data delivery timelines and operational efficiency . Required Skills & Technical Competencies The Data Engineering Lead must possess a strong foundation in Python , SQL , and Azure to execute core data engineering tasks. These skills are essential for building, maintaining, and optimizing data pipelines in a cloud-based environment. Technical Skills Python — advanced — used for developing data ingestion scripts , data transformation logic , and automation workflows in Azure Databricks and Spark . SQL — advanced — used for writing complex data queries , optimizing data processing , and validating data integrity in Spark SQL and data warehouse systems. Azure — advanced — used for deploying, managing, and securing data solutions in Azure Databricks and cloud storage environments. Data Bricks — intermediate — used for building and managing data pipelines and notebook environments in Azure Databricks clusters. Spark — advanced — used for executing batch data processing and transformations via Spark SQL and Spark DataFrame APIs. Airflow — intermediate — used to create, schedule, and monitor data orchestration DAGs with error handling and alerting for pipeline failures . CI/CD — intermediate — used to automate pipeline deployment and testing workflows in Azure and DevOps environments. When showcasing these skills, emphasize specific use cases , such as Python scripts for ETL , SQL queries for data validation , and Airflow DAGs for pipeline orchestration in real-world projects. Eligibility Criteria This role is designed for candidates with a technical engineering background , at least 4 years of hands-on experience, and a strong foundation in data engineering tools like Python , SQL , and Azure . Must hold a Bachelor’s degree in Computer Science , Engineering , or a related technical field. Eligible batches are 2023 , 2024 , 2025 , and 2026 only. Minimum of 4 years of hands-on experience in data engineering or software development with Python and SQL . CGPA of 3.0 or above is required for admission consideration. Must have a portfolio demonstrating data pipeline development using Python , Spark , and Airflow in real-world projects. Experience with cloud-based data platforms such as Azure Databricks or Spark is mandatory. Documentation & Portfolio Requirements Your resume must include a clear technical summary , project descriptions with tools used , and metrics achieved (e.g., data processing speed, error rate reduction). Include code snippets or pipeline diagrams where applicable. Pro tip: Focus on a portfolio that shows end-to-end data pipeline development using Python , Spark , and Airflow , with measurable outcomes such as 99.9% data accuracy or reduced processing time by 40% . Salary for Data Engineering Lead at Optum 💰 Compensation Not Disclosed The advertised compensation for the Data Engineering Lead role at Optum is Not Disclosed . The exact in-hand figure and any additional components are confirmed by the company during the offer or HR discussion stage. Recommended Courses & Preparation Tips for Data Engineering Lead Upskilling with the right resources significantly enhances your chances of being selected for the Data Engineering Lead position at Optum . Recommended Courses & Resources Python — Essential for data manipulation and analysis in engineering tasks. SQL — Crucial for querying and managing databases effectively. Azure — Important for cloud-based data solutions and services. Data Bricks — Useful for collaborative data engineering and analytics. KodNest — Helps in mastering data engineering concepts and practices. Boost your profile with relevant certifications at NexisGrow GetCertified — strengthen your application before you apply. Common Mistakes to Avoid ❌ Applying without demonstrating experience in Python or SQL — ensure to showcase relevant projects. ❌ Using a generic resume instead of tailoring it — customize it to the specific responsibilities listed in the job description. ❌ Listing technologies like Azure or Spark without context — provide details on how they were applied in previous roles. ❌ Ignoring the requirement for 4+ years of experience — this may disqualify your application. ❌ Adding unrelated skills or unsupported claims — focus on relevant experiences to increase keyword density. ❌ Not verifying the official Apply URL and job details — always check before submission. Before You Apply — Checklist ✅ Confirm the job title, company, location, work mode, and experience requirement. ✅ Check that the candidate meets the supplied qualification criteria. ✅ Verify eligibility against the supplied eligible batches and experience requirement. ✅ Add relevant supplied JD keywords naturally to the resume. ✅ Highlight projects or experience related to the supplied technologies and responsibilities. ✅ Remove unsupported technologies, achievements, or experience claims. ✅ Open and verify the supplied Apply URL before submitting the application. ✅ Save the job details, application date, and role-specific resume version for tracking. Resume Tailoring & ATS Keywords for Data Engineering Lead Optimizing your resume for ATS is crucial for standing out in the selection process for the Data Engineering Lead role at Optum . ATS Keywords to Include Data Engineering Azure Python SQL Spark Airflow Data Pipelines CI/CD Data Ingestion Data Transformation Orchestration Monitoring Resume Tips for This Role Highlight your experience with Python and SQL prominently on your resume. Emphasize your hands-on experience with Azure , Spark , and Airflow . Consider including a project where you designed or optimized data pipelines using the mentioned technologies. Use exact keywords from the job description naturally to align with ATS requirements. Avoid adding unsupported technologies or experiences that you cannot substantiate. Build an ATS-optimized resume for this role using NexisGrow Resume Builder — free for all job seekers. Pro Tip: Avoid including unrelated skills or unsupported claims in your resume for this role. How to Apply for Data Engineering Lead at Optum Apply Now — Optum Open the official Apply URL and confirm the job title and company is correct. Prepare a resume aligned with the required skills, responsibilities, qualifications, and experience. Complete the official application form accurately and avoid unsupported claims. Submit the application and save the confirmation or application reference if provided. Record the application date and monitor the official company portal or registered email for updates. Applications reviewed on rolling basis — early submission recommended. Apply Now — Optum NexisGrow.com does not charge any fees for job applications. Optum Optum is a technology company based in Bengaluru, Karnataka, India . It operates in an onsite work mode and serves the global health industry. The company uses technology to deliver care, pharmacy benefits, and data resources to improve health outcomes for individuals worldwide. The team designs and builds scalable data pipelines using Python, SQL, Azure, Data Bricks, Spark, and Airflow . They develop data ingestion and transformation processes, optimize workflows, and maintain orchestration through Airflow DAGs. Collaboration with Product Owners and stakeholders is central to requirements and planning. This role supports Optum ’s mission by enabling efficient data processing and delivery. It directly contributes to connecting people with care, pharmacy benefits, and data resources needed for healthier lives. This role offers early-career exposure to advanced technologies like Azure, Spark, CI/CD , and Data Pipelines , providing foundational experience in real-world data engineering workflows. Company Details Industry Technology Location Bengaluru, Karnataka, India Connect With Us Careers Apply Now Website 🔗 careers.unitedhealthgroup.com Frequently Asked Questions Interview · Role · Salary · Growth ? Who can apply for this role? Eligibility Tap to expand + Answer Candidates with a relevant technical background and 4+ years of experience, particularly from the eligible batches of 2023, 2024, 2025, and 2026. ? What technical skills are most important for this role? Skills Tap to expand + Answer Python, SQL, Azure, Spark, and Airflow are the most important skills for this role. ? What is the expected salary for this position? Salary Tap to expand + Answer Salary Display is Not Disclosed. ? What should I expect after applying? Hiring Process Tap to expand + Answer The exact hiring stages are not specified in the job posting. ? How should I prepare for the interview? Preparation Tap to expand + Answer Review your experience with Python, SQL, and Azure; prepare to discuss data pipeline projects; understand Spark and Airflow; be ready to explain your collaboration with stakeholders; and familiarize yourself with data ingestion and transformation processes. ? Is this role remote, hybrid, or onsite? Work Mode Tap to expand + Answer This role is onsite in Bengaluru, Karnataka. ? What career exposure can this role provide? Growth Tap to expand + Answer This role provides exposure to advanced data engineering tools and practices, including Azure, Spark, and CI/CD processes. ? What should I highlight in my resume for this role? Resume Tap to expand + Answer Highlight your experience with Python, SQL, Azure, and any relevant data engineering projects. ? Is there a last date to apply? Application Tap to expand + Answer Not specified in the job posting. ? Is there a probation period? Probation Tap to expand + Answer Not specified in the job posting. ? What is the work environment like for this role? Culture Tap to expand + Answer The role involves collaboration with Product Owners and Business Analysts, emphasizing teamwork in requirements gathering. ? Can freshers apply for this role? Fresher Tap to expand + Answer No, the role requires 4+ years of experience. 🔗 Explore More on NexisGrow More jobs in Bengaluru Browse all Tech jobs Latest Fresher jobs More jobs at Optum Work From Home jobs Ready to Apply? Don't Miss This Opportunity! Apply only via the official link. NexisGrow.com charges zero application fees. 👉 Apply Now — Official Link NexisGrow.com does not charge any application or registration fees. Beware of fraudulent offers. Naukri ki baat, NexisGrow ke saath • NexisGrow.com