hirly

Apply with hirly

SAP BW

Infosys · Hyderabad, India

Upload your resume to see how well you match this job — free, in seconds, no account needed.

Your resume is used only to score it against this job. If you don't create an account, it is deleted within 24 hours.

Join a high-impact data engineering team where you’ll lead the design and modernization of enterprise analytics solutions by blending strong

Sap Bw

expertise with scalable Databricks and PySpark capabilities. In this role, you’ll work closely with business stakeholders, architects, and cross-functional engineering teams to deliver trusted datasets, performant pipelines, and actionable insights. You’ll be empowered to shape technical direction, mentor team members, and drive best practices across development, testing, and deployment. If you enjoy solving complex data challenges, improving reliability and performance, and enabling data-driven decision-making at scale, this opportunity offers the right mix of leadership, hands-on engineering, and collaborative ownership in a fast-moving environment. Responsibilities Key Responsibilities:

  • Lead end-to-end delivery of data engineering solutions leveraging Databricks and PySpark for scalable processing and transformation.
  • Design, build, and optimize batch/near-real-time pipelines with strong focus on performance, cost efficiency, and reliability.
  • Collaborate with

Sap Bw

stakeholders to understand source models, data semantics, and reporting needs; translate them into modern data platform designs.

  • Develop reusable frameworks, coding standards, and best practices for Spark-based development and notebook/job orchestration.
  • Ensure data quality through validations, reconciliation checks, and robust error handling/monitoring across pipelines.
  • Drive technical discussions, estimate work, plan sprints, and manage delivery risks/dependencies for the team.
  • Mentor engineers, conduct code reviews, and enforce secure, maintainable, and well-documented implementations.
  • Partner with platform/DevOps teams to support CI/CD, environment management, and production readiness for Databricks workloads. Minimum Qualifications:
  • Bachelor’s or Master’s degree (BTECH, MTECH, MCA, MSC) in Computer Science, Engineering, or a related field.
  • 7–9 years of overall experience with strong hands-on expertise in Databricks and PySpark for large-scale data processing.
  • Strong experience working with

Sap Bw

concepts and data structures to support analytics/reporting requirements.

  • Solid understanding of data modeling, ETL/ELT patterns, and performance tuning in distributed data processing environments.
  • Ability to lead technical delivery, collaborate with stakeholders, and communicate clearly across teams. Technical requirements Technology->Business Intelligence
  • Reporting->SAP BW Additional responsibilities Preferred Qualifications:
  • Experience modernizing or integrating

Sap Bw

data with cloud-based lakehouse architectures using Databricks.

  • Strong knowledge of Spark optimization techniques (partitioning, caching, joins, file sizing) and production-grade pipeline design.
  • Exposure to Delta Lake patterns (ACID tables, MERGE, time travel) and building curated layers for analytics consumption.
  • Experience with workflow orchestration and operational monitoring for data pipelines, including alerting and SLA management.
  • Proven ability to guide teams through design reviews, code quality improvements, and delivery governance in agile environments. Education MCA,MSc,MTech,Bachelor of Engineering,BTech