hirly

Apply with hirly

Spark Scala Developer

Infosys · Hyderabad, India

Upload your resume to see how well you match this job — free, in seconds, no account needed.

Your resume is used only to score it against this job. If you don't create an account, it is deleted within 24 hours.

Join a fast-paced data engineering team where you’ll build and optimize large-scale data processing solutions that power analytics and decision-making across the business. In this role, you’ll use Spark and Scala to design reliable, high-performance pipelines, collaborating closely with data engineers, analysts, and platform teams to deliver clean, trusted datasets. You’ll work on challenging problems like performance tuning, handling complex transformations, and ensuring data quality at scale—while contributing to a culture that values ownership, continuous improvement, and knowledge sharing. If you enjoy turning raw data into well-structured, production-ready assets and want to make a measurable impact through scalable engineering, this is a great opportunity to grow and lead through hands-on delivery. Responsibilities Data Engineering & Development

  • Design, develop, and maintain Spark-based batch processing pipelines using Scala for large datasets.
  • Implement efficient transformations, aggregations, and joins, ensuring correctness and scalability.
  • Write optimized SQL for data extraction, validation, and reconciliation across sources and targets. Performance, Quality & Reliability
  • Tune Spark jobs (partitioning, caching, shuffles, memory/executor settings) to improve runtime and cost efficiency.
  • Build data quality checks and validations to ensure accuracy, completeness, and consistency of outputs.
  • Troubleshoot production issues, perform root-cause analysis, and implement preventive fixes. Collaboration & Delivery
  • Work with stakeholders to understand data requirements and translate them into technical solutions.
  • Participate in code reviews, follow engineering best practices, and contribute to reusable components.
  • Document pipelines, logic, and operational runbooks for maintainability and onboarding. Technical requirements Technology->Big Data
  • Data Processing->Spark,Technology->Java->Apache->Scala Additional responsibilities
  • Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent practical experience).
  • 5–9 years of overall experience with strong hands-on development in Spark and Scala.
  • Solid experience writing and optimizing SQL for analytics and data processing use cases.
  • Strong understanding of distributed processing concepts, data transformations, and performance considerations.
  • Ability to debug and resolve issues in data pipelines with a focus on reliability and quality. Education Bachelor of Engineering