Apply with hirly
Senior Azure Databricks Engineer
Tata Consultancy Services · India
Upload your resume to see how well you match this job — free, in seconds, no account needed.
Your resume is used only to score it against this job. If you don't create an account, it is deleted within 24 hours.
Design, build, and maintain scalable and efficient data pipelines using Databricks. Integrate data from various sources (for eg. Azure storage account, SFTP, Fabric) using Apache Spark within Databricks. Implement processes and checks to ensure the accuracy and completeness of data. Work closely with data owners, analysts, and other stakeholders to understand data requirements and deliver solutions. Monitor data pipelines for issues and resolve them promptly to maintain data flow integrity. Exp…