Apply with hirly
InfoBeans Technologies - ETL Quality Assurance Engineer - Databricks/Python
InfoBeans · Indore, Madhya Pradesh, India
Upload your resume to see how well you match this job — free, in seconds, no account needed.
Your resume is used only to score it against this job. If you don't create an account, it is deleted within 24 hours.
Job Title :
Etl QA
Tester with Python and Databricks experience Summary We are seeking a meticulous
Etl QA
Engineer to ensure data integrity across our Databricks platform. You will validate complex data pipelines using SQL and Python, working closely with global teams to deliver high-quality data solutions. This role requires flexibility to ensure overlap with
US Est
working hours for real-time coordination and team collaboration. Key Responsibilities
- Design, develop, and execute ETL test cases to validate data extraction, transformation, and loading processes.
- Write and execute complex SQL queries to perform data validation between multiple hops.
- Medallion Architecture Testing: Validate data integrity as it moves through the Bronze, Silver, and Gold layers within Databricks.
- Write and execute advanced SQL and Python scripts to validate large datasets and identify defects.
- Design, develop, and execute UI Front end manual test cases to validate the functionalities of the software.
- Identify, document, and track defects, collaborate with developers to ensure timely resolution.
- Participate in project meetings and be available for discussions in
US Est
working hours as needed. Required Skills & Advanced SQL: Proficiency in windows functions, complex joins and CTEs for deep data validation.
- ETL & DWH: Deep understanding of ETL and Data Warehouse concepts. Good To Have
- Databricks Experience: Hands-on experience with Databricks Notebooks and cluster management.
- Programming: Strong skills in Python, specifically PySpark and Pandas for large-scale data manipulation.
- Cloud Platform Familiarity: Experience working within Azure or AWS environments.
- Agile Methodologies and Defect Tracking Tools: Experience with Jira for defect tracking and working with Agile/Scrum framework.
- CI/CD (Additional Plus): Familiarity with automated deployment pipelines and version control (Git). (ref:hirist.tech)