Technical skills
PythonSQLData engineeringCI/CDAWSAzureGoogle CloudCloud platformsDevOpsQuality Assurance
About this role
Ensure quality of the data processing engine, in terms of result accuracy, performance fidelity, and robust execution at scale.
Requirements
- BS EE/CS or equivalent
- 5+ years of experience in data processing quality or performance testing for database, data warehouse, or query engine applications. Experience testing for platforms such as Apache Spark, Gluten, Velox, DataFusion preferred.
- Solid knowledge of SQL, Python, and similar data processing languages
- Automation-first mindset, experienced with programming/scripting languages and automation tools.
- Strong in problem-solving and coming up with the test strategy for the complex system.
- Strong in debugging, root cause, and narrowing down the failures.
- Experience in Functional, Performance, Integration, System Level testing
- Experience with the use of public cloud platforms such as AWS, GCP, and MS Azure
- Good Knowledge of tools like Jira, Confluence, Git, Jenkins.
- Good understanding of SDLC and agile methodologies.
- Good understanding of CI/CD implementations.