Jr. QA Data Engineer
What You'll Do
- Create scripts using SQL and/or Python to test data either on-premise or in the cloud to determine if data is accurate.Ā This involves testing counts and looking for nulls, missing data, wrong values, and duplicates.
- Test SQL or Python scripts from different sources with same conditions to make sure that they are returning matching results.
- Test reports against code to ensure that reports are returning the same results as data.
- Compare requirements versus output in tables or reports.
- Collaborate with Data Engineers to solve and fix problems.
- Automate testing in Databricks by creating Python or SQL scripts to monitor data.
- Optimize code for better performance resulting in quicker run times.
What You'll Need
- Required Skills
- 1 to 2 years of work experience
- BS/MS Degree in Computer Science, Computer Engineering or related area
- Intermediate SQL
- QA experience writing SQL or Python to test code manually
- Solid knowledge of database design and how entity relationship diagrams work
- Basic Python
- Strong attention to detail
- Good communication skills
- PreferredĀ Skills
- Experience automating testing through the creation of scripts and jobs in Databricks
- Knowledge of Power BI
- Experience working with Databricks