Test Engineer (Data & Automation)OverviewWe are seeking an experienced Test Engineer to support the delivery of high-quality data... Read more
Test Engineer (Data & Automation)
Overview
We are seeking an experienced Test Engineer to support the delivery of high-quality data and application solutions. This role focuses on automation, data validation, and production analysis within a modern cloud-based environment. You will play a key role in ensuring system reliability, improving testing frameworks, and driving best practices across engineering teams.
This is a collaborative position requiring strong technical expertise, analytical thinking, and the ability to mentor others while working across complex data platforms.
Key Responsibilities
Design, develop, and maintain automated test frameworks to improve testing efficiency and coverageAnalyse and interpret test results, identifying risks, issues, and areas for improvementProduce clear reports on testing activities, outcomes, and associated risksAutomate data validation and application testing processes across distributed systemsInvestigate production issues using data analysis to identify root causesWork with orchestration tools (e.g., Apache Airflow) to monitor workflows and troubleshoot failuresValidate data using tools such as Jupyter Notebooks and Amazon AthenaAnalyse data across multiple formats to ensure integrity and correctness of new functionalitySupport CI/CD practices using Git-based workflows and pipeline automationParticipate in infrastructure and deployment activities, including containerisation and Infrastructure as CodeCollaborate with cross-functional teams to translate business requirements into testable solutionsMentor and guide team members on testing methodologies and best practicesKey Skills & Experience
Technical Skills
Proficiency in Python, SQL, and at least one additional programming language (e.g., Java)Experience with scripting languages such as BashStrong understanding of automated testing frameworks and methodologiesHands-on experience with Apache Airflow and log analysisFamiliarity with data processing tools such as Apache SparkExperience working with cloud platforms and services, including:Monitoring and logging toolsStorage and data servicesCompute and container servicesExperience with CI/CD pipelines and version control systems (e.g., GitLab)Knowledge of Infrastructure as Code (e.g., Terraform)Familiarity with Docker and containerised environmentsData & Analytics
Strong data analysis skills, including working with structured and semi-structured dataExperience validating and querying data using tools such as Athena and notebooksUnderstanding of data modelling concepts, including dimensional models and slowly changing dimensionsAbility to generate realistic test data for various scenariosAdditional Knowledge
Understanding of distributed data platforms and big data environments (e.g., EMR)Knowledge of encryption principles (client-side and server-side)Awareness of production system monitoring and incident analysisSoft Skills
Strong analytical and problem-solving abilitiesExcellent communication skills, with the ability to present findings clearlyProactive approach to identifying and mitigating risksAbility to mentor and support less experienced team membersCollaborative mindset with experience working in agile delivery environmentsWorking Arrangements
UK-based role with flexible locationOccasional travel required for team collaboration sessions and workshops Read less
