[ref. t1592904] AI Quality Engineer

Job Description

Type: Permanent OR Contract

Must be fluent German and English Speaker

1. Test Planning: Creating test plans and strategies for evaluating AI systems, including defining test objectives, selecting suitable testing methods, and identifying test scenarios.
2. Test Execution: Performing various types of tests, such as functional testing, regression testing, performance testing, and usability testing, to evaluate the behavior and performance of AI algorithms and models.
3. Defect Identification: Identifying and documenting defects, irregularities, or inconsistencies in AI systems and working closely with developers to rectify and resolve them.
4. Data Quality Assurance: Ensuring the quality, consistency, and relevance of data used for training and testing AI models, which involves tasks like collecting, cleaning, preprocessing, and validating data. Identifying and mitigating bias in datasets.
5. Test Data Generation: Generate synthetic data for variety, data for edge cases and input fuzzing
6. Model Evaluation & Metrics: Understanding when to use which metric (Accuracy, Precision, Recall, F1-score), visualizing model performance (ROC Curves, Confusion Matrices), diagnosing & addressing Overfitting/Underfitting.
7. Ethical and Bias Testing: Assessing AI systems for ethical considerations and potential biases to make sure they follow ethical standards and encourage inclusivity and diversity.
8. Test Automation: Develop and maintain automated test scripts and frameworks for efficient and effective testing.
9. Collaboration: Collaborating with diverse teams, including developers, data scientists, and domain experts, to understand requirements, validate assumptions, and align testing efforts with project goals.
10. Documentation and Reporting: Documenting test methods, results, and suggestions in clear and brief reports for stakeholders.
11. Drive continuous improvement and best practices in testing methodologies and processes for AI implementations.

1. 7+ years of experience in software testing, with a focus on AI or machine learning applications.
2. Strong understanding of testing methodologies, techniques, and tools.
3. Experience in designing and executing test cases for complex software systems.
4. Proficiency in programming languages such as Python for test automation.
5. Fundamental knowledge of AI, including ML, deep learning, NLP and computer vision.
6. Familiar with AI-driven testing tools and frameworks utilized for automating tests, predictive analytics, and generating intelligent test cases.
7. Specialize in particular areas of AI testing, such as NLP testing, computer vision testing, or AI-driven test automation.
8. Proficiency in testing AI-powered applications and systems, including chatbots, recommendation engines, and image recognition systems.
9. Strong communication and collaboration skills.
10. Transformation Experience in CRM domain is good to have

About Company

We work towards delivering sustained value creation for customers, employees, industries and society at large. Core offerings include data warehousing, middleware development, product development and web-enablement of legacy applications in verticals like telecom, finance, healthcare, manufacturing, energy & utilities, retail & distribution, enablement of legacy Relentless exploration of technology horizons and a Global Delivery Model that is a judicious combination of onsite, offsite and offshore development, offer a complete range of high-ROI business solutions spanning the consulting, technology, operations and process outsourcing value chain.

Respecting the knowledge and experience of your staf.