The Power of Experience On the Usefulness of Validation Knowledge

TURING Test technologies are promising ways to validate AI systems which may have no alternative way to indicate va-lidity. Human experts (validators) are often too expensive to involve. Furthermore, they often have different opinions from each other and from themselves over time. One way out of this situation is to employ a Validation Knowledge Base (V KB) which can be considered to be the collective experience of human expert panels. V KB is constructed and maintained across various validation sessions. Primary ben-efits are (1) decreasing the validators ’ workload and (2) re-fining the methodology itself. Additionally, there are some side effects that (1) improve the selection of an appropriate expert panel and (2) improve the identification of an optimal solution to a test cases. Furthermore, Validation Experts Software Agents (V ESA) are introduced as an model of a particular expert’s knowledge. V ESA is a software agent corresponding to a human validator. It systematically models the validation knowledge and behavior of its human origin. After a learning period, it can be used to substitute the human exert