Evaluation method based on case retrieval.
Evaluate lists of cases with evaluate_retrieval(). For each problem description the remaining descriptions are assessed, and the solution corresponding to the best matching description is retrieved. Actual solution is compared to retrieved solution using cosine of solution vectors.
The overall evaluation score is equal to the average solution-solution similarity over the case base.
Author: | Kjetil Valle <kjetilva@stud.ntnu.no> |
---|
Perform retrieval operations for each input case, returning overall performance.
Each description in descriptions is used to retrieve the solution (from solutions) corresponding to the most similar other description. The average similarity between query and retrieved solution is returned.