dief |
Tools for Computing Diefficiency Metrics |
diefk |
Compute metric dief@k |
diefk2 |
Compute dief@k at a portion of the answer |
dieft |
Compute metric dief@t |
experiment1 |
Compares dief@t with other benchmark metrics as in <doi:10.1007/978-3-319-68204-4_1> |
experiment2 |
Compares dief@k at different answer portions as in <doi:10.1007/978-3-319-68204-4_1> |
metrics |
Example of benchmarking performance with other metrics |
plotAnswerTrace |
Plot the answer trace of approaches |
plotExperiment1 |
Generate radar plots that compare dief@t with other benchmark metrics in all tests as in <doi:10.1007/978-3-319-68204-4_1> |
plotExperiment1Test |
Generate radar plots that compare dief@t with other benchmark metrics in a specific test as in <doi:10.1007/978-3-319-68204-4_1> |
plotExperiment2 |
Generate radar plots that compare dief@k at different answer completeness in all tests as in <doi:10.1007/978-3-319-68204-4_1> |
plotExperiment2Test |
Generate radar plots that compare dief@k at different answer completeness in a specific test as in <doi:10.1007/978-3-319-68204-4_1> |
traces |
Example of answer traces |