Wednesday, July 26, 2006
Baseline application accuracy
Yontem 1: num of exactly matching words < avg. number of exactly matching words for the specific task(SUM, QA, IE, IR)?
Yontem 2: std. dev. in the alignment of the matching words < avg. std. dev. for the specific task?
Yontem 3: dist. between first and last matching words < avg. dist for the specific task?
YONTEM 1 YONTEM 2 YONTEM 3
-------------------------------------------------------------------
SUM 108/200 (54%) 121/200(60%) 100/200(50%)
QA 99/200 (50%) 119/200(59%) 117/200(58%)
IE 103/200 (52%) 110/200(55%) 109/200(55%)
IR 106/200 (53%) 106/200(53%) 106/200(53%)
Yontem 2: std. dev. in the alignment of the matching words < avg. std. dev. for the specific task?
Yontem 3: dist. between first and last matching words < avg. dist for the specific task?
YONTEM 1 YONTEM 2 YONTEM 3
------------------------------
SUM 108/200 (54%) 121/200(60%) 100/200(50%)
QA 99/200 (50%) 119/200(59%) 117/200(58%)
IE 103/200 (52%) 110/200(55%) 109/200(55%)
IR 106/200 (53%) 106/200(53%) 106/200(53%)
# posted by Bengi Mizrahi @ 2:36 PM 
