Re: [Corpora-List] comparing two IR systems using statistical tests?

From: Chris Jordan (cjordan@cs.dal.ca)
Date: Tue Oct 11 2005 - 16:09:09 MET DST

  • Next message: Dr Wendy Anderson: "[Corpora-List] Scottish Corpus of Texts and Speech - update"

    Not to plug my own thesis work or anything :P

    I have been exploring the usage of automatic query generation based on
    relative entropy to manufacture controlled environments for evaluating
    retrieval algorithms. I have paper I am preparing for ECIR with futher
    controlled environments that I have been playing with that has resulted
    in some interesting findings. I can pass that along to you if it gets
    accepted (knock on wood) but for now I can give you ready access to a
    pdf of my thesis.

    Timad Kahena wrote:

    >Hi,
    >
    >Based on two (or more) results list (in TREC formats), how can we
    >compare two IR systems using statistical tests? Could someone show me how to
    >do that?
    >
    >Examples and tutorial links are welcome…
    >
    >Thank you,
    >Timad
    >
    >
    >
    >---------------------------------
    > Appel audio GRATUIT partout dans le monde avec le nouveau Yahoo! Messenger
    > Téléchargez le ici !
    >
    >
    >
    >


    This archive was generated by hypermail 2b29 : Tue Oct 11 2005 - 16:20:34 MET DST