Re: [Corpora-List] Brown Corpus

From: Jean Veronis (Jean.Veronis@up.univ-mrs.fr)
Date: Fri Jun 17 2005 - 14:28:24 MET DST

Next message: Steven Bird: "RE: [Corpora-List] Brown Corpus"

Previous message: Adam Kilgarriff: "RE: [Corpora-List] Brown Corpus"
In reply to: Adam Kilgarriff: "RE: [Corpora-List] Brown Corpus"
Next in thread: Steven Bird: "RE: [Corpora-List] Brown Corpus"
Next in thread: Jörg Schuster: "[Corpora-List] Re: Brown Corpus"
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]

Hi Adam,

Although I agree on the same-size sample design, I am less convinced by
the use of the mean and standard deviation on corpora (as well as
t-score and a few others). The distributions are so strongly skewed that
these measures are probably not advisable. Without getting into anything
too complicated, the median and measures based on it, like the MAD (mean
absolute deviation), and in general what's called "robust statistics",
seem preferable to me.

--j
http://aixtal.blogspot.com

Next message: Steven Bird: "RE: [Corpora-List] Brown Corpus"
Previous message: Adam Kilgarriff: "RE: [Corpora-List] Brown Corpus"
In reply to: Adam Kilgarriff: "RE: [Corpora-List] Brown Corpus"
Next in thread: Steven Bird: "RE: [Corpora-List] Brown Corpus"
Next in thread: Jörg Schuster: "[Corpora-List] Re: Brown Corpus"
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]

This archive was generated by hypermail 2b29 : Fri Jun 17 2005 - 14:54:17 MET DST