An odd couple – Corpus frequency and look-up frequency: what relationship?

  • Lars Trap-Jensen Society for Danish Language and Literature
  • Henrik Lorentzen Society for Danish Language and Literature
  • Nicolai H. Sørensen Society for Danish Language and Literature
Keywords: corpus frequency, lemma selection, look-up behaviour, updating dictionaries, log files

Abstract

In this paper, we investigate the relationship between log file records and corpus frequency. The study was motivated by practical considerations of how best to keep an already existing corpus-based dictionary updated. Should the next word in the dictionary be the one that follows next on a list of declining corpus frequency? Or the one that users most frequently look up but don’t find? In order to establish manageable criteria, we analysed log files for The Danish Dictionary from 2009 to 2012 and compared the list of most popular words looked up by the users with the frequency of the same words in the corpus underlying The Danish Dictionary. The users’ actual search behaviour was analysed in order to find answers to questions such as these: Are there words which are never looked up? If so, can we say something meaningful about their corpus frequency patterns – do they belong to particular parts of speech, are they particularly frequent or infrequent, could it even be that the pattern is cumulative, in such a way that a particular threshold can be identified? Ultimately, the question is whether it makes sense to use corpus frequency as a criterion for lemma selection.

Downloads

Download data is not yet available.

References

Trap-Jensen, L., Lorentzen, H., Sørensen, N. (2014): An odd couple – Corpus frequency and look-up frequency: what relationship?Slovenščina 2.0, 2 (2): 94–113.
Published
2014-12-01
How to Cite
Trap-JensenL., LorentzenH., & H. SørensenN. (2014). An odd couple – Corpus frequency and look-up frequency: what relationship?. Slovenščina 2.0: Empirical, Applied and Interdisciplinary Research, 2(2), 94-113. https://doi.org/10.4312/slo2.0.2014.2.94-113
Section
Articles