Corpora at NLP Centre

• ske.fi.muni.cz provides:
  • access to all corpora at NLP Centre for anybody at the Masaryk University
  • access to the English Clueweb collection – a text corpus of more than 82 billion tokens¹.
• Sketch Engine for Masaryk University staff and students
• corpora (being) developed at NLP Centre:

  Corpus (lang)	millions of tokens
  NEW: English (ClueWeb09)1	82,581
  Russian	20,162
  English	12,968
  French	12,369
  Japanese	11,113
  Polish	9,567
  Spanish (American)	8,719
  Arabic	6,637
  Czech	5,818
  Turkish	4,125
  Hungarian	3,184
  Italian	3,077
  German	2,844
  Spanish (European)	2,459
  Chinese	2,107
  Portuguese (European)	948
  Slovak	876
  Bulgarian	849
  Norwegian	770
  Korean	561
  czes (Czech)	465
  Estonian	324
  Kazakh	139
  Azerbaijani	115
  Tajik	52
  Uzbek	25
  Kyrgyz	24
  Turkmen	2
  DESAM (Czech)	1

• Software developed in cooperation with Lexical Computing Ltd.:
  • Sketch Engine, a powerful corpus management system for text corpora and language analysis software
  • NoSketch Engine – the free version of Sketch Engine without Word Sketches
  • Corpus tools for html/text processing such as encoding detection, boilerplate removal, de-duplication, tokenisation
  • Web crawler SpiderLing
• Corpus related projects at NLP Centre:
  • Corpus Pattern Analysis
  • TIL corpus – corpus of formulas in Transparent Intensional Logic formulae
  • Kapradí

If necessary, contact corpadm@aurora.fi.muni.cz

¹ In order to get access to the English ClueWeb collection from 2009, please acquire the (free) license from Carnegie Mellon first and then contact us for granting the access.