Open data
Catchtype's decision data is based on FrequencyWords. We release the word data derived from it under the same license (CC BY-SA 4.0), so anyone can download, use, change and share it.
Source: FrequencyWords 2018 Korean and English 50k lists (OpenSubtitles 2018), by Hermit Dave, https://github.com/hermitdave/FrequencyWords, licensed under CC BY-SA 4.0. FrequencyWords was counted from the OpenSubtitles 2018 corpus (OPUS, http://opus.nlpl.eu/OpenSubtitles2018.php; P. Lison and J. Tiedemann, 2016), made from subtitles at http://www.opensubtitles.org.
Changes: the lists were cut and filtered, and turned into the statistics below. Counts from NSMC (https://github.com/e9t/nsmc) and Mozilla Common Voice sentences, both CC0 1.0, and from word lists written for Catchtype were added to the syllable and letter statistics. For english-subtitle-only-words.txt, Google Books Ngram 2020 (CC BY 3.0) and SCOWL 2020.12.07 were used only to remove words; nothing from those lists is included.
License: these files are licensed under the Creative Commons Attribution-ShareAlike 4.0 International License by Hebbian AI Co., Ltd. See LICENSE.txt or https://creativecommons.org/licenses/by-sa/4.0/.
Files
| File | Size | SHA-256 |
|---|---|---|
| README.txt | 2 KB | 2df7387ffd9b219576da040e8ff862d317d2bcf108d431438e5bd6848e70cbd9 |
| LICENSE.txt | 20 KB | 28a9529c7d0bb4dc51f4bf5c116a3d16ef247a052f7591466768ddf563fd1cf5 |
| common-syllables.txt | 6 KB | 14bd78060c9262e7a79d0f82b5efabb3e08ca64ec22a9dfd1a5153d6df3252d2 |
| english-letter-triples.txt | 70 KB | 0284cadf51acbf21d33dd91cdcf22c8ecb8d3a7d55979fd53bec381ac67eb4f7 |
| english-subtitle-only-words.txt | 8 KB | 66d955b9d952de8ea8e0ff38eb05237edd0ee8400a7ac8d010bd48d1709be79d |
| english-unseen.txt | 5 KB | ddaa8b91a57621addbf903e02a2ff7ce5f5b4edf2a862efb6b485f5fdd773959 |
| english-words.txt | 372 KB | 760fcaf6114a516f6a6cfa834e8d83f2f6ad60b0968cdc5fd424c8248d20e935 |
| korean-more-words.txt | 221 KB | 367572445f56783ae6fd98c76a22d024706b2eaa84fdda3eab1d90b16fad00c3 |
| korean-syllable-pairs.txt | 556 KB | e16f60f800999748e43f3e28ede75218ba552d2eb5f97c4ccc775b7c21d2008c |
| korean-unseen.txt | 15 KB | 43fa6d0176b51b3a9cd4140fe17e34a53ed73b1c57720d76804f594391add3b7 |
| korean-words.txt | 312 KB | dbde8d2d25baf790463b25987202b7566e5c6c994d4e8ff647c7ddb07cd529e0 |
| unknown.txt | 1 KB | 3302c5c430459c86d872f28bec3635765a1f671bdcf77ce40d3f1abe5f32401c |