data-mining information-retrieval lexer nlp tokenization

Engineering (40%) Earth and Environmental Sciences (40%)

julia natural-language-processing nlp text-encoding textprocessing tokenization

corpus-tools language-detection language-identification lemmatiser lemmatization lemmatizer low-resource-nlp morphological-analysis nlp tokenization tokenizer wordlist

ai artificial-intelligence cython data-science deep-learning entity-linking machine-learning named-entity-recognition natural-language-processing neural-network neural-networks nlp nlp-library python spacy text-classification tokenization

bpe tokenization tokenizer

bpe cpp icu machine-translation natural-language-processing python sentencepiece tokenization tokenizer unicode

llm llms tokenization tokenizer tokens tokenwars

distillation jax llms machine-learning tokenization tokenizer-transfer transfer-learning

nlp nlp-library semeval spell-corrector spelling-correction text-processing text-segmentation tokenization tokenizer word-normalization word-segmentation

language-model llm llms multilingual tokenization transfer-learning

inference llm prompts tokenization

java maven natural-language-processing nlg nlp tokenization

medical-informatics pretraining tokenization transformer-architecture

keras-tensorflow linear-regression lstm naive-bayes-classifier natural-language-processing news-sentiment-analyser sentiment-analysis svc-svm tokenization twitter-sentiment-analysis

character-understanding cross-attention llms paper tokenization transformer

classification corpus sentiment-analysis thai tokenization

climate-change ethnologue gdp language llm openai-api tokenization wdi