textrecipes

Extra recipes for Text Processing

https://github.com/tidymodels/textrecipes

Science Score: 26.0%

This score indicates how likely this project is to be science-related based on various indicators:

○
CITATION.cff file
✓
codemeta.json file
Found codemeta.json file
✓
.zenodo.json file
Found .zenodo.json file
○
DOI references
○
Academic publication links
○
Committers with academic emails
○
Institutional organization owner
○
JOSS paper metadata
○
Scientific vocabulary similarity
Low similarity (16.7%) to scientific vocabulary

Keywords from Contributors

tidy-data setup tidyverse unit-testing grammar data-manipulation documentation-tool color-palette visualisation twitter

Last synced: 10 months ago · JSON representation

Repository

Extra recipes for Text Processing

Basic Info

Host: GitHub
Owner: tidymodels
License: other
Language: R
Default Branch: main
Homepage: https://textrecipes.tidymodels.org/
Size: 71.9 MB

Statistics

Stars: 162
Watchers: 9
Forks: 15
Open Issues: 36
Releases: 20

Created almost 8 years ago · Last pushed about 1 year ago

Metadata Files

Readme Changelog License Code of conduct

README.Rmd

---
output: github_document
---



```{r}
#| label: setup
#| include: false
knitr::opts_chunk$set(
  collapse = TRUE,
  comment = "#>",
  fig.path = "man/figures/README-",
  out.width = "100%"
)
```

# textrecipes 


[![R-CMD-check](https://github.com/tidymodels/textrecipes/actions/workflows/R-CMD-check.yaml/badge.svg)](https://github.com/tidymodels/textrecipes/actions/workflows/R-CMD-check.yaml)
[![Codecov test coverage](https://codecov.io/gh/tidymodels/textrecipes/branch/main/graph/badge.svg)](https://app.codecov.io/gh/tidymodels/textrecipes?branch=main)
[![CRAN status](http://www.r-pkg.org/badges/version/textrecipes)](https://CRAN.R-project.org/package=textrecipes)
[![Downloads](http://cranlogs.r-pkg.org/badges/textrecipes)](https://CRAN.R-project.org/package=textrecipes)
[![Lifecycle: maturing](https://img.shields.io/badge/lifecycle-maturing-blue.svg)](https://lifecycle.r-lib.org/articles/stages.html)


## Introduction

**textrecipes** contain extra steps for the [`recipes`](https://CRAN.R-project.org/package=recipes) package for preprocessing text data. 

## Installation

You can install the released version of textrecipes from [CRAN](https://CRAN.R-project.org) with:

```{r}
#| eval: false
install.packages("textrecipes")
```

Install the development version from GitHub with:

```{r}
#| label: installation
#| eval: false
# install.packages("pak")
pak::pak("tidymodels/textrecipes")
```

## Example

In the following example we will go through the steps needed, to convert a character variable to the TF-IDF of its tokenized words after removing stopwords, and, limiting ourself to only the 10 most used words. The preprocessing will be conducted on the variable `medium` and `artist`.

```{r}
#| message: false
library(recipes)
library(textrecipes)
library(modeldata)

data("tate_text")

okc_rec <- recipe(~ medium + artist, data = tate_text) |>
  step_tokenize(medium, artist) |>
  step_stopwords(medium, artist) |>
  step_tokenfilter(medium, artist, max_tokens = 10) |>
  step_tfidf(medium, artist)

okc_obj <- okc_rec |>
  prep()

str(bake(okc_obj, tate_text))
```

## Breaking changes

As of version 0.4.0, `step_lda()` no longer accepts character variables and instead takes tokenlist variables.

the following recipe

```{r}
#| eval: false
recipe(~text_var, data = data) |>
  step_lda(text_var)
```

can be replaced with the following recipe to achive the same results

```{r}
#| eval: false
lda_tokenizer <- function(x) text2vec::word_tokenizer(tolower(x))
recipe(~text_var, data = data) |>
  step_tokenize(text_var,
    custom_token = lda_tokenizer
  ) |>
  step_lda(text_var)
```

## Contributing

This project is released with a [Contributor Code of Conduct](https://contributor-covenant.org/version/2/0/CODE_OF_CONDUCT.html). By contributing to this project, you agree to abide by its terms.

- For questions and discussions about tidymodels packages, modeling, and machine learning, please [post on RStudio Community](https://forum.posit.co/new-topic?category_id=15&tags=tidymodels,question).

- If you think you have encountered a bug, please [submit an issue](https://github.com/tidymodels/textrecipes/issues).

- Either way, learn how to create and share a [reprex](https://reprex.tidyverse.org/articles/articles/learn-reprex.html) (a minimal, reproducible example), to clearly communicate about your code.

- Check out further details on [contributing guidelines for tidymodels packages](https://www.tidymodels.org/contribute/) and [how to get help](https://www.tidymodels.org/help/).

Owner

Name: tidymodels
Login: tidymodels
Kind: organization

Repositories: 59
Profile: https://github.com/tidymodels

GitHub Events

Total

Create event: 18
Release event: 2
Issues event: 18
Watch event: 2
Delete event: 14
Issue comment event: 3
Push event: 59
Pull request event: 30
Fork event: 1

Last Year

Create event: 18
Release event: 2
Issues event: 18
Watch event: 2
Delete event: 14
Issue comment event: 3
Push event: 59
Pull request event: 30
Fork event: 1

Committers

Last synced: about 1 year ago

All Time

Total Commits: 707
Total Committers: 11
Avg Commits per committer: 64.273
Development Distribution Score (DDS): 0.081

Past Year

Commits: 67
Committers: 1
Avg Commits per committer: 67.0
Development Distribution Score (DDS): 0.0

Top Committers

Name	Email	Commits
Emil Hvitfeldt	e**t@g**m	650
Julia Silge	j**e@g**m	23
Max Kuhn	m**n@g**m	13
Jon Harmon	j**k@g**m	7
joran	j**s@g**m	4
DavisVaughan	d**s@r**m	3
Kanishka Misra	m**e@g**m	2
Hannah Frick	h**h@r**m	2
Hadley Wickham	h**m@g**m	1
Darío Hereñú	m**a@g**m	1
Ashish Dutt	a**8@g**m	1

Committer Domains (Top 20 + Academic)

rstudio.com: 2

Issues and Pull Requests

Last synced: 11 months ago

All Time

Total issues: 75
Total pull requests: 101
Average time to close issues: 3 months
Average time to close pull requests: 2 days
Total issue authors: 19
Total pull request authors: 7
Average comments per issue: 1.43
Average comments per pull request: 0.78
Merged pull requests: 99
Bot issues: 0
Bot pull requests: 0

Past Year

Issues: 13
Pull requests: 29
Average time to close issues: 29 days
Average time to close pull requests: about 10 hours
Issue authors: 2
Pull request authors: 1
Average comments per issue: 0.15
Average comments per pull request: 0.0
Merged pull requests: 28
Bot issues: 0
Bot pull requests: 0

View more stats

Top Authors

Issue Authors

EmilHvitfeldt (53)
PursuitOfDataScience (3)
nipnipj (2)
alexpghayes (1)
gary-mu (1)
lionel- (1)
jd4ds (1)
juliasilge (1)
NLDataScientist (1)
Malichot (1)
topepo (1)
apsteinmetz (1)
jrosell (1)
lmullen (1)
raj-hubber (1)

Pull Request Authors

EmilHvitfeldt (101)
juliasilge (2)
DavisVaughan (2)
joranE (2)
hadley (1)
topepo (1)
hfrick (1)

Top Labels

Issue Labels

documentation (12) next release :rocket: (12) upkeep (10) feature (9) bug (7) new steps (3) question (1) breaking change :skull_and_crossbones: (1) Long Term (1)

Pull Request Labels

Packages

Total packages: 2
Total downloads:
- cran 1,037 last-month
Total docker downloads: 89

Total dependent packages: 0
(may contain duplicates)
Total dependent repositories: 8
(may contain duplicates)
Total versions: 37
Total maintainers: 1

cran.r-project.org: textrecipes

Extra 'Recipes' for Text Processing

Homepage: https://github.com/tidymodels/textrecipes
Documentation: http://cran.r-project.org/web/packages/textrecipes/textrecipes.pdf
License: MIT + file LICENSE
Latest release: 1.1.0
published over 1 year ago

Versions: 22
Dependent Packages: 0
Dependent Repositories: 8
Downloads: 1,037 Last month
Docker Downloads: 89

Rankings

Stargazers count: 2.7%

Forks count: 5.5%

Dependent repos count: 10.5%

Downloads: 11.0%

Average: 13.9%

Docker downloads count: 24.9%

Dependent packages count: 28.8%

Maintainers (1)

emil.hvitfeldt@posit.co

Last synced: 11 months ago

conda-forge.org: r-textrecipes

Homepage: https://textrecipes.tidymodels.org/
License: MIT
Latest release: 1.0.1
published almost 4 years ago

Versions: 15
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Stargazers count: 27.1%

Dependent repos count: 34.0%

Average: 37.8%

Forks count: 39.0%

Dependent packages count: 51.2%

Last synced: 11 months ago

Dependencies

.github/workflows/R-CMD-check.yaml actions

actions/checkout v2 composite
r-lib/actions/check-r-package v2 composite
r-lib/actions/setup-pandoc v2 composite
r-lib/actions/setup-r v2 composite
r-lib/actions/setup-r-dependencies v2 composite

.github/workflows/lock.yaml actions

dessant/lock-threads v2 composite

.github/workflows/pkgdown.yaml actions

JamesIves/github-pages-deploy-action 4.1.4 composite
actions/checkout v2 composite
r-lib/actions/setup-pandoc v2 composite
r-lib/actions/setup-r v2 composite
r-lib/actions/setup-r-dependencies v2 composite

.github/workflows/pr-commands.yaml actions

actions/checkout v2 composite
r-lib/actions/pr-fetch v2 composite
r-lib/actions/pr-push v2 composite
r-lib/actions/setup-r v2 composite
r-lib/actions/setup-r-dependencies v2 composite

.github/workflows/test-coverage.yaml actions

actions/checkout v2 composite
r-lib/actions/setup-r v2 composite
r-lib/actions/setup-r-dependencies v2 composite

DESCRIPTION cran

R >= 3.4 depends
recipes >= 1.0.4 depends
Matrix * imports
SnowballC * imports
dplyr * imports
generics >= 0.1.0 imports
glue * imports
lifecycle * imports
magrittr * imports
purrr * imports
rlang * imports
tibble * imports
tokenizers * imports
vctrs * imports
covr * suggests
janitor * suggests
knitr * suggests
modeldata * suggests
rmarkdown * suggests
sentencepiece * suggests
spacyr * suggests
stopwords * suggests
stringi * suggests
testthat >= 3.0.0 suggests
text2vec * suggests
textfeatures >= 0.3.3 suggests
tokenizers.bpe * suggests
udpipe * suggests
wordpiece * suggests

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Open Source Science

textrecipes

Science Score: 26.0%

Keywords from Contributors

Repository

Basic Info

Statistics

Metadata Files

README.Rmd

Owner

GitHub Events

Total

Last Year

Committers

All Time

Past Year

Top Committers

Committer Domains (Top 20 + Academic)

Issues and Pull Requests

All Time

Past Year

Top Authors

Issue Authors

Pull Request Authors

Top Labels

Issue Labels

Pull Request Labels

Packages

cran.r-project.org: textrecipes

Rankings

Maintainers (1)

conda-forge.org: r-textrecipes

Rankings

Dependencies