https://github.com/amalan-constat/needs4bigdata

R package implementing subsampling methods to find informative samples from big data

https://github.com/amalan-constat/needs4bigdata

Keywords

Repository

R package implementing subsampling methods to find informative samples from big data

README.Rmd

---
output: github_document
---

```{r setup, include=FALSE}
knitr::opts_chunk$set(echo = TRUE,comment = "#>",collapse = TRUE, fig.retina=2, fig.path = "man/figures/",
                      out.width = "100%")
library(badger)
```

# NeEDS4BigData 



`r badge_cran_release("NeEDS4BigData")`
`r badge_cran_checks("NeEDS4BigData")`
`r badge_runiverse()`

`r badge_cran_download("NeEDS4BigData", "grand-total", "green")`
`r badge_cran_download("NeEDS4BigData", "last-month", "green")`
`r badge_cran_download("NeEDS4BigData", "last-week", "green")`

`r badge_repostatus("Active")`
`r badge_lifecycle("stable")`
[![GitHub issues](https://img.shields.io/github/issues/Amalan-ConStat/NeEDS4BigData.svg?style=popout)](https://github.com/Amalan-ConStat/NeEDS4BigData/issues)

[![codecov](https://codecov.io/gh/Amalan-ConStat/NeEDS4BigData/graph/badge.svg?token=UHFWYFPDSI)](https://codecov.io/gh/Amalan-ConStat/NeEDS4BigData)
`r badge_codefactor("Amalan-ConStat/NeEDS4BigData")`
`r badge_code_size("Amalan-ConStat/NeEDS4BigData")`

[![MIT license](https://img.shields.io/badge/License-MIT-blue.svg)](https://lbesson.mit-license.org/)
`r badge_doi("10.1007/s00362-023-01446-9", "green")`


_The R package "NeEDS4BigData" provides approaches to implement subsampling methods to analyse big data._

### What is “NeEDS4BigData” an abbreviation for?

*Ne*w *E*xperimental *D*esign based *S*ubsampling methods *for Big Data*.

### How to engage with "NeEDS4BigData" the first time ? 

```{r NeEDS4BigData from GitHub or CRAN,eval=FALSE}
## Installing the package from GitHub
devtools::install_github("Amalan-ConStat/NeEDS4BigData")

## Installing the package from CRAN
install.packages("NeEDS4BigData")
```

### Subsampling Methods

1. A- and L-optimality based subsampling for GLMs.
2. A-optimality based subsampling for Gaussian Linear Models.
3. Leverage sampling for GLMs.
4. Local case control sampling for logistic regression.
5. A-optimality based subsampling under measurement constraints for GLMs.
6. Model robust subsampling method for GLMs.
7. Subsampling method for GLMs when the model is potentially misspecified.

These seven methods are described in the following articles under the topics

1. Introduction - explains the need for subsampling methods.
2. Model based subsampling
3. Model robust and misspecification
4. Benchmarking Functions

For $2)$ we assume the main effects model can describe the data. 
While for $3)$ first we consider there are several models that can describe the big data, then later we assume the given main effects model is misspecified. 
Under these conditions from $2)$ and $3)$ we explore subsampling for four given big data sets.
Further, to explore the computation time we ran simulations for the scenarios $2)$ and $3)$ where we compare our subsampling functions against full data modelling in $4)$.

#### Thank You

[![Twitter](https://img.shields.io/twitter/url/https/github.com/Amalan-ConStat/NeEDS4BigData.svg?style=social)](https://twitter.com/intent/tweet?text=Wow:&url=https%3A%2F%2Fgithub.com%2FAmalan-ConStat%2FNeEDS4BigData)

[ ![](https://img.shields.io/badge/LinkedIn-Amalan%20Mahendran-black.svg?style=flat) ]( https://www.linkedin.com/in/amalan-mahendran-72b86b37/)
[ ![](https://img.shields.io/badge/Research%20Gate-Amalan%20Mahendran-black.svg?style=flat) ]( https://www.researchgate.net/profile/Amalan_Mahendran )

Owner

GitHub Events