Data

Tools

Indexes

Applications

Experiments

Open Source Science

https://github.com/johnkerl/miller

Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON

https://github.com/johnkerl/miller

Science Score: 26.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Committers with academic emails
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (7.8%) to scientific vocabulary

Keywords

command-line command-line-tools csv csv-format data-cleaning data-processing data-reduction data-regression devops devops-tools json json-data miller statistical-analysis statistics streaming-algorithms streaming-data tabular-data tsv unix-toolkit

Keywords from Contributors

embedded distribution parallel genomics tensors converter document transformers medical-imaging pandoc
Last synced: 6 months ago · JSON representation

Repository

Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON

Basic Info
Statistics
  • Stars: 9,425
  • Watchers: 65
  • Forks: 226
  • Open Issues: 130
  • Releases: 68
Topics
command-line command-line-tools csv csv-format data-cleaning data-processing data-reduction data-regression devops devops-tools json json-data miller statistical-analysis statistics streaming-algorithms streaming-data tabular-data tsv unix-toolkit
Created almost 11 years ago · Last pushed 6 months ago
Metadata Files
Readme License

README-RPM.md

Instructions to make Miller source/binary RPMs for the RPM-experienced

Grab miller.spec and go to town.

Instructions to make Miller source/binary RPMs for the RPM-inexperienced

One-time setup

Change 6.2.0 to desired version. Release-package example:

https://github.com/johnkerl/miller/releases/download/v6.2.0/miller-6.2.0.tar.gz

``` cd mkdir ~/rpmbuild mkdir ~/rpmbuild/SPECS mkdir ~/rpmbuild/SOURCES cp /your/path/to/miller/clone/miller.spec ~/rpmbuild/SPECS cp /your/path/to/miller-6.2.0.tar.gz ~/rpmbuild/SOURCES

cd ~/rpmbuild/SPECS ```

You may need to do sudo yum install rpmbuild

Linting

If you have changed the miller.spec file: rpmlint miller.spec You may need to do sudo yum install rpmlint

Build source-RPM only

rpmbuild -bs miller.spec Wrote: /your/home/dir/rpmbuild/SRPMS/miller-6.2.0-1.el6.src.rpm

rpm -qpl ../SRPMS/miller-6.2.0-1.el6.src.rpm miller-6.2.0.tar.gz miller.spec

rpm -qpi ../SRPMS/miller-6.2.0-1.el6.src.rpm Name : mlr Relocations: (not relocatable) Version : 6.2.0 Vendor: (none) ...

Build source and binary RPMs

rpmbuild -ba miller.spec

rpm -qpl ../RPMS/x86_64//miller-6.2.0-1.el6.x86_64.rpm /usr/bin/mlr /usr/share/man/man1/mlr.1.gz

sudo rpm -ivh ../RPMS/x86_64/miller-6.2.0-1.el6.x86_64.rpm Preparing... ########################################### [100%] 1:mlr ########################################### [100%]

``` /usr/bin/mlr --version Miller 6.2.0

man -M /usr/share/man mlr ``` and check the version in the DESCRIPTION section.

Owner

  • Name: John Kerl
  • Login: johnkerl
  • Kind: user
  • Location: Washington DC

Who: Nerd/dad What: () => {this}

GitHub Events

Total
  • Issues event: 49
  • Watch event: 486
  • Delete event: 95
  • Issue comment event: 137
  • Push event: 140
  • Pull request review comment event: 8
  • Pull request review event: 18
  • Pull request event: 219
  • Fork event: 14
  • Create event: 109
Last Year
  • Issues event: 49
  • Watch event: 486
  • Delete event: 95
  • Issue comment event: 137
  • Push event: 140
  • Pull request review comment event: 8
  • Pull request review event: 18
  • Pull request event: 219
  • Fork event: 14
  • Create event: 109

Committers

Last synced: 9 months ago

All Time
  • Total Commits: 8,544
  • Total Committers: 64
  • Avg Commits per committer: 133.5
  • Development Distribution Score (DDS): 0.067
Past Year
  • Commits: 168
  • Committers: 11
  • Avg Commits per committer: 15.273
  • Development Distribution Score (DDS): 0.327
Top Committers
Name Email Commits
John Kerl k****r@g****m 7,973
dependabot[bot] 4****] 256
John Kerl k****l@f****m 75
John Kerl j****l@a****m 53
Thomas Klausner w****z@N****g 39
Stephen Kitt s****e@s****g 22
jungle-boogie s****n@j****e 17
Andrea Borruso a****o@g****m 15
Jauder Ho j****o 10
Muntek Singh m****i@h****m 5
vapniks v****s@y****m 4
allcontributors[bot] 4****] 4
Fulvio Scapin t****a@g****m 4
Eng Zer Jun e****n@g****m 4
John Kerl k****l@a****m 3
Matt Forrester f****r 3
Nikos Alexandris n****k@n****t 2
Adam Lesperance l****a 2
Brian Fulton-Howard f****1@g****m 2
Eric MSP Veith e****h@w****t 2
Markus Elfring e****g@u****t 2
Miodrag Milić m****c@g****m 2
Richard Patel me@t****v 2
tkob e****4@g****m 2
Ben Ranker b****r@g****m 2
luzpaz l****z 1
rui r****i@c****v 1
srinivas32 7****2 1
Clindbergh C****h 1
Dave Nicolson d****n@g****m 1
and 34 more...
Committer Domains (Top 20 + Academic)
weather.com: 1 krigovsky.com: 1 jwilk.net: 1 csie.org: 1 michel-slm.name: 1 stepsecurity.io: 1 tesser.org: 1 github.fake: 1 xerus.org: 1 tkwsping.nl: 1 balki.me: 1 wolen.com: 1 chenrui.dev: 1 groupcse.com: 1 terorie.dev: 1 users.sourceforge.net: 1 wwweb-library.net: 1 nikosalexandris.net: 1 amazon.com: 1 hostgator.com: 1

Issues and Pull Requests

Last synced: 6 months ago

All Time
  • Total issues: 271
  • Total pull requests: 613
  • Average time to close issues: 5 months
  • Average time to close pull requests: 1 day
  • Total issue authors: 122
  • Total pull request authors: 22
  • Average comments per issue: 4.1
  • Average comments per pull request: 0.23
  • Merged pull requests: 524
  • Bot issues: 2
  • Bot pull requests: 387
Past Year
  • Issues: 48
  • Pull requests: 262
  • Average time to close issues: 4 days
  • Average time to close pull requests: 2 days
  • Issue authors: 32
  • Pull request authors: 12
  • Average comments per issue: 0.96
  • Average comments per pull request: 0.27
  • Merged pull requests: 212
  • Bot issues: 1
  • Bot pull requests: 181
View more stats
Top Authors
Issue Authors
  • aborruso (45)
  • johnkerl (40)
  • Poshi (9)
  • spmundi (7)
  • agguser (6)
  • karudonaldson (6)
  • janxkoci (6)
  • archetyped (5)
  • skitt (5)
  • sjackman (4)
  • tooptoop4 (3)
  • holmescharles (3)
  • TobyBrull (3)
  • derekmahar (3)
  • kusalananda (3)
Pull Request Authors
  • dependabot[bot] (387)
  • johnkerl (174)
  • aborruso (10)
  • balki (6)
  • lespea (6)
  • Juneezee (5)
  • skitt (3)
  • kz6fittycent (3)
  • cwarden (2)
  • michel-slm (2)
  • camcui (2)
  • austinletson (2)
  • oandrew (2)
  • dflock (1)
  • tkob (1)
Top Labels
Issue Labels
feature-request (74) bug (37) help wanted (11) needs-documentation (9) pending feedback to close (9) go-port (7) active (7) dependencies (3) on deck (2) question (2) duplicate (2) leave-open (1) wontfix (1) analysis (1) go (1) github_actions (1)
Pull Request Labels
dependencies (387) github_actions (238) go (149)

Dependencies

.github/workflows/codeql-analysis.yml actions
  • actions/checkout ac593985615ec2ede58e132d2e21d2b1cbd6127c composite
  • github/codeql-action/analyze 515828d97454b8354517688ddc5b48402b723750 composite
  • github/codeql-action/autobuild 515828d97454b8354517688ddc5b48402b723750 composite
  • github/codeql-action/init 515828d97454b8354517688ddc5b48402b723750 composite
.github/workflows/codespell.yml actions
  • actions/checkout ac593985615ec2ede58e132d2e21d2b1cbd6127c composite
  • codespell-project/actions-codespell 9c63fddd79f483308bfaea379a505dcd361b5d1d composite
.github/workflows/go.yml actions
  • actions/checkout ac593985615ec2ede58e132d2e21d2b1cbd6127c composite
  • actions/setup-go 6edd4406fa81c3da01a34fa6f6343087c207a568 composite
  • actions/upload-artifact 0b7f8abb1508181956e8e162db84b466c27e18ce composite
.github/workflows/release.yml actions
  • actions/cache 58c146cc91c5b9e778e71775dfe9bf1442ad9a12 composite
  • actions/checkout ac593985615ec2ede58e132d2e21d2b1cbd6127c composite
  • actions/setup-go 6edd4406fa81c3da01a34fa6f6343087c207a568 composite
  • goreleaser/goreleaser-action 8f67e590f2d095516493f017008adc464e63adb1 composite
cmd/experiments/cli_parser/go.mod go
  • github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
  • golang.org/x/sys v0.0.0-20210326220804-49726bf1d181
cmd/experiments/cli_parser/go.sum go
  • github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
  • golang.org/x/sys v0.0.0-20210326220804-49726bf1d181
cmd/experiments/dsl_parser/one/go.mod go
  • github.com/goccmack/gocc v0.0.0-20210322175033-34358ebe5808
cmd/experiments/dsl_parser/one/go.sum go
  • github.com/goccmack/gocc v0.0.0-20210322175033-34358ebe5808
  • github.com/yuin/goldmark v1.2.1
  • golang.org/x/crypto v0.0.0-20190308221718-c2843e01d9a2
  • golang.org/x/crypto v0.0.0-20191011191535-87dc89f01550
  • golang.org/x/crypto v0.0.0-20200622213623-75b288015ac9
  • golang.org/x/mod v0.3.0
  • golang.org/x/net v0.0.0-20190404232315-eb5bcb51f2a3
  • golang.org/x/net v0.0.0-20190620200207-3b0461eec859
  • golang.org/x/net v0.0.0-20201021035429-f5854403a974
  • golang.org/x/sync v0.0.0-20190423024810-112230192c58
  • golang.org/x/sync v0.0.0-20201020160332-67f06af15bc9
  • golang.org/x/sys v0.0.0-20190215142949-d0b11bdaac8a
  • golang.org/x/sys v0.0.0-20190412213103-97732733099d
  • golang.org/x/sys v0.0.0-20200930185726-fdedc70b468f
  • golang.org/x/sys v0.0.0-20210119212857-b64e53b001e4
  • golang.org/x/text v0.3.0
  • golang.org/x/text v0.3.3
  • golang.org/x/tools v0.0.0-20180917221912-90fa682c2a6e
  • golang.org/x/tools v0.0.0-20191119224855-298f0cb1881e
  • golang.org/x/tools v0.1.0
  • golang.org/x/xerrors v0.0.0-20190717185122-a985d3407aa7
  • golang.org/x/xerrors v0.0.0-20191011141410-1b5146add898
  • golang.org/x/xerrors v0.0.0-20200804184101-5ec99f83aff1
cmd/experiments/dsl_parser/two/go.mod go
  • github.com/goccmack/gocc v0.0.0-20210322175033-34358ebe5808
cmd/experiments/dsl_parser/two/go.sum go
  • github.com/goccmack/gocc v0.0.0-20210322175033-34358ebe5808
  • github.com/yuin/goldmark v1.2.1
  • golang.org/x/crypto v0.0.0-20190308221718-c2843e01d9a2
  • golang.org/x/crypto v0.0.0-20191011191535-87dc89f01550
  • golang.org/x/crypto v0.0.0-20200622213623-75b288015ac9
  • golang.org/x/mod v0.3.0
  • golang.org/x/net v0.0.0-20190404232315-eb5bcb51f2a3
  • golang.org/x/net v0.0.0-20190620200207-3b0461eec859
  • golang.org/x/net v0.0.0-20201021035429-f5854403a974
  • golang.org/x/sync v0.0.0-20190423024810-112230192c58
  • golang.org/x/sync v0.0.0-20201020160332-67f06af15bc9
  • golang.org/x/sys v0.0.0-20190215142949-d0b11bdaac8a
  • golang.org/x/sys v0.0.0-20190412213103-97732733099d
  • golang.org/x/sys v0.0.0-20200930185726-fdedc70b468f
  • golang.org/x/sys v0.0.0-20210119212857-b64e53b001e4
  • golang.org/x/text v0.3.0
  • golang.org/x/text v0.3.3
  • golang.org/x/tools v0.0.0-20180917221912-90fa682c2a6e
  • golang.org/x/tools v0.0.0-20191119224855-298f0cb1881e
  • golang.org/x/tools v0.1.0
  • golang.org/x/xerrors v0.0.0-20190717185122-a985d3407aa7
  • golang.org/x/xerrors v0.0.0-20191011141410-1b5146add898
  • golang.org/x/xerrors v0.0.0-20200804184101-5ec99f83aff1
go.mod go
  • github.com/facette/natsort v0.0.0-20181210072756-2cd4dd1e2dcb
  • github.com/johnkerl/lumin v1.0.0
  • github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
  • github.com/lestrrat-go/strftime v1.0.6
  • github.com/mattn/go-isatty v0.0.17
  • github.com/nine-lives-later/go-windows-terminal-sequences v1.0.4
  • github.com/pkg/profile v1.7.0
  • github.com/stretchr/testify v1.8.1
  • golang.org/x/sys v0.0.0-20220811171246-fbc7d0a398ab
  • golang.org/x/term v0.0.0-20201210144234-2321bbc49cbf
go.sum go
  • github.com/chzyer/logex v1.1.10
  • github.com/chzyer/readline v0.0.0-20180603132655-2972be24d48e
  • github.com/chzyer/test v0.0.0-20180213035817-a1ea475d72b1
  • github.com/davecgh/go-spew v1.1.0
  • github.com/davecgh/go-spew v1.1.1
  • github.com/facette/natsort v0.0.0-20181210072756-2cd4dd1e2dcb
  • github.com/felixge/fgprof v0.9.3
  • github.com/google/pprof v0.0.0-20211214055906-6f57359322fd
  • github.com/ianlancetaylor/demangle v0.0.0-20210905161508-09a460cdf81d
  • github.com/johnkerl/lumin v1.0.0
  • github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51
  • github.com/lestrrat-go/envload v0.0.0-20180220234015-a3eb8ddeffcc
  • github.com/lestrrat-go/strftime v1.0.6
  • github.com/mattn/go-isatty v0.0.17
  • github.com/nine-lives-later/go-windows-terminal-sequences v1.0.4
  • github.com/pkg/errors v0.9.1
  • github.com/pkg/profile v1.7.0
  • github.com/pmezard/go-difflib v1.0.0
  • github.com/stretchr/objx v0.1.0
  • github.com/stretchr/objx v0.4.0
  • github.com/stretchr/objx v0.5.0
  • github.com/stretchr/testify v1.3.0
  • github.com/stretchr/testify v1.7.1
  • github.com/stretchr/testify v1.8.0
  • github.com/stretchr/testify v1.8.1
  • golang.org/x/sys v0.0.0-20201119102817-f84b799fce68
  • golang.org/x/sys v0.0.0-20211007075335-d3039528d8ac
  • golang.org/x/sys v0.0.0-20220811171246-fbc7d0a398ab
  • golang.org/x/term v0.0.0-20201210144234-2321bbc49cbf
  • gopkg.in/check.v1 v0.0.0-20161208181325-20d25e280405
  • gopkg.in/yaml.v3 v3.0.0-20200313102051-9f266ea9e77c
  • gopkg.in/yaml.v3 v3.0.1
docs/requirements.txt pypi
  • mkdocs-material *