Data

Tools

Indexes

Applications

Experiments

Open Source Science

https://github.com/xiaodaigh/jdf.jl

Julia DataFrames serialization format

https://github.com/xiaodaigh/jdf.jl

Science Score: 23.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ○
    .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ✓
    Committers with academic emails
    1 of 7 committers (14.3%) from academic institutions
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (2.7%) to scientific vocabulary

Keywords

julia serialization-format

Keywords from Contributors

numeric data-frame dataframes julialang tabular-data fluxes optim programming-language numerical-methods energy-systems
Last synced: 11 months ago · JSON representation

Repository

Julia DataFrames serialization format

Basic Info
  • Host: GitHub
  • Owner: xiaodaigh
  • License: mit
  • Language: Julia
  • Default Branch: main
  • Homepage:
  • Size: 362 KB
Statistics
  • Stars: 92
  • Watchers: 7
  • Forks: 9
  • Open Issues: 17
  • Releases: 38
Topics
julia serialization-format
Created almost 7 years ago · Last pushed over 1 year ago
Metadata Files
Readme Changelog Funding License

README.jl 

using RDatasets, JDF, DataFrames

a = dataset("datasets", "iris");

first(a, 2)


@time jdffile = JDF.save("iris.jdf", a)
@time a2 = DataFrame(JDF.load("iris.jdf"))


all(names(a2) .== names(a)) # true
all(skipmissing([all(a2[!,name] .== Array(a[!,name])) for name in names(a2)])) #true


a2_selected = DataFrame(JDF.load("iris.jdf", cols = [:Species, :SepalLength, :PetalWidth]))


jdf"path/to/JDF.jdf"


path_to_JDF = "path/to/JDF.jdf"
JDFFile(path_to_JDF)


afile = JDFFile("iris.jdf")

afile[:Species] # load Species column


using Tables
ajdf = JDFFile("iris.jdf")
Tables.columnaccess(ajdf)


Tables.columns(ajdf)


Tables.schema(ajdf)


getproperty(Tables.columns(ajdf), :Species)


jdffile = jdf"iris.jdf"
for col in eachcol(jdffile)
  # do something to col
  # where `col` is the content of one column of iris.jdf
end


jdffile = jdf"iris.jdf"
for (name, col) in zip(names(jdffile), eachcol(jdffile))
  # `name::Symbol` is the name of the column
  #  `col` is the content of one column of iris.jdf
end


using JDF, DataFrames
df = DataFrame(a = 1:3, b = 1:3)
JDF.save(df, "plsdel.jdf")

names(jdf"plsdel.jdf") # [:a, :b]

# clean up
rm("plsdel.jdf", force = true, recursive = true)


@time jdffile = ssavejdf("iris.jdf", a)
@time jdffile = sloadjdf("iris.jdf")


type_compress!(df)


type_compress!(df, compress_float = true)

Owner

  • Name: evalparse
  • Login: xiaodaigh
  • Kind: user
  • Location: Melbourne, Australia
  • Company: @evalparse

Machine Learning developer - Julia enthusiast - makes the most popular medium-data tool in R {diskframe.com}

GitHub Events

Total
  • Create event: 1
  • Commit comment event: 2
  • Release event: 1
  • Issues event: 4
  • Watch event: 2
  • Issue comment event: 8
  • Push event: 2
  • Pull request event: 1
Last Year
  • Create event: 1
  • Commit comment event: 2
  • Release event: 1
  • Issues event: 4
  • Watch event: 2
  • Issue comment event: 8
  • Push event: 2
  • Pull request event: 1

Committers

Last synced: about 1 year ago

All Time
  • Total Commits: 323
  • Total Committers: 7
  • Avg Commits per committer: 46.143
  • Development Distribution Score (DDS): 0.124
Past Year
  • Commits: 3
  • Committers: 1
  • Avg Commits per committer: 3.0
  • Development Distribution Score (DDS): 0.0
Top Committers
Name Email Commits
evalparse z****i@g****m 283
ZJ z****i@p****e 16
github-actions[bot] 4****] 14
Bogumił Kamiński b****s@s****l 4
Krisztián Schäffer t****o 2
Kristoffer Carlsson k****n@c****e 2
Julia TagBot 5****t 2
Committer Domains (Top 20 + Academic)
chalmers.se: 1 sgh.waw.pl: 1 pi.exchange: 1

Issues and Pull Requests

Last synced: 11 months ago

All Time
  • Total issues: 40
  • Total pull requests: 47
  • Average time to close issues: about 1 month
  • Average time to close pull requests: 19 days
  • Total issue authors: 20
  • Total pull request authors: 9
  • Average comments per issue: 2.18
  • Average comments per pull request: 0.13
  • Merged pull requests: 35
  • Bot issues: 0
  • Bot pull requests: 15
Past Year
  • Issues: 3
  • Pull requests: 0
  • Average time to close issues: about 11 hours
  • Average time to close pull requests: N/A
  • Issue authors: 1
  • Pull request authors: 0
  • Average comments per issue: 2.33
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
  • xiaodaigh (12)
  • Para7etamol (5)
  • kafisatz (3)
  • bkamins (3)
  • ym-han (2)
  • Mirage10 (2)
  • rana (1)
  • timbp (1)
  • ro-ble (1)
  • chipkent (1)
  • JuliaTagBot (1)
  • Ossifragus (1)
  • gcalderone (1)
  • jerlich (1)
  • claforte (1)
Pull Request Authors
  • xiaodaigh (24)
  • github-actions[bot] (15)
  • KronosTheLate (2)
  • kafisatz (2)
  • KristofferC (1)
  • bkamins (1)
  • tisztamo (1)
  • quinnj (1)
  • JuliaTagBot (1)
Top Labels
Issue Labels
wontfix (1) question (1)
Pull Request Labels

Packages

  • Total packages: 1
  • Total downloads:
    • julia 14 total
  • Total dependent packages: 3
  • Total dependent repositories: 0
  • Total versions: 39
juliahub.com: JDF

Julia DataFrames serialization format

  • Versions: 39
  • Dependent Packages: 3
  • Dependent Repositories: 0
  • Downloads: 14 Total
Rankings
Dependent repos count: 9.9%
Stargazers count: 10.1%
Average: 13.1%
Dependent packages count: 13.2%
Forks count: 19.4%
Last synced: 11 months ago

Dependencies

.github/workflows/CompatHelper.yml actions
  • julia-actions/setup-julia latest composite
.github/workflows/TagBot.yml actions
  • JuliaRegistries/TagBot v1 composite