OpenMindat

An R package for querying and accessing open data from the Mindat API

News

When the new Mindat server is fully deployed, please connect using the default settings: mindat_connection(YourToken).

The first version of the OpenMindat R package has been published on CRAN and can be accessed via https://cran.r-project.org/web/packages/OpenMindat/index.html

Overview

OpenMindat is a package for retrieving and processing data from mindat.org Database through its open data API.

Mindat and University of Idaho collaborate on 'OpenMindat'

Quick start

Install and load necessary packages

This package can be installed directly through the remotes package:

coffee install.packages("remotes") remotes::install_github("quexiang/OpenMindat")

Or through devtools:

coffee install.packages("devtools") library("devtools") install_github("quexiang/OpenMindat")

Or download the source code locally and install it as follows:

1. Download all the source codes and Open the OpenMindat.Rproj with RStudio.

2. Install packages usethis,httr,readxl, and jsonlite.

3. Currently the OpenMindat package can be installed from source files. Select the Install Package in the Build menu of RStudio (Ctrl + Shift + B).

Then, you can create a new file to load the dependent package, and then call the function of this package to retrieve and get the data you need from the Mindat API:

1. Create a New R Script (Ctrl + Shift + N).

2. Load the packages OpenMindat, usethis,httr,readxl, and jsonlite.

```coffee

install.packages("httr")

install.packages("jsonlite")

install.packages("usethis")

install.packages("readxl")

install.packages("OpenMindat")

library(OpenMindat) library(httr) library(usethis) library(jsonlite) library(readxl) ```

Set up API connection with your Mindat API token and use the functions

1. You should first get your own Mindat api token YourToken . (How to get your mindat API token ?)

2. Set up your token YourToken

```coffee

input your Mindat API token

mindat_connection("YourToken") #including the quotation marks

The new Mindat server's API is not yet fully deployed，you may need to specify the base_url

mindatconnection("YourToken",baseurl = "147.135.28.115") ```

1. You can now retrieve datasets of interest using functions in the OpenMindat package. Below are a few examples.

(1) Retrieve geomaterials records by chemical elements： ```coffee

query the geomaterials that contain all of the elements (e.g. Be, Cr):

respmaterialselmsdf <- geomaterialscontainallelems(c('Be','Cr'))

query the geomaterials that contain any of the elemnts(e.g. Be,Cr):

respmaterialselmsdf <- geomaterialscontainanyelems(c('Be','Cr'))

query the geomaterials that contain all of the elemnts(e.g. Be,Cr) but without the element (e.g. H):

respmaterialselmsdf <- geomaterialscontainallbutnotelems(c('Be','Cr'),c('H'))

query the geomaterials that contain any of the elemnts(e.g. Be,Cr) but without the element (e.g. H):

respmaterialselmsdf <- geomaterialscontainanybutnotelems(c('Be','Cr'),c('H')) ```

(2) Retrieve geomaterials records by physical properties: ```coffee

query the geomaterials by given crystal system (e.g. Hexagonal):

respmaterialscrystalsysdf <- geomaterialscrystal_system(c("Hexagonal"))

query the geomaterials by given cleavagetype (e.g. Imperfect/Fair):

respmaterialscleavdf <- geomaterialscleavagetype(c("Imperfect/Fair"))

query the geomaterials whose hardness greater than a given value(e.g. 9):

respmaterialsharddf <- geomaterialshardness_gt(9)

query the geomaterials whose hardness less than a given value(e.g. 1):

respmaterialsharddf <- geomaterialshardness_lt(1)

query the geomaterials whose hardness within a range e.g.(1,1.2):

respmaterialsharddf <- geomaterialshardness_range(1,1.2)

query the mindat geomaterials by a given id, e.g.6:

respmaterialsiddf <- mindatgeomaterial(id=6) ```

(3) Retrieve geomaterials records by wildcard names and others: coffee df1<-geomaterials_search_name("Quartz") df2<-geomaterials_name("qu_rtz") df3<-geomaterials_name("_u_r_z") df4<-geomaterials_name("qu*") df5<- geomaterials_field_exists("meteoritical_code",TRUE) df6<-mindat_geomaterial(id=3337) df7<-geomaterials_varietyof(3337) df8<-geomaterials_entrytype(c('2')) (4) Retrieve geomaterials records by combined conditions: coffee df<-geomaterials_contain_all_elems(c('Li','O'), hardness_min = 5.8, hardness_max = 6, crystal_system = "Triclinic",ima_status = "APPROVED",entrytype = 0) (5) Retrieve IMA minerals: ```coffee

query all the IMA list

dfimaminerals <- mineralsimalist()

query all the IMA list (only show the ima mame list):

dfimaminerals <- mineralsimalist(fields = "name")

query the IMA minerals by a given id e.g. 1 :

dfimaminerals <- mineralsimaretrieve(id =1)

(6) Retrieve Localities by descriptions and elements: coffee

query localities in a given country (e.g. China):

dflocalities <- localitieslist_country("China")

query localities that contain a given description:

dfvolcano<-localitieslist_description("volcano")

query localities contain the elements(e.g. Be,Si) withou the elements(e.g. H,Al) :

dflocincexc <- localitieslistelemsinc_exc(c("Be","Si"),c("H","Al")) (7) Output the retrieved R dataframe to files: coffee

df <- geomaterialshardnessgt(9.8,fields = "id,longid,name,imaformula") library(readxl) out <- ConvertDF2JsonLD(df) saveMindatDataAs(df,"dfgeomaterials.jsonld") saveMindatDataAs(df,"dfgeomaterials.ttl") saveMindatDataAs(df,"dfgeomaterials.txt") saveMindatDataAs(df,"df_geomaterials.csv")

```

Documention of function list

An initial version of the OpenMindat documentation is available, inclduing a function list and the description of each function, which can be called using the code below. ```coffee help(package = OpenMindat)

``` Technical architecture of the software package

Bug Reports

Any issues or bugs?

Related Articles

Ma, X., Ralph, J., Zhang, J., Que, X., Prabhu, A., Morrison, S.M., Hazen, R.M., Wyborn, L. and Lehnert, K., 2024. OpenMindat: Open and FAIR mineralogy data from the Mindat database. Geoscience Data Journal (SCI), 11(1), pp.94-104.[https://doi.org/10.1002/gdj3.204]

Jiyin Zhang,Xiang Que, Bhuwan Mdahikarmi,Robert M Hazen,Jolyon Ralph; Anirudh Prabhu, Shaunna M Morrison,Xiaogang Ma*, Using a 3D heat map to explore the diverse correlations among elements and mineral species, Applied Computing & Geosciences, 2024, https://doi.org/10.1016/j.acags.2024.100154

Acknowledgments

This work is supported by NSF, Award #2126315.