jqjs

Pure-JavaScript implementation of the jq JSON query language

https://github.com/mwh/jqjs

Science Score: 57.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
    Found CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
    Found 2 DOI reference(s) in README
  • Academic publication links
  • Committers with academic emails
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (8.7%) to scientific vocabulary

Keywords

jq
Last synced: 7 months ago · JSON representation ·

Repository

Pure-JavaScript implementation of the jq JSON query language

Basic Info
  • Host: GitHub
  • Owner: mwh
  • License: mit
  • Language: JavaScript
  • Default Branch: master
  • Size: 114 KB
Statistics
  • Stars: 91
  • Watchers: 3
  • Forks: 9
  • Open Issues: 3
  • Releases: 0
Topics
jq
Created over 7 years ago · Last pushed 8 months ago
Metadata Files
Readme License Citation

README.md

jqjs is a JavaScript implementation of the jq query language. It implements the core language features in pure JavaScript.

The main entry point to jqjs is the compile function, which turns a jq program string into a generator function:

import jq from './jq.js'
let filter = jq.compile(".x[].y")
for (let v of filter({x:[{y:2}, {y:4}]}) { ... }

The module also has a prettyPrint function for rendering an object to text.

As a shorthand, the default export is itself callable in two ways:

let filter = jq('.x[].y')
for (let x of filter(obj)) { ... }

for (let x of jq('.x[].y', obj)) { ... }

With a single argument, this is equivalent to jq.compile, and with two arguments it is equivalent to jq.compile(arg1)(arg2).

Features

jqjs supports most of the core jq language features, but lacks functions and some of the advanced functionality. It also uses JavaScript strings as backing, so does not have jq proper's Unicode support.

  • [x] Identity: .
  • [x] Object Identifier-Index: .foo, .foo.bar
  • [x] Generic Object Index: .[<string>]
  • [x] Array Index: .[2]
  • [x] Array/String Slice: .[10:15]
  • [x] Array/Object Value Iterator: .[]
  • [x] Comma: ,
  • [x] Pipe: |
  • [x] Parentheses: (...)
  • [x] Array Construction: [...]
  • [x] Object Construction: { ... } including shorthand { user, title } and computed keys { (.x): true }
  • [x] Recursive Descent: ..
  • [x] Addition, subtraction, multiplication, division, and modulo, including the overloaded type operations.
  • [x] Named functions
    • Built-in functions
      • [x] tostring, tonumber, toboolean, tojson, fromjson
      • [x] length, keys, has, in, type, del
      • [x] empty, select, arrays, objects, booleans, numbers, strings, nulls
      • [x] map, mapvalues, sort, sortby, explode, implode, split, join
      • [x] add, add/1
      • [x] toentries, fromentries, with_entries, walk/1
      • [x] range/1, range/2, range/3
      • [x] any/0, any/1, any/2, all/0, all/1, all/2
      • [x] contains, inside
      • [x] path, getpath/1, setpath/2, delpaths/1, pick/1
      • [x] trim/0, ltrim/0, rtrim/0, trimstr/1, ltrimstr/1, rtrimstr/1
      • [x] first, last, nth/1, first/1, last/1, nth/2, limit/2, skip/2
      • [x] sub/1, sub/2, gsub/1, gsub/2, test/1, test/2, split/2
      • [x] capture/1, capture/2, match/1, match/2, splits/1, splits/2
      • [x] asciiupcase/1, asciidowncase/1
      • [ ] the others
    • [ ] User-defined functions
    • [ ] Mathematical functions
    • [ ] Date functions
    • [ ] SQL-style operators
  • [x] String interpolation: \(foo)
  • [x] Format strings and escaping: @text, @json, @html, @uri, @csv, @tsv, @sh, @base64, @base64d
    • [x] Format interpolations: @uri "https://google.com/search?q=\(.x)"
  • [x] Equality checks: ==, !=
  • [x] Comparisons: <, >, <=, >=
    • [x] Correct sorting order for unequal types (null < 7, [] < {})
  • [x] Conditionals: if A then B elif C then D else E end
  • [x] Alternative operator: //
  • [ ] Try-catch: try EXP catch EXP
    • [x] Error Suppression operator ?
  • [x] Regular expressions (uses JavaScript RegExp, so behaviour is incomplete)
  • [x] Variable/Symbolic Binding Operator ... as $identifier | ...
  • [x] Reduce: reduce .[] as $item (0; . + $item)
  • [ ] foreach: foreach .[] as $item (...;...;...)
  • [ ] Recursion: recurse(.children[])
  • [ ] I/O (unlikely to make sense here)
  • [x] Update-assignment: .posts[].comments |= . + ["Another"]
  • [x] Arithmetic update-assignment: +=, -=, *=, /=, %=, //=
  • [ ] Plain assignment: (.a,.b) = range(2)
  • [ ] Modules with import and include

Installing and using

The jq.js module can be imported and used directly:

import jq from "./jqjs.js";

but this library can also be installed through npm:

npm install @michaelhomer/jqjs

then

import jq from "@michaelhomer/jqjs";
// or
const jq = require("@michaelhomer/jqjs");

Or

npm install mwh/jqjs

then

import jq from "jqjs/jq.js";
// or
const jq = require("jqjs/jq.js");

After that

let func = jq.compile(".x[].y")

will create a func function that can be given any JavaScript object to process, and will return an iterator producing each output of the jq program:

for (let v of filter({x:[{y:2}, {y:4}]}) { ... }

will run the loop body with v holding 2, then 4, then stop.

func also exposes the jq syntax tree (as func.filter) and a function returning a complete trace of the output of every component of the jq program (func.trace({x:[{y:2}, {y:4}]})) as nested arrays and objects.

Performance

Not great.

The intention is to be semantically correct first and to have clear code second. Performance improvements sit after that, if at all. Executing a program may reëvaluate parts of it or traverse the object multiple times where that makes things simpler, and internally evaluation happens by tree-walking the input syntax.

Demonstration

demo.html is a live demo of how to use jqjs that lets you enter a jq program and an input JSON value and see the output JSON values it produces.

A demonstration of the tracing functionality from the paper "Branching Compositional Data Transformations in jq, Visually" is also available.

Owner

  • Name: Michael Homer
  • Login: mwh
  • Kind: user
  • Location: Wellington, NZ

Citation (CITATION.cff)

cff-version: 1.2.0
message: "If you use this software, please cite it as below."
authors:
- family-names: "Homer"
  given-names: "Michael"
  orcid: "https://orcid.org/0000-0003-0280-6748"
title: "jqjs"
url: "https://github.com/mwh/jqjs"
preferred-citation:
  type: conference-paper
  authors:
  - family-names: "Homer"
    given-names: "Michael"
    orcid: "https://orcid.org/0000-0003-0280-6748"
  doi: "10.1145/3623504.3623567"
  conference:
    name: "ACM SIGPLAN International Workshop on Programming Abstractions and Interactive Notations, Tools, and Environments"
    abbreviation: "PAINT"
    date-start: 2023-10-23
    date-end: 2023-10-23
  month: 10
  title: "Branching Compositional Data Transformations in jq, Visually"
  year: 2023

GitHub Events

Total
  • Issues event: 1
  • Watch event: 11
  • Delete event: 1
  • Issue comment event: 1
  • Push event: 6
  • Pull request event: 2
  • Fork event: 1
  • Create event: 2
Last Year
  • Issues event: 1
  • Watch event: 11
  • Delete event: 1
  • Issue comment event: 1
  • Push event: 6
  • Pull request event: 2
  • Fork event: 1
  • Create event: 2

Committers

Last synced: 10 months ago

All Time
  • Total Commits: 74
  • Total Committers: 3
  • Avg Commits per committer: 24.667
  • Development Distribution Score (DDS): 0.041
Past Year
  • Commits: 2
  • Committers: 1
  • Avg Commits per committer: 2.0
  • Development Distribution Score (DDS): 0.0
Top Committers
Name Email Commits
Michael Homer m****h@e****z 71
Rémy F y****e 2
Mihir Samdarshi m****i 1
Committer Domains (Top 20 + Academic)

Issues and Pull Requests

Last synced: 7 months ago

All Time
  • Total issues: 6
  • Total pull requests: 3
  • Average time to close issues: 2 months
  • Average time to close pull requests: about 9 hours
  • Total issue authors: 6
  • Total pull request authors: 2
  • Average comments per issue: 0.0
  • Average comments per pull request: 2.33
  • Merged pull requests: 3
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 1
  • Average time to close issues: N/A
  • Average time to close pull requests: about 10 hours
  • Issue authors: 0
  • Pull request authors: 1
  • Average comments per issue: 0
  • Average comments per pull request: 1.0
  • Merged pull requests: 1
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
  • mwh (1)
  • noamtamim (1)
  • kemeris2000 (1)
  • sannysoft (1)
  • dcore94 (1)
Pull Request Authors
  • yne (4)
  • mihirsamdarshi (1)
Top Labels
Issue Labels
bug (1) good first issue (1)
Pull Request Labels