https://github.com/brain-image-library/py-inventory-builder
Inventory script that generates a JSON file with file level stats. Replaces manifest scripts.
Science Score: 26.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
○CITATION.cff file
-
✓codemeta.json file
Found codemeta.json file -
✓.zenodo.json file
Found .zenodo.json file -
○DOI references
-
○Academic publication links
-
○Academic email domains
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (8.1%) to scientific vocabulary
Repository
Inventory script that generates a JSON file with file level stats. Replaces manifest scripts.
Basic Info
- Host: GitHub
- Owner: brain-image-library
- License: gpl-3.0
- Language: Python
- Default Branch: master
- Size: 1.6 MB
Statistics
- Stars: 0
- Watchers: 3
- Forks: 0
- Open Issues: 0
- Releases: 0
Metadata Files
README.md
Inventory Script
Description
This Python script generates an inventory of files in a specified directory, including file metadata such as extension, file type, creation date, size, checksums, and more. The script can be configured to update existing inventories, compress JSON files, and utilize multi-threading for faster processing.
Prerequisites
- Python 3
- Required Python packages can be installed using the following command:
bash
pip install numpy pandas tabulate tqdm compress_json numpyencoder magic pandarallel
Usage
python inventory_script.py -d <directory_path> [-n <number_of_cores>] [--update] [--compress] [--rebuild] [--avoid-checksums] [--multi-threading]
Options
-d, --directory Specify the target directory for inventory.
-n, --number-of-cores Number of CPU cores to use for parallel processing.
--update Update existing inventories.
--compress Compress JSON files.
--rebuild Rebuild the inventory, removing existing TSV file.
--avoid-checksums Skip checksum computation.
--multi-threading Enable multi-threading for faster processing.
Example
python inventory_script.py -d /path/to/dataset -n 4 --update --compress
Copyright © 2020-2023 Pittsburgh Supercomputing Center. All Rights Reserved.
The Biomedical Applications Group at the Pittsburgh Supercomputing Center in the Mellon College of Science at Carnegie Mellon University.
Owner
- Name: Brain Image Library
- Login: brain-image-library
- Kind: organization
- Email: bil-support@psc.edu
- Repositories: 3
- Profile: https://github.com/brain-image-library
GitHub Events
Total
- Push event: 16
- Create event: 1
Last Year
- Push event: 16
- Create event: 1