https://github.com/agoose77/texat-slurm-cluster

https://github.com/agoose77/texat-slurm-cluster

Science Score: 13.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
  • DOI references
  • Academic publication links
  • Academic email domains
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (8.1%) to scientific vocabulary
Last synced: 9 months ago · JSON representation

Repository

Basic Info
  • Host: GitHub
  • Owner: agoose77
  • Language: Python
  • Default Branch: main
  • Size: 27.3 KB
Statistics
  • Stars: 0
  • Watchers: 3
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Created over 5 years ago · Last pushed over 3 years ago
Metadata Files
Readme

README.md

TexAT Slurm Cluster

This repository contains the runtime scripts required to launch a TexAT Dask cluster on SLURM. It contains a few BlueBEAR specific variables, but otherwise targets SLURM.

Setup

  1. The use.own module should be loaded by default on the target system
  2. Ansible should be installed pip install -U ansible
  3. Run the setup playbook ansible-playbook setup.yml -e "texat_data_path=<TEXAT_DATA_PATH> texat_geant4_path=<TEXAT_GEANT4_PATH>", where <TEXAT_DATA_PATH> is the path to the shared storage, and <TEXAT_GEANT4_PATH> is the path to the Geant4 data-files storage.

The bin directory contains the texat and python executables, and the scripts executables use these to perform various functions. The texat-runtime.sif image must be on PATH

Usage

First, load the texat module: module load texat-1.0.0.

To launch a cluster, first start the scheduler: bash sbatch -t "24:00:00" launch-scheduler The workers locate the scheduler using a configuration file that is written by the scheduler to /mnt/data in the container.

The print-ssh-command script will load this file and print the appropriate SSH command to tunnel into the scheduler node.

Then launch some single process workers: bash sbatch -t 5:00:00 --array 0-395 --mem-per-cpu "1G" launch-worker

Owner

  • Name: Angus Hollands
  • Login: agoose77
  • Kind: user
  • Location: United Kingdom
  • Company: 2i2c

Open Source Infrastructure Engineer @ 2i2c. Executable Books core team member. PhD in Nuclear Physics from the University of Birmingham.

GitHub Events

Total
Last Year

Issues and Pull Requests

Last synced: over 1 year ago

All Time
  • Total issues: 0
  • Total pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Total issue authors: 0
  • Total pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
Pull Request Authors
Top Labels
Issue Labels
Pull Request Labels