Data

Tools

Indexes

Applications

Experiments

Open Source Science

https://github.com/alan-turing-institute/hpc-landscape

https://github.com/alan-turing-institute/hpc-landscape

Science Score: 26.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (7.1%) to scientific vocabulary

Keywords

hut23 hut23-562
Last synced: 9 months ago · JSON representation

Repository

Basic Info
  • Host: GitHub
  • Owner: alan-turing-institute
  • Language: Python
  • Default Branch: main
  • Homepage:
  • Size: 824 KB
Statistics
  • Stars: 2
  • Watchers: 3
  • Forks: 1
  • Open Issues: 7
  • Releases: 0
Topics
hut23 hut23-562
Created over 2 years ago · Last pushed about 1 year ago
Metadata Files
Readme

README.md

HPC Landscape

Walkthroughs, documentation and training material for making best use of the Turing’s HPC resouces.

Overview

The Turing has access to a multitude of HPC resources. For example:

  1. Azure - CPU and GPU instances, Azure ML.
  2. Baskerville - Intel Xeon CPUs and Nvidia A100 GPUs
  3. JADE2 - Intel Xeon CPUs and Nvidia V100 GPUs
  4. Dawn - Intel Xeon CPUs and Intel Data Centre Max 1550 GPUs
  5. Isambard-AI - Nvidia Grace Hopper superchips (ARM CPUs, H100 GPUs)

See the Research Computing site on Mathison for a full list of available computing resources.

This repository collects together useful walkthroughs developed in-house at the Turing to make use of these HPC resources more manageable and effective.

Structure

The repository is structured by compute resource. Some material may be relevant to multiple systems and where this is the case we’ve tried to make this clear.

Document generation

At present we rely on GitHub’s markdown capabilities to display content. In the future we may switch to using Jupyter Book, Hugo or Jekyll.

Contributing

We welcome contributions. If you’d like to contribute, please submit a pull request to the repository in the normal way. This will be reviewed by the Research Computing Platforms team prior to merging.

Owner

  • Name: The Alan Turing Institute
  • Login: alan-turing-institute
  • Kind: organization
  • Email: info@turing.ac.uk

The UK's national institute for data science and artificial intelligence.

GitHub Events

Total
  • Issues event: 4
  • Issue comment event: 1
  • Push event: 2
  • Pull request review comment event: 12
  • Pull request review event: 6
  • Pull request event: 4
  • Fork event: 1
Last Year
  • Issues event: 4
  • Issue comment event: 1
  • Push event: 2
  • Pull request review comment event: 12
  • Pull request review event: 6
  • Pull request event: 4
  • Fork event: 1

Issues and Pull Requests

Last synced: 9 months ago

All Time
  • Total issues: 6
  • Total pull requests: 13
  • Average time to close issues: N/A
  • Average time to close pull requests: 28 days
  • Total issue authors: 1
  • Total pull request authors: 2
  • Average comments per issue: 0.0
  • Average comments per pull request: 1.69
  • Merged pull requests: 10
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 5
  • Pull requests: 5
  • Average time to close issues: N/A
  • Average time to close pull requests: 4 days
  • Issue authors: 1
  • Pull request authors: 2
  • Average comments per issue: 0.0
  • Average comments per pull request: 0.4
  • Merged pull requests: 4
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
  • llewelld (6)
Pull Request Authors
  • llewelld (17)
  • alexeatscake (4)
Top Labels
Issue Labels
documentation (2) enhancement (1)
Pull Request Labels

Dependencies

DAWN/examples/multi_node_accelerate/environment.yaml conda
  • _libgcc_mutex 0.1
  • _openmp_mutex 4.5
  • alembic 1.13.1
  • alsa-lib 1.2.10
  • annotated-types 0.6.0
  • asciitree 0.3.3
  • attr 2.5.1
  • aws-c-auth 0.7.15
  • aws-c-cal 0.6.9
  • aws-c-common 0.9.12
  • aws-c-compression 0.2.17
  • aws-c-event-stream 0.4.1
  • aws-c-http 0.8.0
  • aws-c-io 0.14.3
  • aws-c-mqtt 0.10.1
  • aws-c-s3 0.5.0
  • aws-c-sdkutils 0.1.14
  • aws-checksums 0.1.17
  • aws-crt-cpp 0.26.1
  • aws-sdk-cpp 1.11.242
  • bcrypt 4.1.2
  • blinker 1.7.0
  • brotli 1.1.0
  • brotli-bin 1.1.0
  • brotli-python 1.1.0
  • bzip2 1.0.8
  • c-ares 1.26.0
  • ca-certificates 2024.2.2
  • cairo 1.18.0
  • certifi 2024.2.2
  • cffi 1.16.0
  • charset-normalizer 3.3.2
  • click 8.1.7
  • cloudpickle 3.0.0
  • colorama 0.4.6
  • contourpy 1.2.0
  • cryptography 42.0.2
  • cycler 0.12.1
  • dbus 1.13.6
  • deepspeed 0.13.1
  • docker-py 7.0.0
  • dpcpp-cpp-rt 2023.2.3
  • dpcpp_cpp_rt 2024.0.2
  • dpctl 0.14.5
  • entrypoints 0.4
  • expat 2.5.0
  • fasteners 0.17.3
  • filelock 3.13.1
  • flask 3.0.2
  • font-ttf-dejavu-sans-mono 2.37
  • font-ttf-inconsolata 3.000
  • font-ttf-source-code-pro 2.038
  • font-ttf-ubuntu 0.83
  • fontconfig 2.14.2
  • fonts-conda-ecosystem 1
  • fonts-conda-forge 1
  • fonttools 4.48.1
  • freetype 2.12.1
  • gettext 0.21.1
  • gflags 2.2.2
  • gitdb 4.0.11
  • gitpython 3.1.41
  • glib 2.78.3
  • glib-tools 2.78.3
  • glog 0.6.0
  • gmp 6.3.0
  • gmpy2 2.1.2
  • graphite2 1.3.13
  • greenlet 3.0.3
  • gst-plugins-base 1.22.9
  • gstreamer 1.22.9
  • gunicorn 21.2.0
  • harfbuzz 8.3.0
  • hjson-py 3.1.0
  • icc_rt 2023.2.3
  • icu 73.2
  • idna 3.6
  • importlib-metadata 7.0.1
  • importlib_resources 6.1.1
  • intel-cmplr-lib-rt 2023.2.3
  • intel-cmplr-lic-rt 2023.2.3
  • intel-extension-for-pytorch 2.0.120
  • intel-opencl-rt 2023.2.3
  • intel-openmp 2023.2.3
  • intelpython 2024.0.0
  • itsdangerous 2.1.2
  • jinja2 3.1.3
  • joblib 1.3.2
  • keyutils 1.6.1
  • kiwisolver 1.4.5
  • krb5 1.21.2
  • lame 3.100
  • lark-parser 0.9.0
  • lcms2 2.15
  • ld_impl_linux-64 2.40
  • lerc 4.0.0
  • level-zero 1.15.13
  • libabseil 20230802.1
  • libaio 0.3.113
  • libarrow 15.0.0
  • libarrow-acero 15.0.0
  • libarrow-dataset 15.0.0
  • libarrow-flight 15.0.0
  • libarrow-flight-sql 15.0.0
  • libarrow-gandiva 15.0.0
  • libarrow-substrait 15.0.0
  • libblas 3.9.0
  • libbrotlicommon 1.1.0
  • libbrotlidec 1.1.0
  • libbrotlienc 1.1.0
  • libcap 2.69
  • libcblas 3.9.0
  • libclang 15.0.7
  • libclang13 15.0.7
  • libcrc32c 1.1.2
  • libcups 2.3.3
  • libcurl 8.5.0
  • libdeflate 1.19
  • libedit 3.1.20191231
  • libev 4.33
  • libevent 2.1.12
  • libexpat 2.5.0
  • libffi 3.4.2
  • libflac 1.4.3
  • libgcc-ng 13.2.0
  • libgcrypt 1.10.3
  • libgfortran-ng 13.2.0
  • libgfortran5 13.2.0
  • libglib 2.78.3
  • libgomp 13.2.0
  • libgoogle-cloud 2.12.0
  • libgpg-error 1.47
  • libgrpc 1.60.1
  • libhwloc 2.9.3
  • libiconv 1.17
  • libjpeg-turbo 2.1.5.1
  • liblapack 3.9.0
  • libllvm15 15.0.7
  • libnghttp2 1.58.0
  • libnl 3.9.0
  • libnsl 2.0.1
  • libnuma 2.0.16
  • libogg 1.3.4
  • libopenblas 0.3.26
  • libopus 1.3.1
  • libparquet 15.0.0
  • libpng 1.6.42
  • libpq 15.6
  • libprotobuf 4.25.1
  • libre2-11 2023.06.02
  • libsndfile 1.2.2
  • libsodium 1.0.18
  • libsqlite 3.45.1
  • libssh2 1.11.0
  • libstdcxx-ng 13.2.0
  • libsystemd0 255
  • libthrift 0.19.0
  • libtiff 4.6.0
  • libutf8proc 2.8.0
  • libuuid 2.38.1
  • libvorbis 1.3.7
  • libwebp-base 1.3.2
  • libxcb 1.15
  • libxcrypt 4.4.36
  • libxkbcommon 1.6.0
  • libxml2 2.12.5
  • libzlib 1.2.13
  • lz4-c 1.9.4
  • mako 1.3.2
  • markdown 3.5.2
  • markupsafe 2.1.5
  • matplotlib 3.8.2
  • matplotlib-base 3.8.2
  • mkl 2023.2.0
  • mkl-dpcpp 2023.2.0
  • mkl-include 2024.0.0
  • mkl-service 2.4.1
  • mkl_fft 1.3.6
  • mkl_random 1.2.2
  • mkl_umath 0.1.1
  • mlflow 2.10.2
  • mpc 1.3.1
  • mpfr 4.2.1
  • mpg123 1.32.4
  • mpmath 1.3.0
  • msgpack-python 1.0.7
  • munkres 1.1.4
  • mysql-common 8.0.33
  • mysql-libs 8.0.33
  • ncurses 6.4
  • networkx 3.2.1
  • nspr 4.35
  • nss 3.97
  • numcodecs 0.12.1
  • numpy 1.24.3
  • numpy-base 1.24.3
  • oneccl_bind_pt 2.0.200
  • openjpeg 2.5.0
  • openssl 3.2.1
  • orc 1.9.2
  • packaging 23.2
  • pandas 2.2.0
  • paramiko 3.4.0
  • pcre2 10.42
  • pillow 10.0.1
  • pip 24.0
  • pixman 0.43.2
  • ply 3.11
  • prometheus_client 0.19.0
  • prometheus_flask_exporter 0.23.0
  • protobuf 4.25.1
  • psutil 5.9.8
  • pthread-stubs 0.4
  • pulseaudio-client 16.1
  • py-cpuinfo 9.0.0
  • pyarrow 15.0.0
  • pycparser 2.21
  • pydantic 2.6.1
  • pydantic-core 2.16.2
  • pynacl 1.5.0
  • pynvml 11.5.0
  • pyparsing 3.1.1
  • pyqt 5.15.9
  • pyqt5-sip 12.12.2
  • pysocks 1.7.1
  • python 3.10.13
  • python-dateutil 2.8.2
  • python-tzdata 2024.1
  • python_abi 3.10
  • pytorch 2.0.1
  • pytz 2023.4
  • pywin32-on-windows 0.1.0
  • pyyaml 6.0.1
  • qt-main 5.15.8
  • querystring_parser 1.2.4
  • rdma-core 50.0
  • re2 2023.06.02
  • readline 8.2
  • requests 2.31.0
  • s2n 1.4.3
  • scikit-learn 1.4.0
  • scipy 1.12.0
  • setuptools 69.0.3
  • sip 6.7.12
  • six 1.16.0
  • smmap 5.0.0
  • snappy 1.1.10
  • sqlalchemy 2.0.27
  • sqlparse 0.4.4
  • sympy 1.12
  • tbb 2021.11.0
  • tbb4py 2021.11.0
  • threadpoolctl 3.2.0
  • tk 8.6.13
  • toml 0.10.2
  • tomli 2.0.1
  • torchvision 0.15.2
  • tornado 6.3.3
  • typing-extensions 4.9.0
  • typing_extensions 4.9.0
  • tzdata 2024a
  • ucx 1.15.0
  • unicodedata2 15.1.0
  • urllib3 2.2.0
  • websocket-client 1.7.0
  • werkzeug 3.0.1
  • wheel 0.42.0
  • xarray 2024.1.1
  • xcb-util 0.4.0
  • xcb-util-image 0.4.0
  • xcb-util-keysyms 0.4.0
  • xcb-util-renderutil 0.3.9
  • xcb-util-wm 0.4.1
  • xkeyboard-config 2.41
  • xorg-kbproto 1.0.7
  • xorg-libice 1.1.1
  • xorg-libsm 1.2.4
  • xorg-libx11 1.8.7
  • xorg-libxau 1.0.11
  • xorg-libxdmcp 1.1.3
  • xorg-libxext 1.3.4
  • xorg-libxrender 0.9.11
  • xorg-renderproto 0.11.1
  • xorg-xextproto 7.3.0
  • xorg-xf86vidmodeproto 2.3.1
  • xorg-xproto 7.0.31
  • xz 5.2.6
  • yaml 0.2.5
  • zarr 2.16.1
  • zipp 3.17.0
  • zlib 1.2.13
  • zstd 1.5.5