Data

Tools

Indexes

Applications

Experiments

Open Source Science

auto-circuit

A library for efficient patching and automatic circuit discovery.

https://github.com/ufo-101/auto-circuit

Science Score: 54.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ✓
    CITATION.cff file
    Found CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ✓
    Academic publication links
    Links to: arxiv.org
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (7.4%) to scientific vocabulary
Last synced: 7 months ago · JSON representation ·

Repository

A library for efficient patching and automatic circuit discovery.

Basic Info
Statistics
  • Stars: 76
  • Watchers: 2
  • Forks: 19
  • Open Issues: 10
  • Releases: 10
Created over 2 years ago · Last pushed 8 months ago
Metadata Files
Readme Citation

README.md

PyPI - Version GitHub Release

AutoCircuit

A library for efficient patching and automatic circuit discovery.

Static Badge

Read the paper

Transformer Circuit Metrics are not Robust (Oral spotlight, COLM 2024)

Getting Started

bash pip install auto-circuit

Easy and Efficient Edge Patching

https://github.com/UFO-101/auto-circuit/blob/03ce552ccdea98fc6fed3b05cfb2df9b0eb4e323/experiments/demos/zeroablatean_edge.py#L20-L26

Different Ablation Methods

https://github.com/UFO-101/auto-circuit/blob/03ce552ccdea98fc6fed3b05cfb2df9b0eb4e323/experiments/demos/patchanedge.py#L37

Automatic Circuit Discovery

https://github.com/UFO-101/auto-circuit/blob/03ce552ccdea98fc6fed3b05cfb2df9b0eb4e323/experiments/demos/patchanedge.py#L49-L55

Visualization

https://github.com/UFO-101/auto-circuit/blob/5777057b445d55b7d4695eed8aface9d6bcefbe3/experiments/demos/patchsomeedges.py#L49

Cite this library

@inproceedings{ miller2024transformer, title={Transformer Circuit Evaluation Metrics Are Not Robust}, author={Joseph Miller and Bilal Chughtai and William Saunders}, booktitle={First Conference on Language Modeling}, year={2024}, url={https://openreview.net/forum?id=zSf8PJyQb2} }

Owner

  • Login: UFO-101
  • Kind: user

Citation (CITATION.cff) 

cff-version: 1.2.0
message: "If you use this software, please cite it as below."
authors:
  - family-names: "Miller"
    given-names: "Joseph"
  - family-names: "Chughtai"
    given-names: "Bilal"
  - family-names: "Saunders"
    given-names: "William"
title: "Transformer Circuit Evaluation Metrics Are Not Robust"
date-released: 2024
url: "https://openreview.net/forum?id=zSf8PJyQb2"
preferred-citation:
  type: conference-paper
  authors:
    - family-names: "Miller"
      given-names: "Joseph"
    - family-names: "Chughtai"
      given-names: "Bilal"
    - family-names: "Saunders"
      given-names: "William"
  title: "Transformer Circuit Evaluation Metrics Are Not Robust"
  collection-title: "First Conference on Language Modeling"
  year: 2024
  url: "https://openreview.net/forum?id=zSf8PJyQb2"

GitHub Events

Total
  • Issues event: 4
  • Watch event: 41
  • Issue comment event: 11
  • Push event: 5
  • Pull request event: 2
  • Fork event: 8
Last Year
  • Issues event: 4
  • Watch event: 41
  • Issue comment event: 11
  • Push event: 5
  • Pull request event: 2
  • Fork event: 8

Issues and Pull Requests

Last synced: 7 months ago

All Time
  • Total issues: 1
  • Total pull requests: 1
  • Average time to close issues: 9 minutes
  • Average time to close pull requests: less than a minute
  • Total issue authors: 1
  • Total pull request authors: 1
  • Average comments per issue: 1.0
  • Average comments per pull request: 0.0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 1
  • Pull requests: 1
  • Average time to close issues: 9 minutes
  • Average time to close pull requests: less than a minute
  • Issue authors: 1
  • Pull request authors: 1
  • Average comments per issue: 1.0
  • Average comments per pull request: 0.0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
  • JoakimEdin (1)
  • dtch1997 (1)
  • TianBian95 (1)
  • gerald4 (1)
  • oliveradk (1)
Pull Request Authors
  • oliveradk (6)
  • UFO-101 (2)
  • leobertolazzi (1)
  • PMMon (1)
Top Labels
Issue Labels
Pull Request Labels

Packages

  • Total packages: 1
  • Total downloads:
    • pypi 55 last-month
  • Total dependent packages: 0
  • Total dependent repositories: 0
  • Total versions: 10
  • Total maintainers: 1
pypi.org: auto-circuit
  • Versions: 10
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 55 Last month
Rankings
Dependent packages count: 9.5%
Average: 36.0%
Dependent repos count: 62.5%
Maintainers (1)
UFO-101
Last synced: 7 months ago

Dependencies

poetry.lock pypi
  • 163 dependencies
pyproject.toml pypi
  • einops ^0.6.1
  • ordered-set ^4.1.0
  • plotly ^5.15.0
  • pygraphviz ^1.11
  • python ~3.10
  • torch ^2.0.1
  • transformer-lens ^1.4.0