Data

Tools

Indexes

Applications

Experiments

Open Source Science

argdown-feedback

Hindsight Instruction Relabeling Preferences

https://github.com/debatelab/argdown-feedback

Science Score: 44.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ✓
    CITATION.cff file
    Found CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (3.4%) to scientific vocabulary
Last synced: 6 months ago · JSON representation ·

Repository

Hindsight Instruction Relabeling Preferences

Basic Info
  • Host: GitHub
  • Owner: debatelab
  • License: agpl-3.0
  • Language: Python
  • Default Branch: main
  • Size: 994 KB
Statistics
  • Stars: 0
  • Watchers: 2
  • Forks: 0
  • Open Issues: 1
  • Releases: 0
Created about 1 year ago · Last pushed 8 months ago
Metadata Files
Readme License Citation

README.md

argdown-feedback

Argdown Verifiers & Data Generators for Hindsight Instruction Relabeling Preferences

Installation

!pip install "git+https://github.com/debatelab/argdown-feedback"

Usage

```python import pprint

from argdownfeedback.verifiers.base import CompositeHandler from argdownfeedback.verifiers.core.infrecohandler import InfRecoCompositeHandler from argdownfeedback.verifiers.processinghandler import ( DefaultProcessingHandler, FencedCodeBlockExtractor, ) from argdownfeedback.tasks.base import Evaluation from argdownfeedback.verifiers.verificationrequest import VerificationRequest

snippet = """ Hello. Here's some argdown code.

```argdown

(1) Premise (2) Premise -- {from:["2"]} -- (3) Conclusion \n``` """

handler = CompositeHandler( handlers=[ DefaultProcessingHandler(), InfRecoCompositeHandler(), ] ) request = VerificationRequest(inputs=snippet) result = handler.process(request) evaluation = Evaluation.fromverificationrequest(result)

pprint.pprint(evaluation)

Evaluation(is_valid=False,

artifacts={'all_declarations': None,

'all_expressions': None,

'argdown': ,

'argdown_map': None,

'argdown_reco': None,

'soup': None},

metrics={'01_HasArgumentsHandler': None,

'02_HasUniqueArgumentHandler': None,

'03_HasPCSHandler': None,

'04_StartsWithPremiseHandler': None,

'05_EndsWithConclusionHandler': None,

'06_NotMultipleGistsHandler': None,

'07_NoDuplicatePCSLabelsHandler': None,

'08_HasLabelHandler': None,

'09_HasGistHandler': 'The following arguments lack gists: '

'',

'10_HasInferenceDataHandler': None,

'11_PropRefsExistHandler': None,

'12_UsesAllPropsHandler': 'In : Some '

'propositions are not explicitly '

'used in any inferences: (1).',

'13_NoExtraPropositionsHandler': None,

'14_OnlyGroundedDialecticalRelationsHandler': None,

'15_NoPropInlineDataHandler': None,

'16_NoArgInlineDataHandler': None})

```

Owner

  • Name: DebateLab @ KIT
  • Login: debatelab
  • Kind: organization

Citation (CITATION.cff) 

cff-version: 1.2.0
message: "If you use this software, please cite it as below."
authors:
- family-names: "Betz"
  given-names: "Gregor"
  orcid: "https://orcid.org/0000-0001-5802-5030"
title: "argdown-feedback: verifiers and dpo data generaors with hindsight instruction relabeleing"
version: 0.1.0
date-released: 2025-04-11
url: "https://github.com/debatelab/argdown-feedback"

GitHub Events

Total
  • Issues event: 1
  • Delete event: 1
  • Push event: 61
  • Public event: 1
  • Pull request event: 3
  • Create event: 2
Last Year
  • Issues event: 1
  • Delete event: 1
  • Push event: 61
  • Public event: 1
  • Pull request event: 3
  • Create event: 2

Dependencies

pyproject.toml pypi
  • beautifulsoup4 >=4.13.3
  • nltk >=3.9.1
  • openai >=1.66.3
  • pyargdown @ git+https://github.com/debatelab/pyargdown.git
  • tenacity >=9.0.0
  • textdistance >=4.6.3
  • z3-solver >=4.14.1.0
uv.lock pypi
  • annotated-types 0.7.0
  • anyio 4.9.0
  • argdown-feedback 0.1.0
  • beautifulsoup4 4.13.3
  • certifi 2025.1.31
  • click 8.1.8
  • colorama 0.4.6
  • distro 1.9.0
  • h11 0.14.0
  • httpcore 1.0.7
  • httpx 0.28.1
  • idna 3.10
  • iniconfig 2.0.0
  • jiter 0.9.0
  • joblib 1.4.2
  • lark 1.2.2
  • networkx 3.4.2
  • nltk 3.9.1
  • openai 1.66.3
  • packaging 24.2
  • pluggy 1.5.0
  • pyargdown 0.1.0
  • pydantic 2.10.6
  • pydantic-core 2.27.2
  • pytest 8.3.4
  • pytest-asyncio 0.25.3
  • pyyaml 6.0.2
  • regex 2024.11.6
  • sniffio 1.3.1
  • soupsieve 2.6
  • tenacity 9.0.0
  • textdistance 4.6.3
  • tqdm 4.67.1
  • typing-extensions 4.12.2
  • z3-solver 4.14.1.0