https://github.com/agda/tasty-silver

A fancy test runner for tasty and support for golden tests.

https://github.com/agda/tasty-silver

Science Score: 36.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
  • Academic publication links
  • Committers with academic emails
    2 of 10 committers (20.0%) from academic institutions
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (10.2%) to scientific vocabulary

Keywords from Contributors

proof type-theory agda dependent-types programming-language proof-assistant haskell whitespace version-control sanitization
Last synced: 10 months ago · JSON representation

Repository

A fancy test runner for tasty and support for golden tests.

Basic Info
  • Host: GitHub
  • Owner: agda
  • License: mit
  • Language: Haskell
  • Default Branch: master
  • Homepage:
  • Size: 287 KB
Statistics
  • Stars: 13
  • Watchers: 3
  • Forks: 4
  • Open Issues: 8
  • Releases: 0
Created over 11 years ago · Last pushed 11 months ago
Metadata Files
Readme Changelog License

README.md

Hackage version tasty-silver on Stackage Nightly Stackage LTS version Haskell-CI macOS windows <!-- Hackage CI -->

Tasty Silver

This package provides support for «golden testing».

A golden test is an IO action that writes its result to a file. To pass the test, this output file should be identical to the corresponding «golden» file, which contains the correct result for the test.

Interactive Mode

If the test runner is called with the -i option, the diff of any failing golden test is shown to the user. Based upon this diff, the user can choose to update the golden standard or to fix the test case as necessary. Interactive mode requires that at least git diff and less is available, or preferrably wdiff and colordiff for character-based diffs.

Portability

tasty-silver aims to work under Linux, macOS, and Windows. In particular, it should work in the GitHub CI virtual environments.

Known limitations:

  • On macOS, GHC ≥ 7.10 is required, as GHC ≤ 7.8 produces code that is not compatible with the System Integrity Protection mechanism of Mac OS X. In particular, you could see errors like: /usr/bin/less: getPermissions:fileAccess: permission denied (Operation not permitted)

  • On Windows, the colored diff may not be available as it depends on the availability of colordiff, less, sh, and wdiff.

Examples

For a non-trivial example see the Agda tests, which is used for testing the Agda compiler.

Maintainers

Philipp Hausmann is the primary maintainer. Andreas Abel is co-maintainer.

Owner

  • Name: Agda Github Community
  • Login: agda
  • Kind: organization

GitHub Events

Total
  • Issue comment event: 2
  • Push event: 1
  • Pull request event: 2
  • Fork event: 1
Last Year
  • Issue comment event: 2
  • Push event: 1
  • Pull request event: 2
  • Fork event: 1

Committers

Last synced: 11 months ago

All Time
  • Total Commits: 238
  • Total Committers: 10
  • Avg Commits per committer: 23.8
  • Development Distribution Score (DDS): 0.626
Past Year
  • Commits: 5
  • Committers: 1
  • Avg Commits per committer: 5.0
  • Development Distribution Score (DDS): 0.0
Top Committers
Name Email Commits
Philipp Hausmann p****t@3****h 89
Roman Cheplyaka r****a@r****o 84
Andreas Abel a****l@i****e 55
Craig Roy c****y@s****k 3
Felix Yan f****s@a****g 2
Philipp Hausmann p****n@f****h 1
Niklas Hambüchen m****l@n****e 1
Liang-Ting Chen l****w@g****m 1
Kirill Zaborsky q****a@g****m 1
Andrés Sicard-Ramírez a****r@e****o 1
Committer Domains (Top 20 + Academic)

Issues and Pull Requests

Last synced: 11 months ago

All Time
  • Total issues: 0
  • Total pull requests: 1
  • Average time to close issues: N/A
  • Average time to close pull requests: 20 minutes
  • Total issue authors: 0
  • Total pull request authors: 1
  • Average comments per issue: 0
  • Average comments per pull request: 0.0
  • Merged pull requests: 1
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 1
  • Average time to close issues: N/A
  • Average time to close pull requests: 20 minutes
  • Issue authors: 0
  • Pull request authors: 1
  • Average comments per issue: 0
  • Average comments per pull request: 0.0
  • Merged pull requests: 1
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
Pull Request Authors
  • andreasabel (1)
Top Labels
Issue Labels
Pull Request Labels

Dependencies

tasty-silver.cabal hackage
  • ansi-terminal >=0.6.2.1
  • async *
  • base >=4.5 && <5
  • bytestring >=0.9.2.1
  • containers *
  • deepseq *
  • directory >=1.2.3.0
  • filepath *
  • mtl *
  • optparse-applicative *
  • process >=1.2
  • process-extras >=0.3
  • regex-tdfa >=1.2.0
  • semigroups >=0.18.3
  • silently >=1.2.5.1
  • stm >=2.4.2
  • tagged *
  • tasty >=1.4
  • temporary *
  • text >=0.11.0.0
  • transformers >=0.3
  • base * test
  • directory * test
  • filepath * test
  • process * test
  • semigroups * test
  • silently * test
  • tasty * test
  • tasty-hunit * test
  • tasty-silver * test
  • temporary * test
  • transformers * test