https://github.com/christian-byrne/comfy-node-testing-tools
Tools to generate branches for custom comfy nodes and visualize test results
Science Score: 26.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
○CITATION.cff file
-
✓codemeta.json file
Found codemeta.json file -
✓.zenodo.json file
Found .zenodo.json file -
○DOI references
-
○Academic publication links
-
○Committers with academic emails
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (14.9%) to scientific vocabulary
Last synced: 9 months ago
·
JSON representation
Repository
Tools to generate branches for custom comfy nodes and visualize test results
Basic Info
- Host: GitHub
- Owner: christian-byrne
- Language: Python
- Default Branch: master
- Size: 56.5 MB
Statistics
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
- Releases: 0
Created about 2 years ago
· Last pushed about 2 years ago
Metadata Files
Readme
README.md
Custom Node Testing Tools - Table of Contents
Overview
- Loads and executes a custom node using the same methods as comfy, just specify the path and the node's name
- Lots of default tests which generate branches based on the input fields of the custom node
- Each test class generates branches for its target input fields (e.g., the image size test generates permutations of image size comparisons for each IMAGE or MASK field)
- For the other fields/inputs not being tested, they are chosen randomly from the available options or ranges, so a large number of input permutations gets tested naturally while running the main test classes
- Creates a visual webview of the test results from each test class and opens it automatically
- After opening, all the generated data, images, html, etc. are deleted, but the results will still visible in the browser. This way there is no cleanup required
- Has checks to ensure tests won't be too demanding or take too long to run
- Uses test data that is fast to work with to enable a large number of branches (e.g., 64x64 random noise image tensors)
- Auto-generate Edge cases to fill out coverage until a threshold is hit
- In some cases, uses a database of real images to test with, but still descales them to a smaller size to keep the tests fast
- When visual consistency from input to output is relevant to the test
- To test differnet file formats, channel numbers, exif, etc.
- The database includes a wide diversity of images/videos
- Test images can be added by moving files to the
test_imagesfolder
Purposes
- Allow for fast testing/debugging of custom nodes without requiring you to constantly relaunch comfy process or suffer from inconsistencies with the comfy webview's grid's state not updating the way you expect between tests
- Compare speed/efficiency of different methods
- Auto-generate permutations for full branch coverage of a custom node's processes
- Help identify issues with mismatched tensor shapes/sizes/formats more easily
- Visualize how a node performs (its output) across all possible input permutations for a custom node
- Test inference algorithms
- Help improve speed
Test Types
Image Size Permutations
Tensor Format/Type Permutations
Owner
- Name: Christian Byrne
- Login: christian-byrne
- Kind: user
- Location: San Francisco
- Company: Comfy-Org
- Twitter: c__byrne
- Repositories: 100
- Profile: https://github.com/christian-byrne
GitHub Events
Total
Last Year
Committers
Last synced: about 1 year ago
Top Committers
| Name | Commits | |
|---|---|---|
| christian-byrne | a****m@g****m | 8 |
Issues and Pull Requests
Last synced: about 1 year ago
All Time
- Total issues: 0
- Total pull requests: 0
- Average time to close issues: N/A
- Average time to close pull requests: N/A
- Total issue authors: 0
- Total pull request authors: 0
- Average comments per issue: 0
- Average comments per pull request: 0
- Merged pull requests: 0
- Bot issues: 0
- Bot pull requests: 0
Past Year
- Issues: 0
- Pull requests: 0
- Average time to close issues: N/A
- Average time to close pull requests: N/A
- Issue authors: 0
- Pull request authors: 0
- Average comments per issue: 0
- Average comments per pull request: 0
- Merged pull requests: 0
- Bot issues: 0
- Bot pull requests: 0