Recent Releases of PyCM
PyCM - Version 4.4
Added
print_timingsmethod #581- Test outcome positive rate #580
- Positive rate #580
run_report_benchmarkfunction #581 ### ChangedREADME.mdmodified- Test system modified
- Document modified
PRE_calcfunction renamed toproportion_calcPython 3.6support dropped
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi 4 months ago
PyCM - Version 4.3
Added
dissimilarity_matrixmethod #579 ### Changed- HTML generator engine modified
README.mdmodified- Document modified
- String templates modified ### Removed
html_initfunctionhtml_endfunction
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi 9 months ago
PyCM - Version 4.2
Added
- 5 new distance/similarity #349 #350
- KuhnsIII
- KuhnsIV
- KuhnsV
- KuhnsVI
- KuhnsVII ### Changed
- Test system modified
- PyPI badge in
README.md - GitHub actions are limited to the
devandmasterbranches AUTHORS.mdupdatedREADME.mdmodified- Document modified
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi 12 months ago
PyCM - Version 4.1
- 5 new distance/similarity added #349 #350
- KoppenI
- KoppenII
- KuderRichardson
- KuhnsI
- KuhnsII
feature_request.ymltemplate added #522config.ymlfor issue template added #522SECURITY.mdadded- Bug report template modified #522
thresholds_calcfunction updated__midpoint_numeric_integral__function updated__trapezoidal_numeric_integral__function updated- Diagrams updated #524
- Document modified
- Document build system updated
AUTHORS.mdupdatedREADME.mdmodified- Test system modified #498
Python 3.12added totest.yml#523Python 3.13added totest.yml- Warning and error messages updated
pycm_util.pyrenamed toutils.pypycm_test.pyrenamed tobasic_test.pypycm_profile.pyrenamed toprofile.pypycm_param.pyrenamed toparams.pypycm_overall_func.pyrenamed tooverall_funcs.pypycm_output.pyrenamed tooutput.pypycm_obj.pyrenamed tocm.pypycm_multilabel_cm.pyrenamed tomultilabel_cm.pypycm_interpret.pyrenamed tointerpret.pypycm_handler.pyrenamed tohandlers.pypycm_error.pyrenamed toerrors.pypycm_distance.pyrenamed todistance.pypycm_curve.pyrenamed tocurve.pypycm_compare.pyrenamed tocompare.pypycm_class_func.pyrenamed toclass_funcs.pypycm_ci.pyrenamed toci.py
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi about 1 year ago
PyCM - Version 4.0
pycmMultiLabelErrorclass added #211MultiLabelCMclass added #211get_cm_by_classmethod added #211get_cm_by_samplemethod added #211__mlcm_vector_handler__function added #211__mlcm_assign_classes__function added #211__mlcm_vectors_filter__function added #211__set_to_multihot__function added #211deprecatedfunction added #499- Document modified #496
README.mdmodified- Example-4 modified #496
- Test system modified
- Python 3.5 support dropped
Acknowledgment
This version has been funded by the NLnet foundation
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi over 2 years ago
PyCM - Version 3.9
OVERALL_PARAMSdictionary added__imbalancement_handler__function addedvector_serializerfunction added- NPV micro/macro added #435
log_lossmethod added #387- 23 new distance/similarity added #349 #350
- Dennis
- Digby
- Dispersion
- Doolittle
- Eyraud
- Fager & McGowan
- Faith
- Fleiss-Levin-Paik
- Forbes I
- Forbes II
- Fossum
- Gilbert & Wells
- Goodall
- Goodman & Kruskal's Lambda
- Goodman & Kruskal Lambda-r
- Guttman's Lambda A
- Guttman's Lambda B
- Hamann
- Harris & Lahey
- Hawkins & Dotson
- Kendall's Tau
- Kent & Foster I
- Kent & Foster II
metrics_offparameter added to ConfusionMatrix__init__method #341CLASS_PARAMSchanged to a dictionary- Code style modified
sortparameter added torelabelmethod #412- Document modified
CONTRIBUTING.mdupdatedcodecovremoved fromdev-requirements.txt#492- Test system modified #488 #492
Acknowledgment
This version has been funded by the NLnet foundation
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi over 2 years ago
PyCM - Version 3.8
distancemethod added #349 #350__contains__method added__getitem__method added- Goodman-Kruskal's Lambda A benchmark added
- Goodman-Kruskal's Lambda B benchmark added
- Krippendorff's Alpha benchmark added
- Pearson's C benchmark added
- 30 new distance/similarity added #349 #350
- AMPLE
- Anderberg's D
- Andres & Marzo's Delta
- Baroni-Urbani & Buser I
- Baroni-Urbani & Buser II
- Batagelj & Bren
- Baulieu I
- Baulieu II
- Baulieu III
- Baulieu IV
- Baulieu V
- Baulieu VI
- Baulieu VII
- Baulieu VIII
- Baulieu IX
- Baulieu X
- Baulieu XI
- Baulieu XII
- Baulieu XIII
- Baulieu XIV
- Baulieu XV
- Benini I
- Benini II
- Canberra
- Clement
- Consonni & Todeschini I
- Consonni & Todeschini II
- Consonni & Todeschini III
- Consonni & Todeschini IV
- Consonni & Todeschini V
relabelmethod sort bug fixedREADME.mdmodifiedCompareoverall benchmarks default weights updated- Document modified
- Test system modified
Acknowledgment
This version has been funded by the NLnet foundation
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi almost 3 years ago
PyCM - Version 3.7
Curveclass added #355ROCCurveclass added #355PRCurveclass added #355pycmCurveErrorclass added #355CONTRIBUTING.mdupdatedmatrix_params_calcfunction optimizedREADME.mdmodified- Document modified
- Test system modified
Python 3.11added totest.yml
Acknowledgment
This version has been funded by the NLnet foundation and Python Software Foundation (PSF)
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi about 3 years ago
PyCM - Version 3.6
- Hamming distance added #350
- Braun-Blanquet similarity added #349
classesparameter added tomatrix_params_from_tablefunction- Matrices with
numpy.integerelements are now accepted - Arrays added to
matrixparameter accepting formats #402 - Website changed to http://www.pycm.io
- Document modified
README.mdmodified
Acknowledgment
This version has been funded by the NLnet foundation
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi over 3 years ago
PyCM - Version 3.5
- Anaconda workflow added
- Custom iterating setting added #409
- Custom casting setting added #409
plotmethod updated #408class_statisticsfunction modifiedoverall_statisticsfunction modifiedBCD_calcfunction modifiedCONTRIBUTING.mdupdatedCODE_OF_CONDUCT.mdupdated #399- Document modified
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi over 3 years ago
PyCM - Version 3.4
- Colab badge added #389
- Discord badge added #397
brier_scoremethod added #219J (Jaccard index)section inDocument.ipynbupdated #401save_objmethod updated #219Python 3.10added totest.yml#391- Example-3 updated #405
- Docstrings of the functions updated #345
CONTRIBUTING.mdupdated #345
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi almost 4 years ago
PyCM - Version 3.3
__compare_weight_handler__function added #347is_imbalancedparameter added to ConfusionMatrix__init__method #276class_benchmark_weightandoverall_benchmark_weightparameters added to Compare__init__method #347statistic_recommendfunction modified #276- Compare
weightparameter renamed toclass_weight#347 - Document modified
- License updated
AUTHORS.mdupdatedREADME.mdmodified- Block diagrams updated
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi about 4 years ago
PyCM - Version 3.2
classes_filterfunction added #358classesparameter added tomatrix_params_calcfunction #358classesparameter added to__obj_vector_handler__function #358classesparameter added to ConfusionMatrix__init__method #358nameparameter removed fromhtml_initfunctionshortenerparameter added tohtml_tablefunction #364shortenerparameter added tosave_htmlmethod #364- Document modified
- HTML report modified
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi over 4 years ago
PyCM - Version 3.1
requirements-splitter.pyaddedsensitivity_indexmethod added #357- Test system modified #361
overall_statisticsfunction modified #346- HTML report modified #367
- Document modified
- References format updated #173
CONTRIBUTING.mdupdated
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi almost 5 years ago
PyCM - Version 3.0
plot_test.pyadded #330axes_genfunction added #330add_number_labelfunction added #330plotmethod added #330combinemethod added #326matrix_combinefunction added #326- Document modified
README.mdmodified- Example-2 deprecated #330
- Example-7 deprecated #330
- Error messages modified
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi about 5 years ago
PyCM - Version 2.9
notebook_check.pyadded #335to_arraymethod added #328__copy__method added #327copymethod added #327averagemethod refactored #332
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi over 5 years ago
PyCM - Version 2.8
label_mapattribute added #256 #323positionsattribute added #256positionmethod added #256- Krippendorff's Alpha added #313
- Aickin's Alpha added #317
weighted_alphamethod added #313- Single class bug fixed #310
CLASS_NUMBER_ERRORerror type changed topycmMatrixErrorrelabelmethod bug fixed #323- Document modified
README.mdmodified
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi over 5 years ago
PyCM - Version 2.7
averagemethod added #299weighted_averagemethod added #274weighted_kappamethod added #243pycmAverageErrorclass added #274 #299- Bangdiwala's B added #303
- MATLAB examples added #268
- Github action added #297
- Document modified
README.mdmodifiedrelabelmethod bug fixed #293sparse_table_printfunction bug fixed #293matrix_checkfunction bug fixed- Minor bug in
Compareclass fixed #294 - Class names mismatch bug fixed #293
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi over 5 years ago
PyCM - Version 2.6
custom_rounderfunction added #279complementfunction addedsparse_matrixattribute added #185sparse_normalized_matrixattribute added #185- Net benefit (NB) added #264
- Yule's Q interpretation (QI) added #267
- Adjusted Rand index (ARI) added #270
- TNR micro/macro added #284
- FPR micro/macro added #284
- FNR micro/macro added #284
sparseparameter added toprint_matrix,print_normalized_matrixandsave_statmethods #185headerparameter added tosave_csvmethod #282- Handler functions moved to
pycm_handler.py - Error objects moved to
pycm_error.py - Verified tests references updated
- Verified tests moved to
verified_test.py - Test system modified
CONTRIBUTING.mdupdated- Namespace optimized
README.mdmodified #266- Document modified
print_normalized_matrixmethod modified #279normalized_table_calcfunction modified #279setup.pymodified- summary mode updated #284
- Dockerfile updated
Python 3.8added to.travis.yamlandappveyor.yml
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi almost 6 years ago
PyCM - Version 2.5
__version__variable added #241- Individual classification success index (ICSI) added #238
- Classification success index (CSI) added #238
- Example-8 (Confidence interval) added #237
install.shaddedautopep8.shadded- Dockerfile added
CImethod added (supported statistics :ACC,AUC,Overall ACC,Kappa,TPR,TNR,PPV,NPV,PLR,NLR,PRE) #237test.shmoved to.travisfolder- Python 3.4 support dropped
- Python 2.7 support dropped
AUTHORS.mdupdatedsave_stat,save_csvandsave_htmlmethods Non-ASCII character bug fixed #246- Mixed type input vectors bug fixed #240
CONTRIBUTING.mdupdated #245- Example-3 updated #239
README.mdmodified #248- Document modified #248
CIattribute renamed toCI95#237kappa_se_calcfunction renamed tokappa_SE_calc#237se_calcfunction modified and renamed toSE_calc#237- CI/SE functions moved to
pycm_ci.py#237 - Minor bug in
save_htmlmethod fixed
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi about 6 years ago
PyCM - Version 2.4
- Tversky index (TI) added #214
- Area under the PR curve (AUPR) added #216
FUNDING.ymladdedAUC_calcfunction modified- Document modified #225
summaryparameter added tosave_html,save_stat,save_csvandstatmethods #217sample_weightbug innumpyarray format fixed #227- Inputs manipulation bug fixed #226
- Test system modified #229 @sadrasabouri
- Warning system modified #228
alt_linkparameter added tosave_htmlmethod andonline_helpfunction #232Compareclass tests moved tocompare_test.py- Warning tests moved to
warning_test.py
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi over 6 years ago
PyCM - Version 2.3
- Adjusted F-score (AGF) added #209
- Overlap coefficient (OC) added #212
- Otsuka-Ochiai coefficient (OOC) added #213
save_statandsave_vectorparameters added tosave_objmethod #210- Document modified #221
README.mdmodified- Parameters recommendation for imbalance dataset modified
- Minor bug in
Compareclass fixed pycm_helpfunction modified- Benchmarks color modified #221
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi over 6 years ago
PyCM - Version 2.2
- Negative likelihood ratio interpretation (NLRI) added
- Cramer's benchmark (SOA5) added
- Matthews correlation coefficient interpretation (MCCI) added #204
- Matthews's benchmark (SOA6) added #204
- F1 macro added
- F1 micro added
- Accuracy macro added #205
Compareclass score calculation modified- Parameters recommendation for multi-class dataset modified
- Parameters recommendation for imbalance dataset modified
README.mdmodified- Document modified
- Logo updated
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi over 6 years ago
PyCM - Version 2.1
- Adjusted geometric mean (AGM) added #177
- Yule's Q (Q) added #193
Compareclass and parameters recommendation system block diagrams added #192- Document links bug fixed #194
- Document modified #173
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi over 6 years ago
PyCM - Version 2.0
- G-Mean (GM) added #178
- Index of balanced accuracy (IBA) added #176
- Optimized precision (OP) added #152
- Pearson's C (C) added #180
Compareclass added #111- Parameters recommendation warning added #174
ConfusionMatrixequal method added #181- Document modified #173
stat_printfunction bug fixedtable_printfunction bug fixedBetaparameter renamed tobeta(F_calcfunction &F_betamethod)- Parameters recommendation for imbalance dataset modified
normalizeparameter added tosave_htmlmethod #183pycm_func.pysplitted intopycm_class_func.pyandpycm_overall_func.pyvector_filter,vector_check,class_checkandmatrix_checkfunctions moved topycm_util.pyRACC_calcandRACCU_calcfunctions exception handler modified #187- Docstrings modified
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi over 6 years ago
PyCM - Version 1.9
- Automatic/Manual (AM) added #144
- Bray-Curtis dissimilarity (BCD) added #143
CODE_OF_CONDUCT.mdadded #151ISSUE_TEMPLATE.mdadded #156PULL_REQUEST_TEMPLATE.mdadded #156CONTRIBUTING.mdadded #155- X11 color names support for
save_htmlmethod added #146 - Parameters recommendation system added #112
- Warning message for high dimension matrix print added #120
- Interactive notebooks section (binder) added #142
save_matrixandnormalizearguments added tosave_csvmethod #120README.mdmodified- Document modified #149 #164
ConfusionMatrix.__init__optimized #145- Document and examples output files moved to different folders #149
- Test system modified #138
relabelmethod bug fixed #167
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi almost 7 years ago
PyCM - Version 1.8
- Lift Score (LS) added #128
colorargument added tosave_htmlmethod #130version_check.pyadded- Error messages modified #132
- Document modified #131
- Website changed to http://www.pycm.ir
- Interpretation functions moved to
pycm_interpret.py - Utility functions moved to
pycm_util.py - Unnecessary
elseandelifremoved ==changed tois
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi almost 7 years ago
PyCM - Version 1.7
- Gini Index (GI) added #119
- Example-7 added #121
pycm_profile.pyaddedclass_nameargument added tostat,save_stat,save_csvandsave_htmlmethods #118overall_paramandclass_paramarguments empty list bug fixed #118matrix_params_calc,matrix_params_from_tableandvector_filterfunctions optimized #118overall_MCC_calc,CEN_misclassification_calcandconvex_combinationfunctions optimized #118- Document modified #124
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi about 7 years ago
PyCM - Version 1.6
- AUC Value Interpretation (AUCI) added #114
- Example-6 added #113
- Anaconda cloud package added #90
overall_paramandclass_paramarguments added tostat,save_statandsave_htmlmethodsclass_paramargument added tosave_csvmethod_removed from overall statistics namesREADME.mdmodified- Document modified
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi about 7 years ago
PyCM - Version 1.5
- Relative Classifier Information (RCI) added #82
- Discriminator Power (DP) added #104
- Youden's Index (Y) added #105
- Discriminant Power Interpretation (DPI) added #107
- Positive Likelihood Ratio Interpretation (PLRI) added #106
__len__method addedrelabelmethod added #98__class_stat_init__function added__overall_stat_init__function addedmatrixattribute added #99normalized_matrixattribute added #99normalized_tableattribute added #99Python 3.7added to.travis.yaml&appveyor.ymlREADME.mdmodified- Document modified
LR+renamed toPLRLR-renamed toNLRnormalized_matrixmethod renamed toprint_normalized_matrix#99matrixmethod renamed toprint_matrix#99entropy_calcfixedcross_entropy_calcfixedconditional_entropy_calcfixedprint_tablebug for large numbers fixed- JSON key bug in
save_objfixed #108 transposebug insave_objfixed #108
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi about 7 years ago
PyCM - Version 1.4
- Area Under Curve added #83
- AUNU added #83
- AUNP added #83
- Class Balance Accuracy added #81
- Global Performance Index (RR) added #80
- Overall MCC added #75
- Distance index (dInd) added #84
- Similarity index (sInd) added #84
one_vs_alladded #76dev-requirements.txtaddedREADME.mdmodified #85- Document modified #85
save_statmodified #78requirements.txtmodified
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi about 7 years ago
PyCM - Version 1.3
- Confusion Entropy added #72
- Overall Confusion Entropy added #72
- Modified Confusion Entropy added #73
- Overall Modified Confusion Entropy added #73
- Information Score added #71
README.mdmodified
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi about 7 years ago
PyCM - Version 1.2
- NIR (No Information Rate) added
- P-Value added
sample_weightaddedtransposeaddedREADME.mdmodified- Key error in some parameters fixed
OSXenv added to.travis.yml
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi about 7 years ago
PyCM - Version 1.1
- Zero-one loss added
- Support added
online_helpfunction addedREADME.mdmodifiedhtml_tablefunction modifiedtable_printfunction modifiednormalized_table_printfunction modified
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi over 7 years ago
PyCM - Version 1.0
- Hamming loss added
README.mdmodified
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi over 7 years ago
PyCM - Version 0.9.5
- Obj load added
- Obj save added
- Example-4 added
README.mdmodified- Block diagram updated
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi over 7 years ago
PyCM - Version 0.9
- Activation Threshold added
- Example-3 added
- Jaccard index added
- Overall Jaccard index added
README.mdmodifiedsetup.pymodified
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi over 7 years ago
PyCM - Version 0.8.6
- Example section in document added
- Python 2.7 CI added
- JOSS paper pdf added
- Cite section modified
- ConfusionMatrix docstring modified
- round function changed to numpy.around
- README.md modified
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi over 7 years ago
PyCM - Version 0.8.5
- Confusion matrix size in HTML report modified
- Example-1 (Comparison of three different classifiers) added
- Example-2 (How to plot via matplotlib) added
- ConfusionMatrix docstring added
- JOSS paper added
- Test system modified
- README.md modified
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi over 7 years ago
PyCM - Version 0.8.1
1.New parameters added : * Goodman and Kruskal's lambda B * Goodman and Kruskal's lambda A * Cross Entropy * Conditional Entropy * Joint Entropy * Reference Entropy * Response Entropy * Kullback-Liebler divergence * Mutual Information * Kappa Unbiased * Kappa No Prevalence * Random Accuracy Unbiased
- Direct ConfusionMatrix added
- pycmVectorError class added
- pycmMatrixError class added
- Support numpy arrays
- pycmError class removed
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi almost 8 years ago
PyCM - Version 0.7
- New parameters added :
- Cramer's V
- 95% Confidence interval
- Chi-Squared
- Phi-Squared
- Chi-Squared DF
- Standard error
- Kappa standard error
- Kappa 95% confidence interval
- Cicchetti benchmark
- Parameters description links in HTML report modified
- Confusion matrix color in HTML report modified
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi almost 8 years ago
PyCM - Version 0.6
- CSV Report added (
save_csv) - Changelog added
- Confusion matrix color in HTML report changed
- Parameters description links in HTML report added
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi almost 8 years ago
PyCM - Version 0.5
- New parameters added :
- Scott's pi
- Gwet's AC1
Bennett S score
HTML Report Added (
save_html)
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi almost 8 years ago
PyCM - Version 0.4
- New parameters added :
- TPR Micro/Macro
- PPV Micro/Macro
- RACC Overall
- Normalized Matrix Bugs Fixed
- Zero Class Bugs Fixed
- Fleiss & Altman Benchmarks Added
- Output File(.pycm) Method Added
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi almost 8 years ago
PyCM - Version 0.3
- New parameters added :
- Kappa
- Random Accuracy
Strength of Agreement
Overall statistics added
Round bug fixed
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi almost 8 years ago
PyCM - Version 0.2
- New parameters added :
- Population
- Condition positive
- Condition negative
- Test outcome positive
- Test outcome negative
- Prevalence
- G-measure
- matrix & normalized_matrix method added
- params method added
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi almost 8 years ago
PyCM - Version 0.1
In the field of machine learning and specifically the problem of statistical classification, a confusion matrix, also known as an error matrix, is a specific table layout that allows visualization of the performance of an algorithm, typically a supervised learning one (in unsupervised learning it is usually called a matching matrix). Each row of the matrix represents the instances in a predicted class while each column represents the instances in an actual class (or vice versa)
pycm(python confusion matrix) is a multi class confusion matrix library in python.
First Release Supported Class Statistics :
- ACC
- BM
- DOR
- F1-Score
- FDR
- FNR
- FOR
- FPR
- LR+
- LR-
- MCC
- MK
- NPV
- PPV
- TNR
- TPR
Scientific Software - Peer-reviewed
- Python
Published by sepandhaghighi almost 8 years ago