Recent Releases of clustimage
clustimage - 1.6.19
- improve speed in case thumbnail already exists, load it without additional steps (because these are already done before storing the thumbnail)
- Set the
tempdirpath for the thumbnails using initialization. - Some cleaning
- Jupyter Notebook
Published by erdogant 12 months ago
clustimage - 1.6.18
- reformat the logger so that it does not interfere with others
- update setup.py into pyproject.toml
- catch error if target dir does not exist
- Jupyter Notebook
Published by erdogant 12 months ago
clustimage - v1.6.17
- Catch error for unique() function in case no labels are present
- Jupyter Notebook
Published by erdogant about 1 year ago
clustimage - v1.6.16
- Retrieve EXIF information from more images by opening the image if required. This is more time consuming but it will extract the data if there.
- Jupyter Notebook
Published by erdogant about 1 year ago
clustimage - 1.6.14
- bug fix when images do not have latlon coordinates. These were removed but are now kept
- Jupyter Notebook
Published by erdogant about 1 year ago
clustimage - 1.6.13
- bugfix in case exif method with latlon finds no single image.
- Jupyter Notebook
Published by erdogant about 1 year ago
clustimage - 1.6.12
- Fix for brutal error when no valid input directory is given as input.
- Jupyter Notebook
Published by erdogant about 1 year ago
clustimage - 1.6.11
- name convention:
store_to_diskintouse_image_cache - Add
use_thumbnail_cachefor creating and loading thumbnails. - Fixed bug for unique plotting
- Fixed a bug in scatter and and updated parameters for pca usage
- Jupyter Notebook
Published by erdogant about 1 year ago
clustimage - 1.6.10
- Performance upgrades for EXIF information processing.
- Implemented parallel processing for EXIF information.
store_to_diskparameter now also stores thumbnails to the user-temp which speeds up image plotting.- Code refactoring
- Jupyter Notebook
Published by erdogant about 1 year ago
clustimage - 1.6.9
- Fix for when using exif and datetime seconds is off
- Jupyter Notebook
Published by erdogant about 1 year ago
clustimage - 1.6.8
fix issue when datetime format is weird.
- Jupyter Notebook
Published by erdogant about 1 year ago
clustimage - 1.6.7
- opencv is removed from requirements and setup. This needs to be installed manually based on the conditions where you are working in.
- Jupyter Notebook
Published by erdogant about 1 year ago
clustimage - 1.6.6
- Changed import
opencv-pythontoopencv-python-headless, as this one does not depend on graphical user interfaces. This allows the model to run on servers without a graphical environment, ensuring compatibility with headless systems.
- Jupyter Notebook
Published by erdogant about 1 year ago
clustimage - 1.6.5
- Added
move_filesto init.
- Jupyter Notebook
Published by erdogant about 1 year ago
clustimage - 1.6.4
- Various improvements in the
move_to_dirfunction- Parameter
targetrdiris changed intosavedir - Parameter
overwriteis added and set as default to False - Return dict with the status whether files are moved/copied
- Parameter
- In the plot functionality,
min_clustis changed intomin_samplesfor clarity. - Blacklist is to None by default
- Fix in case latlon not exist
- Some other minor fixes
- Jupyter Notebook
Published by erdogant about 1 year ago
clustimage - 1.6.3
- Added functionality to also cluster all kinds of files, such as "mov" and "mp4" and "txt" etc. This only works when using EXIF method and datetime metric.
- Update in making plots: colors can be inverted and if the file is not supported, it does not throw an error but shows an empty image.
- Jupyter Notebook
Published by erdogant about 1 year ago
clustimage - 1.6.2
- Fix for
url2disk - Parameter added to invert colors when using plot function.
- Jupyter Notebook
Published by erdogant about 1 year ago
clustimage - 1.6.1
Various small fixes. * Icons are not on top of each other anymore in the map when the lat/lon are the same. A bit of noise is added (optional). * All GPS coordinates are now correctly processed * Clustering datetime is now based on DBSCAN
- Jupyter Notebook
Published by erdogant about 1 year ago
clustimage - 1.6.0
After many small updates here again is a larger update of clustimage!
- New method added to extract EXIF information from images.
- Cluster on lat/lon coordinates using exif metadata (great use case when having photos) See here for docs.
- Cluster on datetime using exif metadata (great use case when having photos) See here for docs.
- Images can physically be moved into subdirectories using
move_to_dir. See here for more details. - Images can be plotted on a map using
plot_map - Unit tests are fixed.
- Issue #25 and #26 is fixed.
- Jupyter Notebook
Published by erdogant about 1 year ago
clustimage - v1.5.20
- Some more fixes regarding carefully Logging
- Jupyter Notebook
Published by erdogant over 2 years ago
clustimage - v1.5.19
- fix for bug inhomogeneous shape
- Jupyter Notebook
Published by erdogant over 2 years ago
clustimage - v1.5.18
- Replace local examples with datazets
- Jupyter Notebook
Published by erdogant over 2 years ago
clustimage - v1.5.17
- update labels when dendrogram is used to set cut-off point
- Jupyter Notebook
Published by erdogant over 2 years ago
clustimage - v1.5.16
- fix for plotting colors
- docstrings update
- Jupyter Notebook
Published by erdogant over 2 years ago
clustimage - v1.5.15
- fix for greyscale images
- UMAP disables because of numba error
- Jupyter Notebook
Published by erdogant almost 3 years ago
clustimage - v1.5.14
- Fix for libpng error #16
- Functionality to specify the number of clusters #17
- Jupyter Notebook
Published by erdogant almost 3 years ago
clustimage - v1.5.13
- Fix required due to updates in umap
- Jupyter Notebook
Published by erdogant almost 3 years ago
clustimage - v1.5.12
- Fix for TSNE when having less than 30 samples.
- Jupyter Notebook
Published by erdogant about 3 years ago
clustimage - v1.5.11
- Fix in case images have readily the desired input size #12.
Thanks to @ricaiu.
- Jupyter Notebook
Published by erdogant about 3 years ago
clustimage - v1.5.10
sklearnchanged intoscikit-learnin both requirements and setup file.
- Jupyter Notebook
Published by erdogant about 3 years ago
clustimage - v1.5.9
- Added check for whether whash-haar is power of 2
- Jupyter Notebook
Published by erdogant over 3 years ago
clustimage - v1.5.8
- Added crop-resistant-hash method
- Jupyter Notebook
Published by erdogant over 3 years ago
clustimage - v1.5.7
- added plt.show and plt.draw in the scatter function to prevent that the figures suddenly disappear.
- Jupyter Notebook
Published by erdogant over 3 years ago
clustimage - v1.5.6
- Updated sample colors when using the
findfunctionality. The class colors now match with other scatter plots.
- Jupyter Notebook
Published by erdogant over 3 years ago
clustimage - v1.5.5
- added ouput
labelsfor the find functionality
- Jupyter Notebook
Published by erdogant over 3 years ago
clustimage - v1.5.4
- fix for setting temp directory.
- Jupyter Notebook
Published by erdogant over 3 years ago
clustimage - v1.5.3
- Save and load also stores models
- Saving without filepath stores the save file to the systems/clustimage/ default temp directory
- Jupyter Notebook
Published by erdogant over 3 years ago
clustimage - v1.5.2
- Added functionality to read pandas dataframe as input matrix and use the index names a filenames.
``` from clustimage import Clustimage import pandas as pd import numpy as np
Initialize
cl = Clustimage()
Import data
Xraw = cl.import_example(data='mnist')
print(Xraw)
array([[ 0., 0., 5., ..., 0., 0., 0.],
[ 0., 0., 0., ..., 10., 0., 0.],
[ 0., 0., 0., ..., 16., 9., 0.],
...,
[ 0., 0., 1., ..., 6., 0., 0.],
[ 0., 0., 2., ..., 12., 0., 0.],
[ 0., 0., 10., ..., 12., 1., 0.]])
filenames = list(map(lambda x: str(x) + '.png', np.arange(0, Xraw.shape[0]))) Xraw = pd.DataFrame(Xraw, index=filenames)
print(Xraw)
0 1 2 3 4 5 ... 58 59 60 61 62 63
0.png 0.0 0.0 5.0 13.0 9.0 1.0 ... 6.0 13.0 10.0 0.0 0.0 0.0
1.png 0.0 0.0 0.0 12.0 13.0 5.0 ... 0.0 11.0 16.0 10.0 0.0 0.0
2.png 0.0 0.0 0.0 4.0 15.0 12.0 ... 0.0 3.0 11.0 16.0 9.0 0.0
3.png 0.0 0.0 7.0 15.0 13.0 1.0 ... 7.0 13.0 13.0 9.0 0.0 0.0
4.png 0.0 0.0 0.0 1.0 11.0 0.0 ... 0.0 2.0 16.0 4.0 0.0 0.0
... ... ... ... ... ... ... ... ... ... ... ... ...
1792.png 0.0 0.0 4.0 10.0 13.0 6.0 ... 2.0 14.0 15.0 9.0 0.0 0.0
1793.png 0.0 0.0 6.0 16.0 13.0 11.0 ... 6.0 16.0 14.0 6.0 0.0 0.0
1794.png 0.0 0.0 1.0 11.0 15.0 1.0 ... 2.0 9.0 13.0 6.0 0.0 0.0
1795.png 0.0 0.0 2.0 10.0 7.0 0.0 ... 5.0 12.0 16.0 12.0 0.0 0.0
1796.png 0.0 0.0 10.0 14.0 8.0 1.0 ... 8.0 12.0 14.0 12.0 1.0 0.0
Or all in one run
results = cl.fit_transform(Xraw)
print(results['filenames'])
array(['0.png', '1.png', '2.png', ..., '1794.png', '1795.png', '1796.png'],
```
- Jupyter Notebook
Published by erdogant over 3 years ago
clustimage - v1.5.1
- Fix for storing urls correctly
- Jupyter Notebook
Published by erdogant over 3 years ago
clustimage - v1.5.0
- Adding original url paths in the results
- bug fix in scatter that occurred in some cases when having low sample sizes
- Code cleaning
- Jupyter Notebook
Published by erdogant over 3 years ago
clustimage - v1.4.10
- fix in case clean_tempdir=True is used
- Jupyter Notebook
Published by erdogant over 3 years ago
clustimage - v1.4.9
- catch error when files are deleted from temp directory and trying to make a plot
- Jupyter Notebook
Published by erdogant over 3 years ago
clustimage - v1.4.8
- added functionality to remove temp directory using the function
cl.clean_files(clean_tempdir=True)
- Jupyter Notebook
Published by erdogant over 3 years ago
clustimage - v1.4.7
- Tempdirectory is set to system temp + "clustimage' to avoid the creation of many temp directories and better managing.
- Jupyter Notebook
Published by erdogant over 3 years ago
clustimage - v1.4.6
- Add warning in case of large
dimis used.
- Jupyter Notebook
Published by erdogant almost 4 years ago
clustimage - v1.4.5
- Minor update of showing embedding text correctly in print statements and plots
- Jupyter Notebook
Published by erdogant almost 4 years ago
clustimage - v1.4.4
- added functionality to import images from URL locations
- Example can be found here
- Jupyter Notebook
Published by erdogant almost 4 years ago
clustimage - v1.4.3
- Fix for scatterplot
- More input arguments for scatterplot to make even more pretty plots. Examples can be found here.
- Jupyter Notebook
Published by erdogant almost 4 years ago
clustimage - v1.4.2
- Fix for input argument in
scatterd - Added input argument density to
scatter(density=True)function
- Jupyter Notebook
Published by erdogant almost 4 years ago
clustimage - 1.4.1
- UMAP can be used as embedding technique
Example:
``` from clustimage import Clustimage
Initialize
cl = Clustimage(embedding='umap') ```
- Jupyter Notebook
Published by erdogant almost 4 years ago
clustimage - 1.4.0
- in case of clustering on hash, the image-hash is now directly used in the clustering instead of pre-computing the adjacency matrix.
- Removal of complicated functionalities regarding hashes
- Jupyter Notebook
Published by erdogant about 4 years ago
clustimage - 1.3.15
- Fix that pathnames and filenames is always return in a numpy array
- Some code refactoring and cleaning
- Jupyter Notebook
Published by erdogant about 4 years ago
clustimage - 1.3.14
- fix for colors when making plots
- smaller bugs fixed
- codestyling
- Jupyter Notebook
Published by erdogant about 4 years ago
clustimage - 1.3.13
- Changed
_check_dimintoget_dimwhich now can more easily be used to determine the dimension of vector images - Other minor updates
- Jupyter Notebook
Published by erdogant about 4 years ago
clustimage - 1.3.12
- fix for throwing error during the embedding part
- fix in case of using hog features
- fix in case of unique plotting
- Jupyter Notebook
Published by erdogant about 4 years ago
clustimage - 1.3.11
bugfix for unexpected keyword argument 'method'
- Jupyter Notebook
Published by erdogant about 4 years ago
clustimage - 1.3.10
- Minor fix in case of using hog feature. Grayscale needs to be set on True.
- Jupyter Notebook
Published by erdogant about 4 years ago
clustimage - 1.3.9
- added black listing for search through directories
- Jupyter Notebook
Published by erdogant about 4 years ago
clustimage - 1.3.8
- Some bug fixes
- Code refactoring
- Jupyter Notebook
Published by erdogant about 4 years ago
clustimage - 1.3.7
- Code refactoring to break-up the fit_transform() into multiple smaller steps that can also be separately. Examle is shown in the readme.
- Jupyter Notebook
Published by erdogant about 4 years ago
clustimage - 1.3.6
- Fixes for plotting in notebooks
- Jupyter Notebook
Published by erdogant about 4 years ago
clustimage - 1.3.5
- fix for plotting in case of storetodisk is False
- Jupyter Notebook
Published by erdogant about 4 years ago
clustimage - 1.3.4
- bug fix in case storetodisk is True
- Jupyter Notebook
Published by erdogant about 4 years ago
clustimage - 1.3.3
- Bug fixes
- Improved plots
- added clustering on hashes
- Docstrings udpates
- Code refactored
- Jupyter Notebook
Published by erdogant about 4 years ago
clustimage - 1.3.1
- removed data files from package
- Jupyter Notebook
Published by erdogant about 4 years ago
clustimage - 1.2.2
- Fixes regarding saving and loading
- Code refactoring
- Docstrings updated
- Jupyter Notebook
Published by erdogant over 4 years ago
clustimage - 1.2.1
- More code refactoring
- More code conventions
- Plots and scatterplots are improved
- Jupyter Notebook
Published by erdogant over 4 years ago
clustimage - 1.2.0
- Various bug fixes
- changing parameter conventions, method into evaluate
- Added new function to extract unique images
- code refactoring
- docstring updated
- new plots added
- Jupyter Notebook
Published by erdogant over 4 years ago
clustimage - 1.1.0
- bug fixes
- plot updates
- Docstrings
- Some code refactoring
- Jupyter Notebook
Published by erdogant over 4 years ago