Recent Releases of clustimage

clustimage - 1.6.19

  • improve speed in case thumbnail already exists, load it without additional steps (because these are already done before storing the thumbnail)
  • Set the tempdir path for the thumbnails using initialization.
  • Some cleaning

- Jupyter Notebook
Published by erdogant 12 months ago

clustimage - 1.6.18

  • reformat the logger so that it does not interfere with others
  • update setup.py into pyproject.toml
  • catch error if target dir does not exist

- Jupyter Notebook
Published by erdogant 12 months ago

clustimage - v1.6.17

  • Catch error for unique() function in case no labels are present

- Jupyter Notebook
Published by erdogant about 1 year ago

clustimage - v1.6.16

  • Retrieve EXIF information from more images by opening the image if required. This is more time consuming but it will extract the data if there.

- Jupyter Notebook
Published by erdogant about 1 year ago

clustimage - 1.6.15

oops.. import fix

- Jupyter Notebook
Published by erdogant about 1 year ago

clustimage - 1.6.14

  • bug fix when images do not have latlon coordinates. These were removed but are now kept

- Jupyter Notebook
Published by erdogant about 1 year ago

clustimage - 1.6.13

  • bugfix in case exif method with latlon finds no single image.

- Jupyter Notebook
Published by erdogant about 1 year ago

clustimage - 1.6.12

  • Fix for brutal error when no valid input directory is given as input.

- Jupyter Notebook
Published by erdogant about 1 year ago

clustimage - 1.6.11

  • name convention: store_to_diskinto use_image_cache
  • Add use_thumbnail_cache for creating and loading thumbnails.
  • Fixed bug for unique plotting
  • Fixed a bug in scatter and and updated parameters for pca usage

- Jupyter Notebook
Published by erdogant about 1 year ago

clustimage - 1.6.10

  • Performance upgrades for EXIF information processing.
  • Implemented parallel processing for EXIF information.
  • store_to_disk parameter now also stores thumbnails to the user-temp which speeds up image plotting.
  • Code refactoring

- Jupyter Notebook
Published by erdogant about 1 year ago

clustimage - 1.6.9

  • Fix for when using exif and datetime seconds is off

- Jupyter Notebook
Published by erdogant about 1 year ago

clustimage - 1.6.8

fix issue when datetime format is weird.

- Jupyter Notebook
Published by erdogant about 1 year ago

clustimage - 1.6.7

  • opencv is removed from requirements and setup. This needs to be installed manually based on the conditions where you are working in.

- Jupyter Notebook
Published by erdogant about 1 year ago

clustimage - 1.6.6

  • Changed import opencv-python to opencv-python-headless, as this one does not depend on graphical user interfaces. This allows the model to run on servers without a graphical environment, ensuring compatibility with headless systems.

- Jupyter Notebook
Published by erdogant about 1 year ago

clustimage - 1.6.5

  • Added move_filesto init.

- Jupyter Notebook
Published by erdogant about 1 year ago

clustimage - 1.6.4

  • Various improvements in the move_to_dirfunction
    • Parameter targetrdiris changed into savedir
    • Parameter overwriteis added and set as default to False
    • Return dict with the status whether files are moved/copied
  • In the plot functionality, min_clustis changed into min_samplesfor clarity.
  • Blacklist is to None by default
  • Fix in case latlon not exist
  • Some other minor fixes

- Jupyter Notebook
Published by erdogant about 1 year ago

clustimage - 1.6.3

  • Added functionality to also cluster all kinds of files, such as "mov" and "mp4" and "txt" etc. This only works when using EXIF method and datetime metric.
  • Update in making plots: colors can be inverted and if the file is not supported, it does not throw an error but shows an empty image.

- Jupyter Notebook
Published by erdogant about 1 year ago

clustimage - 1.6.2

  • Fix for url2disk
  • Parameter added to invert colors when using plot function.

- Jupyter Notebook
Published by erdogant about 1 year ago

clustimage - 1.6.1

Various small fixes. * Icons are not on top of each other anymore in the map when the lat/lon are the same. A bit of noise is added (optional). * All GPS coordinates are now correctly processed * Clustering datetime is now based on DBSCAN

- Jupyter Notebook
Published by erdogant about 1 year ago

clustimage - 1.6.0

After many small updates here again is a larger update of clustimage!

  • New method added to extract EXIF information from images.
  • Cluster on lat/lon coordinates using exif metadata (great use case when having photos) See here for docs.
  • Cluster on datetime using exif metadata (great use case when having photos) See here for docs.
  • Images can physically be moved into subdirectories using move_to_dir. See here for more details.
  • Images can be plotted on a map using plot_map
  • Unit tests are fixed.
  • Issue #25 and #26 is fixed.

- Jupyter Notebook
Published by erdogant about 1 year ago

clustimage - v1.5.20

  • Some more fixes regarding carefully Logging

- Jupyter Notebook
Published by erdogant over 2 years ago

clustimage - v1.5.19

  • fix for bug inhomogeneous shape

- Jupyter Notebook
Published by erdogant over 2 years ago

clustimage - v1.5.18

  • Replace local examples with datazets

- Jupyter Notebook
Published by erdogant over 2 years ago

clustimage - v1.5.17

  • update labels when dendrogram is used to set cut-off point

- Jupyter Notebook
Published by erdogant over 2 years ago

clustimage - v1.5.16

  • fix for plotting colors
  • docstrings update

- Jupyter Notebook
Published by erdogant over 2 years ago

clustimage - v1.5.15

  • fix for greyscale images
  • UMAP disables because of numba error

- Jupyter Notebook
Published by erdogant almost 3 years ago

clustimage - v1.5.14

  • Fix for libpng error #16
  • Functionality to specify the number of clusters #17

- Jupyter Notebook
Published by erdogant almost 3 years ago

clustimage - v1.5.13

  • Fix required due to updates in umap

- Jupyter Notebook
Published by erdogant almost 3 years ago

clustimage - v1.5.12

  • Fix for TSNE when having less than 30 samples.

- Jupyter Notebook
Published by erdogant about 3 years ago

clustimage - v1.5.11

  • Fix in case images have readily the desired input size #12.

Thanks to @ricaiu.

- Jupyter Notebook
Published by erdogant about 3 years ago

clustimage - v1.5.10

  • sklearn changed into scikit-learn in both requirements and setup file.

- Jupyter Notebook
Published by erdogant about 3 years ago

clustimage - v1.5.9

  • Added check for whether whash-haar is power of 2

- Jupyter Notebook
Published by erdogant over 3 years ago

clustimage - v1.5.8

  • Added crop-resistant-hash method

- Jupyter Notebook
Published by erdogant over 3 years ago

clustimage - v1.5.7

  • added plt.show and plt.draw in the scatter function to prevent that the figures suddenly disappear.

- Jupyter Notebook
Published by erdogant over 3 years ago

clustimage - v1.5.6

  • Updated sample colors when using the find functionality. The class colors now match with other scatter plots.

- Jupyter Notebook
Published by erdogant over 3 years ago

clustimage - v1.5.5

  • added ouput labels for the find functionality

- Jupyter Notebook
Published by erdogant over 3 years ago

clustimage - v1.5.4

  • fix for setting temp directory.

- Jupyter Notebook
Published by erdogant over 3 years ago

clustimage - v1.5.3

  • Save and load also stores models
  • Saving without filepath stores the save file to the systems/clustimage/ default temp directory

- Jupyter Notebook
Published by erdogant over 3 years ago

clustimage - v1.5.2

  • Added functionality to read pandas dataframe as input matrix and use the index names a filenames.

``` from clustimage import Clustimage import pandas as pd import numpy as np

Initialize

cl = Clustimage()

Import data

Xraw = cl.import_example(data='mnist')

print(Xraw)

array([[ 0., 0., 5., ..., 0., 0., 0.],

[ 0., 0., 0., ..., 10., 0., 0.],

[ 0., 0., 0., ..., 16., 9., 0.],

...,

[ 0., 0., 1., ..., 6., 0., 0.],

[ 0., 0., 2., ..., 12., 0., 0.],

[ 0., 0., 10., ..., 12., 1., 0.]])

filenames = list(map(lambda x: str(x) + '.png', np.arange(0, Xraw.shape[0]))) Xraw = pd.DataFrame(Xraw, index=filenames)

print(Xraw)

0 1 2 3 4 5 ... 58 59 60 61 62 63

0.png 0.0 0.0 5.0 13.0 9.0 1.0 ... 6.0 13.0 10.0 0.0 0.0 0.0

1.png 0.0 0.0 0.0 12.0 13.0 5.0 ... 0.0 11.0 16.0 10.0 0.0 0.0

2.png 0.0 0.0 0.0 4.0 15.0 12.0 ... 0.0 3.0 11.0 16.0 9.0 0.0

3.png 0.0 0.0 7.0 15.0 13.0 1.0 ... 7.0 13.0 13.0 9.0 0.0 0.0

4.png 0.0 0.0 0.0 1.0 11.0 0.0 ... 0.0 2.0 16.0 4.0 0.0 0.0

... ... ... ... ... ... ... ... ... ... ... ... ...

1792.png 0.0 0.0 4.0 10.0 13.0 6.0 ... 2.0 14.0 15.0 9.0 0.0 0.0

1793.png 0.0 0.0 6.0 16.0 13.0 11.0 ... 6.0 16.0 14.0 6.0 0.0 0.0

1794.png 0.0 0.0 1.0 11.0 15.0 1.0 ... 2.0 9.0 13.0 6.0 0.0 0.0

1795.png 0.0 0.0 2.0 10.0 7.0 0.0 ... 5.0 12.0 16.0 12.0 0.0 0.0

1796.png 0.0 0.0 10.0 14.0 8.0 1.0 ... 8.0 12.0 14.0 12.0 1.0 0.0

Or all in one run

results = cl.fit_transform(Xraw)

print(results['filenames'])

array(['0.png', '1.png', '2.png', ..., '1794.png', '1795.png', '1796.png'],

```

- Jupyter Notebook
Published by erdogant over 3 years ago

clustimage - v1.5.1

  • Fix for storing urls correctly

- Jupyter Notebook
Published by erdogant over 3 years ago

clustimage - v1.5.0

  • Adding original url paths in the results
  • bug fix in scatter that occurred in some cases when having low sample sizes
  • Code cleaning

- Jupyter Notebook
Published by erdogant over 3 years ago

clustimage - v1.4.10

  • fix in case clean_tempdir=True is used

- Jupyter Notebook
Published by erdogant over 3 years ago

clustimage - v1.4.9

  • catch error when files are deleted from temp directory and trying to make a plot

- Jupyter Notebook
Published by erdogant over 3 years ago

clustimage - v1.4.8

  • added functionality to remove temp directory using the function cl.clean_files(clean_tempdir=True)

- Jupyter Notebook
Published by erdogant over 3 years ago

clustimage - v1.4.7

  • Tempdirectory is set to system temp + "clustimage' to avoid the creation of many temp directories and better managing.

- Jupyter Notebook
Published by erdogant over 3 years ago

clustimage - v1.4.6

  • Add warning in case of large dim is used.

- Jupyter Notebook
Published by erdogant almost 4 years ago

clustimage - v1.4.5

  • Minor update of showing embedding text correctly in print statements and plots

- Jupyter Notebook
Published by erdogant almost 4 years ago

clustimage - v1.4.4

  • added functionality to import images from URL locations
  • Example can be found here

- Jupyter Notebook
Published by erdogant almost 4 years ago

clustimage - v1.4.3

  • Fix for scatterplot
  • More input arguments for scatterplot to make even more pretty plots. Examples can be found here.

- Jupyter Notebook
Published by erdogant almost 4 years ago

clustimage - v1.4.2

  • Fix for input argument in scatterd
  • Added input argument density to scatter(density=True) function

- Jupyter Notebook
Published by erdogant almost 4 years ago

clustimage - 1.4.1

  • UMAP can be used as embedding technique

Example:

``` from clustimage import Clustimage

Initialize

cl = Clustimage(embedding='umap') ```

- Jupyter Notebook
Published by erdogant almost 4 years ago

clustimage - 1.4.0

  • in case of clustering on hash, the image-hash is now directly used in the clustering instead of pre-computing the adjacency matrix.
  • Removal of complicated functionalities regarding hashes

- Jupyter Notebook
Published by erdogant about 4 years ago

clustimage - 1.3.15

  • Fix that pathnames and filenames is always return in a numpy array
  • Some code refactoring and cleaning

- Jupyter Notebook
Published by erdogant about 4 years ago

clustimage - 1.3.14

  • fix for colors when making plots
  • smaller bugs fixed
  • codestyling

- Jupyter Notebook
Published by erdogant about 4 years ago

clustimage - 1.3.13

  • Changed _check_diminto get_dim which now can more easily be used to determine the dimension of vector images
  • Other minor updates

- Jupyter Notebook
Published by erdogant about 4 years ago

clustimage - 1.3.12

  • fix for throwing error during the embedding part
  • fix in case of using hog features
  • fix in case of unique plotting

- Jupyter Notebook
Published by erdogant about 4 years ago

clustimage - 1.3.11

bugfix for unexpected keyword argument 'method'

- Jupyter Notebook
Published by erdogant about 4 years ago

clustimage - 1.3.10

  • Minor fix in case of using hog feature. Grayscale needs to be set on True.

- Jupyter Notebook
Published by erdogant about 4 years ago

clustimage - 1.3.9

  • added black listing for search through directories

- Jupyter Notebook
Published by erdogant about 4 years ago

clustimage - 1.3.8

  • Some bug fixes
  • Code refactoring

- Jupyter Notebook
Published by erdogant about 4 years ago

clustimage - 1.3.7

  • Code refactoring to break-up the fit_transform() into multiple smaller steps that can also be separately. Examle is shown in the readme.

- Jupyter Notebook
Published by erdogant about 4 years ago

clustimage - 1.3.6

  • Fixes for plotting in notebooks

- Jupyter Notebook
Published by erdogant about 4 years ago

clustimage - 1.3.5

  • fix for plotting in case of storetodisk is False

- Jupyter Notebook
Published by erdogant about 4 years ago

clustimage - 1.3.4

  • bug fix in case storetodisk is True

- Jupyter Notebook
Published by erdogant about 4 years ago

clustimage - 1.3.3

  • Bug fixes
  • Improved plots
  • added clustering on hashes
  • Docstrings udpates
  • Code refactored

- Jupyter Notebook
Published by erdogant about 4 years ago

clustimage - 1.3.2

  • added doi

- Jupyter Notebook
Published by erdogant about 4 years ago

clustimage - 1.3.1

  • removed data files from package

- Jupyter Notebook
Published by erdogant about 4 years ago

clustimage - 1.3.0

  • many many fixes

- Jupyter Notebook
Published by erdogant about 4 years ago

clustimage - 1.2.2

  • Fixes regarding saving and loading
  • Code refactoring
  • Docstrings updated

- Jupyter Notebook
Published by erdogant over 4 years ago

clustimage - 1.2.1

  • More code refactoring
  • More code conventions
  • Plots and scatterplots are improved

- Jupyter Notebook
Published by erdogant over 4 years ago

clustimage - 1.2.0

  • Various bug fixes
  • changing parameter conventions, method into evaluate
  • Added new function to extract unique images
  • code refactoring
  • docstring updated
  • new plots added

- Jupyter Notebook
Published by erdogant over 4 years ago

clustimage - 1.1.0

  • bug fixes
  • plot updates
  • Docstrings
  • Some code refactoring

- Jupyter Notebook
Published by erdogant over 4 years ago

clustimage - 1.0.0

  • First release!

- Jupyter Notebook
Published by erdogant over 4 years ago