Release Notes

New Features

Update the links for eHydro web services to the latest addresses.

- Python
Published by github-actions[bot] 9 months ago

Release Notes

Internal Changes

Use orjson instead of ujson due to the package not being maintained anymore. The developer of ujson raised conrcerns about security vulnerabilities and recommended using orjson instead.

- Python
Published by github-actions[bot] 12 months ago

Release Notes

Internal Changes

Update all dependencies on HyRiver libraries to the latest versions and modify the code to be compatible with the latest versions of the libraries.

- Python
Published by github-actions[bot] about 1 year ago

Release Notes

New Features

Update the links for NLDI and PyGeoAPI web services to the latest addresses.

Bug Fixes

Fix a bug in WFS.getfeature_bygeom where if the input geometry is in a geographic CRS, the function fails to transform it correctly to the web service\'s CRS.

Breaking Changes

Drop support for Python 3.8 since its end-of-life date is October 2024.
Remove all exceptions from the main module and raise them from the exceptions module. This is to declutter the main module and make it easier to maintain.

- Python
Published by github-actions[bot] over 1 year ago

Release Notes

New Features

Update the links for FEMA web services to the latest addresses.
When the CRS of a WMS cannot be parsed throw a more informative error regarding the service being down (122{.interpreted-text role="issue_hydro"}).

Internal Changes

Drop support for Python 3.8 since its end-of-life date is October 2024.

- Python
Published by github-actions[bot] over 1 year ago

Release Notes

Internal Changes

Make streaming_download more robust when encoutring request issues by returning None for those links that have failed to be processed, instead of throwing exceptions. So, for example, if only one link fails, the function will return a list of paths with None for the failed link.
In all requests by geometries, set the geometry precision to 6 decimal points to avoid issues with large decimal points.
Add the exceptions module to the high-level API to declutter the main module. In the future, all exceptions will be raised from this module and not from the main module. For now, the exceptions are raised from both modules for backward compatibility.

- Python
Published by github-actions[bot] over 1 year ago

Release Notes

Internal Changes

Make streaming_download more robust when encoutring request issues by returning None for those links that have failed to be processed, instead of throwing exceptions. So, for example, if only one link fails, the function will return a list of paths with None for the failed link.
In all requests by geometries, set the geometry precision to 6 decimal points to avoid issues with large decimal points.
Add the exceptions module to the high-level API to declutter the main module. In the future, all exceptions will be raised from this module and not from the main module. For now, the exceptions are raised from both modules for backward compatibility.

- Python
Published by github-actions[bot] almost 2 years ago

Release Notes

Internal Changes

Remove the deprecated AirMap URL.

- Python
Published by github-actions[bot] almost 2 years ago

Release Notes

Bug Fixes

pyproj uses its own env variables for SSL certification. This release fixes the issue with pyproj not being able to download the grid database when using DOI SSL certification file. This release uses pyproj.network.set_ca_bundle_path for setting the SSL certification file given by the user via HYRIVER_SSL_CERT env variable.
Fix an issue in WFS.getfeature_byid where the max_nrecords argument was not being used correctly, thus resulting in large requests to fail.

Internal Changes

For ServiceURL class, use dataclass instead for better performance and consistency.

- Python
Published by github-actions[bot] about 2 years ago

Release Notes

New Features

Add a new arg to WMS.getmap_bybox called tiff_dir for storing the responses from a WMS request as a GeoTIFF file on disk instead of keeping all responses in memory. When this arg is given the function return a list of paths to these files. This is useful for large requests where the response is too large to be kept in memory. You can create a VRT file from these files using pygeoutils.gtiff2vrt function.

- Python
Published by github-actions[bot] about 2 years ago

Release Notes

New Features

Added RESTfulURLs for FEMA\'s National Flood Hazard Layer (NFHL) service. Contributed by Fernando Aristizabal. (62{.interpreted-text role="pull_ogc"})
Now, RetrySession can be used as a context manager. This is useful for closing the session after using it. For example:

``` python from pygeoogc import RetrySession

with RetrySession() as session: r = session.get("https://httpbin.org/get").json() ```

Internal Changes

Improve the example in the docstring of traverse_json function.
Improve exception handling in the ArcGISRESTful class and return a more informative error message.

- Python
Published by github-actions[bot] over 2 years ago

Release Notes

New Features

Add the STN Flood Event Data URL to the list of RESTfuls. Contributed by Fernando Aristizabal.
Add the link for the eHydro\'s web service.

- Python
Published by github-actions[bot] over 2 years ago

Release Notes

From release 0.15 onward, all minor versions of HyRiver packages will be pinned. This ensures that previous minor versions of HyRiver packages cannot be installed with later minor releases. For example, if you have pygeoogc==0.14.x installed, you cannot install pygeoogc==0.15.x series. This is to ensure that the API is consistent across all minor versions.

New Features

For now, retain compatibility with shapely<2 while supporting shapley>=2.

Bug Fixes

Fix an issue in WFS where the getfeature_bygeom method fails if the requested web service does not have geometry_column attribute in its schema. This release addresses this issue by trying to find the name from other attributes in the schema. If it fails to find, it raises a ValueError.
Catch an edge case in match_crs function where the input is a list of coordinates of length 4.
Give precedence to non-default arguments for caching related arguments instead of directly getting them from env variables. This is to avoid the case where the user sets the env variables but then passes different arguments to the function. In this case, the function should use the passed arguments instead of the env variables.

Internal Changes

Remove pyyaml as a dependency since it is not used anymore.

- Python
Published by github-actions[bot] almost 3 years ago

pygeoogc - v0.14.0

Release Notes

Breaking Changes

Bump the minimum required version of shapely to 2.0, and use its new API.

Internal Changes

Sync all minor versions of HyRiver packages to 0.14.0.

- Python
Published by github-actions[bot] almost 3 years ago

pygeoogc - v0.13.12

Release Notes

New Features

Make match_crs less strict in terms of the input geometry type being tuple or list by relying on shapely and contextlib.suppress. So, now users can pass any combination of list or tuple as coordinates or bounding box.

Bug Fixes

In WFS when some layers have missing schema info, the class failed to initialize. This release fixes this issue by ignoring layers with missing schema info and asks the user to pass a sort parameter instead of trying to automatically find a sort parameter. This fix also improves the performance of this function by making fewer web requests.

Internal Changes

Fully migrate setup.cfg and setup.py to pyproject.toml.
Convert relative imports to absolute with absolufy-imports.
Sync all patch versions of HyRiver packages to x.x.12.

- Python
Published by github-actions[bot] about 3 years ago

pygeoogc - v0.13.10

Release Notes

Bug Fixes

Remove all Python 3.9 type-annotation-style in the codebase except for function signatures to ensure compatibility with Python 3.8. (:issueogc:[57]{.title-ref}, :pullogc:[58]{.title-ref}). Thanks to Tim Cera for reporting and fixing the issue.

Internal Changes

Use pyright for type checking instead of mypy since it is faster and more accurate. Also, fix all the type errors reported by pyright.
Improve code quality by addressing issues raised by DeepSource.

- Python
Published by github-actions[bot] about 3 years ago

pygeoogc - v0.13.9

Release Notes

Bug Fixes

Add the missing annotation import to the [cache_keys]{.title-ref} to ensure Python 3.8 and 3.9 work with Python 3.10 style type hinting.

- Python
Published by github-actions[bot] about 3 years ago

pygeoogc - v0.13.8

Release Notes

New Features

Add a new property to WFS class called schema that contains information about column names and their types for all layers. It also the geometry type and its name for each layer.
Automatically determine the geometry keyword that should be passed to WFS.getfeature_bygeom using the new schema property of WFS.
Add support for disabling SSL verification to RetrySession via ssl parameter.
Add support for streaming responses to RetrySession via stream parameter to get and post methods.
Add support for closing the session to RetrySession via close method.
Add support for passing params, data, and json to RetrySession via get and post methods. Previously, keyword payload was used for params in get and data in post. Now, params and data can also be passed as keyword arguments to these methods.
Add a new function called streaming_download for downloading large files in parallel and in chunks.

Bug Fixes

Fix an issue in WFS class where number of requested features exceeds the maximum number of features allowed by the server, but only a portion of the features are returned. This release addresses this issue by first getting only the number of features and then requesting the features in chunks of features IDs based on the maximum number of features allowed by the server.

Internal Changes

Drop support for WFS version 1.0.0 since it does not support paging.
Modify the codebase based on Refurb suggestions.

Bug Fixes

Fix the warning message in ArcGISRESTFul where wrong number of missing feature IDs were being reported.

- Python
Published by github-actions[bot] about 3 years ago

pygeoogc - v0.13.7

Release Notes

New Features

Add a new method to RetrySession for getting the request head called RetrySession.head. This is useful for getting the headers of a request without having to make a full request which is useful for getting the Content-Length header for example, i.e., download size.

Bug Fixes

Fix an issue in the decompose function, utils.bbox_decompose, where the generated bounding boxes might overlap in some cases. A new approach has been implemented based on finding the number of required bounding boxes from max allowable no. of pixels and total requested pixels without changing the input bounding box projection. This ensures that the decomposed bounding boxes are not overlapping so xarray.open_mfdataset can be used without any issues.

Internal Changes

In the utils.match_crs function, don\'t perform any projection if the source target CRS are the same.
Improve type hints for CRS-related arguments of all functions by including string, integer, and pyproj.CRS types.
Add a new class method to WMSBase and WFSBase classes called get_service_options for retrieving the available layers, output formats, and CRSs for a given service. Here\'s an example:
Use pyupgrade package to update the type hinting annotations to Python 3.10 style.

``` python from pygeoogc.core import WMSBase

url = "https://elevation.nationalmap.gov/arcgis/services/3DEPElevation/ImageServer/WMSServer" wms = WMSBase(url, validation=False) wms.getserviceoptions() print(wms.available_layer) ```

- Python
Published by github-actions[bot] over 3 years ago

pygeoogc - v0.13.6

Release Notes

Internal Changes

Add the missing PyPi classifiers for the supported Python versions.

- Python
Published by github-actions[bot] over 3 years ago

pygeoogc - v0.13.5

Release Notes

Breaking Changes

Append \"Error\" to all exception classes for conforming to PEP-8 naming conventions.

Internal Changes

Bump minimum version of owslib to 0.27.2 since the pyproj incompatibility issue has been addressed in this issue.
Bump minimum version of requests-cache to 0.9.6 since the attrs version issue has been addressed.

- Python
Published by github-actions[bot] over 3 years ago

pygeoogc - v0.13.3

Release Notes

New Features

Add support for disabling persistent caching in RetrySession via an argument and also HYRIVER_CACHE_DISABLE environmental variable.

- Python
Published by github-actions[bot] over 3 years ago

pygeoogc - v0.13.2

Release Notes

Breaking Changes

Set the minimum supported version of Python to 3.8 since many of the dependencies such as xarray, pandas, rioxarray have dropped support for Python 3.7.
Pin owslib to version <0.26 since version 0.26 has pinned pyproj to version <3.3 which is not compatible with rasterio on macOS.

Internal Changes

Use micromamba for running tests and use nox for linting in CI.

- Python
Published by github-actions[bot] over 3 years ago

pygeoogc - v0.13.1

Release Notes

New Features

More robust handling of errors in ArcGISRESTful by catching None responses. Also, use the POST method for ArcGISRESTful.bysql since the SQL Clause could be a long string.

- Python
Published by github-actions[bot] over 3 years ago

pygeoogc - v0.13.0

Release Notes

Breaking Changes

Remove caching-related arguments from all functions since now they can be set globally via three environmental variables:
- HYRIVER_CACHE_NAME: Path to the caching SQLite database.
- HYRIVER_CACHE_EXPIRE: Expiration time for cached requests in seconds.
- HYRIVER_CACHE_DISABLE: Disable reading/writing from/to the cache file.
You can do this like so:

``` python import os

os.environ["HYRIVERCACHENAME"] = "path/to/file.sqlite" os.environ["HYRIVERCACHEEXPIRE"] = "3600" os.environ["HYRIVERCACHEDISABLE"] = "true" ```

Bug Fixes

In ArcGISRESTful.oids_byfield convert the input ids to a list if a user passes a single id.

Internal Changes

Refactor ServicURL to hard code the supported links instead of reading them from a file. Also, the class now is based on NamedTuple that has a nicer __repr__.

- Python
Published by github-actions[bot] almost 4 years ago

pygeoogc - v0.12.2

Release Notes

New Features

Make validate_crs public that can be accessed from the utils module. This is useful for checking validity of user input CRS values and getting its string representation.
Add pygeoogc.utils.valid_wms_crs function for getting a list of valid CRS values from a WMS service.
Add 3DEP\'s index WFS service for querying availability of 3DEP data within a bounding box.

Internal Changes

Add type checking with typeguard and fixed typing issues raised by typeguard.
Refactor show_versions to ensure getting correct versions of all dependencies.

- Python
Published by github-actions[bot] about 4 years ago

pygeoogc - v0.12.1

Release Notes

Internal Changes

Use the three new ar.retrieve_* functions instead of the old ar.retrieve function to improve type hinting and to make the API more consistent.

- Python
Published by github-actions[bot] about 4 years ago

pygeoogc - v0.12.0

Release Notes

New Features

Add a new argument to ArcGISRESTful called verbose to turn on/off all info level logs.
Add an option to ArcGISRESTful.get_features called get_geometry to turn on/off requesting the data with or without geometry.
Now, ArcGISRESTful saves the object IDs of the features that user requested but are not available in the database to ./cache/failed_request_ids.txt.
Add a new parameter to ArcGISRESTful called disable_retry that If True in case there are any failed queries, no retrying attempts is done and object IDs of the failed requests are saved to a text file which its path can be accessed via ArcGISRESTful.client.failed_path.
Set response caching expiration time to never expire, for all base classes. A new argument has been added to all three base classes called expire_after that can be used to set the expiration time.
Add a new method to all three base classes called clear_cache that clears all cached responses for that specific client.

Breaking Changes

All oids_by* methods of ArcGISRESTful class now return a list of object IDs rather than setting self.featureids. This makes it possible to pass the outputs of the oids_by* functions directly to the get_features method.

Internal Changes

Make ArcGISRESTful less cluttered by instantiating ArcGISRESTfulBase in the init method of ArcGISRESTful rather than inheriting from its base class.
Explicitly set a minimum value of 1 for the maximum number of feature IDs per request in ArcGISRESTful, i.e., self.max_nrecords.
Add all the missing types so mypy --strict passes.

- Python
Published by github-actions[bot] about 4 years ago

pygeoogc - v0.11.7

Release Notes

Breaking Changes

Remove the onlyipv4 method from RetrySession since it can be easily be achieved using with unittest.mock.patch("socket.has_ipv6", False):.

Internal Changes

Use the geoms method for iterating over geometries to address the deprecation warning of shapely.
Use importlib-metadata for getting the version insead of pkg_resources to decrease import time as discussed in this issue.
Remove unnecessary dependency on simplejson and use ujson instead.

- Python
Published by github-actions[bot] over 4 years ago

pygeoogc - v0.11.6

Release Notes

Breaking Changes

Remove the onlyipv4 method from RetrySession since it can be easily be achieved using with unittest.mock.patch("socket.has_ipv6", False):.

Internal Changes

Use the geoms method for iterating over geometries to address the deprecation warning of shapely.
Use importlib-metadata for getting the version insead of pkg_resources to decrease import time as discussed in this issue.

- Python
Published by github-actions[bot] over 4 years ago

pygeoogc - v0.11.5

Release Notes

Bug Fixes

Update the code to use the latest requsts-cache API.

- Python
Published by github-actions[bot] over 4 years ago

pygeoogc - v0.11.4

Release Notes

New Features

Add URL for PyGeoAPI service.

- Python
Published by github-actions[bot] over 4 years ago

pygeoogc - v0.11.3

Release Notes

Internal Changes

Fix a bug in WFS.getfeature_byid when the number of IDs exceeds the service\'s limit by splitting large requests into multiple smaller requests.
Add two new arguments, max_nrecords and read_method, to WFS to control the maximum number of records per request (defaults to 1000) and specify the response read method (defaults to json), respectively.

- Python
Published by github-actions[bot] over 4 years ago

pygeoogc - v0.11.2

Release Notes

Internal Changes

Simplify the retry logic ArcGISRESTFul by making it run four times and making sure that the last retry is one object id per request.

- Python
Published by github-actions[bot] over 4 years ago

pygeoogc - v0.11.1

Release Notes

The highlight of this release is migrating to use AsyncRetriever that can improve the network response time significantly. Another highlight is a major refactoring of ArcGISRESTFul that improves performance and reduce code complexity.

New Features

Add a new method to ArcGISRESTFul class for automatically retrying the failed requests. This private method plucks out individual features that were in a failed request with several features. This happens when there are some object IDs that are not available on the server, and they are included in the request. In these situations the request will fail, although there are valid object IDs in the request. This method will pluck out the valid object IDs.
Add support for passing additional parameters to WMS requests such as styles.
Add support for WFS version 1.0.0.

Internal Changes

Migrate to AsyncRetriever from requests-cache for all the web services.
Rename ServiceError to ServiceUnavailable and ServerError to ServiceError Since it\'s more representative of the intended exception.
Raise for response status in RetrySession before the try-except block so RequestsException can raised and its error messaged be parsed.
Deprecate utils.threading since all threading operations are now handled by AsyncRetriever.
Increase test coverage.

- Python
Published by github-actions[bot] over 4 years ago

pygeoogc - v0.11.0

Release Notes

New Features

Add support for requesting LineString polygon for ArcGISRESTful.
Add a new argument called distance to ArcGISRESTful.oids_bygeom for specifying the buffer distance from the input geometry for getting features.

Breaking Changes

Drop support for Python 3.6 since many of the dependencies such as xarray and pandas have done so.
Remove async_requests function, since it has been packaged as a new Python library called AsyncRetriever.
Refactor MatchCRS. Now, it should be instantiated by providing the in and out CRSs like so: MatchCRS(in_crs, out_crs). Then its methods, namely, geometry, bounds and coords, can be called. These methods now have only one input, geometry.
Change input and output types of MatchCRS.coords from tuple of lists of coordinates to list of (x, y) coordinates.
ArcGISRESTful now has a new argument, layer, for specifying the layer number (int). Now, the target layer should either be a part of base_url or be passed with layer argument.
Move the spatial_relation argument from ArcGISRESTful class to oids_bygeom method, since that\'s where it\'s applicable.

Internal Changes

Refactor ArcGISRESTfulBase class to reduce its code complexity and make the service initialization logic much simpler. The class is faster since it makes less requests during the initialization process.
Add pydantic as a new dependency that takes care of ArcGISRESTfulBase validation.
Use persistent caching for all send/receive requests that can significantly improve the network response time.
Explicitly include all the hard dependencies in setup.cfg.
Set a default value of 1000 for max_nrecords in ArcGISRESTfulBase.
Use dataclass for WMSBase and WFSBase since support for Python 3.6 is dropped.

- Python
Published by github-actions[bot] over 4 years ago

pygeoogc - v0.10.1

Release Notes -------------\n

Add annoucement regarding the new name for the softwate stack, HyRiver.
Improve pip installation and release workflow.

- Python
Published by github-actions[bot] almost 5 years ago

pygeoogc - Release v0.10.0

Please check HISTORY.rst file for a detailed list of changes.

- Python
Published by github-actions[bot] almost 5 years ago

pygeoogc - Release v0.9.0

Please check HISTORY.rst file for a detailed list of changes.

- Python
Published by github-actions[bot] about 5 years ago

pygeoogc - Release v0.2.2

Please check HISTORY.rst file for a detailed list of changes.

- Python
Published by github-actions[bot] about 5 years ago

pygeoogc - Release v0.2.1

Please check HISTORY.rst file for a detailed list of changes.

- Python
Published by github-actions[bot] about 5 years ago

pygeoogc - Release v0.2.0

Please check the HISTORY.rst file for a detailed list of changes.

- Python
Published by github-actions[bot] about 5 years ago