nost-tools - NOS-T Tools v3.0.2

Updated: - Removed self._next_time = self._time from resume() in simulator.py, which was causing a drift of approximately 1 second per simulated day. - Changed a log statement in freeze() within manager.py from log.info to log.debug to reduce verbosity. The affected line reports the remaining time during a freeze.

Full Changelog: https://github.com/code-lab-org/nost-tools/compare/v3.0.1...v3.0.2

- Python
Published by emmanuelgonz 6 months ago

nost-tools - NOS-T Tools v3.0.1

Updated: - Removed the calculation of target_resume_time from the freeze() method in manager.py. A freeze event now persists until the resume time specified in the FreezeCommand message payload is reached. Previously, the resume time was calculated from the scenario time at which the FreezeRequest message was received by the manager (scenario time at message receipt + freeze duration), which could cause time drift. - Prevented a one-step early advance after RESUMING by ensuring the _wait_for_tock() method in simulator.py re-anchors epochs and waits until the next tick before advancing. - Updated the on_manager_freeze() method in managed_application.py to honor simFreezeTime from a FreezeCommand, aligning to the requested scenario time (via wallclock mapping) before calling pause() so all apps freeze at the same scenario time.

Full Changelog: https://github.com/code-lab-org/nost-tools/compare/v3.0.0...v3.0.1

- Python
Published by emmanuelgonz 6 months ago

nost-tools - NOS-T Tools v3.0.0

Added: - Added comprehensive freeze time tracking system and callbacks in Manager class in manager.py to properly account for dynamic, distributed freezes, resumes, and updates to scenario time: - Added on_freeze_request() callback which freezes scenario time based on messages containing requests from managed applications, integrated this callback into start_up() method - Added _handle_freeze_request() that handles dynamic, distributed freeze requests - Added freeze() that issues freeze command, integrated this into the _handle_freeze_request() - Added on_resume_request() callback which resumes scenario time based on messages containing requests from managed applications, integrated this callback into start_up() method - Added on_update_request() callback which updates the time scale factor based on messages containing requests from managed applications, integrated this callback into start_up() method - Added update() that issues update command, integrated this into the on_update_request() method - Added new methods to ManagedApplication class in managed_application.py to allow requests for a freeze in scenario time from the Manager class in manager.py - Added request_freeze() method that sends a FreezeRequest message which is received by the Manager application, added an associated on_manager_freeze() callback that responds to FreezeCommand messages from Manger - Added request_resume() method that sends a ResumeRequest message which is received by the Manager application, added an associated on_manager_resume() callback that responds to ResumeCommand messages from Manager - Added request_update() method that sends a UpdateRequest message which is received by the Manager application, added an associated on_manager_update() callback that responds to UpdateCommand messages from Manager - Added new freeze-tracking capabilities to Simulator class in simulator.py - Added reset of wallclock and simulation epochs when mode switches to Mode.EXECUTING in _wait_for_tock() method - Added the following classes to schemas.py: - FreezeTaskingParameters, FreezeCommand, ResumeTaskingParameters, ResumeCommand, FreezeRequestParameters, FreezeRequest, ResumeRequestParameters, ResumeRequest, UpdateRequestParameters, UpdateRequest

Updated: - Removed code related to scheduled time scale updates in _execute_test_plan_impl() of Manager application. Scheduled time scale factor updates, defined in the YAML configuration file, are no longer supported. They must now be requested by a ManagedApplication and processed by the Manager who maintains control of sending the FreezeCommand as defined in schemas.py - Removed TimeScaleUpdate class in manager.py - Removed TimeScaleUpdateSchema and FreezeSchema classes in schemas.py - Removed time_scale_updates and freezes fields from ManagerConfig class in schemas.py - Prevent re-entrant execution in Simulator.execute() by adding an explicit mode guard; now raises a clear RuntimeError when called outside UNDEFINED, INITIALIZED, or TERMINATED modes: Cannot execute: simulator is {self._mode}. Wait for TERMINATED or terminate the current run. - Removed WallclockOffsetProperties class and wallclock_offset_properties section from RuntimeConfig in schemas.py and configuration.py. - Added wallclock_offset_refresh_interval and ntp_host to GeneralConfig class in schemas.py - Updated FireSat test suite to show examples of time scale updates and scenario time freezes.

Full Changelog: https://github.com/code-lab-org/nost-tools/compare/v2.4.0...v3.0.0

- Python
Published by emmanuelgonz 6 months ago

nost-tools - NOS-T Tools v2.4.0

Added: - Introduced the configure_file_logging() method in the base Application class, automatically invoked during the start_up() process. - Added a LoggingConfig Pydantic model to encapsulate configuration parameters for the configure_file_logging() method.

Updated: - Changed the default value of token_refresh_interval in the KeycloakConfig Pydantic class from 60 seconds (1 minute) to 240 seconds (4 minutes).

Full Changelog: https://github.com/code-lab-org/nost-tools/compare/v2.3.0...v2.4.0

- Python
Published by emmanuelgonz 8 months ago

nost-tools - NOS-T Tools v2.3.0

Added: - Introduced a boolean setup_signal_handlers (default=True) parameter for Application() class, which makes self._setup_signal_handlers() conditional. This prevents errors in nost-manager-backend. - Added setup_signal_handlers argument (default=True) to __init__ of Manager and ManagedApplication classes. - Added yaml_file section to RuntimeConfig in both schemas.py and configuration.py. This attribute holds the path to YAML configuration file if provided; otherwise, it defaults to None. - Introduced _get_parameters_from_config() in Application, Manager, and ManagedApplication to facilitate getting the application parameters from the YAML configuration or user-provided arguments based on self.config.rc.yaml_file being None or not. - Added keycloak_authentication argument to __init__() of ConnectionConfig class (default=False). - Implemented start_wallclock_refresh_thread() which periodically updates the wallclock offset. - Added WallclockOffsetProperties to schemas.py that contains wallclock_offset_refresh_interval and ntp_host fields used in start_wallclock_refresh_thread() - Implemented is_scenario_time_step in ManagerConfig class, similar to that of ManagedApplicationConfig

Updated: - Made general section of ExecConfig optional in schemas.pyfor situations where YAML configuration file is not provided. - Made client_id and client_secret_key in Credentials default to None. - Changed parameters.time_scale_updates reference to self.time_scale_updates in manager.py. - Updated code in start_up() related to the definition of parameters to use _get_parameters_from_config() subclasses to customize parameter retrieval in: - Application class of application.py - Manager class of manager.py - ManagedApplication class of managed_application.py - Updated self.simulator.set_end_time(sim_stop_time) from stop() in manager.py to run only if self.simulator.get_mode() == Mode.EXECUTING - Removed time_step and manager_app_name arguments from start_up() in Manager class - Modified set_wallclock_offset() in simulator.py to allow setting wallclock offset when in Mode.EXECUTING - Update default value of time_status_init to datetime.now() in ApplicationConfig class

Full Changelog: https://github.com/code-lab-org/nost-tools/compare/v2.2.0...v2.3.0

- Python
Published by emmanuelgonz 9 months ago

nost-tools - NOS-T Tools v2.2.0

Added: - Introduced TimeScaleUpdateSchema in schemas.py, which allows users to define time scale updates in the YAML configuration file at execution.manager.time_scale_updates, each update can be defined by time_scale_factor and sim_update_time. For example: yaml time_scale_updates: - time_scale_factor: 120.0 sim_update_time: "2020-01-01T08:20:00+00:00"

NOTE: An example is provided in FireSat+ YAML configuration file. - Introduced get_app_specific_config() in configuration.py that retrieves application-specific configuration from the execution.managed_applications section based on the application name. - Added application_configuration to config.rc (runtime configuration) at configuration.py, which contains user-provided, application-specific configurations. These application-specific configurations can be defined for each application within the YAML configuration file at the field execution.managed_applications.<application name>.configuration_parameters. This replaces config.py for each application in the NOS-T Tools examples.

Changed: - Moved self.establish_exchange() from self._execute_test_plan_impl() to self.start_up() to prevent execution from starting before RabbitMQ exchanges have been declared and resulting in an error. - Removed conditional check for self.app.channel.is_open and self.app.connection.is_open in application_utils.py before sending status messages; now assumes connection is always valid or managed externally. - Refactored the FireSat+, Downlink, Scalability, and scienceDash test suites to: - Use a unified YAML configuration file per example - Define application-specific settings under the execution.managed_applications.<application name>.configuration_parameters field instead of the previous config.py - Improve general code structure for enhanced efficiency, readability, and user experience - Updated documentation for the FireSat+, Downlink, Scalability, and scienceDash test suites.

Full Changelog: https://github.com/code-lab-org/nost-tools/compare/v2.1.1...v2.2.0

- Python
Published by emmanuelgonz 9 months ago

nost-tools - NOS-T Tools v2.1.1

Added - Introduces a new boolean flags to explicitly define the time domain for time_step and time_status_step. These flags will determine whether the associated values are interpreted in scenario time (unscaled) or wall clock time (scaled by the time scale factor).

Full Changelog: https://github.com/code-lab-org/nost-tools/compare/v2.1.0...v2.1.1

- Python
Published by emmanuelgonz 9 months ago

nost-tools - NOS-T Tools v2.1.0

Added:

Added frame_max and blocked_connection_timeout to YAML for use in pika.connection.ConnectionParameters within Application class
Added content_type, content_encoding, headers, priority, correlation_id, reply_to, message_expiration, message_id, timestamp, type, user_id, app_id, and cluster_id to YAML for use in pika.spec.BasicProperties within Application class
Refresh Keycloak access token before attempting reconnection in reconnect() method, as the token may have expired during connection drop
Added servers.rabbitmq.queue_max_size to YAML, establishing the maximum number of messages that can be queued in self._message_queue during connection drop
Introduced a new private method _setup_signal_handlers() in the Application class to handle system signals (SIGINT and SIGTERM), ensuing the application can shut down gracefully when interrupted (e.g., via CTRL+C or termination signals)
Introduced a new private method _cleanup_resources() that cleans up resources used by joblib and Python's multiprocessing module during execution of shut_down()
New callback observer classes for flexible event handling:
- PropertyChangeCallback: Triggers a custom callback function when a specific property changes
- ScenarioTimeIntervalCallback: Executes a callback at fixed intervals in simulation time
- WallclockTimeIntervalCallback: Executes a callback at fixed intervals in real-world time, independent of simulation speed

Changed:

Modified delete_all_queues_and_exchanges() method to check if connection is open before attempting to clean up
Modified on_connection_closed() method attempt to clean up
Modified tick() method to only perform time calculation if the entity has been initizlied
Removed exchange and queue declaration by yamless_declare_bind_queue() in send_message() method
Modified on_channel_closed and on_connection_closed methods to delete queues only when the connection or channel is intentionally closed. If the connection drops unexpectedly due to network issues, queues are retained. This ensures that the connection can be re-established without needing to redeclare and rebind queues.
Queues are now declared with auto_delete=False and durable=True. This configuration ensures that queues are not deleted during unexpected network issues, but only when intentionally closed, such as at the end of a simulation.
Exchanges are now declared with auto_delete=True and durable=True. This configuration ensures that exchanges are deleted only when no more queues are bound to it, such as the end of a simulation run.
Messages that fail to send due to a connection drop are added to the self._message_queue dictionary in the send_message method. After reconnection by the reconnect method, these queued messages are later dispatched asynchronously via the _process_message_queue method, which is scheduled using self.connection.ioloop.call_later.
Updated SSL context for TLS configuration to that of Amazon MQ for RabbitMQ in start_up method
Updated add_message_callback method to create a _saved_callbacks list to store all registered callbacks. Each entry is a tuple of (app_name, app_topic, user_callback)
Updated on_channel_open to check for and restore saved callbacks in _saved_callbacks, each saved callback is re-registered by calling the add_message_callback method
Updated reconnect to reset _callbacks_per_topic dictionary to prevent duplicate callbacks when restoring after reconnection

Full Changelog: https://github.com/code-lab-org/nost-tools/compare/v2.0.5...v2.1.0

- Python
Published by emmanuelgonz 9 months ago

nost-tools - NOS-T Tools v2.0.5

Added

Implemented a heartbeat-safe sleep mechanism called _sleep_with_heartbeat() in the Manager class by @emmanuelgonz in https://github.com/code-lab-org/nost-tools/pull/88

Changed

Modified _execute_test_plan_impl() to use the new heartbeat-safe sleep method for all long-duration sleeps in the Manager class by @emmanuelgonz in https://github.com/code-lab-org/nost-tools/pull/88
Update authors, version, and release date in CITATION.cff by @emmanuelgonz in https://github.com/code-lab-org/nost-tools/pull/89

Full Changelog: https://github.com/code-lab-org/nost-tools/compare/v2.0.4...v2.0.5

- Python
Published by emmanuelgonz 10 months ago

nost-tools - NOS-T Tools v2.0.4

Changed

Refactored manager.py so that execute_test_plan runs in a background thread by @emmanuelgonz in https://github.com/code-lab-org/nost-tools/pull/86

Full Changelog: https://github.com/code-lab-org/nost-tools/compare/v2.0.3...v2.0.4

- Python
Published by emmanuelgonz 10 months ago

nost-tools - NOS-T Tools v2.0.3

Added:

GitHub Action for PyPi publishing

Changed:

Updated PyDantic model to allow for multiple managed applications to be configured using a dictionary for execution.managed_applications.<app name>. If a field is not provided, default values specified in ManagedApplicationConfig are used for all applications.
Updated the start_up() method to filter the necessary fields within the dictionary. Ensure that only the execution parameters for the specific application (e.g., "planner") are pulled and applied for each application separately.

Full Changelog: https://github.com/code-lab-org/nost-tools/compare/v2.0.2...v2.0.3

- Python
Published by emmanuelgonz 10 months ago

nost-tools - NOS-T Tools v2.0.2

Added:

Added optional reconnect_delay YAML field in the servers.rabbitmq section, with default value of 10 seconds (#70)
Used model_validator to check servers.rabbitmq.keycloak_authentication. If servers.rabbitmq.keycloak_authentication is True and servers.keycloak is None, raise a ValueError (#72)

Changed:

Updated on_close_callback of pika.SelectConnection to react to connection failure events. The callback attempts to recover the connection (#70)
Made servers.keycloak YAML field optional. When running NOS-T Tools on localhost, servers.keycloak is not necessary, so it is now optional (#72)
Fixed scaling of time_status_step in ManagerConfig, and time_step and time_status_step in ManagedApplicationConfig. The code now correctly parses hours, minutes, and seconds from the string format "HH:MM:SS" and calculates the total seconds accordingly. Total seconds are then correctly scaled by the time_scale_factor (#74)

- Python
Published by emmanuelgonz 11 months ago

nost-tools - NOS-T Tools v2.0.1

Added: - Added socket_timeout, stack_timeout, and locale fields of pika.connection.ConnectionParameters to YAML (#66)

Changed: - Made manager, managed_application, and logger_application YAML fields optional (#64) - Updated defaults values for pika.connection.ConnectionParameters and pika.spec.BasicProperties to mirror those of Pika if not set in YAML file (#66) - Updated SSL configuration to use ssl.create_default_context() (#66)

Full Changelog: https://github.com/code-lab-org/nost-tools/compare/v2.0.0...v2.0.1

- Python
Published by emmanuelgonz 11 months ago

nost-tools - NOS-T Tools v2.0.0

Major release enhancing messaging persistence and reliability, integrating identity and authentication management, and consolidating configurations and parameters.

What's Changed

Added:

Integrates Keycloak for enhanced identity and authentication management (IAM) of protected resources.
Consolidates execution configurations and parameters into a single YAML file for streamlined setup and management.

Changed:

Replaces the Paho-MQTT library with the Pika-AMQP library for improved messaging persistence and reliability.
Updates the documentation to reflect the new changes and features introduced in this major version update.

- Python
Published by emmanuelgonz 11 months ago

nost-tools - NOS-T Tools v1.1.5

Very delayed release of minor updates, mostly oriented around documentation.

What's Changed

Added Solace client authorization guide by @bchell in https://github.com/code-lab-org/nost-tools/pull/42
Additions to 1.1.5 Release by @mlevine324 in https://github.com/code-lab-org/nost-tools/pull/43
Added documentation for scenario time management by @bchell in https://github.com/code-lab-org/nost-tools/pull/40
Added ground station template by @bchell in https://github.com/code-lab-org/nost-tools/pull/41
New application templates and updates to documentation by @bchell in https://github.com/code-lab-org/nost-tools/pull/44
Update documentation by @bchell in https://github.com/code-lab-org/nost-tools/pull/49
Updates to broker's guide and NOS-T Tools API by @mlevine324 in https://github.com/code-lab-org/nost-tools/pull/54
Updated documentation by @bchell in https://github.com/code-lab-org/nost-tools/pull/59
Minor updates in preparation of 1.1.5 Release by @ptgrogan in https://github.com/code-lab-org/nost-tools/pull/60

Full Changelog: https://github.com/code-lab-org/nost-tools/compare/v1.1.4...v1.1.5

- Python
Published by ptgrogan over 1 year ago

nost-tools - NOS-T Tools v1.1.4

April 2023 release containing:

Improved documentation
More flexible dependencies for easier conflict resolution
New extras installation option for examples

- Python
Published by ptgrogan almost 3 years ago

nost-tools - NOS-T Tools v1.1.3

March 2023 Release of NOS-T Tools

- Python
Published by ptgrogan almost 3 years ago

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Open Source Science

Recent Releases of nost-tools

nost-tools - NOS-T Tools v3.0.2

nost-tools - NOS-T Tools v3.0.1

nost-tools - NOS-T Tools v3.0.0

nost-tools - NOS-T Tools v2.4.0

nost-tools - NOS-T Tools v2.3.0

nost-tools - NOS-T Tools v2.2.0

nost-tools - NOS-T Tools v2.1.1

nost-tools - NOS-T Tools v2.1.0

Added:

Changed:

nost-tools - NOS-T Tools v2.0.5

Added

Changed

nost-tools - NOS-T Tools v2.0.4

Changed

nost-tools - NOS-T Tools v2.0.3

Added:

Changed:

nost-tools - NOS-T Tools v2.0.2

Added:

Changed:

nost-tools - NOS-T Tools v2.0.1

nost-tools - NOS-T Tools v2.0.0

What's Changed

Added:

Changed:

nost-tools - NOS-T Tools v1.1.5

What's Changed

nost-tools - NOS-T Tools v1.1.4

nost-tools - NOS-T Tools v1.1.3