xenon - This is release 3.1.0 of Xenon.

What problem does Xenon solve?

Many applications use remote storage and compute resources. To do so, they need to include code to interact with the scheduling systems and file transfer protocols used on those remote machines.

Unfortunately, many different scheduler systems and file transfer protocols exist, often with completely different programming interfaces. This makes it hard for applications to switch to a different system or support multiple remote systems simultaneously.

Xenon solves this problem by providing a single programming interface to many different types of remote resources, allowing applications to switch without changing a single line of code.

Notable changes compared to v3.0.4:

• improved error state returned by getJobStatusses to show the difference between no job and connection loss.
• added support for slurm 19
• added heartbeat in the SSH adaptor quickly detect lost connections.
• moved to version 2.4.0 of SSHD

- Java
Published by jmaassen about 6 years ago

xenon - This is release 3.0.4 of Xenon.

What problem does Xenon solve?

Many applications use remote storage and compute resources. To do so, they need to include code to interact with the scheduling systems and file transfer protocols used on those remote machines.

Unfortunately, many different scheduler systems and file transfer protocols exist, often with completely different programming interfaces. This makes it hard for applications to switch to a different system or support multiple remote systems simultaneously.

Xenon solves this problem by providing a single programming interface to many different types of remote resources, allowing applications to switch without changing a single line of code.

Notable changes compared to v3.0.3:

• fixed bug in FTP adaptor when listing the root directory
• fixed bug in SFTP adaptor when listing the root directory

- Java
Published by jmaassen almost 7 years ago

xenon - This is release 3.0.3 of Xenon.

What problem does Xenon solve?

Many applications use remote storage and compute resources. To do so, they need to include code to interact with the scheduling systems and file transfer protocols used on those remote machines.

Unfortunately, many different scheduler systems and file transfer protocols exist, often with completely different programming interfaces. This makes it hard for applications to switch to a different system or support multiple remote systems simultaneously.

Xenon solves this problem by providing a single programming interface to many different types of remote resources, allowing applications to switch without changing a single line of code.

Notable changes compared to v3.0.2:

• fixed the FTP adaptor which lost bytes due to being in ASCII mode
• fixed the numbering in this changelog

- Java
Published by jmaassen almost 7 years ago

xenon - This is release 3.0.2 of Xenon.

What problem does Xenon solve?

Many applications use remote storage and compute resources. To do so, they need to include code to interact with the scheduling systems and file transfer protocols used on those remote machines.

Unfortunately, many different scheduler systems and file transfer protocols exist, often with completely different programming interfaces. This makes it hard for applications to switch to a different system or support multiple remote systems simultaneously.

Xenon solves this problem by providing a single programming interface to many different types of remote resources, allowing applications to switch without changing a single line of code.

Notable changes compared to v3.0.1:

• updated jaxb dependencies to prevent illegal access warning from JVM
• removed leftover debug print in webdav

- Java
Published by jmaassen almost 7 years ago

xenon - This is release 3.0.1 of Xenon.

What problem does Xenon solve?

Many applications use remote storage and compute resources. To do so, they need to include code to interact with the scheduling systems and file transfer protocols used on those remote machines.

Unfortunately, many different scheduler systems and file transfer protocols exist, often with completely different programming interfaces. This makes it hard for applications to switch to a different system or support multiple remote systems simultaneously.

Xenon solves this problem by providing a single programming interface to many different types of remote resources, allowing applications to switch without changing a single line of code.

Notable changes compared to v3.0.0:

• fixed minute delay on shutdown when SSH adaptor was used (discussed as part of #654).

- Java
Published by jmaassen almost 7 years ago

xenon - This is release 3.0.0 of Xenon.

What problem does Xenon solve?

Many applications use remote storage and compute resources. To do so, they need to include code to interact with the scheduling systems and file transfer protocols used on those remote machines.

Unfortunately, many different scheduler systems and file transfer protocols exist, often with completely different programming interfaces. This makes it hard for applications to switch to a different system or support multiple remote systems simultaneously.

Xenon solves this problem by providing a single programming interface to many different types of remote resources, allowing applications to switch without changing a single line of code.

Notable changes compared to v2.6.2:

• Moved adaptors with large dependencies (such as S3 and HDFS) into separate libraries, resulting in a much smaller "core" distribution.
• Changed JobDescription to a tasks+cores model, instead of nodes+processes+thread (#625).
  
• Remove the JOB_OPTIONS hack from JobDescription (#629 and #628)
• Added support for memory requirements and job name in JobDescription (#562 and #609)
• Added an adaptor for the at scheduler (#381)
• Dropped offline support (#649)
• Require Java 11 or greater (#647)
• Many smaller bugfixes and updates of dependencies.

- Java
Published by jmaassen about 7 years ago

xenon - This is release 2.6.2 of Xenon.

What problem does Xenon solve?

Many applications use remote storage and compute resources. To do so, they need to include code to interact with the scheduling systems and file transfer protocols used on those remote machines.

Unfortunately, many different scheduler systems and file transfer protocols exist, often with completely different programming interfaces. This makes it hard for applications to switch to a different system or support multiple remote systems simultaneously.

Xenon solves this problem by providing a single programming interface to many different types of remote resources, allowing applications to switch without changing a single line of code.

Notable changes compared to v2.6.1:

• added support for temp space in JobDescription.
• added support stdout, stderr and stdin to Torque.
• fixed several unit tests that failed on OSX

- Java
Published by jmaassen about 8 years ago

xenon - This is release 2.6.1 of Xenon.

What problem does Xenon solve?

Many applications use remote storage and compute resources. To do so, they need to include code to interact with the scheduling systems and file transfer protocols used on those remote machines.

Unfortunately, many different scheduler systems and file transfer protocols exist, often with completely different programming interfaces. This makes it hard for applications to switch to a different system or support multiple remote systems simultaneously.

Xenon solves this problem by providing a single programming interface to many different types of remote resources, allowing applications to switch without changing a single line of code.

Notable changes compared to v2.6.0:

• fixed hashCode and equals of JobDescription

- Java
Published by jmaassen about 8 years ago

xenon - This is release 2.6.0 of Xenon.

What problem does Xenon solve?

Many applications use remote storage and compute resources. To do so, they need to include code to interact with the scheduling systems and file transfer protocols used on those remote machines.

Unfortunately, many different scheduler systems and file transfer protocols exist, often with completely different programming interfaces. This makes it hard for applications to switch to a different system or support multiple remote systems simultaneously.

Xenon solves this problem by providing a single programming interface to many different types of remote resources, allowing applications to switch without changing a single line of code.

Notable changes compared to v2.5.0:

• added support for scheduler specific arguments to JobDescription
• fixed specification of runtime limit in gridengine adaptor

- Java
Published by jmaassen over 8 years ago

xenon - This is release 2.5.0 of Xenon.

What problem does Xenon solve?

Many applications use remote storage and compute resources. To do so, they need to include code to interact with the scheduling systems and file transfer protocols used on those remote machines.

Unfortunately, many different scheduler systems and file transfer protocols exist, often with completely different programming interfaces. This makes it hard for applications to switch to a different system or support multiple remote systems simultaneously.

Xenon solves this problem by providing a single programming interface to many different types of remote resources, allowing applications to switch without changing a single line of code.

Notable changes compared to v2.4.1:

• added equals to KeytabCredential (#615)
• added getSupportedCrenentials to AdaptorDescription (#595)
• clarified description of JobState.getState (#596)

- Java
Published by jmaassen over 8 years ago

xenon - This is release 2.4.1 of Xenon.

What problem does Xenon solve?

Many applications use remote storage and compute resources. To do so, they need to include code to interact with the scheduling systems and file transfer protocols used on those remote machines.

Unfortunately, many different scheduler systems and file transfer protocols exist, often with completely different programming interfaces. This makes it hard for applications to switch to a different system or support multiple remote systems simultaneously.

Xenon solves this problem by providing a single programming interface to many different types of remote resources, allowing applications to switch without changing a single line of code.

Notable changes compared to v2.4.0:

• fixed JobDescription equals, hashCode and toString (#612)
• fixed slurm adaptors status retrieval of finished jobs (#613)
• fixed slurm adaptors parsing of scontrol output on pre 17 slurm versions

- Java
Published by jmaassen over 8 years ago

xenon - This is release 2.4.0 of Xenon.

What problem does Xenon solve?

Many applications use remote storage and compute resources. To do so, they need to include code to interact with the scheduling systems and file transfer protocols used on those remote machines.

Unfortunately, many different scheduler systems and file transfer protocols exist, often with completely different programming interfaces. This makes it hard for applications to switch to a different system or support multiple remote systems simultaneously.

Xenon solves this problem by providing a single programming interface to many different types of remote resources, allowing applications to switch without changing a single line of code.

Notable changes compared to v2.3.0:

• added name to job description and job status (#609)
• added max memory to job description (#562)
• added threads per process to job description

- Java
Published by jmaassen over 8 years ago

xenon - This is release 2.3.0 of Xenon.

What problem does Xenon solve?

Many applications use remote storage and compute resources. To do so, they need to include code to interact with the scheduling systems and file transfer protocols used on those remote machines.

Unfortunately, many different scheduler systems and file transfer protocols exist, often with completely different programming interfaces. This makes it hard for applications to switch to a different system or support multiple remote systems simultaneously.

Xenon solves this problem by providing a single programming interface to many different types of remote resources, allowing applications to switch without changing a single line of code.

Notable changes compared to v2.2.0:

• added an HDFS filesystem adaptor
• fixed bug in GridEngineSchedulers for complex configurations of number of slots per node
• various code cleanups, etc.

- Java
Published by jmaassen over 8 years ago

xenon - This is release 2.2.0 of Xenon.

What problem does Xenon solve?

Many applications use remote storage and compute resources. To do so, they need to include code to interact with the scheduling systems and file transfer protocols used on those remote machines.

Unfortunately, many different scheduler systems and file transfer protocols exist, often with completely different programming interfaces. This makes it hard for applications to switch to a different system or support multiple remote systems simultaneously.

Xenon solves this problem by providing a single programming interface to many different types of remote resources, allowing applications to switch without changing a single line of code.

Notable changes compared to v2.1.0:

• extended CredentialMap to retrieve all keys
• removed logback config from jar
• fixed bug in handling workdir of Local and TorqueSchedulers
• many small bugfixes, additional tests, etc.

- Java
Published by jmaassen over 8 years ago

xenon - This is release 2.1.0 of Xenon.

What problem does Xenon solve?

Many applications use remote storage and compute resources. To do so, they need to include code to interact with the scheduling systems and file transfer protocols used on those remote machines.

Unfortunately, many different scheduler systems and file transfer protocols exist, often with completely different programming interfaces. This makes it hard for applications to switch to a different system or support multiple remote systems simultaneously.

Xenon solves this problem by providing a single programming interface to many different types of remote resources, allowing applications to switch without changing a single line of code.

Notable changes compared to v2.0.0:

• added getCredential to Scheduler and FileSystem
• fixed a bug in equals of CredentialMap
• added proper check of supported credential types in adaptors
• many small bugfixes, additional tests, etc.

- Java
Published by jmaassen over 8 years ago

xenon - This is release 2.0.0 of Xenon.

What problem does Xenon solve?

Many applications use remote storage and compute resources. To do so, they need to include code to interact with the scheduling systems and file transfer protocols used on those remote machines.

Unfortunately, many different scheduler systems and file transfer protocols exist, often with completely different programming interfaces. This makes it hard for applications to switch to a different system or support multiple remote systems simultaneously.

Xenon solves this problem by providing a single programming interface to many different types of remote resources, allowing applications to switch without changing a single line of code.

Notable changes compared to v1.2.3:

• complete overhaul of public API, which should increase ease-of-use significantly.
• complete overhaul of integration test framework, which should improve performance and make it easier to test against different versions of the same middleware.
• complete overhaul of implementation, which should make implementing adaptors much more straightforward.
• replaced Jsch with Apache SSHD in the SSH and SFTP adaptors
• replaced Apache Jackrabbit with Sardine in the Webdav adaptor.
• added an S3 filesystem adaptor.

- Java
Published by jmaassen over 8 years ago

xenon - This is release candidate 2 of Xenon 2.0.0.

This is the first release candidate of Xenon 2.0.0

Notable changes compared to v1.2.3:

• complete overhaul of public API, which should increase ease-of-use significantly.
• complete overhaul of integration test framework, which should improve performance and make it easier to test against different versions of the same middleware.
• complete overhaul of implementation, which should make implementing adaptors much more straightforward.
• replaced Jsch with Apache SSHD in the SSH and SFTP adaptors
• replaced Apache Jackrabbit with Sardine in the Webdav adaptor.

- Java
Published by jmaassen almost 9 years ago

xenon - This is release 1.2.3 of Xenon.

This is the final regular 1.x release before switching to the 2.0 branch.

No further development will be done on 1.x (although we may release additional bug-fix releases).

Bugfixes:

fixed various issues flagged by sonarqube

What's missing:

The GridFTP adaptor is not considered stable yet. It is not part of this release.

There is no adaptor writing documentation at the moment, nor is the Javadoc complete for the internals methods of the adaptor implementations.

It should be made easier to inspect at runtime which adaptors are available and what properties they support.

We can always use more adaptors, e.g, for S3, SWIFT, HDFS, YARN, Azure-Batch, Amazon-Batch etc. Many of these are in progress for 2.0.

- Java
Published by jmaassen almost 9 years ago

xenon - Xenon 1.2.2

This is release 1.2.2 of Xenon.

Bugfixes: - fixed bug in the copy engine that would ignore a copy if source and destination had exactly the same path (even on different machines). - added timeout overflow detection in Jobs.waitUntilDone and Jobs.waitUntilRunning.

Other changes: - we have a new logo! - added SonarQube code for quality analysis and coverage

What's missing:

The GridFTP adaptor is not considered stable yet. It is not part of this release.

There is no adaptor writing documentation at the moment, nor is the Javadoc complete for the internals methods of the adaptor implementations.

It should be made easier to inspect at runtime which adaptors are available and what properties they support.

We can always use more adaptors, e.g, for S3, SWIFT, HDFS, YARN, Azure-Batch, Amazon-Batch etc. These are planned for 1.3 or later.

We can always use more interfaces, e.g. for clouds. This is planned for 2.0.

- Java
Published by jmaassen about 9 years ago

xenon - Xenon 1.2.1

Xenon 1.2.1

This is release 1.2.1 of Xenon.

Bugfixes:

• fixed nasty inconsistency in adaptor implementations of waiting for jobs to start or finish.

What's missing:

The GridFTP adaptor is not considered stable yet. It is not part of this release.

There is no adaptor writing documentation at the moment, nor is the Javadoc complete for the internals methods of the adaptor implementations.

It should be made easier to inspect at runtime which adaptors are available and what properties they support.

We can always use more adaptors, e.g, for S3, SWIFT, HDFS, YARN, Azure-Batch, Amazon-Batch etc. These are planned for 1.3 or later.

We can always use more interfaces, e.g. for clouds. This is planned for 2.0.

- Java
Published by jmaassen over 9 years ago

xenon - Xenon 1.2.0

Xenon 1.2.0

This is release 1.2.0 of Xenon.

Notable changes compared to v1.1.0:

• added support for WebDAV file access.
• added OSX testing in Travis
• added support for Slurm version 15.08.6
• many additional tests

Bugfixes:

• fixed several bugs related to Windows local file system semantics
• many small bugfixes

What's missing:

The GridFTP adaptor is not considered stable yet. It is not part of this release.

There is no adaptor writing documentation at the moment, nor is the Javadoc complete for the internals methods of the adaptor implementations.

It should be made easier to inspect at runtime which adaptors are available and what properties they support.

We can always use more adaptors, e.g, for S3, SWIFT, HDFS, YARN, Azure-Batch, etc. These are planned for 1.3 or later.

We can always use more interfaces, e.g. for clouds. This is planned for 2.0.

- Java
Published by jmaassen over 9 years ago

xenon - Xenon 1.1.0

Xenon 1.1.0

This is release 1.1.0 of Xenon.

Notable changes compared to v1.0.0:

• added support for FTP file access.
• added support for Torque resource manager.
• added support for Slurm versions 2.6.0, 14.03.0 and 14.11.9-Bull.1.0.
• added option to specify resources in sge adaptor.
• added support for SSH agent and agent proxies
• added a -lot- of unit and integration tests
• javadoc is java 8 compliant.
• the adaptor documentation is now part of the javadoc.
• Xenon releases are now available in jCenter.
• switched from ant to gradle based build system, this is reflected in the directory structure
• split unit and integration tests
• added docker support for integration tests
• now using travis-ci for continous integration
• now using PMD and codacy for code quality
• now using codecov for unit and integration test coverage
• moved examples and tutorial to a separate repository https://github.com/NLeSC/Xenon-examples

Bugfixes:

Many bugfixes in adaptors and tests.

What's missing:

The GridFTP and WebDAV adaptors are not considered stable yet. They are not part of this release.

There is no adaptor writing documentation at the moment, nor is the Javadoc complete for the internals methods of the adaptor implementations.

We can always use more adaptors.

We can always use more interfaces, e.g. for bandwidth-on-demand or clouds.

- Java
Published by jmaassen over 10 years ago

xenon - First beta release of Xenon 1.1.0

Xenon 1.1.0-beta.1

This is a beta release of version 1.1.0 of Xenon.

Notable changes compared to v1.0.0:

• added GridFTP adaptor (unstable).
• added support for Slurm 2.6.
• added option to specify resources in sge adaptor.

Bugfixes:

• Fixed bug in caching of SFTP connections.
• Fixed retrieval of local FileSystems on Windows machines.

What's missing:

There is no adaptor writing documentation at the moment, nor is the Javadoc complete for the internals methods of the adaptor implementations.

The SSH adaptor does not support SSH agent or SSH agent forwarding yet.

We can always use more adaptors, e.g, for FTP, CIFS, etc.

We can always use more interfaces, e.g. for bandwidth-on-demand or clouds.

The GridFTP adaptor is not considered stable yet. Third-party copying is still missing, and it the documentation is still missing.

- Java
Published by jmaassen over 12 years ago

xenon - The first stable release of Xenon

Xenon 1.0.0

This is the first stable release of Xenon, version 1.0.0.

What's there:

The Xenon programming interface is stable and completely documented. User documentation, examples, and Javadoc are available for the public API of Xenon.

This version of Xenon contains adaptors for local, SSH, Grid Engine and Slurm that should be fully functional.

The library has been tested extensively under Linux, Windows 7 and OSX.

What's missing:

There is no adaptor writing documentation at the moment, nor is the Javadoc complete for the internals methods of the adaptor implementations.

The SSH adaptor does not support SSH agent or SSH agent forwarding yet.

We can always use more adaptors, e.g, for FTP, CIFS, GridFTP, etc.

We can always use more interfaces, e.g. for bandwidth-on-demand or clouds.

Whatever happened to Octopus ?

Xenon was previously called Octopus. We changed its name to fit into the NLeSC naming scheme, which has an elements theme.

- Java
Published by jmaassen over 12 years ago

xenon - First public release of Octopus

Octopus 0.9-beta

It is the first public release of Octopus. This release is intended to allow others to experiment with Octopus and provide feedback.

What's there:

The Octopus programming interface should be mostly done. Very little changes are expected for the final 1.0 release.

Octopus currently contains three adaptors, local, ssh and gridengine. These adaptor should be mostly functional. See below for what's missing.

The user documentation is 90% done (but will undoubtedly contain lots of typos).

The library has been tested quite extensively under linux.

What's missing:

Octopus has not been tested at all under Windows or OSX.

ssh adaptor does not support environment variables.

gridengine does not support parallel jobs yet (just single core jobs).

Adaptors may not provide adaptor specific information yet.

There is no adaptor writing documentation at the moment.

There is no adaptor specific documentation at the moment.

More adaptors, more interfaces!

- Java
Published by jmaassen almost 13 years ago