wrench - v2.7

WRENCH is a simulation framework for building simulators of Cyberinfrastructure platforms, systems, and applications. WRENCH implements high-level simulation abstractions on top of the SimGrid simulation framework, so as to make it possible to build simulators that are accurate, that can run scalably on a single computer, and that can be implemented with minimal software development effort.

This release includes:

• Implementation of a ServerlessComputeService to simulate serverless, function-based cloud infrastructures (e.g., AWS Lambda, Google Functions, etc). Comes with a simple user-level API and a FunctionManager component to develop simulation controllers that place function invocations. An example is provided in the examples directory. Although several unit tests have been developed, this serverless simulation feature is still experimental. It will likely evolved, along with its API, in the near future.
• Removed all usage of httplib in wrench-daemon (which now uses only CrowCPP).
• Minor bug fixes and code/documentation cleanups.

Note: WRENCH 2.7 requires SimGrid 4.0 and SimGrid FSMod 0.3

Documentation and additional information: - Simulation 101 (Complete newcomers): https://wrench-project.org/wrench/2.5/simulation_101.html - WRENCH 101 (Beginners): https://wrench-project.org/wrench/2.5/wrench_101.html - WRENCH 102 (Users): https://wrench-project.org/wrench/2.5/wrench_102.html

- C++
Published by henricasanova about 1 year ago

wrench - v2.6

WRENCH is a simulation framework for building simulators of Cyberinfrastructure platforms, systems, and applications. WRENCH implements high-level simulation abstractions on top of the SimGrid simulation framework, so as to make it possible to build simulators that are accurate, that can run scalably on a single computer, and that can be implemented with minimal software development effort.

This release includes:

• Implementation of a "backfilling depth" feature for EASY and convervative_bf batch scheduling algorithms
• Upgrade to SimGrid v4.0 and FSMod v0.3
• Minor code/documentation cleanups

Note: WRENCH 2.6 requires SimGrid 4.0 and SimGrid FSMod 0.3

Documentation and additional information: - Simulation 101 (Complete newcomers): https://wrench-project.org/wrench/2.5/simulation_101.html - WRENCH 101 (Beginners): https://wrench-project.org/wrench/2.5/wrench_101.html - WRENCH 102 (Users): https://wrench-project.org/wrench/2.5/wrench_102.html

- C++
Published by henricasanova about 1 year ago

wrench - v2.5

WRENCH is a simulation framework for building simulators of Cyberinfrastructure platforms, systems, and applications. WRENCH implements high-level simulation abstractions on top of the SimGrid simulation framework, so as to make it possible to build simulators that are accurate, that can run scalably on a single computer, and that can be implemented with minimal software development effort.

This release includes:

• Implementation of the EASY batch scheduling algorithm in BatchComputeService
• New command-line argument for the wrench-daemon to specify the number of commports
• Minor code/documentation cleanups

Note: WRENCH 2.5 requires SimGrid 3.36 and SimGrid FSMod 0.2

Documentation and additional information: - Simulation 101 (Complete newcomers): https://wrench-project.org/wrench/2.5/simulation_101.html - WRENCH 101 (Beginners): https://wrench-project.org/wrench/2.5/wrench_101.html - WRENCH 102 (Users): https://wrench-project.org/wrench/2.5/wrench_102.html

- C++
Published by henricasanova over 1 year ago

wrench -

WRENCH is a simulation framework for building simulators of Cyberinfrastructure platforms, systems, and applications. WRENCH implements high-level simulation abstractions on top of the SimGrid simulation framework, so as to make it possible to build simulators that are accurate, that can run scalably on a single computer, and that can be implemented with minimal software development effort.

This release includes:

• Removal of all file system simulation code, which was replaced by calls to the SimGrid File System Module (FSMod), which is now a new software dependency for WRENCH
• API change: all numbers of bytes (file and memory sizes) are now of type sg_size_t instead of double (due to the use of FSMod above)
• Added REST API functionality and updated all documentation
• Minor code/documentation cleanups

Note: WRENCH 2.4 requires SimGrid 3.36 and SimGrid FSMod 0.2

Documentation and additional information: - Simulation 101 (Complete newcomers): https://wrench-project.org/wrench/2.3/simulation_101.html - WRENCH 101 (Beginners): https://wrench-project.org/wrench/2.3/wrench_101.html - WRENCH 102 (Users): https://wrench-project.org/wrench/2.3/wrench_102.html

- C++
Published by henricasanova over 1 year ago

wrench -

WRENCH is a simulation framework for building simulators of Cyberinfrastructure platforms, systems, and applications. WRENCH implements high-level simulation abstractions on top of the SimGrid simulation framework, so as to make it possible to build simulators that are accurate, that can run scalably on a single computer, and that can be implemented with minimal software development effort.

This release includes mostly updates/upgrades:

• A more full-feature REST API that now include the Action API: https://wrench-project.org/wrench/2.3/rest_api.html
• Upgrade to use SimGrid v3.36 and WfCommons's WfFormat v1.5
• Minor bug fixes and code updates

Note: WRENCH 2.3 requires SimGrid 3.36.

Documentation and additional information: - Simulation 101 (Complete newcomers): https://wrench-project.org/wrench/2.3/simulation_101.html - WRENCH 101 (Beginners): https://wrench-project.org/wrench/2.3/wrench_101.html - WRENCH 102 (Users): https://wrench-project.org/wrench/2.3/wrench_102.html

- C++
Published by henricasanova over 1 year ago

wrench -

WRENCH is a simulation framework for building simulators of Cyberinfrastructure platforms, systems, and applications. WRENCH implements high-level simulation abstractions on top of the SimGrid simulation framework, so as to make it possible to build simulators that are accurate, that can run scalably on a single computer, and that can be implemented with minimal software development effort.

This release includes:

• Implementation of wrench-daemon, which can be started on the local machine and supports a REST API so that users can create and run simulations in a language-agnostic manner.
• Implementation of non-bufferized (i.e., buffer size of zero) storage services, which is transparent to the user but can vastly reduce simulation time by using a fluid (rather than message-based) model for how storage services read/write data to/from disk while sending/receiving that same data to/from the network.
• API change by which a FileLocation now includes a DataFile.
• Added a CACHING_BEHAVIOR property to StorageService, which can take value NONE (the original behavior in which when full the storage service fails on writes) and LRU (the storage service implements a Least Recently Used strategy so as to function as a cache).
• Implementation of a File Proxy Service, which acts as a proxy for a file service while maintaining a local cache for files.
• Implementation of a Compound Storage Service, which acts as a proxy for an arbitrary set of Simple Storage Services and performs file striping.
• Implementation of an MPI action, which can be part of any job and makes it possible to simulate message-passing programs implemented with the MPI API. The simulation of the MPI program is handled by the SMPI component is SimGrid, which has proven both accurate and scalable.
• Minor bug fixes and scalability improvements.

Note: WRENCH 2.2 requires SimGrid 3.34.

Documentation and additional information: https://wrench-project.org - Simulation 101 (Complete newcomers): https://wrench-project.org/wrench/2.2/simulation101.html - WRENCH 101 (Beginners): https://wrench-project.org/wrench/2.2/wrench101.html - WRENCH 102 (Users): https://wrench-project.org/wrench/2.2/wrench_102.html

- C++
Published by henricasanova almost 3 years ago

wrench - v2.1

WRENCH is a simulation framework for building simulators of Cyberinfrastructure platforms, systems, and applications. WRENCH implements high-level simulation abstractions on top of the SimGrid simulation framework, so as to make it possible to build simulators that are accurate, that can run scalably on a single computer, and that can be implemented with minimal software development effort.

This is a minor release, which includes:

• Implementation of a new storage service for the simulation of the XRootD storage system, along with implementation and examples.
• Performance and scalability improvements that reduce memory footprint and simulation execution time.
• Minor bug fixes

Note: WRENCH 2.1 requires SimGrid 3.32.

Documentation and additional information: https://wrench-project.org - Simulation 101 (Complete newcomers): https://wrench-project.org/wrench/2.1/simulation101.html - WRENCH 101 (Beginners): https://wrench-project.org/wrench/2.1/wrench101.html - WRENCH 102 (Users): https://wrench-project.org/wrench/2.1/wrench_102.html

- C++
Published by henricasanova over 3 years ago

wrench - v2.0

WRENCH is a simulation framework for building simulators of Cyberinfrastructure platforms, systems, and applications. WRENCH implements high-level simulation abstractions on top of the SimGrid simulation framework, so as to make it possible to build simulators that are accurate, that can run scalably on a single computer, and that can be implemented with minimal software development effort.

This is a major release, which includes:

• Created a more general Developer API, called the action API, that makes it possible to simulate application workloads that are not necessarily workflow applications. Examples are provided in the examples/action_api directory.
• Minor changes to the workflow API (which is now implemented internally on top of the action API).
• Removed support for the obsolete DAX XML workflow description format, which removes an external software dependency.
• Added support for the WfCommons JSON workflow description format.
• Many additional API functionality, typically as requested by users.
• Scalability improvements both in terms of simulation time and simulation memory footprint.
• New and improved documentation.

Note: WRENCH 2.0 requires SimGrid 3.31.

Documentation and additional information: https://wrench-project.org - Simulation 101 (Beginners): https://wrench-project.org/wrench/2.0/simulation101.html - WRENCH 101 (Users): https://wrench-project.org/wrench/2.0/wrench101.html - WRENCH 102 (Developers): https://wrench-project.org/wrench/2.0/wrench_102.html

- C++
Published by rafaelfsilva about 4 years ago

wrench - v1.11

WRENCH is a simulation framework for building simulators of Cyberinfrastructure and Workflow Systems. WRENCH implements high-level simulation abstractions on top of the SimGrid simulation framework, so as to make it possible to build simulators that are accurate, that can run scalably on a single computer, and that can be implemented with minimal software development effort.

This release includes only minor changes and bug fixes. This is the last release of WRENCH version 1.x. WRENCH version 2.0 will be released soon, which will include minor changes to the current "workflow" API, a new more generic "non-workflow" API, as well as significantly decreased simulation time and memory footprint.

Note: WRENCH 1.11 requires SimGrid 3.30.

Documentation and additional information: https://wrench-project.org - WRENCH 101 (Users): https://wrench-project.org/wrench/1.11/wrench-101.html - WRENCH 102 (Developers): https://wrench-project.org/wrench/1.11/wrench-102.html

- C++
Published by henricasanova over 4 years ago

wrench - v1.10

WRENCH is a simulation framework for building simulators of Cyberinfrastructure and Workflow Systems. WRENCH implements high-level simulation abstractions on top of the SimGrid simulation framework, so as to make it possible to build simulators that are accurate, that can run scalably on a single computer, and that can be implemented with minimal software development effort.

This release includes a series of new features, enhancements, and bug fixes, including:

• Support for programmatic platform description (#228)
• Enable a job to check locations for a file in some order of preference (#229)
• Enhancement (#226)

Note: WRENCH 1.10 requires SimGrid 3.29.

Documentation and additional information: https://wrench-project.org - WRENCH 101 (Users): https://wrench-project.org/wrench/1.10/wrench-101.html - WRENCH 102 (Developers): https://wrench-project.org/wrench/1.10/wrench-102.html

- C++
Published by rafaelfsilva over 4 years ago

wrench - v1.9

WRENCH is a simulation framework for building simulators of Workflow Management Systems. WRENCH implements high-level simulation abstractions on top of the SimGrid simulation framework, so as to make it possible to build simulators that are accurate, that can run scalably on a single computer, and that can be implemented with minimal software development effort.

This release includes a series of new features, enhancements, and bug fixes, including:

• Performance improvement (#221)
• Updates to HTCondor component and API (#220)
• Enhancement (#225)

Note: WRENCH 1.9 requires SimGrid 3.27.

Documentation and additional information: https://wrench-project.org - WRENCH 101 (Users): https://wrench-project.org/wrench/1.9/wrench-101.html - WRENCH 102 (Developers): https://wrench-project.org/wrench/1.9/wrench-102.html

- C++
Published by rafaelfsilva almost 5 years ago

wrench - v1.8

WRENCH is a simulation framework for building simulators of Workflow Management Systems. WRENCH implements high-level simulation abstractions on top of the SimGrid simulation framework, so as to make it possible to build simulators that are accurate, that can run scalably on a single computer, and that can be implemented with minimal software development effort.

This release includes a series of new features, enhancements, and bug fixes, including:

• I/O with Page Cache Simulation Model (#199, #202, #218)
• Extended HTCondor component model with the Grid Universe (#161)
• Improvements to the WRENCH Dashboard (#170, #212)
• Improvements to documentation (#219) and code (#189, #214)

Note: WRENCH 1.8 requires SimGrid 3.26.

Documentation and additional information: https://wrench-project.org - WRENCH 101 (Users): https://wrench-project.org/wrench/1.8/wrench-101.html - WRENCH 102 (Developers): https://wrench-project.org/wrench/1.8/wrench-102.html

- C++
Published by rafaelfsilva over 5 years ago

wrench - v1.7

WRENCH is a simulation framework for building simulators of Workflow Management Systems. WRENCH implements high-level simulation abstractions on top of the SimGrid simulation framework, so as to make it possible to build simulators that are accurate, that can run scalably on a single computer, and that can be implemented with minimal software development effort.

This release includes a series of new features, enhancements, and bug fixes, including:

• Redesign of the WRENCH Dashboard: includes a number of graphs for visualizing the Gantt chart of the workflow execution, host utilization, network bandwidth usage, and energy consumption (#171, #173, #183, #184, #185, #186, #195)
• Improvements to BareMetalComputeService: load is now equally distributed among hosts (#169), and the service provides an API equivalent to the squeue Slurm command (#176)
• Improvements to CloudComputeService: added a function to get the ComputeService for a VM based on its name (#187)
• Improvements to VirtualizedClusterComputeService: added a function to get the physical host (#190)
• Enabled support for capturing network link's usage during the simulation (#182)
• Improvements to Simulation JSON output: added disk read/write failures (#167), and network link usage (#182)
• Added an exception handling for ensuring a link bandwidth in the platform file is not set to zero (#181)
• Bug fixes and small enhancements: #168, #172, #174, #178, #180, #191, #192, #200

Note: WRENCH 1.7 requires SimGrid 3.25.

Documentation and additional information: https://wrench-project.org - WRENCH 101 (Users): https://wrench-project.org/wrench/1.7/wrench-101.html - WRENCH 102 (Developers): https://wrench-project.org/wrench/1.7/wrench-102.html

- C++
Published by rafaelfsilva over 5 years ago

wrench - v1.6

WRENCH is a simulation framework for building simulators of Workflow Management Systems. WRENCH implements high-level simulation abstractions on top of the SimGrid simulation framework, so as to make it possible to build simulators that are accurate, that can run scalably on a single computer, and that can be implemented with minimal software development effort.

This release includes a series of new features, enhancements, and bug fixes, including:

• Refactored the WRENCH documentation (#156):
  • WRENCH 101 for users
  • WRENCH 102 for developers
• New collection of examples provided with WRENCH distribution: over 10 examples of simulators (#157)
• Removed dependency to Lemon library: we now use Boost, which is already used by SimGrid (#159)
• Simulation logging in now disabled by default: can be enabled using --wrench-full-log (#158)
• Refactored the BatchComputeService class: includes a conservative backfilling algorithm for validation purposes (#152)
• Improvements to simulation output processing and JSON output: includes task, host, disk I/O, and energy (#154, #122, #129, #133)
• Improvements to the WRENCH Dashboard: #130, #136, #137, #139, #146, #147, #148, #164
• Bug fixes and small enhancements: #110, #141, #143, #144, #145, #151, #153, #160, #162, #163

Note: WRENCH 1.6 requires SimGrid 3.25.

Documentation and additional information: https://wrench-project.org - WRENCH 101 (Users): https://wrench-project.org/wrench/1.6/wrench-101.html - WRENCH 102 (Developers): https://wrench-project.org/wrench/1.6/wrench-102.html

- C++
Published by rafaelfsilva about 6 years ago

wrench - v1.5

WRENCH is a simulation framework for building simulators of Workflow Management Systems. WRENCH implements high-level simulation abstractions on top of the SimGrid simulation framework, so as to make it possible to build simulators that are accurate, that can run scalably on a single computer, and that can be implemented with minimal software development effort.

This release includes a series of new features and bug fixes, including:

• #65: Simulation of failures
• #82, #131: WRENCH Dashboard
• #105: Enabled Pilot Job Submission for HTCondor compute service
• #7: Improved exception handling
• #115: Added a BatchComputeServiceProperty to make it possible to ignore bogus job specifications in workload trace files
• #114: Allow users to define SIMGRID_INSTALL_PATH for non-standard SimGrid installations
• #102: Code performance improvements
• Bug fixes: #104, #116, #118

Note: WRENCH 1.5 requires SimGrid 3.25.

Documentation and additional information: http://wrench-project.org WRENCH 101 Documentation: http://wrench-project.org/wrench/1.5/user/wrench-101.html

- C++
Published by rafaelfsilva over 6 years ago

wrench - v1.4

WRENCH is a simulation framework for building simulators of Workflow Management Systems. WRENCH implements high-level simulation abstractions on top of the SimGrid simulation framework, so as to make it possible to build simulators that are accurate, that can run scalably on a single computer, and that can be implemented with minimal software development effort.

This release includes a series of new features and bug fixes, including:

• #87: Updated Batsched support (support to new JSON-based protocol)
• #88: Dump pstate and energy consumption data as JSON
• #90: Adding support for bytesRead, bytesWritten, and avgCPU for workflows defined as JSON
• #92: Adding ComputeService::getTotalNumCores() and ComputeService::getTotalNumIdleCores()
• #96: wrench::BatchService should handle requested vs. real job run times when replaying traces
• Bug fixes: #97, #99, #100

Note: WRENCH 1.4 requires SimGrid 3.21.

Documentation and additional information: http://wrench-project.org WRENCH 101 Documentation: http://wrench-project.org/wrench/1.4/user/wrench-101.html

- C++
Published by rafaelfsilva about 7 years ago

wrench - v1.3

WRENCH is a simulation framework for building simulators of Workflow Management Systems. WRENCH implements high-level simulation abstractions on top of the SimGrid simulation framework, so as to make it possible to build simulators that are accurate, that can run scalably on a single computer, and that can be implemented with minimal software development effort.

This release includes a series of new features and bug fixes, including:

• #85: Development of a wrench-init tool
• #76: MultiHostMultiCoreComputeService re-implemented as BareMetalComputeService
• #78: Documentation of the JSON schema for workflows
• #77: Documentation Guide containing detailed descriptions of WRENCH core services
• Bug fixes: #81

Note: WRENCH 1.3 requires SimGrid 3.21.

Documentation and additional information: http://wrench-project.org WRENCH 101 Documentation: http://wrench-project.org/wrench/1.3/user/wrench-101.html

- C++
Published by rafaelfsilva over 7 years ago

wrench - v1.2

WRENCH is a simulation framework for building simulators of Workflow Management Systems. WRENCH implements high-level simulation abstractions on top of the SimGrid simulation framework, so as to make it possible to build simulators that are accurate, that can run scalably on a single computer, and that can be implemented with minimal software development effort.

This release includes a series of new features and bug fixes, including:

• #50: New HTCondor compute service
• #68: Improved standard job submission to specific VM (Cloud Service)
• #70: Allow a WMS to start a new service dynamically
• #74: New function Simulation::dumpWorkflowExecutionJSON() for dumping the workflow execution data in a JSON format
• Bug fixes: #67, #69, #79, #80

Note: WRENCH 1.2 requires SimGrid 3.21.

Documentation and additional information: http://wrench-project.org WRENCH 101 Documentation: http://wrench-project.org/wrench/1.2/user/wrench-101.html

- C++
Published by rafaelfsilva over 7 years ago

wrench - 1.1

WRENCH is a simulation framework for building simulators of Workflow Management Systems. WRENCH implements high-level simulation abstractions on top of the SimGrid simulation framework, so as to make it possible to build simulators that are accurate, that can run scalably on a single computer, and that can be implemented with minimal software development effort.

This release includes a series of new features and bug fixes, including:

• #37: Energy consumption by hosts and support for power state management
• #60: Virtual machine management support including shutdown, start, suspend, and resume operations
• #13: Enriched set of simulation events in the simulation output
• #59: Command-line options
• Bug fixes: #38, #63, #64, #66
• Code improvements: #36, #61

Note: WRENCH 1.1 requires SimGrid 3.20 or higher.

Documentation and additional information: http://wrench-project.org WRENCH 101 Documentation: http://wrench-project.org/wrench/1.1/user/wrench-101.html

- C++
Published by rafaelfsilva almost 8 years ago

wrench - 1.0.1

WRENCH is a simulation framework for building simulators of Workflow Management Systems. WRENCH implements high-level simulation abstractions on top of the SimGrid simulation framework, so as to make it possible to build simulators that are accurate, that can run scalably on a single computer, and that can be implemented with minimal software development effort.

On this minor bug fix and small improvements release, we provide:

• #52: Ability to declare VM creation overhead in seconds to Cloud/VirtualizedCluster service
• #58: Ability to load batch workload trace file in JSON "batsim" format
• Bug fixes: #51, #53, #54, #56, and #57

Note: WRENCH 1.0.1 requires SimGrid 3.20 or higher.

Documentation and additional information: http://wrench-project.org WRENCH 101 Documentation: http://wrench-project.org/wrench/1.0.1/user/wrench-101.html

- C++
Published by rafaelfsilva almost 8 years ago

wrench - 1.0.0

WRENCH's 1.0 release

WRENCH enables novel avenues for scientific workflow use, research, development, and education in the context of large-scale scientific computations and data analyses. WRENCH is an open-source library for developing simulators. WRENCH exposes several high-level simulation abstractions to provide high-level building blocks for developing custom simulators.

This release provides a set of (simulated) services that can be instantiated on the simulated platform:

• Compute Services (multi-core multi-host, virtualized cluster, cloud computing, and batch computing)
• Storage Service (including support for scratch space for computing nodes)
• File Registry Service (file replica catalog)
• Network Proximity Service (monitors the network and provide a database of host-to-host network distances)
• Workflow Management Systems (WMSs)

Documentation and additional information: http://wrench-project.org WRENCH 101 Documentation: http://wrench-project.org/wrench/1.0/user/wrench-101.html

- C++
Published by rafaelfsilva almost 8 years ago

wrench - 1.0.0-beta

WRENCH's 1.0-beta release

This release provides the core components of the WRENCH software for enabling novel avenues for scientific workflow use, research, development, and education in the context of large-scale scientific computations and data analyses.

More information: http://wrench-project.org

- C++
Published by rafaelfsilva about 8 years ago

wrench - 1.0.0-alpha

WRENCH's 1.0-alpha release

This release provides the core components of the WRENCH software for enabling novel avenues for scientific workflow use, research, development, and education in the context of large-scale scientific computations and data analyses. In summary this release provides:

• Compute Services (multi-core multi-host, cloud computing, and batch computing)
• Storage Service
• File Registry Service (file replica catalog)
• Network Proximity Service

More information: http://wrench-project.org

- C++
Published by rafaelfsilva over 8 years ago