https://github.com/bigbuildbench/mvsapphire_powerpipe

https://github.com/bigbuildbench/mvsapphire_powerpipe

Science Score: 13.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
  • DOI references
  • Academic publication links
  • Academic email domains
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (12.0%) to scientific vocabulary
Last synced: 10 months ago · JSON representation

Repository

Basic Info
  • Host: GitHub
  • Owner: BigBuildBench
  • License: mit
  • Language: C#
  • Default Branch: master
  • Size: 447 KB
Statistics
  • Stars: 0
  • Watchers: 0
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Created over 1 year ago · Last pushed over 1 year ago
Metadata Files
Readme License

README.md

drawing

GitHub Workflow Status (with event) badge Nuget Nuget

A .NET Library for Constructing Advanced Workflows with Fluent Interface

PowerPipe is a versatile .NET library designed to streamline the process of building advanced workflows using a fluent interface. The primary objective of this project is to eliminate the need for writing boilerplate code when implementing workflows.

Check out Medium article 👀

If you like this project give it a star 🌟

🔥 Features and Benefits

  • Lightweight
  • Fluent interface
  • Conditional steps
  • Parallel steps execution
  • Nested pipelines
  • Error handling
  • Steps compensation
  • Ease & Structured Workflow construction
  • Dependency Injection support
  • Developed using latest .NET

🧐 Sample use case

Imagine creating an e-commerce platform. The platform must process incoming customer orders, each demanding validation, inventory updates, and potentially more intricate steps.

```csharp public class ECommercePipelineService : IECommercePipelineService { private readonly IPipelineStepFactory _pipelineStepFactory;

private bool PaymentSucceed(ECommerceContext context) => context.PaymentResult.Status is PaymentStatus.Success;

public  ECommercePipelineService(IPipelineStepFactory pipelineStepFactory)
{
    _pipelineStepFactory  =  pipelineStepFactory;
}

public IPipeline<OrderResult> BuildPipeline()
{
    var context = new ECommerceContext();

    return new PipelineBuilder<ECommerceContext, OrderResult>(_pipelineStepFactory, context)
        .Add<OrderValidationStep>()
        .Add<PaymentProcessingStep>()
            .OnError(PipelineStepErrorHandling.Retry,  retryInterval:  TimeSpan.FromSeconds(2), maxRetryCount: 2)
        .If(PaymentSucceed, b => b
            .Add<OrderConfirmationStep>()
            .Add<InventoryReservationStep>())
        .Parallel(b => b
            .Add<CustomerNotificationsStep>()
            .Add<AnalyticsAndReportingStep>(), maxDegreeOfParallelism: 2)
        .Build();
}

} ```

🤩 Workflow visualization

Sometimes workflows could be too big to track what is happening.

That's why we created a workflow visualization tool. This tool was designed with simplicity in mind. You have to add just few lines of code to make this work!

Install required packages

  • Package Manager Console Install-Package PowerPipe.Visualization Install-Package PowerPipe.Visualization.Extensions.MicrosoftDependencyInjection

  • .NET CLI dotnet add package PowerPipe.Visualization dotnet add package PowerPipe.Visualization.Extensions.MicrosoftDependencyInjection

Usage

In your Startup/Program file add required services and register middleware:

``` csharp builder.Services.AddPowerPipeVisualization(o => o.ScanFromType(typeof(ECommercePipelineService)));

// ...

app.UsePowerPipeVisualization(); ```

Then start you application and navigate to /powerpipe endpoint.

And workflow from the sample above parsed to this beautiful diagram. 🌟

drawing

Note! This is the very first version of workflow visualization! Looking forward to your feedback 🤗

Known issues: - OnError parsing could lead to missing steps on the diagram - Double links between entities

🛠️ Getting started

Installation

  • Package Manager Console Install-Package PowerPipe Install-Package PowerPipe.Extensions.MicrosoftDependencyInjection

  • .NET CLI dotnet add package PowerPipe dotnet add package PowerPipe.Extensions.MicrosoftDependencyInjection

Building pipeline

  1. Create pipeline context and result

```csharp public class SampleContext : PipelineContext
{
// Properties and methods specific to the context
}

public class SampleResult { // Implementation details } ```

  1. Create pipeline steps

```csharp public class SampleStep1 : IPipelineStep
{
// Implementation details… }

public class SampleStep2 : IPipelineStep
{
// Implementation details… } ```

  1. Define your pipeline
  • Use Add<T> method to add a step to your pipeline

csharp var pipeline = new PipelineBuilder<OrderProcessingContext, Order>() .Add<SampleStep1>() .Add<SampleStep2>() .Build();

  • Use AddIf<T> method to add a step to the pipeline based on the predicate

```csharp // Define predicate based on context private bool ExecuteStep2(OrderProcessingContext context) => context.ExecuteStep2Allowed;

var pipeline = new PipelineBuilder() .Add() .AddIf(ExecuteStep2) .Build(); ```

  • Use AddIfElse<TFirst, TSecond> method to add one of the steps by the predicate

```csharp private bool ExecuteStep2(OrderProcessingContext context) => context.ExecuteStep2Allowed;

var pipeline = new PipelineBuilder() .AddIfElse(ExecuteStep2) .Build(); ```

  • Use If method to add a nested pipeline based on a predicate

```csharp private bool ExecuteNestedPipeline(OrderProcessingContext context) => context.ExecuteNestedPipelineAllowed;

var pipeline = new PipelineBuilder() .If(ExecuteNestedPipeline, b => b .Add() .Add()) .Build(); ```

  • Use Parallel method to execute your steps in parallel

In order to execute steps in parallel your steps should implement IPipelineParallelStep<TContext> interface

csharp var pipeline = new PipelineBuilder<OrderProcessingContext, Order>() .Parallel(b => b .Add<SampleParallelStep1>() .Add<SampleParallelStep2>(), maxDegreeOfParallelism: 3) .Build();

  • Use OnError method to add error-handling behavior

Currently available only two types of error handling Suppress and Retry

csharp var pipeline = new PipelineBuilder<OrderProcessingContext, Order>() .Add<SampleStep1>() .OnError(PipelineStepErrorHandling.Retry) .Build();

  • Use CompensateWith method to add a compensation step to the previously added step in the pipeline

Compensation steps should implement IPipelineCompensationStep<TContext>

```csharp public class SampleStep1Compensation : IPipelineCompensationStep {}

var pipeline = new PipelineBuilder() .Add() .CompensateWith() .Build(); ```

  1. Extensions: Microsoft Dependency Injection

The PowerPipe.Extensions.MicrosoftDependencyInjection extension provides integration with Microsoft Dependency Injection.

  • Use AddPowerPipe to register all required services and scan libraries for your step implementations.

csharp public static IServiceCollection AddPowerPipe( this IServiceCollection serviceCollection, PowerPipeConfiguration configuration)

By default all found implementations will be registered as Transient.

csharp services.AddPowerPipe(cfg => { cfg.RegisterServicesFromAssemblies(Assembly.GetExecutingAssembly()); });

But you can configure service lifetime per step implementation.

csharp services.AddPowerPipe(cfg => { cfg.RegisterServicesFromAssemblies(typeof(Program).Assembly) .ChangeStepsDefaultLifetime(ServiceLifetime.Scoped) .AddSingleton<Step1>() .AddTransient<Step2>() .AddTransient(typeof(Step2)); });

Check out sample project 👀

Owner

  • Name: BigBuildBench
  • Login: BigBuildBench
  • Kind: organization

abbr. B3, benchmarking the repo-level understanding capability of your LLMs by reconstructing project build-file.

GitHub Events

Total
  • Create event: 8
Last Year
  • Create event: 8

Dependencies

.github/workflows/build.yml actions
  • actions/checkout v3 composite
  • actions/setup-dotnet v3 composite
  • simon-k/dotnet-code-coverage-badge v1.0.0 composite
.github/workflows/publish.yml actions
  • actions/checkout v3 composite
  • actions/setup-dotnet v3 composite
  • nowsprinting/check-version-format-action v3 composite
samples/PowerPipe.Sample/PowerPipe.Sample.csproj nuget
src/PowerPipe/PowerPipe.csproj nuget
src/PowerPipe.Extensions.MicrosoftDependencyInjection/PowerPipe.Extensions.MicrosoftDependencyInjection.csproj nuget
src/PowerPipe.Visualization/PowerPipe.Visualization.csproj nuget
src/PowerPipe.Visualization.Extensions.MicrosoftDependencyInjection/PowerPipe.Visualization.Extensions.MicrosoftDependencyInjection.csproj nuget
tests/PowerPipe.UnitTests/PowerPipe.UnitTests.csproj nuget