airflow-provider-vineyard - vineyard v0.24.4

vineyard v0.24.4

- C++
Published by github-actions[bot] about 1 year ago

airflow-provider-vineyard - vineyard v0.24.3

vineyard v0.24.3

- C++
Published by github-actions[bot] about 1 year ago

airflow-provider-vineyard - vineyard v0.24.2

vineyard v0.24.2

- C++
Published by github-actions[bot] almost 2 years ago

airflow-provider-vineyard - vineyard v0.24.1

vineyard v0.24.1

- C++
Published by github-actions[bot] almost 2 years ago

airflow-provider-vineyard - vineyard v0.24.0

vineyard v0.24.0

- C++
Published by github-actions[bot] almost 2 years ago

airflow-provider-vineyard - vineyard v0.23.2

vineyard v0.23.2

- C++
Published by github-actions[bot] almost 2 years ago

airflow-provider-vineyard - vineyard v0.23.1

vineyard v0.23.1

- C++
Published by github-actions[bot] almost 2 years ago

airflow-provider-vineyard - vineyard v0.23.0

vineyard v0.23.0

- C++
Published by github-actions[bot] almost 2 years ago

airflow-provider-vineyard - vineyard v0.22.2

vineyard v0.22.2

- C++
Published by github-actions[bot] almost 2 years ago

airflow-provider-vineyard - vineyard v0.22.1

vineyard v0.22.1

- C++
Published by github-actions[bot] about 2 years ago

airflow-provider-vineyard - vineyard v0.22.0

vineyard v0.22.0

- C++
Published by github-actions[bot] about 2 years ago

airflow-provider-vineyard - vineyard v0.21.5

vineyard v0.21.5

- C++
Published by github-actions[bot] about 2 years ago

airflow-provider-vineyard - vineyard v0.21.4

vineyard v0.21.4

- C++
Published by github-actions[bot] about 2 years ago

airflow-provider-vineyard - vineyard v0.21.3

vineyard v0.21.3

- C++
Published by github-actions[bot] over 2 years ago

airflow-provider-vineyard - vineyard v0.21.2

vineyard v0.21.2

- C++
Published by github-actions[bot] over 2 years ago

airflow-provider-vineyard - vineyard v0.21.1

vineyard v0.21.1

- C++
Published by github-actions[bot] over 2 years ago

airflow-provider-vineyard - vineyard v0.21.0

vineyard-contrib v0.21.0

- C++
Published by github-actions[bot] over 2 years ago

airflow-provider-vineyard - vineyard v0.20.3

vineyard v0.20.3

- C++
Published by github-actions[bot] over 2 years ago

airflow-provider-vineyard - vineyard v0.20.2

Vineyard v0.20.2 is a bugfix release which address a failure in typename resolution.

Commits

• [8fd14a46]: Bump up vineyard version to v0.20.1 and fixes a bug in typenames (Tao He)

- C++
Published by github-actions[bot] over 2 years ago

airflow-provider-vineyard - vineyard v0.20.1

Vineyard v0.20.1 supports dates data types in graphs.

Commits

• [0bb61f2f]: Bump up vineyard version to v0.20.1 and fixes a bug in type parameter (Tao He)
• [16c20b95]: Bump up vineyard version to v0.20.1 (Tao He)
• [3ac1f053]: Enable date and time types support in vineyard-graph (#1721) (Tao He)
• [b0c3129d]: Packed nbrunitt to decrease the memory footprint when using int32t as vidt (#1715) (Tao He)

- C++
Published by github-actions[bot] over 2 years ago

airflow-provider-vineyard - vineyard v0.20.1

vineyard v0.20.1

- C++
Published by github-actions[bot] over 2 years ago

airflow-provider-vineyard - vineyard v0.20.0

Commits

• [6bc3c307]: Bump up vineyard version to v0.20.0 (Tao He)
• [9dc9b378]: chmod vineyard socket mode to 777 (#1713) (Siyuan Zhang)
• [b737472f]: Delete the cert manager dependencies and generate the self-signed CA for webhook. (#1707) (Ye Cao)
• [495c3429]: Add CI test for spark and distributed hive. (#1705) (vegetableysm)
• [07f84f71]: Avoid to hardcode the fuse dir and rename the image to vineyard-fluid-fuse to match the convension in fluid (#1711) (Ye Cao)
• [bea6c083]: Fix kubernetes deploy command (#1706) (Bingshen Wang)
• [ad0f5bec]: Add the mount vineyard socket dockerfile for fluid integration (#1704) (Ye Cao)
• [818ad3bc]: Fix the unit test error and adjust the condition for fetching objects (#1703) (Ye Cao)
• [f21f4373]: Fix dependency conflict between tez and vineyard. (#1701) (vegetableysm)
• [7575eee1]: Refactor the columnar related code (#1696) (vegetableysm)
• [d4f820da]: Allow skipping retry when failed to connect (#1702) (Tao He)
• [a54010ac]: Delete the wrong file java/hive/hive. (#1699) (Ye Cao)
• [2955b60e]: Distributed execution support of Hive with vineyard (#1624) (vegetableysm)
• [5e3ba475]: Fix the ci test failing due to out-of-order query results (#1697) (vegetableysm)

- C++
Published by github-actions[bot] over 2 years ago

airflow-provider-vineyard - vineyard v0.19.3

vineyard-contrib v0.19.3

- C++
Published by github-actions[bot] over 2 years ago

airflow-provider-vineyard - vineyard v0.19.2

vineyard v0.19.2

- C++
Published by github-actions[bot] over 2 years ago

airflow-provider-vineyard - vineyard v0.19.1

vineyard v0.19.1

- C++
Published by github-actions[bot] over 2 years ago

airflow-provider-vineyard - vineyard v0.19.0

vineyard v0.19.0

- C++
Published by github-actions[bot] over 2 years ago

airflow-provider-vineyard - vineyard v0.18.2

vineyard v0.18.2

- C++
Published by github-actions[bot] over 2 years ago

airflow-provider-vineyard - vineyard v0.18.1

vineyard v0.18.1

- C++
Published by github-actions[bot] over 2 years ago

airflow-provider-vineyard - vineyard v0.18.0

vineyard v0.18.0

- C++
Published by github-actions[bot] over 2 years ago

airflow-provider-vineyard - vineyard v0.17.3

vineyard v0.17.3

- C++
Published by github-actions[bot] over 2 years ago

airflow-provider-vineyard - vineyard v0.17.2

vineyard v0.17.2

- C++
Published by github-actions[bot] over 2 years ago

airflow-provider-vineyard -

vineyard-contrib v0.17.2

- C++
Published by github-actions[bot] over 2 years ago

airflow-provider-vineyard - vineyard v0.17.1

vineyard v0.17.1

- C++
Published by github-actions[bot] over 2 years ago

airflow-provider-vineyard - vineyard v0.17.0

vineyard v0.17.0

- C++
Published by github-actions[bot] over 2 years ago

airflow-provider-vineyard - vineyard v0.17.0

vineyard-contrib v0.17.0

- C++
Published by github-actions[bot] over 2 years ago

airflow-provider-vineyard - vineyard v0.16.5

Vineyard v0.16.5 tried to address the issue of exceptions during parsing request body and check response message type.

Commits

• [1a674d62]: Bump up the version to v0.16.5 (Tao He)
• [916b0dd9]: Fixes the error checking in protocol.cc implementation (#1531) (Tao He)
• [4961a9e0]: Fixes the codeblock markup in README.md (Tao He)
• [87acb598]: Add CITATION.cff and bibtex in README (Tao He)
• [b576634c]: Use the crd-ref-docs to generate the docs for CRDs API automatically. (#1527) (Ye Cao)

- C++
Published by github-actions[bot] almost 3 years ago

airflow-provider-vineyard - vineyard v0.16.4

Vineyard v0.16.4 is a bugfix release that addressed an issue in varint encoding and fixed a bug in vineyard server during batch persisting.

Commits

• [83b8efcc]: Release vineyard v0.16.4 (Tao He)
• [21c4fe78]: Fixes a bug in persist when multiple objects are involved (#1526) (Tao He)
• [b6fb46b3]: Fixes the schema builder/resolver in java (#1524) (Tao He)
• [6fac3183]: Fixes the compatibility issue with pandas 2.1.0+ (#1523) (Tao He)
• [c73fbac9]: Fixes varint encoding: use a special buffer for first 1k encoding to avoid value overwrite issue (#1521) (Tao He)

- C++
Published by github-actions[bot] almost 3 years ago

airflow-provider-vineyard - vineyard v0.16.3

Vineyard v0.16.3 comes with the following changes:

• Improve the vineyard Go SDK and Rust SDK
• Improve the vineyardctl and k8s integration
• Fixes the peak memory usage during compacting CSR in arrow fragment
• Fixes the bug about object ID generation on Arm platform.

Commits

• [41a59381]: Bump up vineyard version to v0.16.3 (Tao He)
• [0c852fd6]: Support WSL1 support where memfd_create returns ENOSYS (function not implemented). (#1519) (Tao He)
• [6d7dfc49]: Improve the varint encoding for edges by avoiding copy and extra memory (#1516) (Tao He)
• [b85a4789]: Use the golang sdk for tracking chunks for best-effort scheduling and add the relevant e2e test (#1508) (Ye Cao)
• [c2d21534]: set seed for random generator (#1517) (Siyuan Zhang)
• [8ccd4980]: fix the deploy backup job failed when set the pv-pvc-spec (#1515) (Ye Cao)
• [ff4e7fb1]: Implements a shrink API on blob to allow resize blob builder (#1514) (Tao He)
• [0ca7ea32]: Implement cluster-info API of Golang SDK and add the vineyardctl get cluster-info subcommand (#1507) (Ye Cao)
• [7a275fcd]: Revert "[Snyk] Security upgrade alpine from latest to 3.18.3 (#1506)" (Tao He)
• [189f0cff]: Embed operator manifests into vineyardctl and install operator from them (#1513) (Ye Cao)
• [dbf1a50a]: Fixes object ID generation on arm platform (#1510) (Tao He)
• [5a4af631]: Unify the log for vineyardctl and find an appropriate port for forwarding (#1505) (Ye Cao)
• [4dc4a98c]: [Snyk] Security upgrade alpine from latest to 3.18.3 (#1506) (Tao He)
• [52f99369]: Implement the rust SDK: client, object & metadata and array as an example data structure (#1504) (Tao He)
• [a7ea4001]: Bump the airflow to v2.6.3 and improve the doc to adapt to the latest vineyardctl. (#1500) (Ye Cao)
• [8e9caed3]: Add the namespace configurations to the podAffinity and delete the legacy '--wait' flag of helm chart (#1502) (Ye Cao)
• [aa29bbc0]: Fixes the behaviour of removing properties (#1496) (Tao He)

- C++
Published by github-actions[bot] almost 3 years ago

airflow-provider-vineyard - vineyard v0.16.2

Vineyard v0.16.2 improve the the vineyardctl and kedro plugin, and fixes several bugs in io adaptors.

Commits

• [f65e18c5]: Add the missing extract tag step for release vineyardctl CI (#1495) (Ye Cao)
• [0d01e161]: Bump up vineyard version to v0.16.2 (Tao He)
• [55eb0e77]: Fixes the io adaptor parameters: the key should be string (#1493) (Tao He)
• [b438f0e7]: Delete the '--wait' flag during the installation of helm chart. (#1492) (Ye Cao)
• [56b82024]: Add a tutorial for data sharing with vineyard on kubernetes via vineyardctl (#1486) (Ye Cao)
• [adc335b2]: Add cloudpickle-s3 dataset to the benchmark (#1489) (Ye Cao)
• [f2137d0b]: Add socket volume and volumesMount to the workload if not exist and support to inject a pod in the vineyardctl (#1488) (Ye Cao)
• [70d32f20]: Unify table/batch schemas when reading chunks from vineyard streams (#1485) (Tao He)
• [540511ea]: Fixes the bug in vineyard docker image generation (#1483) (Tao He)
• [6c9c7de3]: Add the installation doc of vineyardctl and fix typos of vineyard operator doc (#1481) (Ye Cao)
• [d6ec099b]: Add the vineyardctl of mainstream architecture and os to the release page (#1480) (Ye Cao)
• [a10d87e0]: Improve the kedro mlops tutorial: remove duplication and revise docs (#1479) (Tao He)
• [015b1f28]: Fixes the Google Analytics on vineyard pages (#1470) (Tao He)
• [85eff5a8]: Fixes macos wheels building: use a update-to-date version for apache-arrow (#1467) (Tao He)

- C++
Published by github-actions[bot] almost 3 years ago

airflow-provider-vineyard - vineyard v0.16.1

Vineyard v0.16.1 came with many new features:

• The legacy vineyard-cli has been fully integrated into vineyardctl command line tool for a unified user interfaces.
• torch.data and torcharrow has been integrated into vineyard Python SDK for smooth user experience.
• velox has been integrated for data analytics on vineyard dataframe and tables.
• New website has been published to https://v6d.io.

Commits

• [39f463ab]: Bump up vineyard version to v0.16.1 (Tao He)
• [93c65fd7]: Bump up vineyard version to v0.16.0 (Tao He)
• [71d01a58]: Add velox integration on arrays, dataframes and tables (#1466) (Tao He)
• [cb68733c]: Enrich the functionality of vineyard.connect() method (#1465) (Tao He)
• [12d0d933]: Support to list vineyard objects, metadata, and blobs on the local machine and kubernetes cluster (#1464) (Ye Cao)
• [8df9f248]: Improve pytorch data / torcharrow / torchdata integration (#1463) (Tao He)
• [5b248ceb]: Add a chunk_hook support for vineyard.{read/write} in io adaptors (#1462) (Tao He)
• [cf27180f]: Website: Tiny UI Improvements (#1461) (Uchechukwu Obasi)
• [231fea0e]: Website: Create new landing page (#1449) (Uchechukwu Obasi)
• [999bcd80]: Use distroless rather than alpine-glibc as the base image (#1460) (Tao He)
• [f85e6e0b]: Bump up the version of etcd in the vineyardd image to v3.5.9 (#1459) (Ye Cao)
• [5b30c2e9]: Improve the kedro integration documentation (#1456) (Tao He)
• [eb66753e]: Bump google.golang.org/grpc from 1.47.0 to 1.53.0 in /k8s (#1455) (dependabot[bot])
• [643bf909]: Bump up the version of kubernetes-log-export-action to v5 (#1454) (Ye Cao)
• [7b5b9c15]: Try preview docs using netlify (#1453) (Tao He)
• [6d3c35f3]: Bump up the k8s version to v1.25.10 to fix the existing Kubelet bug (#1448) (Ye Cao)
• [0a98a140]: Update the kedro integration performance report. (#1450) (Ye Cao)
• [32b6e08b]: Bump up the k8s to v1.25.0 and address the security issues (#1447) (Ye Cao)

- C++
Published by github-actions[bot] almost 3 years ago

airflow-provider-vineyard - vineyard v0.15.3

vineyard v0.15.3

- C++
Published by github-actions[bot] almost 3 years ago

airflow-provider-vineyard - vineyard v0.15.2

vineyard v0.15.2 is a bugfix release which addressed an issue about creating remote blobs when vineyardd itself is out-of-memory.

Commits

• [5e418b59]: Bump up vineyard version to v0.15.2 (Tao He)
• [56ff90d3]: Fixes remote blob creation error when OOM (#1433) (Tao He)

- C++
Published by github-actions[bot] almost 3 years ago

airflow-provider-vineyard - vineyard v0.15.1

Vineyard v0.15.1 includes the following minor changes:

• Use a customized Buffer() class to avoid requiring apache-arrow in vineyard_client.
• Add an optional argument to control the parallelism of serializer/deserializer.
• Defaults the shared memory limit to not limited.
• Fixes creating remote blobs when there are trailing 0-sized chunks.

Commits

• [31a3e340]: Bump up vineyard version to v0.15.1 (Tao He)
• [75e3dc4e]: Fixes creating remote blobs when there are trailing 0-sized chunks (#1431) (Tao He)
• [da55873d]: Add the camera ready artifacts for the publication (#1432) (Tao He)
• [78b4d72f]: Fix ConcatenateTables() (#1429) (Songqing Zhang)
• [7d647a5c]: Bump guava from 31.0.1-jre to 32.0.0-jre in /packages-java (#1428) (dependabot[bot])
• [50e59370]: Bump guava from 31.0.1-jre to 32.0.0-jre in /java (#1427) (dependabot[bot])
• [988a471b]: Defaults the shared memory limit to not limited (#1425) (Tao He)
• [55a17bb8]: Check in the missing catalog.py file (#1424) (Tao He)
• [765f91fb]: Implements Buffer/MutableBuffer to remove the arrow deps in vineyard client (#1422) (Tao He)
• [4136522c]: Add the framework for hive integration (#1421) (Tao He)
• [86af8dd5]: Support perfect hashmap in VertexMap (#1408) (vegetableysm)
• [2f8f9518]: Fixes warnings with recent gcc/clang (#1417) (Tao He)
• [13ccf1bf]: Be compatible with Chinese locale for gcc outputs. (#1415) (Tao He)
• [195e57a2]: Add an optional argument to control the parallelism of serailizer/deserializer (#1414) (Tao He)
• [67f893f9]: Use add_subdirectory to generate correct target-*.cmake (#1413) (Tao He)
• [3150e4ad]: Remove the nlohmann/json submodule. (#1412) (Tao He)

- C++
Published by github-actions[bot] almost 3 years ago

airflow-provider-vineyard - vineyard v0.15.0

Vineyard v0.15.0 brings the following two key enhancements:

• Enable delta encoding + varint compression for CSR to reduce the memory usage of graph data structure
• Add backup and failure functionality to vineyardctl interfaces.

Commits

• [b3e01845]: Bump up vineyard version to v0.15.0 (Tao He)
• [286a3300]: Fixes a bug in arrow fragment builder for local vertex map (Tao He)
• [1e1b3998]: Fixes the typename generation for fragment types (#1411) (Tao He)
• [e77ed2b5]: Fixes the delta decoding of compact CSR (#1410) (Tao He)
• [9da4c149]: Fixes the exception during resolving path of vineyardd. (#1409) (Tao He)
• [b8930aeb]: Support to deploy the backup and recover job with an existing pvc (#1407) (Ye Cao)
• [b9e5ed73]: Fix a bug to avoid the panic 'interger divide by zero' during scheduling (#1405) (Ye Cao)

- C++
Published by github-actions[bot] almost 3 years ago

airflow-provider-vineyard - vineyard v0.14.8

Vineyard v0.14.8 adds compression support to the RPC client for efficient remote blob transfer and manipulation.

Commits

• [c20acf8d]: Bump up vineyard version to v0.14.8 (Tao He)
• [a2cdee5a]: Improve GetInnerVertex() by querying local fragment only (#1404) (Songqing Zhang)
• [19616c8c]: Replace the limits with the objectIDs in the backup and recover of vineyard cluster. (#1402) (Ye Cao)
• [2c0957bd]: Batch encoding/decoding (with SIMD) of varint CSR (#1403) (Tao He)
• [e8952166]: Upgrade the libgrape-lite submodule (#1401) (Dongze Li)
• [63caa8e9]: Add compression to rpc clients for remote blobs (#1400) (Tao He)
• [d9a30617]: Simplify the template arguments of loader and modularize the builder (#1399) (Tao He)
• [25390d2b]: Add the labelselector for injected resources to bind the vineyard rpc service (#1398) (Ye Cao)

- C++
Published by github-actions[bot] about 3 years ago

airflow-provider-vineyard - vineyeard v0.14.7

Vineyard v0.14.7 is a bugfix release that address the volume issue in vineyardctl.

Commits

• [ced8892a]: Bump up vineyard version to v0.14.7 (Tao He)
• [991a9393]: Fix the errors of templates when set the volume path of vineyard socket (#1397) (Ye Cao)
• [0c9c16e4]: Implements varint + delta encoding on CSR to optimize the fragment memory usage (#1372) (vegetableysm)
• [a0b6fe3c]: Kedro integration: the vineyardataset, plugin and cli tools (#1287) (Tao He)
• [0b6e36d0]: Add write vertices num to FragmentWriter to adapt the latest GraphAr format (#1395) (Weibin Zeng)
• [51bc511d]: Remove the ctti dependency (#1394) (Tao He)
• [af45fc6b]: Enable cpplint over vineyard-mod files (#1393) (Tao He)
• [e297c80d]: Upload the e2e test of deploying raw backup and recover logs to stoat dev (#1392) (Ye Cao)

- C++
Published by github-actions[bot] about 3 years ago

airflow-provider-vineyard - vineyard v0.14.6

Vineyard v0.14.6 is a bugfix release which addressed many issues in vineyardctl and vineyard-graph-loader.

Commits

• [b2a81047]: Bump up vineyard version to v0.14.6 (Tao He)
• [1e6ed21f]: Fixes the bug in transfer large buffers over rpc client (#1391) (Tao He)
• [c6be274b]: Support deploying a raw backup and recover job for vineyard cluster via vineyardctl (#1384) (Ye Cao)
• [4113deb7]: Improve the error message about misuses of IPC/RPC client (#1387) (Tao He)
• [e934861a]: Specify the required version of libgrape-lite (#1388) (Tao He)
• [2e218974]: Wait the vineyard deployment for ready while using vineyardctl deploy vineyard-deployment (#1383) (Ye Cao)
• [9ed9e745]: Fixes the codegen script for non-type template parameter (#1382) (Tao He)
• [753a1416]: codegen: support TEMPLATENONTYPE_PARAMETER in templates (#1381) (Tao He)
• [55b6ec88]: Load multiple edges with same label but different src/dst (#1380) (Tao He)
• [d3640e3c]: Add OwnerReferences for all resource created during deploying vineyard-deployment and support default namespace (#1378) (Ye Cao)
• [afb6b48a]: Add an option to graph loader to measure graph accessing performance (#1377) (Tao He)
• [37f84fd4]: Improve the performance of initDestFidList() when there are many fragments (#1375) (Songqing Zhang)
• [c44c65e5]: Welcome @vegetableysm :sparkles: (Tao He)
• [fe74ce9b]: Add the missing topologyKey in the schedule workload subcommand of vineyardctl (#1370) (Ye Cao)
• [195dcf95]: Bump github.com/docker/distribution from 2.8.1+incompatible to 2.8.2+incompatible in /k8s (#1371) (dependabot[bot])
• [c2438465]: Warn about duplicated vertices (#1369) (Tao He)
• [eeedd2b1]: Report error when edge src/dst not present in vertices (#1368) (Tao He)
• [bf37a327]: cmake: keep backwards compatibility with cmake<3.18 (#1367) (Tao He)
• [adeacbc3]: Document how to dump the graph (#1366) (Tao He)
• [a64cb46c]: Dump the logs under the namespace which match the wildcard (#1365) (Ye Cao)
• [bd81c72b]: Introduce the kubernetes logs export action and stoat app for debugging the failed e2e test (#1361) (Ye Cao)
• [a99c0bdc]: Print more detail logs when there are unexpected errors in metadata (#1364) (Tao He)
• [470ab448]: Improve the macos CI to build the wheel packages (#1363) (Tao He)

- C++
Published by github-actions[bot] about 3 years ago

airflow-provider-vineyard - vineyard v0.14.5

Vineyard v0.14.5 is a quick bugfix release to adapt to apache-arrow 12.0.0.

Commits

• [9298a3fe]: Bump up vineyard version to v0.14.5 (Tao He)
• [eef604fd]: Adapt to arrow-11/12 (VisitTypeInline & Run-End encoded data) (#1362) (Tao He)
• [15f02c15]: Add a configuration file for stoat-app bot (#1360) (Ye Cao)

- C++
Published by github-actions[bot] about 3 years ago

airflow-provider-vineyard - vineyard v0.14.4

Vineyard v0.14.4 is a bugfix release to adapt to apache-arrow 12.0.0.

Commits

• [9bc031ae]: Bump up vineyard version to v0.14.4 (Tao He)
• [08770451]: Adapt to arrow-12 (arrow::MemoryPool interfaces) (#1359) (Tao He)
• [50746330]: Fixes referenced before assignment error (#1358) (Siyuan Zhang)

- C++
Published by github-actions[bot] about 3 years ago

airflow-provider-vineyard - vineyard v0.14.3

Vineyard v0.14.3 distributes wheel packages that is compatible with MacOS 11 on Apple M1, and - improve the configuration in vineyard operator for easier installation - switch to ~/.local/vineyard/vineyard.sock as the default socket file location for non-root users.

Commits

• [b55b7393]: Bump up vineyard version to v0.14.3 (Tao He)
• [9d081fb7]: Fixes the default location of vineyard IPC socket (#1354) (Tao He)
• [5cf89b06]: Add reserver memory option to k8s deployment (#1353) (Tao He)
• [9dafd6fc]: Homebrew: build dependencies from sources on M1 (#1352) (Tao He)
• [b6771bca]: Update submodules: etcd-cpp-apiv3 & graphar (#1351) (Tao He)
• [dbf23e9a]: Rebuild wheel images for macos 11 with pyenv-installed Python (#1350) (Tao He)
• [e89762c4]: Revert the field name to backwards compatibility. (#1346) (Tao He)
• [77fc94a5]: Add memory and cpu args for vineyardctl. (#1345) (Ye Cao)

- C++
Published by github-actions[bot] about 3 years ago

airflow-provider-vineyard - vineyard v0.14.2

Commits

• [3eceab70]: Bump up vineyard version to v0.14.2 (Tao He)
• [8c8b2551]: [GraphAr] Bump up GraphAr to fix curl dependency issue (#1342) (Weibin Zeng)
• [f8f45e01]: Add the enable-certificate-owner-ref to the subchart of cert-manager. (#1341) (Ye Cao)
• [4ff47f5b]: Prefix etcd pod and services with the vineyardd name to avoid conflicts (#1339) (Tao He)
• [d52c77ce]: Fix the wrong indents of yaml files. (#1338) (Ye Cao)
• [7c5baf2a]: Update the helm chart for the latest vineyard operator (#1337) (Ye Cao)
• [b6e3b469]: Add --load for building the image of vineyard operator to avoid the inconsistent image. (#1334) (Ye Cao)
• [0a80ca44]: Integration with polars dataframe (#1335) (Tao He)
• [e80a7fc2]: Bump spark-core_2.12 from 3.2.2 to 3.4.0 in /java/spark (#1330) (dependabot[bot])
• [ade3612c]: Improve the vineyardctl inject command for integrating with GraphScope (#1315) (Ye Cao)

- C++
Published by github-actions[bot] about 3 years ago

airflow-provider-vineyard - vineyard v0.14.1

Vineyard v0.14.1 is a bugfix release which improves the behaviour of send/recv file descriptors.

Commits

• [a36447a9]: Bump up vineyard version to v0.14.1 (Tao He)
• [bf1b0fc1]: Mitigate the race condition about send/recv file descriptors (#1327) (Tao He)
• [3552f2cd]: Upgrade submodule GraphAr (#1326) (Weibin Zeng)
• [fd83d426]: Remove the redundant and inconsistent configurations (#1323) (Tao He)
• [1b00df45]: Add instructions to leverage llvm on MacOS (#1319) (Tao He)
• [f62bea89]: Fix some dead links of vineyard operator doc (#1318) (Ye Cao)
• [cd7151e9]: [Docs] Fixes typo in docs of PersistentVolume (#1317) (Paul)
• [bbf16abb]: Small code improvement of graph (#1314) (Songqing Zhang)
• [b289484e]: Fixes issue1312: resolve std::string with pa.large_binary (#1313) (wuyueandrew)

- C++
Published by github-actions[bot] about 3 years ago

airflow-provider-vineyard - vineyard v0.14.0

Commits

• [ba75acc1]: Bump up vineyard version to v0.14.0 (Tao He)
• [5170efcd]: Delete CRDs when deleting objects from vineyard (#1311) (Tao He)
• [13a5c26a]: [GraphAr] Bump up GraphAr and fix loading csv data error of gar_fragment_loader (#1310) (Weibin Zeng)
• [00151ddb]: Retry when meets etcderror during persist (#1307) (Tao He)
• [45384fda]: Ignore non-exists objects when during deletion (#1306) (Tao He)
• [29a8828a]: Add the short-term milestones and the long-term milestones for vineyard operator (#1300) (Ye Cao)
• [94f63c65]: Refactor the code of vineyardctl and vineyard operator (#1290) (Ye Cao)
• [a959918e]: Fix deploying vineyard cluster via vineyardctl deploy vineyard-cluster occasionally fail in ci (#1285) (Ye Cao)
• [67bbb633]: Resolve the memfd_create symbol at runtime to compat with different version of glibc (#1298) (Tao He)
• [a3b20106]: Add some notes about indicating to users the required RBAC roles before creating vineyard resources (#1297) (Ye Cao)
• [dfb58097]: Use memfd_create(2) for sharable file descriptor allocation (#1293) (Tao He)
• [e6885b6d]: Redefine the rbac roles of vineyard operator and update the helm chart (#1286) (Ye Cao)
• [7d1a7c31]: Make GAR library as PRIVATE and replace gar header include with forward declarations (#1291) (Weibin Zeng)
• [50e251fc]: Fixes the issue that string_view header of submodule libgrape-lite cannot be referenced (#1289) (wuyueandrew)
• [fb09f646]: Reflactor the vineyard scheduler code (#1276) (Ye Cao)
• [14d2fc4e]: Move vineyard_io to python/vineyard for a locally installable layout (#1279) (Tao He)
• [170cf8a8]: Allow pass options from uri and load fragments from streams (#1278) (Siyuan Zhang)
• [4912b6ae]: Improve the python APIs, add type stubs and inline dostrings (#1277) (Tao He)
• [b897b76c]: Install the cert-manager as a subchart for the chart of vineyard operator (#1275) (Ye Cao)
• [86ffafac]: Clarify the path and data types (#1271) (Tao He)
• [99f07842]: Add references documentation for the vineyard-graph-loader (#1270) (Tao He)
• [54745287]: Enable pass storage options from both kw and path (#1267) (Siyuan Zhang)
• [cd657a82]: Fixes macos M1 CI conditions and the release-docker script (#1266) (Tao He)

- C++
Published by github-actions[bot] about 3 years ago

airflow-provider-vineyard - vineyard v0.13.4

Vineyard v0.13.4 improves the documentation, and add libgrape-lite as a submodule to make the installation process eaiser.

Commits

• [236037eb]: Bump up vineyard version to v0.13.4 (Tao He)
• [625c17f6]: Bump up vineyard version to v0.13.4 (Tao He)
• [f9afbfcf]: Build x86_64/arm image/artifacts in a unified way (#1265) (Tao He)
• [cb54ca31]: Fixes the property id indexing in schema normalization (#1264) (Tao He)
• [d07034bc]: Use libgrape-lite as submodules to make the installation less error-prone. (#1263) (Tao He)
• [3a96129a]: Fixes data missing in last worker (#1262) (wuyueandrew)
• [6814ab45]: Fixes footer customization, add giscus comment system. (#1259) (Tao He)
• [e23f5247]: Fixes the link error and wrong typography (#1258) (Ye Cao)
• [6aaa1bf1]: Remove the underline of vineyard operator arch and add a FAQ for vineyard operator (#1256) (Ye Cao)
• [b7ad6f70]: Output schema to /tmp/object_id.json (#1257) (Siyuan Zhang)
• [86de8205]: Fixes the softlink (Tao He)
• [cd38b9b1]: Fix some typos on vineyard doc (#1255) (Ye Cao)
• [9424cb3e]: Misc updates on documentation (#1254) (Tao He)
• [a9c9d0a6]: Documentation revision: re-struct and re-write, assistant with chatgpt (#1253) (Tao He)
• [d5295b03]: Use manylinux 2014 instead of 2010 (#1251) (Siyuan Zhang)
• [694db5bb]: Improve the vineyardctl docs: typos. duplication, and prettyprint (#1250) (Tao He)
• [5d563c57]: Add circus-ci to build artifacts on M1 Mac (#1249) (Tao He)
• [cb6a96b9]: Misc improvements for building/packaging and CI (#1248) (Tao He)

- C++
Published by github-actions[bot] about 3 years ago

airflow-provider-vineyard - vineyard v0.13.3

Vineyard v0.13.3 is a bugfix release which

• fixed a bug in cobra wrapper to handle boolean variable correctly
• addressed a compatibiliy issue with recent fsspec releases

Commits

• [ed235438]: Bump up vineyard version to v0.13.3 (Tao He)
• [bcf9fa40]: Adapt to recent fsspec changes (#1247) (Tao He)
• [9cc10fd0]: Fix the error when parsing and executing bool variables in the python wrapper of vineyarctl (#1245) (Ye Cao)
• [a7eb00a8]: Fix some errors in the k8s Makefile and add the golint action to speed up linting (#1244) (Ye Cao)

- C++
Published by github-actions[bot] about 3 years ago

airflow-provider-vineyard - vineyard v0.13.2

Commits

• [52d5fa34]: Bump up vineyard version to v0.13.2 (Tao He)
• [d8269085]: Add a globalflag --create-namespace for vineyardctl to create the namespace if needed. (#1243) (Ye Cao)
• [73b4cb4a]: Update the podAffinity to support injecting workload to different vineyard cluster and improve the command description (#1242) (Ye Cao)
• [9bd6e45c]: Ignore the output of checking whether the command exists (#1241) (Ye Cao)
• [631f9178]: Allowing capture the output of certain command (#1239) (Tao He)

- C++
Published by github-actions[bot] about 3 years ago

airflow-provider-vineyard - vineyard v0.13.1

Introduce the vineyard-bdist package to make the release management easier.

Commits

• [6427c604]: Bump up vineyard version to v0.13.1 (Tao He)
• [e5ab929c]: Fixes argument parsing bug in cobra (#1237) (Tao He)
• [fd89f723]: Split binary into vineyard-bdist package (#1236) (Tao He)

- C++
Published by github-actions[bot] about 3 years ago

airflow-provider-vineyard - vineyard v0.13.0

Commits

• [ca0ed9e8]: Bump up vineyard version to v0.13.0 (Tao He)
• [86662cf4]: Add vineyardctl for managing vineyard operator and relavant compenents on kubernetes (#1217) (Tao He)
• [55861831]: Print the number of vertices and edges in log (#1235) (Tao He)
• [8af7abff]: Fixes uninitialized member and inconsistent naming in local vertex map (#1230) (Tao He)
• [b9e94af3]: Make sure use bundled nlohmann-json library, and fixes consistency issue between Python and C++ (#1227) (Tao He)
• [5d09543a]: Collections, tables, and schema: keep backwards compatibility (#1225) (Tao He)
• [07d13872]: Fixes project on fragments that already been projected (#1224) (Tao He)
• [d33b5554]: Unify the request/reply tags in protocol.{h,cc} (#1211) (Tao He)
• [883b4d42]: Add chatgpt codeview to github (Tao He)
• [3c956d0f]: Simplify mimalloc support to support multiple allocators in the same process (#1204) (Tao He)
• [c8c41009]: Fix graph property type's convert (#1207) (Songqing Zhang)
• [c964a0c7]: Fixes many typos in the source code (#1202) (Tao He)
• [2b23e8f3]: Add labels support and APIs on client (#1201) (Tao He)
• [35c99d67]: Fix kubernetes ci errors (#1200) (Ye Cao)
• [a69ee750]: Bump up golang.org/x/net from 0.2.0 to 0.7.0 (#1199) (Ye Cao)
• [e832236a]: Implements vineyard::Table using the Collection API for simplication (#1198) (Tao He)
• [433a3a71]: Refine collection API and tensor/dataframe APIs (#1197) (Tao He)
• [c79056f3]: Enable error check in seal() to prevent uncaught exceptions and crashes. (#1195) (Tao He)
• [9a3b9f0c]: Associate timestamp to object metadata (#1194) (Tao He)
• [d99844b1]: Add evict/load/unpin APIs (#1193) (Tao He)
• [c99105be]: Split the test to reduce CI time and run graph related tests on CI (#1192) (Tao He)
• [0eda2067]: [FEAT] Support building or writing graph from/to GAR format data (#1185) (Weibin Zeng)
• [55a22bc7]: Bump up several components including golang, k8s api and controller-runtime (#1187) (Ye Cao)
• [d3ca2073]: Fixes some compilation errors under latest clang (#1188) (Tao He)
• [d5b61e0c]: Update the comments after preview the generated docs to netlify (#1189) (Tao He)
• [f8f21e29]: Bump github.com/emicklei/go-restful in /k8s (dependabot[bot])
• [f96312be]: Add a showcase for vineyard on kubernetes (Vineyard + Mars + Pytorch) (#1161) (Ye Cao)
• [020f83e4]: Replace the etcd image with vineyardd image (#1173) (Ye Cao)
• [8d1215b6]: Update black to latest version and reformat code (#1169) (Tao He)

- C++
Published by github-actions[bot] about 3 years ago

airflow-provider-vineyard - vineyard v0.12.2

Vineyard v0.12.2 delivered some important improvements over the performance of vineyard-graph module, and

• enable htpasswd based authentication
• improve the vineyard-operator docs a lot

Commits

• [cdb619c9]: Kubernetes CI: build latest vineyardd image from source (#1167) (Tao He)
• [5ea8e99e]: Enable authentication using htpasswd (#1166) (Tao He)
• [64db68f1]: Support configuring the operatiom image in the vineyardd CR and update relevant doc (#1165) (Ye Cao)
• [53b40e4b]: is part of c++20 (#1164) (Siyuan Zhang)
• [421f15d1]: Docs: preview on dev/docs branch as well. (#1159) (Tao He)
• [6f6bbf11]: Drop the intermediate stream when ensure it has finished (#1158) (Tao He)
• [ac7f58f3]: Add vineyard operator architecture (#1128) (Ye Cao)
• [9a8f7ed4]: Add commands for remote installation of vineyard operator (#1157) (Ye Cao)
• [827e88dd]: Add the missing code block in the vineyard operator doc (Ye Cao)
• [ccfed832]: Revise all e2e tests to use the kind cluster with local registry (#1137) (Ye Cao)
• [5c2604cd]: Use -1 to indicates unknown chunk index inside a global dataframes (#1156) (Tao He)

- C++
Published by github-actions[bot] over 3 years ago

airflow-provider-vineyard - vineyard v0.11.7

- C++
Published by github-actions[bot] over 3 years ago

airflow-provider-vineyard - vineyard v0.11.6

- C++
Published by github-actions[bot] over 3 years ago

airflow-provider-vineyard - vineyard v0.11.5

Yanked.

- C++
Published by github-actions[bot] over 3 years ago

airflow-provider-vineyard - vineyard v0.11.4

- C++
Published by github-actions[bot] over 3 years ago

airflow-provider-vineyard - vineyard v0.11.3

Commits

• [5ca52df1]: Fixes parsing flags when using higher version of apache-arrow (#1113) (Tao He)
• [c3f83ad4]: Fixes staled version number in setup.cfg (#1112) (Tao He)

- C++
Published by github-actions[bot] over 3 years ago

airflow-provider-vineyard - vineyard v0.11.2

Commits

• [9cf06828]: Fixes a bug in local vertex map specialization (#1111) (Tao He)
• [f6006ef6]: Fixes bugs in fragment loader for corner cases (#1110) (Tao He)
• [c26026b6]: Add scheduler outside k8s cluster (#1097) (Ye Cao)
• [13ba236d]: Removing the CRC functions from thirdparty (#1109) (Tao He)
• [525db6d6]: Fixes conditions for adding hash template specialization for string view (#1108) (Tao He)
• [e4e29fc4]: Fixes conditions for adding hash template specialization for string view (#1107) (Tao He)
• [a16d48c6]: Use a CSR generation implementation with less memory footprint (#1106) (Tao He)
• [414d864a]: Fixes the dask errors on CI (#1105) (Tao He)
• [7a85bfb5]: Accept a filetype arguments for reading orc/parquet using prefix (#1104) (Tao He)
• [20055f30]: Overhual arrow builders and fragment loaders (#1102) (Tao He)
• [b90f2155]: Fixes format/lint errors. (#1101) (Tao He)
• [e00e085a]: String tensors requires arrow.vineyard.h to work. (#1100) (Tao He)
• [f3eb52fe]: Enhance implementation of fragment to accelerate the compilation (#1095) (Tao He)
• [c6f359aa]: Reorganize k8s directory. (#1094) (Ye Cao)
• [5556febf]: Add sidecar webhook for injecting the vineyard container and Sidecar CRD for configuring the sidecar. (#1073) (Ye Cao)
• [afe58e5c]: Upload source tarball after release. (#1092) (Tao He)

- C++
Published by github-actions[bot] over 3 years ago

airflow-provider-vineyard - vineyard v0.11.1

Commits

• [019d2ddd]: Support string tensors (#1079) (Tao He)
• [f8a6c0a5]: Fixes false-postive when testing if pointer is a "VALID" shared memory piece. (#1078) (Tao He)

- C++
Published by github-actions[bot] over 3 years ago

airflow-provider-vineyard - vineyard v0.11.0

Commits

• [57369a10]: Improve some builders and resolvers. (#1069) (Tao He)
• [afe2c629]: Add a go.work file to incorporate the feature of multi-directory workspace since go 1.18 (#1071) (Tao He)
• [605fc9ab]: Decouple the logic of creating stream and parsing header lines, and strip UTF-8 BOMs. (#1068) (Tao He)
• [78f71ef2]: Use the CHECK_IPC_ERROR rather than RETURN_ON_ASSERT to avoid crash on failures. (#1067) (Tao He)
• [2ead595d]: [BugFix] Pass by reference instead of pass by value in generate_local_id (#1066) (Weibin Zeng)
• [144bd4e9]: Use the helmify tool to autogenerate operator helm charts and update relevant e2e test and doc. (#1065) (Ye Cao)
• [db296f47]: Upgrade mimalloc and pybind11 submodules. (#1064) (Tao He)

- C++
Published by github-actions[bot] over 3 years ago

airflow-provider-vineyard - vineyard v0.10.2

Vineyard v0.11.2 improves in the following two aspects,

• implements LocalVertexMap to vineyard-graph.
• implements basic spark integration in the Java SDK.

Commits

• [eed85833]: Don't continue if error occurs during building the array (#1063) (Tao He)
• [38472d45]: Fixes a warning in local vertex map (#1062) (Tao He)
• [a19f103b]: Fix local vertex map when adding edges (#1061) (Siyuan Zhang)
• [3e7ab0ad]: Add options to configure webhook in helm chart and improve the relevant doc. (#1060) (Ye Cao)
• [5d810153]: Resolves failures and warnings in CI (#1058) (Tao He)
• [3add7e17]: Add default value to vineyard deployment, remove ad-hoc filling and fixes typos. (#1057) (Tao He)
• [693af786]: Implement local vertex map in arrow fragment. (#1053) (Siyuan Zhang)
• [71c0afed]: Update vineyard operator's image to vineyardcloudnative/vineyard-operator (#1056) (Ye Cao)
• [430bf6ab]: Revise the vineyard-operator docs: first part. (#1055) (Tao He)
• [ac714de2]: Improve vineyard operator doc. (#1054) (Ye Cao)
• [69108db7]: Enable support for parquet and ORC IO (#1052) (Tao He)
• [3c369893]: Add Vineyard Operator Documention (#1051) (Ye Cao)
• [e7d594a1]: Java: use cmake plugin to build FFI sources. (#1050) (Tao He)
• [ac5f5aed]: Bump junit from 4.12 to 4.13.1 in /java/spark (#1049) (dependabot[bot])
• [c731b96f]: Spark on vineyard POC: run spark RDD/DataFrame APIs and SQL on vineyard table. (#1048) (Tao He)
• [48871f3a]: Add dask repartition operation to pluggable drivers. (#1041) (Ye Cao)
• [1d499f6e]: Add git leaks hooks to this repo (#1045) (Tao He)
• [5675b1a2]: Fixes the read_bytes.py to adapt to the latest fsspec (#1044) (Tao He)
• [1e96b60d]: Source more rf-files and use bash -lc when starting IO drivers (#1043) (Tao He)
• [ef452b55]: operator: move the SchedulerState into a standalone file. (#1042) (Ye Cao)
• [23173c0d]: Source /etc/bash.bashrc as well for Ubuntu 2.04 (#1040) (Tao He)

- C++
Published by github-actions[bot] over 3 years ago

airflow-provider-vineyard - vineyard v0.10.1

Vineyard 0.10.1 is a bugfix release that addresses some compatibility issues.

Commits

• [4a242a1c]: Upgrade vineyard version to v0.10.1 to fixes the wheel error (Tao He)
• [dd723aa4]: Move to ubuntu 20.04 and give up ubuntu 18.04 support (#1038) (Tao He)
• [a370e20d]: Fixes error in vineyard-operator's CRDs (#1039) (Ye Cao)

- C++
Published by github-actions[bot] over 3 years ago

airflow-provider-vineyard - vineyard v0.10.0

Vineyard v0.10.0 brings the following highlighted features:

• Improve the vineyard-operator to add assembly and migration support.
• Refactor the migration implementation and enables transparent compression as an optimization.
• Fixes several errors in IO drivers and improve the error diagnostics.
• Add the cllient.ListNames() API to list all available names inside the cluster.

Commits

• [42a545cf]: Fixes reading ultra-small sized files (#1036) (Tao He)
• [02366680]: Tune the logs when IO driver fails and avoid leak sensitive information in logs (#1035) (Tao He)
• [9651469c]: Fix the error in Dockerfile.vineyard-python-dev (#1034) (Ye Cao)
• [de97d306]: Update helm chart for new CRD (#1032) (Ye Cao)
• [56f1186d]: Implement vineyard assembly operation in vineyard-operator (#990) (Ye Cao)
• [251bf5d4]: Add support for Apache Arrow 10.0.0 (#1030) (Sutou Kouhei)
• [b1e01e12]: Move migration from client to server and push the work to IO workers. (#1027) (Tao He)
• [0b435614]: Revert "Share the etcd and redis watcher between sessions (#1007)" (#1028) (Tao He)
• [bf0e4b26]: upgrade GitHub actions version (#1026) (Siyuan Zhang)
• [6fa66757]: Upgrade required etcd-cpp-apiv3 to v0.2.9. (#1025) (Tao He)
• [accc58bb]: RPC server for sessions: share the same port and switch to child session when needed. (#1024) (Tao He)
• [4c5835e4]: Share the etcd and redis watcher between sessions (#1007) (ShiHao)
• [ff1f050e]: Implements "ListNames". (#1023) (Tao He)
• [c68d0059]: Add Docker Hub badge in the readme (#1021) (Ye Cao)
• [8030d36c]: Add Dockerfile for vineyard python-dev (#1017) (Ye Cao)
• [18cd5c27]: Enable webhook in vineyard operator (dashanji)
• [7580d719]: Add webhook service (dashanji)
• [ec758a6b]: Clean the vineyard operator. * Clean the vineyard operator's configuration. * Add webhook for the vineyard operator helm chart. * Readjust the limits and required of the controller. (dashanji)
• [8deed7b7]: Use the annotation to replace label for vineyard job (#1019) (Ye Cao)
• [910e0d49]: Bump up dependency version to fixes the dependentbot warnings (#1013) (Tao He)
• [07dd5b7a]: Avoid print too much logs (#1011) (Tao He)
• [5e58bb0a]: Disable the coredump by default and add an command line option to enable it (#1010) (Tao He)
• [6c518fa1]: Fix bug in vineyard-operator ci (#1006) (Ye Cao)

- C++
Published by github-actions[bot] over 3 years ago

airflow-provider-vineyard - vineyard v0.9.0

Vineyard v0.9.0 is the first release of v0.9 series, include a notable bugfix where a data race may occuring during load graphs.

Commits

• [4bdd29b2]: Ensure no resize() operation happens at the same time between different worker threads (#1005) (Tao He)
• [bc61680f]: Login into the docker registry to publish image to github packages (Tao He)
• [d861e88c]: Release vineyard-operator in ci (#1002) (Ye Cao)
• [e4e435b1]: Delete the vineyard controller image (#1000) (Ye Cao)

- C++
Published by github-actions[bot] over 3 years ago

airflow-provider-vineyard - vineyard v0.8.6

Vineyard v0.8.6 improves the C++ template files a bit.

Commits

• [8d593b1f]: Fixes the syntax error in comments (#999) (Tao He)
• [e997c3ef]: Syntax highlighting in VIM. (#998) (Tao He)
• [dce0a5de]: Unsigned types in graphs schema. (#997) (Tao He)
• [51019226]: Nested ns declaration is a C++17 extension. (#996) (Tao He)
• [bd7cb9ae]: Fixes the construct of global dataframe/tensor to match the semantic of python. (#994) (Tao He)
• [00a15f42]: Add debuginfo only for vineyard components (#992) (Tao He)

- C++
Published by github-actions[bot] over 3 years ago

airflow-provider-vineyard - vineyard v0.8.5

Vineyard v0.8.5 supports adding columns to edge table of arrow fragments.

Commits

• [74997e35]: Support add edge column for ArrowFragment. (#987) (Zhang Lei)
• [269f3ba4]: Delete useless config in vineyard operator (#985) (Ye Cao)

- C++
Published by github-actions[bot] over 3 years ago

airflow-provider-vineyard - vineyard v0.8.4

Vineyard v0.8.4 is a bugfix release.

Commit

• [66feaea2]: Restore the changes for the 'name' of property types (#986) (Tao He)

- C++
Published by github-actions[bot] over 3 years ago

airflow-provider-vineyard - vineyard v0.8.3

Vineyard v0.8.3 came with the following enhancement:

• Support redis as the metadata backend
• The memory usage of the graph data structure has been optimized
• A vineyard-operator has been added to simplify the deploy and management of vineyard cluster as well as the shared objects.

Commits

• [b901792e]: Move some implementation to .cc to reduce compliation time. (#984) (Tao He)
• [2322faa8]: Remove unused generated clientset/listers/informers and fixes a bug in codegen annotation. (#982) (Tao He)
• [a51ad2f2]: CMake: find and set ccache correctly. (#983) (Tao He)
• [888a67f7]: Disable the lru_test if tbb is not found (#981) (Tao He)
• [61bbc615]: Fix dependency (#980) (Ye Cao)
• [e611dcba]: Add helm chart for vineyard operator (#977) (Ye Cao)
• [a45543ae]: Fixes error under lower version of C++ in wyhash.hpp. (#979) (Tao He)
• [f51ebe1c]: Fixes the typo: ConsodilateColumns -> ConsolidateColumns (#978) (Tao He)
• [24af41e7]: Add Vineyardd CRD and Controller (#951) (Ye Cao)
• [0a948f23]: Use wyhash as the hash function when building the hashmap to reduce memory usage (#976) (Tao He)
• [515f13e8]: Add a consolidate method to merge multiple columns of same type in a table into one (#975) (Tao He)
• [a6528a11]: Lightweight metadata service backend for vineyard (#902) (ShiHao)

- C++
Published by github-actions[bot] over 3 years ago

airflow-provider-vineyard - vineyard v0.8.2

Vineyard v0.8.2 is a bugfix version that address the deadlock issue during spill happening.

Commits

• [337e71df]: Use a recursive mutex to fixes the deadlock failure (#972) (Tao He)

- C++
Published by github-actions[bot] over 3 years ago

airflow-provider-vineyard - vineyard v0.8.1

Vineyard v0.8.1 is a bugfix release that addressed the lock crash issue inside vineyardd.

Commits

• [b478b907]: Lock the mutex when declare the lock (#971) (Tao He)
• [745faa1e]: Fixes compatibility build (#969) (Tao He)

- C++
Published by github-actions[bot] over 3 years ago

airflow-provider-vineyard - vineyard v0.8.0

Vineyard v0.8.0 introduces GPU memory support, and has addressed a race condition bug that may crash vineyardd.

Commits

• [a67d9f19]: Add the interface to create blobs that backed by files on Disk. (#966) (Tao He)
• [3d716997]: Validate the etcd endpoint before feed into the etcd client. (#963) (Tao He)
• [cb3339f6]: Fixes a backwards compatibility issue in payload message. (#960) (Tao He)
• [4428f7a5]: Use the faster memcpy implementation from the ClickHouse project (#959) (Tao He)
• [ebb71386]: Add APIs for the access of offset array in the fragment (#958) (husimplicity)
• [fde982c8]: Replace arrow buffer with chunk buffer (#947) (liusitan)
• [1cece091]: Fixes a incorrect of sharedfromthis in CRTP (#955) (Tao He)
• [f342b3a1]: Implement GPUBulkStore and GPUBulkAllocator (#876) (CSWater)
• [d77c3e26]: Fixes the compatibility issue with Ubuntu 18.04. (#950) (Tao He)

- C++
Published by github-actions[bot] over 3 years ago

airflow-provider-vineyard - vineyard v0.7.2

Vineyard v0.7.2 introduces many new features

• Introduce a FetchAndGet api on client to access remote objects
• Introduce a command line flag --allocator which can be dlmalloc (by default) or mimalloc to select an allocator implementation
• Vineyard can be deployed as a systemd service (see also https://v6d.io/notes/deploy-locally.html#vineyard-a-systemd-service)

Many bugs has been fixed along with this release as well.

Commits

• [ccfb3cf3]: Installing vineyard as a systemd service (#949) (Tao He)
• [61f37417]: Leave larget space for mimalloc. (#946) (Tao He)
• [8c64a7ea]: Avoid including the unsealed blobs and the dummy blob into the result of listobjects. (#945) (Tao He)
• [cfe36d05]: Etcd launcher: use a temporary directory to data for each launching. (#942) (Tao He)
• [1789508f]: Ignore invalid metadata entries in client.ListData(). (#941) (Tao He)
• [ca825c5b]: Upgrage crdVersion to v1 and add multigroup (#939) (Ye Cao)
• [58a9c528]: Improve the ConstructFragmentGroup to accept projected fragments. (#934) (Tao He)
• [2f2c7f76]: vineyard fuse: add serilaization and deserialization factory (#889) (liusitan)
• [8e5643a2]: MarkAsCode: exclude "unsealed" blobs. (#933) (Tao He)
• [3301d5eb]: Add e2e test for scheduler-plugin. (#931) (Ye Cao)
• [a5b7475c]: Enable switch allocator using command line flags. (#930) (Tao He)
• [86d030a0]: Fixes the incorrect link in airflow provider's readme. (Tao He)
• [f11ef56f]: Refactor the migration APIs on vineyard client. (#927) (Tao He)
• [0a7ad1bd]: Cast boolean array to int array. (#928) (Tao He)
• [d0d64875]: Add docker images for vineyard installed and for vineyard developing (#929) (Tao He)
• [7e3a788c]: Unify the implementation of "mmap/munmap" in different allocators to avoid duplication. (#925) (Tao He)
• [66652cc1]: Address a missing import error in Python 3.8. (#924) (Tao He)
• [ecd09eb5]: Upgrade PreFilter to date, add sync_crds in helm charts, and remove unused ubuntu based dockerfile. (#922) (Ye Cao)
• [03e55b90]: "-DGLIBCXXUSECXX11ABI": allow override from command line. (Tao He)
• [8c8a0c65]: Disable usage of __rdtsc under certain circumstances. (#923) (Tao He)
• [b5749726]: Rename the flat_hash_map.hpp to avoid conflicts with other libraries. (#921) (Tao He)
• [cdd648f5]: Remove the jemalloc implementation and use mimalloc as the client side allocator. (#918) (Tao He)
• [3e88b434]: Infer the job replicas from the pods's ownership references (#917) (Tao He)
• [645dc77f]: Remove the unused vineyardjob CRD and refactor the scheduler plugin codebase (#915) (Tao He)
• [df8ea1c7]: Catch the json exception, especially inserting using json_pointer (#914) (Tao He)
• [4c276111]: Fixes the compatibility with latest nlohmann-json. (#909) (Tao He)
• [67883c14]: Upgrade k8s related components to v0.24.0 (#912) (Ye Cao)
• [af399eea]: Remove the API and implementation about "deep copy". (#910) (Tao He)

- C++
Published by github-actions[bot] almost 4 years ago

airflow-provider-vineyard - vineyard v0.7.1

Vineyard v0.7.1 is a bugfix release that improves the arrow-fragment-loader and related test cases a bit.

Commits

• [453778b5]: Improve the loadedarrowfragment_test for better argument parsing and output creation. (#903) (Tao He)
• [f0a4b9a0]: Add @dashanji to the maintainer list. (Tao He)
• [8a0b029d]: Update the copyright timeline (#901) (Ye Cao)
• [10ebb698]: Introduce golang lint (#900) (Ye Cao)
• [e0914954]: Fixes the typename parsing under gcc-7 with cxx11 ABI (on Ubuntu 18.04) (#898) (Tao He)
• [e2616d96]: Fixes a argument parsing bug in the vineyard-graph-loader. (#896) (Tao He)
• [22ce29a6]: Add benchmark test and result for mimalloc (#893) (Ye Cao)
• [54768dc3]: Keeps compatible with apache-arrow 9.0.0. (#895) (Tao He)
• [1ada72c6]: Use macos-11 runner on Github Actions. (Tao He)

- C++
Published by github-actions[bot] almost 4 years ago

airflow-provider-vineyard - vineyard v0.7.0

Commits

• [57a0d1d]: Add mimalloc for shared memory (#892) (Ye Cao)
• [1bfae06]: [CI] Don't panic if we just run out of memory. (#891) (Ke Meng)
• [bb5fd8b]: Return nullptr instead of throw exceptions in getobject. (#888) (Tao He)
• [6c1e52d]: Add a graph loader utility. (#887) (Tao He)

- C++
Published by github-actions[bot] almost 4 years ago

airflow-provider-vineyard - vineyard v0.6.2

Vineyard v0.6.2 is a bugfix release and bring prilimiary support for transparent spilling. The spill can be enabled with the vineyardd -spill_path command line argument.

Commits

• [25c064c]: Use more meaningful message when failed to create the IPC socket (#886) (Tao He)
• [a50b700]: Resolves the data race condition in the destruction of SocketServer. (#885) (Tao He)
• [a9ff904]: Improve the code quality according to the Python and C++ linters. (#882) (Tao He)
• [cad1c41]: fix a small error in the doc (#880) (dashanji)
• [a22c695]: Address some compilation warnings about warn-not-used. (#879) (Tao He)
• [0e2ef2b]: Cleanup the alloc_test, add a makefile for building and testing (#878) (Tao He)
• [af22e6f]: Support spill mechanism for v6d server (#815) (Yitao Wang)
• [7295b8e]: Add doc about etcd (#875) (dashanji)
• [36f62b0]: Add back the vineyard_{malloc,free,calloc,realloc} implementation. (#874) (Tao He)
• [021f5e7]: Split fragment into several compilation unit and conform the C++11 standard. (#872) (Tao He)
• [2ebd304]: Make sure the installed vineyard can be found using find_package() from cmake. (#871) (Tao He)
• [0377128]: Add a shared_ptr reference of bulkstore in the SocketConnection (#869) (Tao He)
• [0cb5726]: Allow customized image when deploying to Kubernetes from Python (#867) (Tao He)
• [c92885e]: Add header row for localioadaptor (#865) (wuyueandrew)
• [2a82aa7]: Leave spaces for jemalloc's arena metadata and internal padding (#866) (Tao He)
• [494d804]: Enhance the fuse integration. (#861) (Tao He)
• [c8a396c]: Fixes the wrong target class and missing arguments in the RPCClient. (#857) (Tao He)
• [32885f9]: Make sure the readme.rst conform the requirements of pypi (#855) (Tao He)
• [a8757ec]: Fixes the compatibility build. (Tao He)

- C++
Published by github-actions[bot] almost 4 years ago

airflow-provider-vineyard - vineyard v0.6.1

Vineyard v0.6.1 enables the following important experimental features:

• Limited mutatbe support for blobs, see also https://github.com/v6d-io/v6d/issues/843
• Refined documentation and deployment guidance on Kubernetes, see also: https://v6d.io/notes/deploy-kubernetes.html
• Integration with the hosseinmoein/DataFrame

Commits

• [c3000d3]: Add some debugging logs for reading tables/recordbatches from streams (#854) (Tao He)
• [6cd26e8]: Revisit the python API and documentation for Kubernetes deployment (#853) (Tao He)
• [5a30488]: Integration with hosseinmoein dataframe (#848) (vegetableysm)
• [84892fa]: Add documents for data accessing, streams and newly added APIs on clients (#850) (Tao He)
• [52b59af]: On M1 mac the error is a RuntimeError. (#847) (Tao He)
• [a48d007]: Enable mutable blob support. (#844) (Tao He)
• [312eda5]: Enable blob creation and access from RPC client. (#841) (Tao He)
• [a34bebf]: Revisit the implementation of issharedmemory testing (#840) (Tao He)
• [bfb9afb]: make all GenerateBlobID use rand generator (#839) (Yitao Wang)
• [7133441]: Fix the bug that macosx thread explicitly marked deleted (#831) (Siyuan Zhang)
• [8ee97a1]: Force light theme, even the browers works under dark mode. (#832) (Tao He)
• [58d7f8c]: Refine the TOC of README.rst, and add committers to our maintainers.md. (#829) (Tao He)
• [cc6d2a0]: Add more sections for the concepts in vineyard and split the dive-in into several pages. (#827) (Tao He)
• [050b1fd]: Use SO_NOSIGPIPE for MacOS (#823) (Tao He)
• [4789f46]: Hotfix: Upgrade the numpy version to avoid compatiblity issue with pandas. (#819) (Tao He)
• [fc9611b]: Ensure the logo is centerized. (#817) (Tao He)
• [340cf25]: Update the vineyard documentation using the furo theme. (#816) (Tao He)

- C++
Published by github-actions[bot] almost 4 years ago

airflow-provider-vineyard - vineyard v0.6.0

Vineyard v0.6.0 enhances the support and backwards compatibility for airflow.

Commits

• [5156574]: Fixes the backwards compatibility issue of airflow (#814) (Tao He)
• [8e02498]: Makes libunwind as an optional dependency. (#809) (Tao He)
• [a37ed14]: Fixes the compatibility issue on MacOS. (#807) (Tao He)

- C++
Published by github-actions[bot] almost 4 years ago

airflow-provider-vineyard - vineyard v0.5.4

Vineyard v0.5.4 address several compliation issues about graph data structures.

Commits

• [7b5b144]: Fixes compilation failure of ArrowTensorT with template specialization (#806) (DongZe Li)
• [d229431]: Fixes a typo in tutorials (#804) (bobhan1)
• [c5db621]: Enable optional wyhash for hashmap. (#800) (Tao He)
• [0da6a95]: Fixes the link failure under C++14. (#801) (Tao He)
• [924f694]: Support lru in ColdObjectTracker (#794) (Yitao Wang)

- C++
Published by github-actions[bot] almost 4 years ago

airflow-provider-vineyard - vineyard v0.5.3

Vineyard v0.5.3 handles several compatibility issue carefully to make vineyard work seamlessly on variaous platforms, e.g., CentOS and ArchLinux.

Commits

• [e45c987]: Add the contrib directory to vineyard include dirs. (#799) (Tao He)
• [c028225]: Erase the misleading tbb warning raised from intel-tbb directory. (#798) (Tao He)
• [0c16d2b]: Search libvineyardinternalregistry.so from current directory. (#797) (Tao He)
• [08dc6a1]: Handle LDLIBRARYPATH properly in runner.py for inplace building. (#796) (Tao He)

- C++
Published by github-actions[bot] almost 4 years ago

airflow-provider-vineyard - vineyard v0.5.2

Vineyard v0.5.2 has the following two key enhancement:

• Improve the serialization/deserialization to bump up the performance
• Add a new API to create placeholder on certain vineyard instance.

- C++
Published by github-actions[bot] almost 4 years ago

airflow-provider-vineyard - vineyard v0.5.1

Vineyard release v0.5.1 address two issues in the io modules:

• Support builtin compression (lz4) in serialization/deserialization
• Add a empty blob checks when building chunks to streams.

- C++
Published by github-actions[bot] almost 4 years ago

airflow-provider-vineyard - vineyard v0.5.0

Vineyard v0.5.0 resolves several dev-infra related issues, simplify the dependency management, and enhance the lifecycle mechanism of blobs.

Commits

• [51632c1]: Vineyard release v0.5.0 (Tao He)
• [65e5267]: Change blob_id from memory address to randomly generated number. (#777) (Ke Meng)
• [87f207e]: Refine the documentation about installation and try in README (#778) (Tao He)
• [7029b20]: Fixes the compatibility issue of stream implementation (#776) (Tao He)
• [89c756b]: Introduce StoreType to support diverse bulk store. (#775) (Ke Meng)
• [49a3a85]: Maintain cold blobs in vineyardd. (#765) (Ke Meng)
• [be01b43]: Add thirdparty/nlohmann-json only when the target doesn't exist. (#773) (Tao He)
• [5fde6d0]: Etcd peer: find a free port. (#770) (Tao He)
• [9f8b1c3]: Enhance the status check macro implementation. (#769) (Tao He)
• [3c64e0a]: Build repository tarball with submodules using github actions. (#757) (Tao He)
• [f32a3b3]: Make the jemalloc dependency optional (#755) (Tao He)
• [894af3e]: Build bundled thirdparty dependencies as static libraries (#756) (Tao He)
• [15ebd98]: Build vineyard-migrate on MacOS with proper ABI tag (#754) (Tao He)
• [932108f]: Fixes issues in compatibility build (#751) (Tao He)
• [c5ff9b3]: Bump up vineyard version to v0.4.2 (Tao He)
• [5fafe72]: Instructions for deploying airflow on Kubernetes with vineyard as backend (#736) (Tao He)
• [192fe5d]: Accept both dataframe stream and recordbatch stream when loading graph from streams (#750) (Tao He)
• [4e4f8dc]: Validate the fd set between client and server (#749) (Tao He)
• [770a24f]: Add a documentation section for how to run test cases (#747) (Tao He)
• [b31d50d]: Add CI actions for ArchLinux and CentOS latest (#745) (Tao He)
• [fbe8d15]: Delete the incorrectly checked files (#744) (Tao He)
• [3f0484b]: Add a dep when compile on macos (#743) (waruto)
• [76c8658]: Makes the readme satisfy the requirements of pypi (#738) (Tao He)
• [73a4a9d]: Update wheels to different paths based on python version (#737) (Tao He)
• [923f09a]: Change the use external libs to OFF by default as we have received some trouble reports from users (#735) (Tao He)
• [c87ac5f]: Update manylinux builder image and add python 3.10 artifacts (#733) (Tao He)
• [5943afb]: Prepare the package vineyard-migrate (#731) (Tao He)
• [5562db0]: Remove the legacy vineyard-copy related source code (#730) (Tao He)
• [d7b8f86]: :sparkles: Add @septicmk to the project maintainers. (Tao He)
• [d2ff0cf]: bugfix: release vineyard v0.4.1 (Tao He)
• [69c9707]: Fixes the interfaces of parallel stream builder (#718) (Tao He)
• [d56ba3e]: Add a copy-way to read chunks from recordbatch stream. (#717) (Tao He)
• [1099be9]: Fixes the compute of iv/ov num (#716) (Tao He)

- C++
Published by github-actions[bot] almost 4 years ago

airflow-provider-vineyard - vineyard v0.4.2

- C++
Published by github-actions[bot] about 4 years ago

airflow-provider-vineyard - vineyard v0.4.1

- C++
Published by github-actions[bot] about 4 years ago

airflow-provider-vineyard - vineyard v0.4.0

Vineyard v0.4.0 includes two major improvements:

• Session support in vineyardd that brought isolation between different users on top of a single vineyardd instance
• Improvement on the implementation of vineyard::ArrowFragment in a more standarized way

Commits

• [08af8de]: Bump up the version to v0.4.0 (Tao He)
• [06fb444]: Fixes several bugs and missing APIs about fragment data structure (#714) (Tao He)
• [c40156f]: Add WriteTable method to LocalIOAdaptor (#712) (Siyuan Zhang)
• [057cfc6]: Adapt the parsing in code generator to latest libclang. (#713) (Tao He)
• [0cf0dcb]: Fix incorrect value of partition size in GlobalDataFrame (#711) (Siyuan Zhang)
• [cea5fd8]: Correctly find vineyard package on Debian with multiarch support (#710) (DongZe Li)
• [e401c5a]: Support query object id from a client-side pointer. (#709) (Tao He)
• [3d7ead3]: Use send() rather than write() to avoid the SIGPIPE signal. (#707) (Tao He)
• [85d7551]: Use a callback to ensure the RPC/IPC server ready before return the the client (#706) (Tao He)
• [2dcfc49]: Sync with the bug-fixed version of etcd-cpp-apiv3. (#705) (Tao He)
• [df24f08]: Remove write msg mutex for SocketConnection. (#704) (Ke Meng)
• [8597b3e]: Refine the invokation of java generator inside CMake process. (#702) (Tao He)
• [318cc10]: Try (sliently) remount when needed and when possible. (#700) (Tao He)
• [06f2152]: Code generate for C++, and implements ArrowFragment using annotations. (#698) (Tao He)
• [4dbce9e]: Resolves the bug in arrow fragment string test. (#696) (Tao He)
• [da839e7]: Restrict the version of click. (#695) (Tao He)
• [7ac275f]: Split tableshufflerbeta impl to cc file (#694) (Zhang Lei)
• [382c0e8]: Fixes the CI failure of dask. (#692) (Tao He)
• [bec2262]: Bump logback-core from 1.2.5 to 1.2.9 in /java (#691) (dependabot[bot])
• [c37e9a3]: Bump jackson-databind from 2.12.4 to 2.12.6.1 in /java (#690) (dependabot[bot])
• [9fa582f]: [2/2] Support "shallow copy" between sessions (plasma and normal) (#689) (Ke Meng)
• [79dbcb8]: [1/2] Support "shallow copy" between sessions (normal only) (#688) (Ke Meng)
• [82db4e1]: Support life cycle management for external blobs (#687) (Ke Meng)
• [23aafa9]: Fixes the compatbility with older version of boost/asio. (#685) (Tao He)

- C++
Published by github-actions[bot] about 4 years ago

airflow-provider-vineyard - vineyard v0.3.21

- C++
Published by github-actions[bot] about 4 years ago

airflow-provider-vineyard - vineyard v0.3.20

- C++
Published by github-actions[bot] about 4 years ago

airflow-provider-vineyard - vineyard v0.3.19

- C++
Published by github-actions[bot] over 4 years ago

airflow-provider-vineyard - vineyard v0.3.18

- C++
Published by github-actions[bot] over 4 years ago

airflow-provider-vineyard - vineyard v0.3.17

- C++
Published by github-actions[bot] over 4 years ago

airflow-provider-vineyard - vineyard v0.3.16

Vineyard v0.3.16 improves the serialization/deserialization of vineyard objects.

Commits

• [0359622]: Allow CI been triggerd manually. (Tao He)
• [7f4b10a]: Fixes serveral issues for (de)serialization on K8s. (#636) (Tao He)
• [2ed6ff8]: Lint some python source files. (#635) (Tao He)
• [31488ea]: Fixes the typing hint under Python 3.8. (#634) (Tao He)
• [eb9ad22]: Bump up the version number to v0.3.16. (Tao He)
• [a80c014]: Implements serialzer and deserializer on vineyard objects. (#632) (Tao He)
• [ca5a7a5]: Fix the sequence of dataframe may not correct (#633) (Siyuan Zhang)
• [6a3d51d]: Fixes a bug when adding full "metadata" as member of global objects. (#631) (Tao He)

- C++
Published by github-actions[bot] over 4 years ago

airflow-provider-vineyard - vineyard v0.3.15

Vineyard v0.3.15 is a bugfix release that correct the key name in the metadata of DataFrames.

Commits

• [2217d37]: Bump up version to v0.3.15. (Tao He)
• [164084d]: Fixes the typing of DataframeStream's name and the "params_" field name. (#630) (Tao He)
• [d2e1b05]: Re- setup python using "actions/setup-python@v2". (#629) (Tao He)
• [1685d55]: Upgrade etcd-cpp-apiv3. (Tao He)

- C++
Published by github-actions[bot] over 4 years ago

airflow-provider-vineyard - vineyard v0.3.14

Vineyard v0.3.14 includes some improvements about the streams APIs.

Commits

• [61a0a6f]: Bump up vineyard version to v0.3.14. (Tao He)
• [d163d1f]: Revisit stream, and reimplements io adaptors in Python. (#628) (Tao He)
• [f1f2cda]: Revisit the stream implementation in vineyard. (#627) (Tao He)
• [43537d3]: Fixes build failure on CI. (#625) (Tao He)
• [f3a4d7e]: Fixes unwind depenency for vineyard_client. (#624) (Tao He)
• [f9c408a]: No stream module in vineyard-client-python. (#623) (Tao He)
• [981bc27]: No glog dependency in vineyard_client. (#622) (Tao He)
• [76df722]: vineyardd: warn about --shm-size when running inside docker. (#621) (Tao He)
• [60a42d8]: Implements a client.Clear() method to drop all objects. (#620) (Tao He)
• [b6eaad3]: Set default value to {get,put}_name. (#619) (Tao He)
• [6f677e9]: Fixes the name matcher for flags when showing help information. (#617) (Tao He)
• [36f091d]: Fixes CI failure on main branch. (#615) (Tao He)
• [ab0bf92]: Fixes the arrow builder/resolver to exchange data with C++/Python. (#614) (Tao He)
• [b5e2953]: Find the longest match when possible. (#613) (Tao He)
• [b259d83]: Fixes for backwards compatibility on Ubuntu 18.04. (#612) (Tao He)

- C++
Published by github-actions[bot] over 4 years ago