ch.cern.spark:spark-avro_2.12

Apache Spark - A unified analytics engine for large-scale data processing

Science Score: 36.0%

This score indicates how likely this project is to be science-related based on various indicators:

○
CITATION.cff file
✓
codemeta.json file
Found codemeta.json file
✓
.zenodo.json file
Found .zenodo.json file
○
DOI references
○
Academic publication links
✓
Committers with academic emails
83 of 2879 committers (2.9%) from academic institutions
○
Institutional organization owner
○
JOSS paper metadata
○
Scientific vocabulary similarity
Low similarity (10.8%) to scientific vocabulary

Keywords

big-data java jdbc python r scala spark sql

Keywords from Contributors

distributed alignment flexible deep-neural-networks agents langchain mlops reinforcement-learning hyperparameter-optimization gbm

Last synced: 6 months ago · JSON representation

Repository

Apache Spark - A unified analytics engine for large-scale data processing

Basic Info

Host: GitHub
Owner: apache
License: apache-2.0
Language: Scala
Default Branch: master
Homepage: https://spark.apache.org/
Size: 490 MB

Statistics

Stars: 41,802
Watchers: 2,020
Forks: 28,766
Open Issues: 217
Releases: 0

Topics

big-data java jdbc python r scala spark sql

Created almost 12 years ago · Last pushed 6 months ago

Metadata Files

Readme Contributing License Security Notice

Apache Spark

Spark is a unified analytics engine for large-scale data processing. It provides high-level APIs in Scala, Java, Python, and R (Deprecated), and an optimized engine that supports general computation graphs for data analysis. It also supports a rich set of higher-level tools including Spark SQL for SQL and DataFrames, pandas API on Spark for pandas workloads, MLlib for machine learning, GraphX for graph processing, and Structured Streaming for stream processing.

Official version: https://spark.apache.org/
Development version: https://apache.github.io/spark/

Online Documentation

You can find the latest Spark documentation, including a programming guide, on the project web page. This README file only contains basic setup instructions.

Build Pipeline Status

| Branch | Status | |------------|-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| | master | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | branch-4.0 | | | | | | | | | | | | | | | | | | | | | branch-3.5 | | | | |

Building Spark

Spark is built using Apache Maven. To build Spark and its example programs, run:

bash ./build/mvn -DskipTests clean package

(You do not need to do this if you downloaded a pre-built package.)

More detailed documentation is available from the project site, at "Building Spark".

For general development tips, including info on developing Spark using an IDE, see "Useful Developer Tools".

Interactive Scala Shell

The easiest way to start using Spark is through the Scala shell:

bash ./bin/spark-shell

Try the following command, which should return 1,000,000,000:

scala scala> spark.range(1000 * 1000 * 1000).count()

Interactive Python Shell

Alternatively, if you prefer Python, you can use the Python shell:

bash ./bin/pyspark

And run the following command, which should also return 1,000,000,000:

```python

spark.range(1000 * 1000 * 1000).count() ```

Example Programs

Spark also comes with several sample programs in the examples directory. To run one of them, use ./bin/run-example <class> [params]. For example:

bash ./bin/run-example SparkPi

will run the Pi example locally.

You can set the MASTER environment variable when running examples to submit examples to a cluster. This can be spark:// URL, "yarn" to run on YARN, and "local" to run locally with one thread, or "local[N]" to run locally with N threads. You can also use an abbreviated class name if the class is in the examples package. For instance:

bash MASTER=spark://host:7077 ./bin/run-example SparkPi

Many of the example programs print usage help if no params are given.

Running Tests

Testing first requires building Spark. Once Spark is built, tests can be run using:

bash ./dev/run-tests

Please see the guidance on how to run tests for a module, or individual tests.

There is also a Kubernetes integration test, see resource-managers/kubernetes/integration-tests/README.md

A Note About Hadoop Versions

Spark uses the Hadoop core library to talk to HDFS and other Hadoop-supported storage systems. Because the protocols have changed in different versions of Hadoop, you must build Spark against the same version that your cluster runs.

Please refer to the build documentation at "Specifying the Hadoop Version and Enabling YARN" for detailed guidance on building for a particular distribution of Hadoop, including building for particular Hive and Hive Thriftserver distributions.

Configuration

Please refer to the Configuration Guide in the online documentation for an overview on how to configure Spark.

Contributing

Please review the Contribution to Spark guide for information on how to get started contributing to the project.

Owner

Name: The Apache Software Foundation
Login: apache
Kind: organization

Website: https://www.apache.org/
Repositories: 2,814
Profile: https://github.com/apache

Committers

Last synced: 10 months ago

All Time

Total Commits: 42,713
Total Committers: 2,879
Avg Commits per committer: 14.836
Development Distribution Score (DDS): 0.957

Past Year

Commits: 3,432
Committers: 283
Avg Commits per committer: 12.127
Development Distribution Score (DDS): 0.883

Top Committers

Name	Email	Commits
Hyukjin Kwon	g**3@a**g	1,858
Dongjoon Hyun	d**n@a**g	1,837
Ruifeng Zheng	r**z@a**g	1,395
Wenchen Fan	w**n@d**m	1,245
Reynold Xin	r**n@d**m	1,219
yangjie01	y**1@b**m	1,008
Max Gekk	m**k@g**m	910
Matei Zaharia	m**i@e**u	834
panbingkun	p**2@g**m	720
Kent Yao	y**o@a**g	695
Liang-Chi Hsieh	v**a@g**m	689
Patrick Wendell	p**l@g**m	687
Sean Owen	s**n@c**m	610
Gengliang Wang	g**g@a**g	560
Josh Rosen	j**n@d**m	557
zsxwing	z**g@g**m	531
Yuming Wang	y**g@e**m	526
itholic	h**e@d**m	516
Tathagata Das	t**5@g**m	481
Jiaan Geng	b**r@1**m	472
Kousuke Saruta	s**k@o**m	450
gatorsmile	g**e@g**m	442
Takuya UESHIN	u**n@d**m	435
Marcelo Vanzin	v**n@c**m	411
Davies Liu	d**s@d**m	389
Cheng Lian	l**n@d**m	377
Xiangrui Meng	m**g@d**m	351
Jungtaek Lim	k**e@g**m	294
Yanbo Liang	y**8@g**m	290
Herman van Hovell	h**n@d**m	286
and 2,849 more...

Committer Domains (Top 20 + Academic)

databricks.com: 241 apache.org: 68 qq.com: 46 cloudera.com: 39 163.com: 39 intel.com: 38 palantir.com: 35 us.ibm.com: 35 apple.com: 26 huawei.com: 23 zte.com.cn: 18 microsoft.com: 17 126.com: 17 amazon.com: 17 alibaba-inc.com: 14 linkedin.com: 14 fb.com: 13 ebay.com: 13 yahoo-inc.com: 12 baidu.com: 11 eecs.berkeley.edu: 7 cs.berkeley.edu: 5 berkeley.edu: 4 broadinstitute.org: 2 uwaterloo.ca: 2 gatech.edu: 2 soe.ucsc.edu: 2 columbia.edu: 2 cornell.edu: 2 paris.eecs.berkeley.edu: 1 alumni.brown.edu: 1 mail.usf.edu: 1 informatik.uni-hamburg.de: 1 am.amrita.edu: 1 kth.se: 1 mtu.edu: 1 alumni.carnegiemellon.edu: 1 utexas.edu: 1 cs.duke.edu: 1 alum.mit.edu: 1 cern.ch: 1 umich.edu: 1 icsi.berkeley.edu: 1 usc.edu: 1 unharmedunarmed.corp.ne1.yahoo.com: 1 sjsu.edu: 1 hmc.edu: 1 domu-12-31-39-0c-c8-96.compute-1.internal: 1 epfl.ch: 1 mail.ecust.edu.cn: 1 sjtu.edu.cn: 1 data61.csiro.au: 1 nyu.edu: 1 klis.tsukuba.ac.jp: 1 zju.edu.cn: 1 illinois.edu: 1 media.mit.edu: 1 iitb.ac.in: 1 iitk.ac.in: 1 ubuntu.ubuntu-domain: 1 uchicago.edu: 1 cs.umass.edu: 1 ncbi.nlm.nih.gov: 1 sogou-inc.com: 1 binghamton.edu: 1 llnl.gov: 1 cs.ccu.edu.tw: 1 ucsd.edu: 1 knights.ucf.edu: 1 csiro.au: 1 csh.rit.edu: 1 usu-software.de: 1 ccs.neu.edu: 1 cs.princeton.edu: 1 u-hopper.com: 1 domu-12-31-39-15-32-8f.compute-1.internal: 1 domu-12-31-39-15-18-a2.compute-1.internal: 1 domu-12-31-39-14-19-71.compute-1.internal: 1 domu-12-31-39-13-d9-11.compute-1.internal: 1 domu-12-31-39-07-ac-b2.compute-1.internal: 1 domu-12-31-39-05-4c-21.compute-1.internal: 1 domu-12-31-39-05-3d-b1.compute-1.internal: 1 domu-12-31-38-01-58-a1.compute-1.internal: 1

Issues and Pull Requests

Last synced: 6 months ago

All Time

Total issues: 63
Total pull requests: 15,502
Average time to close issues: 13 days
Average time to close pull requests: 17 days
Total issue authors: 39
Total pull request authors: 806
Average comments per issue: 1.67
Average comments per pull request: 2.78
Merged pull requests: 4
Bot issues: 0
Bot pull requests: 43

Past Year

Issues: 34
Pull requests: 6,668
Average time to close issues: 3 days
Average time to close pull requests: 9 days
Issue authors: 26
Pull request authors: 422
Average comments per issue: 1.71
Average comments per pull request: 2.05
Merged pull requests: 1
Bot issues: 0
Bot pull requests: 21

View more stats

Top Authors

Issue Authors

panbingkun (6)
dongjoon-hyun (6)
zhengruifeng (5)
yaooqinn (4)
LuciferYang (3)
HyukjinKwon (3)
pan3793 (2)
stefankandic (2)
ericm-db (2)
ianmcook (1)
johanl-db (1)
leovegas (1)
pmenon (1)
stevomitric (1)
HeartSaVioR (1)

Pull Request Authors

zhengruifeng (1,260)
dongjoon-hyun (1,234)
panbingkun (951)
LuciferYang (926)
HyukjinKwon (903)
yaooqinn (600)
itholic (340)
cloud-fan (257)
MaxGekk (237)
xinrong-meng (231)
pan3793 (230)
beliefer (223)
uros-db (215)
allisonwang-db (175)
ueshin (162)

Top Labels

Issue Labels

SQL (32) CONNECT (8) CORE (8) BUILD (8) DOCS (7) STRUCTURED STREAMING (6) PYTHON (6) ML (2) DSTREAM (2) KUBERNETES (2) INFRA (2) R (2) Stale (2) WEB UI (1) YARN (1) MLLIB (1) GRAPHX (1)

Pull Request Labels

SQL (9,265) PYTHON (3,429) CONNECT (2,289) BUILD (2,189) CORE (2,085) DOCS (1,556) STRUCTURED STREAMING (1,210) Stale (1,029) INFRA (898) ML (560) PANDAS API ON SPARK (460) WEB UI (354) KUBERNETES (320) MLLIB (314) AVRO (193) DSTREAM (180) YARN (179) R (134) PROTOBUF (111) EXAMPLES (98) SPARK SHELL (77) GRAPHX (54) DEPLOY (44) dependencies (43) java (27) WINDOWS (24) MESOS (17) SPARK CORE (12) ruby (11) SPARK SUBMIT (4)

Packages

Total packages: 100
Total downloads:
- pypi 44,731,192 last-month
Total docker downloads: 2,360,147,860

Total dependent packages: 5,616
(may contain duplicates)
Total dependent repositories: 33,204
(may contain duplicates)
Total versions: 2,001
Total maintainers: 5
Total advisories: 20

pypi.org: pyspark

Apache Spark Python API

Homepage: https://github.com/apache/spark/tree/master/python
Documentation: https://pyspark.readthedocs.io/
License: http://www.apache.org/licenses/LICENSE-2.0
Latest release: 4.0.1
published 6 months ago

Versions: 55
Dependent Packages: 588
Dependent Repositories: 6,227
Downloads: 44,730,037 Last month
Docker Downloads: 188,119,512

Rankings

Forks count: 0.0%

Downloads: 0.0%

Dependent packages count: 0.0%

Stargazers count: 0.1%

Average: 0.1%

Dependent repos count: 0.1%

Docker downloads count: 0.4%

Maintainers (3)

hyukjinkwon spark-upload yaooqinn

Advisories (10)

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-core_2.11

The Apache Software Foundation provides support for the Apache community of open-source software projects. The Apache projects are characterized by a collaborative, consensus based development process, an open and pragmatic software license, and a desire to create high quality software that leads the way in its field. We consider ourselves not simply a group of projects sharing a server, but rather a community of developers and users.

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-core_2.11/
License: Apache 2.0 License
Latest release: 2.4.8
published almost 5 years ago

Versions: 40
Dependent Packages: 1,401
Dependent Repositories: 8,772
Docker Downloads: 130,296,030

Rankings

Dependent packages count: 0.1%

Dependent repos count: 0.1%

Average: 0.3%

Forks count: 0.4%

Docker downloads count: 0.4%

Stargazers count: 0.7%

Advisories (7)

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-sql_2.12

Homepage: https://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-sql_2.12/
License: Apache-2.0
Latest release: 3.5.6
published 9 months ago

Versions: 41
Dependent Packages: 895
Dependent Repositories: 2,673
Docker Downloads: 220,397,866

Rankings

Dependent packages count: 0.1%

Dependent repos count: 0.2%

Average: 0.3%

Docker downloads count: 0.3%

Forks count: 0.4%

Stargazers count: 0.7%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-sql_2.11

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-sql_2.11/
License: Apache 2.0 License
Latest release: 2.4.8
published almost 5 years ago

Versions: 40
Dependent Packages: 1,197
Dependent Repositories: 7,509
Docker Downloads: 130,075,978

Rankings

Dependent packages count: 0.1%

Dependent repos count: 0.1%

Average: 0.3%

Forks count: 0.4%

Docker downloads count: 0.5%

Stargazers count: 0.7%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-hive_2.12

Homepage: https://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-hive_2.12/
License: Apache-2.0
Latest release: 3.5.6
published 9 months ago

Versions: 41
Dependent Packages: 196
Dependent Repositories: 584
Docker Downloads: 188,107,277

Rankings

Docker downloads count: 0.4%

Forks count: 0.4%

Dependent packages count: 0.4%

Average: 0.5%

Dependent repos count: 0.6%

Stargazers count: 0.7%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-streaming_2.10

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-streaming_2.10/
License: Apache 2.0 License
Latest release: 2.2.3
published about 7 years ago

Versions: 34
Dependent Packages: 206
Dependent Repositories: 1,231
Docker Downloads: 3,703,115

Rankings

Dependent repos count: 0.3%

Dependent packages count: 0.4%

Forks count: 0.4%

Average: 0.6%

Stargazers count: 0.7%

Docker downloads count: 1.5%

Last synced: 6 months ago

repo1.maven.org: org.spark-project.spark:unused

Sonatype helps open source projects to set up Maven repositories on https://oss.sonatype.org/

Homepage: http://nexus.sonatype.org/oss-repository-hosting.html
Documentation: https://appdoc.app/artifact/org.spark-project.spark/unused/
License: The Apache License, Version 2.0
Latest release: 1.0.0
published over 11 years ago

Versions: 1
Dependent Packages: 36
Dependent Repositories: 734
Docker Downloads: 340,417,457

Rankings

Docker downloads count: 0.3%

Forks count: 0.4%

Dependent repos count: 0.5%

Stargazers count: 0.7%

Average: 0.7%

Dependent packages count: 1.8%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-sql_2.10

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-sql_2.10/
License: Apache 2.0 License
Latest release: 2.2.3
published about 7 years ago

Versions: 31
Dependent Packages: 312
Dependent Repositories: 948
Docker Downloads: 210,708

Rankings

Dependent packages count: 0.3%

Forks count: 0.4%

Dependent repos count: 0.4%

Stargazers count: 0.7%

Average: 0.8%

Docker downloads count: 2.4%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-unsafe_2.11

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-unsafe_2.11/
License: Apache 2.0 License
Latest release: 2.4.8
published almost 5 years ago

Versions: 35
Dependent Packages: 34
Dependent Repositories: 170
Docker Downloads: 130,293,434

Rankings

Forks count: 0.4%

Docker downloads count: 0.4%

Stargazers count: 0.7%

Average: 0.9%

Dependent repos count: 1.3%

Dependent packages count: 1.9%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-network-common_2.11

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-network-common_2.11/
License: Apache 2.0 License
Latest release: 2.4.8
published almost 5 years ago

Versions: 40
Dependent Packages: 25
Dependent Repositories: 222
Docker Downloads: 130,293,434

Rankings

Forks count: 0.4%

Docker downloads count: 0.4%

Stargazers count: 0.7%

Average: 1.0%

Dependent repos count: 1.1%

Dependent packages count: 2.6%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-hive_2.10

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-hive_2.10/
License: Apache 2.0 License
Latest release: 2.2.3
published about 7 years ago

Versions: 31
Dependent Packages: 77
Dependent Repositories: 415
Docker Downloads: 36,437

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Dependent repos count: 0.7%

Dependent packages count: 0.9%

Average: 1.1%

Docker downloads count: 2.9%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-sql-kafka-0-10_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-sql-kafka-0-10_2.12/
License: Apache-2.0
Latest release: 3.5.6
published 9 months ago

Versions: 41
Dependent Packages: 51
Dependent Repositories: 166
Docker Downloads: 1,301,298

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Average: 1.2%

Dependent repos count: 1.3%

Dependent packages count: 1.4%

Docker downloads count: 2.0%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-streaming-kafka-0-10_2.11

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-streaming-kafka-0-10_2.11/
License: Apache 2.0 License
Latest release: 2.4.8
published almost 5 years ago

Versions: 25
Dependent Packages: 58
Dependent Repositories: 1,571
Docker Downloads: 5,978

Rankings

Dependent repos count: 0.3%

Forks count: 0.4%

Stargazers count: 0.7%

Average: 1.2%

Dependent packages count: 1.2%

Docker downloads count: 3.5%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-mllib-local_2.11

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-mllib-local_2.11/
License: Apache 2.0 License
Latest release: 2.4.8
published almost 5 years ago

Versions: 26
Dependent Packages: 27
Dependent Repositories: 93
Docker Downloads: 88,157,386

Rankings

Forks count: 0.4%

Docker downloads count: 0.6%

Stargazers count: 0.7%

Average: 1.2%

Dependent repos count: 2.0%

Dependent packages count: 2.4%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-streaming-kafka-0-10_2.12

Homepage: https://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-streaming-kafka-0-10_2.12/
License: Apache-2.0
Latest release: 3.5.6
published 9 months ago

Versions: 41
Dependent Packages: 22
Dependent Repositories: 303
Docker Downloads: 1,297,699

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Dependent repos count: 0.9%

Average: 1.4%

Docker downloads count: 2.0%

Dependent packages count: 2.9%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-core_2.13

Homepage: https://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-core_2.13/
License: Apache-2.0
Latest release: 4.0.1
published 6 months ago

Versions: 27
Dependent Packages: 97
Dependent Repositories: 145
Docker Downloads: 15,297

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Dependent packages count: 0.8%

Average: 1.4%

Dependent repos count: 1.5%

Docker downloads count: 3.8%

Advisories (1)

Apache Spark vulnerable to Improper Privilege Management

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-graphx_2.10

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-graphx_2.10/
License: Apache 2.0 License
Latest release: 2.2.3
published about 7 years ago

Versions: 34
Dependent Packages: 20
Dependent Repositories: 208
Docker Downloads: 197,686

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Dependent repos count: 1.1%

Average: 1.6%

Docker downloads count: 2.4%

Dependent packages count: 3.2%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-network-shuffle_2.10

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-network-shuffle_2.10/
License: Apache 2.0 License
Latest release: 2.2.3
published about 7 years ago

Versions: 26
Dependent Packages: 13
Dependent Repositories: 117
Docker Downloads: 44,659,884

Rankings

Forks count: 0.4%

Docker downloads count: 0.6%

Stargazers count: 0.7%

Average: 1.6%

Dependent repos count: 1.7%

Dependent packages count: 4.8%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-repl_2.10

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-repl_2.10/
License: Apache 2.0 License
Latest release: 2.2.3
published about 7 years ago

Versions: 33
Dependent Packages: 42
Dependent Repositories: 44
Docker Downloads: 175,484

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Dependent packages count: 1.6%

Average: 1.7%

Docker downloads count: 2.4%

Dependent repos count: 3.3%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-avro_2.11

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-avro_2.11/
License: Apache 2.0 License
Latest release: 2.4.8
published almost 5 years ago

Versions: 9
Dependent Packages: 75
Dependent Repositories: 126
Docker Downloads: 179

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Dependent packages count: 1.0%

Dependent repos count: 1.6%

Average: 1.9%

Docker downloads count: 5.6%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-unsafe_2.10

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-unsafe_2.10/
License: Apache 2.0 License
Latest release: 2.2.3
published about 7 years ago

Versions: 21
Dependent Packages: 14
Dependent Repositories: 46
Docker Downloads: 44,646,862

Rankings

Forks count: 0.4%

Docker downloads count: 0.6%

Stargazers count: 0.7%

Average: 1.9%

Dependent repos count: 3.2%

Dependent packages count: 4.5%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-mllib-local_2.12

Homepage: https://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-mllib-local_2.12/
License: Apache-2.0
Latest release: 3.5.6
published 9 months ago

Versions: 41
Dependent Packages: 17
Dependent Repositories: 13
Docker Downloads: 220,312,475

Rankings

Docker downloads count: 0.3%

Forks count: 0.4%

Stargazers count: 0.7%

Average: 2.4%

Dependent packages count: 3.7%

Dependent repos count: 6.8%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-network-shuffle_2.12

Homepage: https://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-network-shuffle_2.12/
License: Apache-2.0
Latest release: 3.5.6
published 9 months ago

Versions: 41
Dependent Packages: 11
Dependent Repositories: 21
Docker Downloads: 220,934,695

Rankings

Docker downloads count: 0.3%

Forks count: 0.4%

Stargazers count: 0.7%

Average: 2.4%

Dependent repos count: 5.3%

Dependent packages count: 5.6%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-hive_2.13

Homepage: https://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-hive_2.13/
License: Apache-2.0
Latest release: 4.0.0
published 9 months ago

Versions: 26
Dependent Packages: 14
Dependent Repositories: 57
Docker Downloads: 12,372

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Average: 2.5%

Dependent repos count: 2.8%

Docker downloads count: 4.3%

Dependent packages count: 4.5%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-kvstore_2.11

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-kvstore_2.11/
License: Apache 2.0 License
Latest release: 2.4.8
published almost 5 years ago

Versions: 14
Dependent Packages: 7
Dependent Repositories: 58
Docker Downloads: 88,866,544

Rankings

Forks count: 0.4%

Docker downloads count: 0.5%

Stargazers count: 0.7%

Average: 2.6%

Dependent repos count: 2.8%

Dependent packages count: 8.4%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-streaming-kafka_2.11

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-streaming-kafka_2.11/
License: Apache 2.0 License
Latest release: 1.6.3
published over 9 years ago

Versions: 9
Dependent Packages: 7
Dependent Repositories: 192

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Dependent repos count: 1.2%

Average: 2.7%

Dependent packages count: 8.4%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-tags_2.10

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-tags_2.10/
License: Apache 2.0 License
Latest release: 2.2.3
published about 7 years ago

Versions: 12
Dependent Packages: 32
Dependent Repositories: 5
Docker Downloads: 2,589

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Dependent packages count: 2.1%

Average: 3.6%

Docker downloads count: 3.8%

Dependent repos count: 10.9%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-streaming-kinesis-asl_2.11

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-streaming-kinesis-asl_2.11/
License: Apache 2.0 License
Latest release: 2.4.8
published almost 5 years ago

Versions: 40
Dependent Packages: 8
Dependent Repositories: 9

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Average: 4.2%

Dependent packages count: 7.5%

Dependent repos count: 8.2%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-mesos_2.11

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-mesos_2.11/
License: Apache 2.0 License
Latest release: 2.4.8
published almost 5 years ago

Versions: 22
Dependent Packages: 6
Dependent Repositories: 8
Docker Downloads: 1,146,520

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Docker downloads count: 1.9%

Average: 4.3%

Dependent repos count: 8.7%

Dependent packages count: 9.7%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-streaming-twitter_2.11

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-streaming-twitter_2.11/
License: Apache 2.0 License
Latest release: 1.6.3
published over 9 years ago

Versions: 14
Dependent Packages: 4
Dependent Repositories: 59

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Dependent repos count: 2.8%

Average: 4.4%

Dependent packages count: 13.9%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-bagel_2.10

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-bagel_2.10/
License: Apache 2.0 License
Latest release: 1.6.3
published over 9 years ago

Versions: 22
Dependent Packages: 4
Dependent Repositories: 23
Docker Downloads: 173,094

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Docker downloads count: 2.4%

Average: 4.5%

Dependent repos count: 5.0%

Dependent packages count: 13.9%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-streaming-kafka-0-8_2.10

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-streaming-kafka-0-8_2.10/
License: Apache 2.0 License
Latest release: 2.2.3
published about 7 years ago

Versions: 12
Dependent Packages: 5
Dependent Repositories: 13
Docker Downloads: 149

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Average: 4.9%

Docker downloads count: 5.0%

Dependent repos count: 6.8%

Dependent packages count: 11.5%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-test-tags_2.11

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-test-tags_2.11/
License: Apache 2.0 License
Latest release: 1.6.3
published over 9 years ago

Versions: 4
Dependent Packages: 26
Dependent Repositories: 2

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Dependent packages count: 2.5%

Average: 4.9%

Dependent repos count: 16.1%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-avro_2.13

Homepage: https://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-avro_2.13/
License: Apache-2.0
Latest release: 4.0.0
published 9 months ago

Versions: 26
Dependent Packages: 6
Dependent Repositories: 8
Docker Downloads: 154

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Average: 5.0%

Docker downloads count: 5.4%

Dependent repos count: 8.7%

Dependent packages count: 9.7%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-streaming-kafka-assembly_2.10

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-streaming-kafka-assembly_2.10/
License: Apache 2.0 License
Latest release: 1.6.3
published over 9 years ago

Versions: 11
Dependent Packages: 5
Dependent Repositories: 6

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Average: 5.6%

Dependent repos count: 10.0%

Dependent packages count: 11.5%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-streaming-flume_2.10

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-streaming-flume_2.10/
License: Apache 2.0 License
Latest release: 2.2.3
published about 7 years ago

Versions: 34
Dependent Packages: 2
Dependent Repositories: 82
Docker Downloads: 172,751

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Dependent repos count: 2.2%

Docker downloads count: 2.4%

Average: 5.8%

Dependent packages count: 23.2%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-mesos_2.12

Homepage: https://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-mesos_2.12/
License: Apache-2.0
Latest release: 3.5.6
published 9 months ago

Versions: 41
Dependent Packages: 5
Dependent Repositories: 2
Docker Downloads: 179,655,118

Rankings

Docker downloads count: 0.4%

Forks count: 0.4%

Stargazers count: 0.7%

Average: 5.8%

Dependent packages count: 11.5%

Dependent repos count: 16.1%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-streaming-kafka-assembly_2.11

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-streaming-kafka-assembly_2.11/
License: Apache 2.0 License
Latest release: 1.6.3
published over 9 years ago

Versions: 9
Dependent Packages: 3
Dependent Repositories: 10

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Average: 6.6%

Dependent repos count: 7.8%

Dependent packages count: 17.6%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-repl_2.13

Homepage: https://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-repl_2.13/
License: Apache-2.0
Latest release: 4.0.0
published 9 months ago

Versions: 26
Dependent Packages: 9
Dependent Repositories: 1
Docker Downloads: 2,257

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Docker downloads count: 4.9%

Average: 6.7%

Dependent packages count: 6.7%

Dependent repos count: 20.8%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-token-provider-kafka-0-10_2.12

Homepage: https://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-token-provider-kafka-0-10_2.12/
License: Apache-2.0
Latest release: 3.5.6
published 9 months ago

Versions: 32
Dependent Packages: 4
Dependent Repositories: 1
Docker Downloads: 1,302,598

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Docker downloads count: 2.0%

Average: 7.6%

Dependent packages count: 13.9%

Dependent repos count: 20.8%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-yarn_2.13

Homepage: https://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-yarn_2.13/
License: Apache-2.0
Latest release: 4.0.0
published 9 months ago

Versions: 26
Dependent Packages: 5
Dependent Repositories: 1
Docker Downloads: 1,571

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Docker downloads count: 4.9%

Average: 7.6%

Dependent packages count: 11.5%

Dependent repos count: 20.8%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-streaming-kinesis-asl_2.12

Homepage: https://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-streaming-kinesis-asl_2.12/
License: Apache-2.0
Latest release: 3.5.6
published 9 months ago

Versions: 41
Dependent Packages: 2
Dependent Repositories: 4
Docker Downloads: 1,292,061

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Docker downloads count: 2.0%

Average: 7.7%

Dependent repos count: 12.1%

Dependent packages count: 23.2%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-streaming-flume_2.11

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-streaming-flume_2.11/
License: Apache 2.0 License
Latest release: 2.4.8
published almost 5 years ago

Versions: 38
Dependent Packages: 1
Dependent Repositories: 185
Docker Downloads: 5,847

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Dependent repos count: 1.2%

Docker downloads count: 3.5%

Average: 7.8%

Dependent packages count: 33.0%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-streaming-kafka-0-10_2.13

Homepage: https://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-streaming-kafka-0-10_2.13/
License: Apache-2.0
Latest release: 4.0.0
published 9 months ago

Versions: 26
Dependent Packages: 2
Dependent Repositories: 11

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Dependent repos count: 7.4%

Average: 7.9%

Dependent packages count: 23.2%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-network-common_2.13

Homepage: https://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-network-common_2.13/
License: Apache-2.0
Latest release: 4.0.0
published 9 months ago

Versions: 26
Dependent Packages: 2
Dependent Repositories: 4
Docker Downloads: 15,297

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Docker downloads count: 3.8%

Average: 8.0%

Dependent repos count: 12.1%

Dependent packages count: 23.2%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-launcher_2.13

Homepage: https://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-launcher_2.13/
License: Apache-2.0
Latest release: 4.0.0
published 9 months ago

Versions: 26
Dependent Packages: 2
Dependent Repositories: 4
Docker Downloads: 15,404

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Docker downloads count: 3.8%

Average: 8.0%

Dependent repos count: 12.1%

Dependent packages count: 23.2%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-streaming-flume-sink_2.11

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-streaming-flume-sink_2.11/
License: Apache 2.0 License
Latest release: 2.4.8
published almost 5 years ago

Versions: 38
Dependent Packages: 1
Dependent Repositories: 47
Docker Downloads: 5,847

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Dependent repos count: 3.2%

Docker downloads count: 3.5%

Average: 8.1%

Dependent packages count: 33.0%

Last synced: 6 months ago

proxy.golang.org: github.com/apache/spark

Documentation: https://pkg.go.dev/github.com/apache/spark#section-documentation
License: apache-2.0
Status: removed
Latest release: v3.5.3+incompatible
published over 1 year ago

Versions: 210
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Dependent packages count: 7.0%

Average: 8.2%

Dependent repos count: 9.3%

Last synced: about 2 years ago

repo1.maven.org: org.apache.spark:spark-streaming-mqtt_2.10

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-streaming-mqtt_2.10/
License: Apache 2.0 License
Latest release: 1.6.3
published over 9 years ago

Versions: 22
Dependent Packages: 1
Dependent Repositories: 12
Docker Downloads: 172,751

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Docker downloads count: 2.4%

Dependent repos count: 7.1%

Average: 8.7%

Dependent packages count: 33.0%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-hadoop-cloud_2.12

Contains Hadoop JARs and transitive dependencies needed to interact with cloud infrastructures.

Homepage: https://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-hadoop-cloud_2.12/
License: Apache-2.0
Latest release: 3.5.6
published 9 months ago

Versions: 22
Dependent Packages: 1
Dependent Repositories: 7
Docker Downloads: 3,602,718

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Docker downloads count: 0.8%

Average: 8.8%

Dependent repos count: 9.3%

Dependent packages count: 33.0%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-assembly_2.10

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-assembly_2.10/
License: Apache-2.0,Apache-2.0
Latest release: 1.1.1
published over 11 years ago

Versions: 8
Dependent Packages: 1
Dependent Repositories: 23
Docker Downloads: 141

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Dependent repos count: 5.0%

Docker downloads count: 5.2%

Average: 8.9%

Dependent packages count: 33.0%

Last synced: 6 months ago

repo1.maven.org: com.github.immuta.hadoop:spark-sql_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/com.github.immuta.hadoop/spark-sql_2.12/
License: Apache 2.0 License
Latest release: 3.1.1-hadoop-2.7
published almost 5 years ago

Versions: 1
Dependent Packages: 7
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Dependent packages count: 8.1%

Average: 10.2%

Dependent repos count: 32.0%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-streaming-kinesis-asl_2.10

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-streaming-kinesis-asl_2.10/
License: Apache 2.0 License
Latest release: 2.2.3
published about 7 years ago

Versions: 28
Dependent Packages: 1
Dependent Repositories: 11

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Dependent repos count: 7.4%

Average: 10.4%

Dependent packages count: 33.0%

Last synced: 6 months ago

repo1.maven.org: com.github.immuta.hadoop:spark-catalyst_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/com.github.immuta.hadoop/spark-catalyst_2.12/
License: Apache 2.0 License
Latest release: 3.1.1-hadoop-2.7
published almost 5 years ago

Versions: 1
Dependent Packages: 6
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Dependent packages count: 9.3%

Average: 10.5%

Dependent repos count: 32.0%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-sketch_2.13

Homepage: https://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-sketch_2.13/
License: Apache-2.0
Latest release: 4.0.0
published 9 months ago

Versions: 26
Dependent Packages: 2
Dependent Repositories: 0
Docker Downloads: 15,058

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Docker downloads count: 3.4%

Average: 11.9%

Dependent packages count: 22.6%

Dependent repos count: 32.4%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-parent_2.12

Homepage: https://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-parent_2.12/
License: Apache-2.0
Latest release: 3.5.6
published 9 months ago

Versions: 41
Dependent Packages: 1
Dependent Repositories: 1
Docker Downloads: 225

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Docker downloads count: 5.2%

Average: 12.0%

Dependent repos count: 20.8%

Dependent packages count: 33.0%

Advisories (2)

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-hive-thriftserver_2.13

Homepage: https://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-hive-thriftserver_2.13/
License: Apache-2.0
Latest release: 4.0.0
published 9 months ago

Versions: 26
Dependent Packages: 2
Dependent Repositories: 0
Docker Downloads: 1,600

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Docker downloads count: 4.2%

Average: 12.1%

Dependent packages count: 22.6%

Dependent repos count: 32.4%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-token-provider-kafka-0-10_2.13

Homepage: https://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-token-provider-kafka-0-10_2.13/
License: Apache-2.0
Latest release: 4.0.0
published 9 months ago

Versions: 26
Dependent Packages: 2
Dependent Repositories: 0
Docker Downloads: 785

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Docker downloads count: 4.3%

Average: 12.1%

Dependent packages count: 22.6%

Dependent repos count: 32.4%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-graph-api_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-graph-api_2.12/
License: Apache 2.0 License
Latest release: 3.0.0-preview2
published about 6 years ago

Versions: 2
Dependent Packages: 1
Dependent Repositories: 1
Docker Downloads: 94

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Docker downloads count: 5.6%

Average: 12.1%

Dependent repos count: 20.8%

Dependent packages count: 33.0%

Last synced: 6 months ago

repo1.maven.org: com.github.immuta.hadoop:spark-mllib_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/com.github.immuta.hadoop/spark-mllib_2.12/
License: Apache 2.0 License
Latest release: 3.1.1-hadoop-2.7
published almost 5 years ago

Versions: 1
Dependent Packages: 3
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 12.4%

Dependent packages count: 16.9%

Dependent repos count: 32.0%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-streaming-kafka-0-8-assembly_2.11

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-streaming-kafka-0-8-assembly_2.11/
License: Apache 2.0 License
Latest release: 2.4.8
published almost 5 years ago

Versions: 26
Dependent Packages: 0
Dependent Repositories: 7
Docker Downloads: 20,192

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Docker downloads count: 3.1%

Dependent repos count: 9.3%

Average: 12.7%

Dependent packages count: 50.2%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-streaming-flume-assembly_2.11

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-streaming-flume-assembly_2.11/
License: Apache 2.0 License
Latest release: 2.4.8
published almost 5 years ago

Versions: 31
Dependent Packages: 0
Dependent Repositories: 6
Docker Downloads: 5,847

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Docker downloads count: 3.5%

Dependent repos count: 10.0%

Average: 12.9%

Dependent packages count: 50.2%

Last synced: 6 months ago

repo1.maven.org: com.github.immuta.hadoop:spark-network-common_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/com.github.immuta.hadoop/spark-network-common_2.12/
License: Apache 2.0 License
Latest release: 3.1.1-hadoop-2.7
published almost 5 years ago

Versions: 1
Dependent Packages: 2
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 13.8%

Dependent packages count: 22.4%

Dependent repos count: 32.0%

Last synced: 6 months ago

repo1.maven.org: com.github.immuta.hadoop:spark-sketch_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/com.github.immuta.hadoop/spark-sketch_2.12/
License: Apache 2.0 License
Latest release: 3.1.1-hadoop-2.7
published almost 5 years ago

Versions: 1
Dependent Packages: 2
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 13.8%

Dependent packages count: 22.4%

Dependent repos count: 32.0%

Last synced: 6 months ago

repo1.maven.org: com.github.immuta.hadoop:spark-network-shuffle_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/com.github.immuta.hadoop/spark-network-shuffle_2.12/
License: Apache 2.0 License
Latest release: 3.1.1-hadoop-2.7
published almost 5 years ago

Versions: 1
Dependent Packages: 2
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 13.8%

Dependent packages count: 22.4%

Dependent repos count: 32.0%

Last synced: 6 months ago

repo1.maven.org: com.github.immuta.hadoop:spark-token-provider-kafka-0-10_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/com.github.immuta.hadoop/spark-token-provider-kafka-0-10_2.12/
License: Apache 2.0 License
Latest release: 3.1.1-hadoop-2.7
published almost 5 years ago

Versions: 1
Dependent Packages: 2
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 13.8%

Dependent packages count: 22.4%

Dependent repos count: 32.0%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-streaming-kafka-0-10-assembly_2.12

Homepage: https://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-streaming-kafka-0-10-assembly_2.12/
License: Apache-2.0
Latest release: 3.5.6
published 9 months ago

Versions: 41
Dependent Packages: 0
Dependent Repositories: 2
Docker Downloads: 776

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Docker downloads count: 4.9%

Average: 14.4%

Dependent repos count: 16.1%

Dependent packages count: 50.2%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-streaming-flume-assembly_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-streaming-flume-assembly_2.12/
License: Apache 2.0 License
Latest release: 2.4.8
published almost 5 years ago

Versions: 8
Dependent Packages: 0
Dependent Repositories: 1
Docker Downloads: 15

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Docker downloads count: 6.4%

Average: 15.7%

Dependent repos count: 20.8%

Dependent packages count: 50.2%

Last synced: 6 months ago

repo1.maven.org: com.github.immuta.hadoop:spark-network-yarn_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/com.github.immuta.hadoop/spark-network-yarn_2.12/
License: Apache-2.0,Apache-2.0
Latest release: 3.1.1-hadoop-2.7
published almost 5 years ago

Versions: 1
Dependent Packages: 1
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 16.2%

Dependent repos count: 32.0%

Dependent packages count: 32.0%

Last synced: 6 months ago

repo1.maven.org: com.github.immuta.hadoop:spark-sql-kafka-0-10_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/com.github.immuta.hadoop/spark-sql-kafka-0-10_2.12/
License: Apache 2.0 License
Latest release: 3.1.1-hadoop-2.7
published almost 5 years ago

Versions: 1
Dependent Packages: 1
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 16.2%

Dependent repos count: 32.0%

Dependent packages count: 32.0%

Last synced: 6 months ago

repo1.maven.org: com.github.immuta.hadoop:spark-streaming-kafka-0-10_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/com.github.immuta.hadoop/spark-streaming-kafka-0-10_2.12/
License: Apache 2.0 License
Latest release: 3.1.1-hadoop-2.7
published almost 5 years ago

Versions: 1
Dependent Packages: 1
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 16.2%

Dependent repos count: 32.0%

Dependent packages count: 32.0%

Last synced: 6 months ago

repo1.maven.org: com.github.immuta.hadoop:spark-repl_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/com.github.immuta.hadoop/spark-repl_2.12/
License: Apache 2.0 License
Latest release: 3.1.1-hadoop-2.7
published almost 5 years ago

Versions: 1
Dependent Packages: 1
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 16.2%

Dependent repos count: 32.0%

Dependent packages count: 32.0%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-streaming-mqtt-assembly_2.11

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-streaming-mqtt-assembly_2.11/
License: Apache 2.0 License
Latest release: 1.6.3
published over 9 years ago

Versions: 7
Dependent Packages: 0
Dependent Repositories: 1

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Average: 18.0%

Dependent repos count: 20.8%

Dependent packages count: 50.2%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-ganglia-lgpl_2.10

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-ganglia-lgpl_2.10/
License: Apache 2.0 License
Latest release: 2.2.3
published about 7 years ago

Versions: 33
Dependent Packages: 0
Dependent Repositories: 1

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Average: 18.0%

Dependent repos count: 20.8%

Dependent packages count: 50.2%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-parent_2.10

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-parent_2.10/
License: Apache 2.0 License
Latest release: 2.2.3
published about 7 years ago

Versions: 23
Dependent Packages: 0
Dependent Repositories: 1

Rankings

Forks count: 0.4%

Stargazers count: 0.7%

Average: 18.0%

Dependent repos count: 20.8%

Dependent packages count: 50.2%

Last synced: 6 months ago

repo1.maven.org: com.github.immuta.hadoop:spark-assembly_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/com.github.immuta.hadoop/spark-assembly_2.12/
License: Apache-2.0,Apache-2.0
Latest release: 3.1.1-hadoop-2.7
published almost 5 years ago

Versions: 1
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 20.4%

Dependent repos count: 32.0%

Dependent packages count: 48.9%

Last synced: 6 months ago

repo1.maven.org: ch.cern.spark:spark-hive-thriftserver_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/ch.cern.spark/spark-hive-thriftserver_2.12/
License: Apache 2.0 License
Latest release: 3.0.1
published over 5 years ago

Versions: 1
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 20.4%

Dependent repos count: 32.0%

Dependent packages count: 48.9%

Last synced: 6 months ago

repo1.maven.org: com.github.immuta.hadoop:spark-yarn_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/com.github.immuta.hadoop/spark-yarn_2.12/
License: Apache 2.0 License
Latest release: 3.1.1-hadoop-2.7
published almost 5 years ago

Versions: 1
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 20.4%

Dependent repos count: 32.0%

Dependent packages count: 48.9%

Last synced: 6 months ago

repo1.maven.org: ch.cern.spark:spark-mllib-local_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/ch.cern.spark/spark-mllib-local_2.12/
License: Apache 2.0 License
Latest release: 3.0.1
published over 5 years ago

Versions: 1
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 20.4%

Dependent repos count: 32.0%

Dependent packages count: 48.9%

Last synced: 6 months ago

repo1.maven.org: ch.cern.spark:spark-avro_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/ch.cern.spark/spark-avro_2.12/
License: Apache 2.0 License
Latest release: 3.0.1
published over 5 years ago

Versions: 1
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 20.4%

Dependent repos count: 32.0%

Dependent packages count: 48.9%

Last synced: 6 months ago

repo1.maven.org: ch.cern.spark:spark-network-yarn_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/ch.cern.spark/spark-network-yarn_2.12/
License: Apache-2.0,Apache-2.0
Latest release: 3.0.1
published over 5 years ago

Versions: 1
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 20.4%

Dependent repos count: 32.0%

Dependent packages count: 48.9%

Last synced: 6 months ago

repo1.maven.org: ch.cern.spark:spark-tools_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/ch.cern.spark/spark-tools_2.12/
License: Apache 2.0 License
Latest release: 3.0.1
published over 5 years ago

Versions: 1
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 20.4%

Dependent repos count: 32.0%

Dependent packages count: 48.9%

Last synced: 6 months ago

repo1.maven.org: ch.cern.spark:spark-streaming-kafka-0-10_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/ch.cern.spark/spark-streaming-kafka-0-10_2.12/
License: Apache 2.0 License
Latest release: 3.0.1
published over 5 years ago

Versions: 1
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 20.4%

Dependent repos count: 32.0%

Dependent packages count: 48.9%

Last synced: 6 months ago

repo1.maven.org: ch.cern.spark:spark-token-provider-kafka-0-10_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/ch.cern.spark/spark-token-provider-kafka-0-10_2.12/
License: Apache 2.0 License
Latest release: 3.0.1
published over 5 years ago

Versions: 1
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 20.4%

Dependent repos count: 32.0%

Dependent packages count: 48.9%

Last synced: 6 months ago

repo1.maven.org: ch.cern.spark:spark-launcher_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/ch.cern.spark/spark-launcher_2.12/
License: Apache 2.0 License
Latest release: 3.0.1
published over 5 years ago

Versions: 1
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 20.4%

Dependent repos count: 32.0%

Dependent packages count: 48.9%

Last synced: 6 months ago

repo1.maven.org: com.github.immuta.hadoop:spark-tools_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/com.github.immuta.hadoop/spark-tools_2.12/
License: Apache 2.0 License
Latest release: 3.1.1-hadoop-2.7
published almost 5 years ago

Versions: 1
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 20.4%

Dependent repos count: 32.0%

Dependent packages count: 48.9%

Last synced: 6 months ago

repo1.maven.org: ch.cern.spark:spark-network-shuffle_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/ch.cern.spark/spark-network-shuffle_2.12/
License: Apache 2.0 License
Latest release: 3.0.1
published over 5 years ago

Versions: 1
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 20.4%

Dependent repos count: 32.0%

Dependent packages count: 48.9%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-ganglia-lgpl_2.13

Homepage: https://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-ganglia-lgpl_2.13/
License: Apache-2.0
Latest release: 4.0.0
published 9 months ago

Versions: 26
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 20.4%

Dependent repos count: 32.0%

Dependent packages count: 48.9%

Last synced: 6 months ago

repo1.maven.org: com.github.immuta.hadoop:spark-examples_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/com.github.immuta.hadoop/spark-examples_2.12/
License: Apache-2.0,Apache-2.0
Latest release: 3.1.1-hadoop-2.7
published almost 5 years ago

Versions: 1
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 20.4%

Dependent repos count: 32.0%

Dependent packages count: 48.9%

Last synced: 6 months ago

repo1.maven.org: ch.cern.spark:spark-streaming-kafka-0-10-assembly_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/ch.cern.spark/spark-streaming-kafka-0-10-assembly_2.12/
License: Apache 2.0 License
Latest release: 3.0.1
published over 5 years ago

Versions: 1
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 20.4%

Dependent repos count: 32.0%

Dependent packages count: 48.9%

Last synced: 6 months ago

repo1.maven.org: ch.cern.spark:spark-examples_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/ch.cern.spark/spark-examples_2.12/
License: Apache-2.0,Apache-2.0
Latest release: 3.0.1
published over 5 years ago

Versions: 1
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 20.4%

Dependent repos count: 32.0%

Dependent packages count: 48.9%

Last synced: 6 months ago

repo1.maven.org: ch.cern.spark:spark-streaming_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/ch.cern.spark/spark-streaming_2.12/
License: Apache 2.0 License
Latest release: 3.0.1
published over 5 years ago

Versions: 1
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 20.4%

Dependent repos count: 32.0%

Dependent packages count: 48.9%

Last synced: 6 months ago

repo1.maven.org: ch.cern.spark:spark-kvstore_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/ch.cern.spark/spark-kvstore_2.12/
License: Apache 2.0 License
Latest release: 3.0.1
published over 5 years ago

Versions: 1
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 20.4%

Dependent repos count: 32.0%

Dependent packages count: 48.9%

Last synced: 6 months ago

repo1.maven.org: com.github.immuta.hadoop:spark-parent_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/com.github.immuta.hadoop/spark-parent_2.12/
License: Apache 2.0 License
Latest release: 3.1.1-hadoop-2.7
published almost 5 years ago

Versions: 1
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 20.4%

Dependent repos count: 32.0%

Dependent packages count: 48.9%

Last synced: 6 months ago

repo1.maven.org: ch.cern.spark:spark-kubernetes_2.12

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/ch.cern.spark/spark-kubernetes_2.12/
License: Apache 2.0 License
Latest release: 3.0.1
published over 5 years ago

Versions: 1
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 20.4%

Dependent repos count: 32.0%

Dependent packages count: 48.9%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-docker-integration-tests_2.10

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-docker-integration-tests_2.10/
License: Apache 2.0 License
Latest release: 1.6.3
published over 9 years ago

Versions: 4
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 20.4%

Dependent repos count: 32.0%

Dependent packages count: 48.9%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-mesos_2.10

Homepage: http://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-mesos_2.10/
License: Apache 2.0 License
Latest release: 2.2.3
published about 7 years ago

Versions: 8
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Forks count: 0.3%

Stargazers count: 0.5%

Average: 20.4%

Dependent repos count: 32.0%

Dependent packages count: 48.9%

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-common-utils_2.13

Homepage: https://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-common-utils_2.13/
License: Apache-2.0
Latest release: 4.0.0
published 9 months ago

Versions: 11
Dependent Packages: 0
Dependent Repositories: 0
Docker Downloads: 657

Rankings

Forks count: 0.4%

Stargazers count: 0.6%

Average: 21.6%

Dependent repos count: 35.1%

Dependent packages count: 50.1%

Last synced: 6 months ago

pypi.org: pyspark-client

Python Spark Connect client for Apache Spark

Homepage: https://github.com/apache/spark/tree/master/python
Documentation: https://pyspark-client.readthedocs.io/
License: http://www.apache.org/licenses/LICENSE-2.0
Latest release: 4.0.0
published 9 months ago

Versions: 2
Dependent Packages: 0
Dependent Repositories: 0
Downloads: 1,155 Last month

Rankings

Dependent packages count: 9.1%

Average: 30.2%

Dependent repos count: 51.3%

Maintainers (3)

holdenk hyukjinkwon dongjoon

Last synced: 6 months ago

repo1.maven.org: org.apache.spark:spark-sql-api_2.13

Homepage: https://spark.apache.org/
Documentation: https://appdoc.app/artifact/org.apache.spark/spark-sql-api_2.13/
License: Apache-2.0
Latest release: 4.0.0
published 9 months ago

Versions: 11
Dependent Packages: 0
Dependent Repositories: 0
Docker Downloads: 657

Rankings

Dependent repos count: 34.3%

Average: 41.7%

Dependent packages count: 49.1%

Last synced: 6 months ago

Dependencies

mllib-local/pom.xml maven

dev.ludovic.netlib:blas
org.apache.commons:commons-math3
org.apache.spark:spark-tags_${scala.binary.version}
org.scalanlp:breeze_${scala.binary.version}
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-tags_${scala.binary.version} test
org.mockito:mockito-core test
org.mockito:mockito-inline test
org.scalacheck:scalacheck_${scala.binary.version} test

pom.xml maven

javax.activation:activation 1.1.1 compile
net.sf.jpam:jpam 1.1 compile
org.apache.avro:avro-mapred 1.11.2 compile
org.apache.curator:curator-recipes 5.2.0 compile
org.apache.hadoop:hadoop-client 3.3.6 compile
org.apache.hadoop:hadoop-client-api 3.3.6 compile
org.apache.hadoop:hadoop-client-runtime 3.3.6 compile
org.apache.hadoop:hadoop-yarn-api 3.3.6 compile
org.apache.hadoop:hadoop-yarn-client 3.3.6 compile
org.apache.hadoop:hadoop-yarn-common 3.3.6 compile
org.apache.hadoop:hadoop-yarn-server-web-proxy 3.3.6 compile
org.apache.hive:hive-beeline 2.3.9 compile
org.apache.hive:hive-cli 2.3.9 compile
org.apache.hive:hive-common 2.3.9 compile
org.apache.hive:hive-exec 2.3.9 compile
org.apache.hive:hive-llap-common 2.3.9 compile
org.apache.hive:hive-metastore 2.3.9 compile
org.apache.hive:hive-serde 2.3.9 compile
org.apache.hive:hive-shims 2.3.9 compile
org.apache.hive:hive-storage-api 2.8.1 compile
org.apache.orc:orc-core 1.9.1 compile
org.apache.orc:orc-mapreduce 1.9.1 compile
org.apache.parquet:parquet-column 1.13.1 compile
org.apache.parquet:parquet-hadoop 1.13.1 compile
org.apache.zookeeper:zookeeper 3.6.3 compile
org.codehaus.jackson:jackson-core-asl 1.9.13 compile
org.codehaus.jackson:jackson-mapper-asl 1.9.13 compile
org.glassfish.jaxb:jaxb-runtime 2.3.2 compile
org.slf4j:slf4j-api 2.0.9 compile
com.google.guava:guava 14.0.1 provided
com.google.protobuf:protobuf-java 3.23.4 provided
com.google.protobuf:protobuf-java-util 3.23.4 provided
org.eclipse.jetty:jetty-client 9.4.52.v20230823 provided
org.eclipse.jetty:jetty-continuation 9.4.52.v20230823 provided
org.eclipse.jetty:jetty-http 9.4.52.v20230823 provided
org.eclipse.jetty:jetty-plus 9.4.52.v20230823 provided
org.eclipse.jetty:jetty-proxy 9.4.52.v20230823 provided
org.eclipse.jetty:jetty-security 9.4.52.v20230823 provided
org.eclipse.jetty:jetty-server 9.4.52.v20230823 provided
org.eclipse.jetty:jetty-servlet 9.4.52.v20230823 provided
org.eclipse.jetty:jetty-servlets 9.4.52.v20230823 provided
org.eclipse.jetty:jetty-util 9.4.52.v20230823 provided
org.eclipse.jetty:jetty-webapp 9.4.52.v20230823 provided
org.jpmml:pmml-model 1.4.8 provided
com.clearspring.analytics:stream 2.9.6
com.fasterxml.jackson.core:jackson-annotations 2.15.2
com.fasterxml.jackson.core:jackson-core 2.15.2
com.fasterxml.jackson.core:jackson-databind 2.15.2
com.fasterxml.jackson.datatype:jackson-datatype-jsr310 2.15.2
com.fasterxml.jackson.module:jackson-module-jaxb-annotations 2.15.2
com.fasterxml.jackson.module:jackson-module-scala_2.13 2.15.2
com.github.luben:zstd-jni 1.5.5-5
com.google.code.findbugs:jsr305 3.0.0
com.google.crypto.tink:tink 1.9.0
com.ning:compress-lzf 1.1.2
com.twitter:chill-java 0.10.0
com.twitter:chill_2.13 0.10.0
com.univocity:univocity-parsers 2.9.1
commons-beanutils:commons-beanutils 1.9.4
commons-cli:commons-cli 1.5.0
commons-codec:commons-codec 1.16.0
commons-collections:commons-collections 3.2.2
commons-io:commons-io 2.13.0
commons-lang:commons-lang 2.6
commons-logging:commons-logging 1.1.3
dev.ludovic.netlib:arpack 3.0.3
dev.ludovic.netlib:blas 3.0.3
dev.ludovic.netlib:lapack 3.0.3
io.dropwizard.metrics:metrics-core 4.2.19
io.dropwizard.metrics:metrics-graphite 4.2.19
io.dropwizard.metrics:metrics-jmx 4.2.19
io.dropwizard.metrics:metrics-json 4.2.19
io.dropwizard.metrics:metrics-jvm 4.2.19
io.netty:netty-all 4.1.96.Final
io.netty:netty-transport-native-epoll 4.1.96.Final
io.netty:netty-transport-native-kqueue 4.1.96.Final
javax.ws.rs:javax.ws.rs-api 2.0.1
javax.xml.bind:jaxb-api 2.2.11
jline:jline 2.14.6
joda-time:joda-time 2.12.5
org.antlr:antlr4-runtime 4.9.3
org.apache.arrow:arrow-memory-netty 13.0.0
org.apache.arrow:arrow-vector 13.0.0
org.apache.avro:avro 1.11.2
org.apache.commons:commons-collections4 4.4
org.apache.commons:commons-compress 1.24.0
org.apache.commons:commons-crypto 1.1.0
org.apache.commons:commons-lang3 3.13.0
org.apache.commons:commons-math3 3.6.1
org.apache.commons:commons-text 1.10.0
org.apache.curator:curator-client 5.2.0
org.apache.curator:curator-framework 5.2.0
org.apache.derby:derby 10.14.2.0
org.apache.hive:hive-jdbc 2.3.9
org.apache.hive:hive-service-rpc 3.1.3
org.apache.httpcomponents:httpclient 4.5.14
org.apache.httpcomponents:httpcore 4.4.16
org.apache.httpcomponents:httpmime 4.5.14
org.apache.ivy:ivy 2.5.1
org.apache.logging.log4j:log4j-1.2-api 2.20.0
org.apache.logging.log4j:log4j-api 2.20.0
org.apache.logging.log4j:log4j-core 2.20.0
org.apache.logging.log4j:log4j-slf4j2-impl 2.20.0
org.apache.spark:spark-tags_2.13 4.0.0-SNAPSHOT
org.apache.thrift:libfb303 0.9.3
org.apache.thrift:libthrift 0.12.0
org.apache.ws.xmlschema:xmlschema-core 2.3.0
org.apache.xbean:xbean-asm9-shaded 4.23
org.codehaus.janino:commons-compiler 3.1.9
org.codehaus.janino:janino 3.1.9
org.datanucleus:datanucleus-core 4.1.17
org.fusesource.leveldbjni:leveldbjni-all 1.8
org.glassfish.jaxb:txw2 3.0.2
org.glassfish.jersey.containers:jersey-container-servlet 2.40
org.glassfish.jersey.containers:jersey-container-servlet-core 2.40
org.glassfish.jersey.core:jersey-client 2.40
org.glassfish.jersey.core:jersey-common 2.40
org.glassfish.jersey.core:jersey-server 2.40
org.glassfish.jersey.inject:jersey-hk2 2.40
org.glassfish.jersey:jersey-client 2.40
org.jodd:jodd-core 3.5.2
org.json4s:json4s-jackson_2.13 3.7.0-M11
org.lz4:lz4-java 1.8.0
org.roaringbitmap:RoaringBitmap 0.9.45
org.rocksdb:rocksdbjni 8.3.2
org.scala-lang.modules:scala-parallel-collections_2.13 1.0.4
org.scala-lang.modules:scala-parser-combinators_2.13 2.3.0
org.scala-lang.modules:scala-xml_2.13 2.2.0
org.scala-lang:scala-compiler 2.13.11
org.scala-lang:scala-library 2.13.11
org.scala-lang:scala-reflect 2.13.11
org.scalanlp:breeze_2.13 2.1.0
org.slf4j:jcl-over-slf4j 2.0.9
org.slf4j:jul-to-slf4j 2.0.9
org.spark-project.spark:unused 1.0.0
org.tukaani:xz 1.9
org.xerial.snappy:snappy-java 1.1.10.3
xerces:xercesImpl 2.12.2
xml-apis:xml-apis 1.4.01
com.github.jnr:jnr-posix 3.1.15 test
com.github.sbt:junit-interface test
com.github.sbt:junit-interface 0.13.3 test
com.ibm.db2:jcc 11.5.8.0 test
com.microsoft.sqlserver:mssql-jdbc 9.4.1.jre8 test
com.mysql:mysql-connector-j 8.0.33 test
com.oracle.database.jdbc:ojdbc8 23.2.0.0 test
com.spotify:docker-client 8.14.1 test
junit:junit test
junit:junit 4.13.2 test
net.bytebuddy:byte-buddy 1.14.5 test
net.bytebuddy:byte-buddy-agent 1.14.5 test
net.sourceforge.htmlunit:htmlunit 2.70.0 test
net.sourceforge.htmlunit:htmlunit-core-js 2.70.0 test
org.apache.curator:curator-test 5.2.0 test
org.apache.hadoop:hadoop-client-minicluster 3.3.6 test
org.apache.hadoop:hadoop-minikdc 3.3.6 test
org.apache.hadoop:hadoop-yarn-server-resourcemanager 3.3.6 test
org.apache.hadoop:hadoop-yarn-server-tests 3.3.6 test
org.apache.hive:hive-llap-client 2.3.9 test
org.apache.parquet:parquet-avro 1.13.1 test
org.apache.parquet:parquet-column 1.13.1 test
org.apache.parquet:parquet-common 1.13.1 test
org.apache.parquet:parquet-encoding 1.13.1 test
org.bouncycastle:bcpkix-jdk15on 1.70 test
org.bouncycastle:bcprov-jdk15on 1.70 test
org.glassfish.jersey.test-framework.providers:jersey-test-framework-provider-simple 2.40 test
org.jmock:jmock-junit4 2.12.0 test
org.mariadb.jdbc:mariadb-java-client 2.7.9 test
org.mockito:mockito-core 4.11.0 test
org.mockito:mockito-inline 4.11.0 test
org.postgresql:postgresql 42.6.0 test
org.scalacheck:scalacheck_2.13 1.17.0 test
org.scalatest:scalatest_2.13 3.2.17 test
org.scalatest:scalatest_2.13 test
org.scalatestplus:mockito-4-11_2.13 3.2.17.0 test
org.scalatestplus:mockito-4-11_2.13 test
org.scalatestplus:scalacheck-1-17_2.13 3.2.17.0 test
org.scalatestplus:scalacheck-1-17_2.13 test
org.scalatestplus:selenium-4-12_2.13 3.2.17.0 test
org.scalatestplus:selenium-4-12_2.13 test
org.seleniumhq.selenium:htmlunit-driver 4.12.0 test
org.seleniumhq.selenium:selenium-java 4.12.1 test

.github/workflows/benchmark.yml actions

actions/cache v3 composite
actions/checkout v3 composite
actions/setup-java v3 composite
actions/upload-artifact v3 composite

.github/workflows/build_and_test.yml actions

actions/cache v3 composite
actions/checkout v3 composite
actions/setup-java v3 composite
actions/setup-python v4 composite
actions/upload-artifact v3 composite
bufbuild/buf-breaking-action v1 composite
bufbuild/buf-setup-action v1 composite
codecov/codecov-action v2 composite
docker/build-push-action v3 composite
docker/login-action v2 composite
docker/setup-buildx-action v2 composite
docker/setup-qemu-action v2 composite

.github/workflows/build_branch35.yml actions

.github/workflows/build_coverage.yml actions

.github/workflows/build_infra_images_cache.yml actions

actions/checkout v3 composite
docker/build-push-action v3 composite
docker/login-action v2 composite
docker/setup-buildx-action v2 composite
docker/setup-qemu-action v2 composite

.github/workflows/build_java21.yml actions

.github/workflows/build_main.yml actions

.github/workflows/build_maven.yml actions

.github/workflows/build_rockdb_as_ui_backend.yml actions

.github/workflows/labeler.yml actions

actions/labeler v4 composite

.github/workflows/maven_test.yml actions

actions/cache v3 composite
actions/checkout v3 composite
actions/setup-java v3 composite
actions/setup-python v4 composite
actions/upload-artifact v3 composite

.github/workflows/notify_test_workflow.yml actions

actions/github-script v6 composite

.github/workflows/publish_snapshot.yml actions

actions/cache v3 composite
actions/checkout v3 composite
actions/setup-java v3 composite

.github/workflows/stale.yml actions

actions/stale c201d45ef4b0ccbd3bb0616f93bae13e73d0a080 composite

.github/workflows/test_report.yml actions

dawidd6/action-download-artifact 09385b76de790122f4da9c82b17bccf858b9557c composite
scacap/action-surefire-report 482f012643ed0560e23ef605a79e8e87ca081648 composite

.github/workflows/update_build_status.yml actions

actions/github-script v6 composite

R/pkg/DESCRIPTION cran

R >= 3.5 depends
methods * depends
arrow >= 1.0.0 suggests
e1071 * suggests
knitr * suggests
markdown * suggests
rmarkdown * suggests
survival * suggests
testthat * suggests

dev/create-release/spark-rm/Dockerfile docker

ubuntu 20.04 build

dev/infra/Dockerfile docker

ubuntu focal-20221019 build

resource-managers/kubernetes/docker/src/main/dockerfiles/spark/Dockerfile docker

azul/zulu-openjdk ${java_image_tag} build

resource-managers/kubernetes/docker/src/main/dockerfiles/spark/bindings/R/Dockerfile docker

$base_img latest build

resource-managers/kubernetes/docker/src/main/dockerfiles/spark/bindings/python/Dockerfile docker

$base_img latest build

assembly/pom.xml maven

com.google.guava:guava ${hadoop.deps.scope}
org.spark-project.spark:unused 1.0.0 provided
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-graphx_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-mllib_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-repl_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-sql_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-streaming_${scala.binary.version} 4.0.0-SNAPSHOT

common/kvstore/pom.xml maven

${leveldbjni.group}:leveldbjni-all
com.fasterxml.jackson.core:jackson-annotations
com.fasterxml.jackson.core:jackson-core
com.fasterxml.jackson.core:jackson-databind
com.google.guava:guava
org.apache.spark:spark-tags_${scala.binary.version}
org.rocksdb:rocksdbjni
commons-io:commons-io test
io.dropwizard.metrics:metrics-core test
org.apache.logging.log4j:log4j-1.2-api test
org.apache.logging.log4j:log4j-api test
org.apache.logging.log4j:log4j-core test
org.apache.logging.log4j:log4j-slf4j2-impl test
org.apache.spark:spark-tags_${scala.binary.version} test
org.slf4j:slf4j-api test

common/network-common/pom.xml maven

com.google.guava:guava compile
org.slf4j:slf4j-api provided
${leveldbjni.group}:leveldbjni-all 1.8
com.fasterxml.jackson.core:jackson-annotations
com.fasterxml.jackson.core:jackson-databind
com.google.code.findbugs:jsr305
com.google.crypto.tink:tink
io.dropwizard.metrics:metrics-core
io.netty:netty-all
io.netty:netty-transport-native-epoll
io.netty:netty-transport-native-kqueue
org.apache.commons:commons-crypto
org.apache.commons:commons-lang3
org.apache.spark:spark-common-utils_${scala.binary.version} 4.0.0-SNAPSHOT
org.roaringbitmap:RoaringBitmap
org.rocksdb:rocksdbjni
org.scala-lang:scala-library
org.apache.logging.log4j:log4j-1.2-api test
org.apache.logging.log4j:log4j-api test
org.apache.logging.log4j:log4j-core test
org.apache.logging.log4j:log4j-slf4j2-impl test
org.apache.spark:spark-tags_${scala.binary.version} test
org.mockito:mockito-core test

common/network-shuffle/pom.xml maven

org.slf4j:slf4j-api provided
com.google.guava:guava
io.dropwizard.metrics:metrics-core
org.apache.spark:spark-network-common_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-tags_${scala.binary.version}
org.roaringbitmap:RoaringBitmap
commons-io:commons-io test
org.apache.logging.log4j:log4j-1.2-api test
org.apache.logging.log4j:log4j-api test
org.apache.logging.log4j:log4j-core test
org.apache.logging.log4j:log4j-slf4j2-impl test
org.apache.spark:spark-network-common_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-tags_${scala.binary.version} test
org.mockito:mockito-core test

common/network-yarn/pom.xml maven

com.google.guava:guava provided
org.slf4j:slf4j-api provided
org.apache.hadoop:hadoop-client-api ${hadoop.version}
org.apache.hadoop:hadoop-client-runtime ${hadoop.version}
org.apache.spark:spark-network-shuffle_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-tags_${scala.binary.version} test

common/sketch/pom.xml maven

org.apache.spark:spark-tags_${scala.binary.version}
org.apache.spark:spark-tags_${scala.binary.version} test

common/tags/pom.xml maven

org.scala-lang:scala-library ${scala.version}

common/unsafe/pom.xml maven

org.slf4j:slf4j-api provided
com.google.code.findbugs:jsr305
com.google.guava:guava
com.twitter:chill_${scala.binary.version}
org.apache.spark:spark-common-utils_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-tags_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.commons:commons-lang3 test
org.apache.commons:commons-text test
org.apache.spark:spark-tags_${scala.binary.version} test
org.mockito:mockito-core test
org.scalacheck:scalacheck_${scala.binary.version} test

common/utils/pom.xml maven

com.fasterxml.jackson.core:jackson-databind
com.fasterxml.jackson.module:jackson-module-scala_${scala.binary.version}
org.apache.commons:commons-text
org.apache.logging.log4j:log4j-1.2-api
org.apache.logging.log4j:log4j-api
org.apache.logging.log4j:log4j-core
org.apache.logging.log4j:log4j-slf4j2-impl
org.apache.spark:spark-tags_${scala.binary.version}
org.slf4j:jcl-over-slf4j
org.slf4j:jul-to-slf4j
org.slf4j:slf4j-api

connector/avro/pom.xml maven

org.apache.spark:spark-sql_${scala.binary.version} 4.0.0-SNAPSHOT provided
org.apache.spark:spark-tags_${scala.binary.version}
org.scala-lang.modules:scala-parallel-collections_${scala.binary.version}
org.tukaani:xz
org.apache.spark:spark-catalyst_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-sql_${scala.binary.version} 4.0.0-SNAPSHOT test
org.scalacheck:scalacheck_${scala.binary.version} test

connector/docker-integration-tests/pom.xml maven

com.google.guava:guava 18.0
com.ibm.db2:jcc test
com.microsoft.sqlserver:mssql-jdbc test
com.mysql:mysql-connector-j test
com.oracle.database.jdbc:ojdbc8 test
com.spotify:docker-client test
org.apache.hadoop:hadoop-minikdc test
org.apache.httpcomponents:httpclient test
org.apache.httpcomponents:httpcore test
org.apache.spark:spark-catalyst_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-sql_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-tags_${scala.binary.version} test
org.glassfish.jersey.bundles.repackaged:jersey-guava 2.25.1 test
org.mariadb.jdbc:mariadb-java-client test
org.postgresql:postgresql test

connector/kafka-0-10/pom.xml maven

org.apache.spark:spark-streaming_${scala.binary.version} 4.0.0-SNAPSHOT provided
org.apache.kafka:kafka-clients ${kafka.version}
org.apache.spark:spark-tags_${scala.binary.version}
org.apache.spark:spark-token-provider-kafka-0-10_${scala.binary.version} 4.0.0-SNAPSHOT
org.scala-lang.modules:scala-parallel-collections_${scala.binary.version}
net.sf.jopt-simple:jopt-simple 3.2 test
org.apache.kafka:kafka_${scala.binary.version} ${kafka.version} test
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-streaming_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-tags_${scala.binary.version} test
org.apache.zookeeper:zookeeper 3.5.7 test
org.jmock:jmock-junit4 test
org.mockito:mockito-core test
org.scalacheck:scalacheck_${scala.binary.version} test

connector/kafka-0-10-assembly/pom.xml maven

com.google.protobuf:protobuf-java provided
commons-codec:commons-codec provided
commons-lang:commons-lang provided
javax.activation:activation provided
org.apache.avro:avro-mapred provided
org.apache.curator:curator-recipes provided
org.apache.hadoop:hadoop-client-api ${hadoop.version} provided
org.apache.hadoop:hadoop-client-runtime ${hadoop.version} provided
org.apache.logging.log4j:log4j-1.2-api provided
org.apache.logging.log4j:log4j-api provided
org.apache.logging.log4j:log4j-core provided
org.apache.logging.log4j:log4j-slf4j2-impl provided
org.apache.spark:spark-streaming_${scala.binary.version} 4.0.0-SNAPSHOT provided
org.apache.zookeeper:zookeeper provided
org.lz4:lz4-java provided
org.scala-lang:scala-library provided
org.slf4j:slf4j-api provided
org.xerial.snappy:snappy-java provided
org.apache.spark:spark-streaming-kafka-0-10_${scala.binary.version} 4.0.0-SNAPSHOT

connector/kafka-0-10-sql/pom.xml maven

org.apache.spark:spark-sql_${scala.binary.version} 4.0.0-SNAPSHOT provided
com.google.code.findbugs:jsr305
org.apache.commons:commons-pool2 ${commons-pool2.version}
org.apache.hadoop:hadoop-minikdc
org.apache.kafka:kafka-clients ${kafka.version}
org.apache.spark:spark-tags_${scala.binary.version}
org.apache.spark:spark-token-provider-kafka-0-10_${scala.binary.version} 4.0.0-SNAPSHOT
org.scala-lang.modules:scala-parallel-collections_${scala.binary.version}
net.sf.jopt-simple:jopt-simple 3.2 test
org.apache.kafka:kafka_${scala.binary.version} ${kafka.version} test
org.apache.spark:spark-catalyst_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-sql_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-tags_${scala.binary.version} test
org.apache.spark:spark-token-provider-kafka-0-10_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.zookeeper:zookeeper 3.5.7 test
org.eclipse.jetty:jetty-servlet ${jetty.version} test
org.jmock:jmock-junit4 test
org.mockito:mockito-core test
org.scalacheck:scalacheck_${scala.binary.version} test

connector/kafka-0-10-token-provider/pom.xml maven

org.apache.hadoop:hadoop-client-runtime ${hadoop.deps.scope}
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT provided
org.apache.kafka:kafka-clients ${kafka.version}
org.apache.spark:spark-tags_${scala.binary.version}
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-tags_${scala.binary.version} test
org.mockito:mockito-core test

connector/kinesis-asl/pom.xml maven

com.amazonaws:amazon-kinesis-client ${aws.kinesis.client.version}
com.amazonaws:aws-java-sdk-sts ${aws.java.sdk.version}
com.fasterxml.jackson.dataformat:jackson-dataformat-cbor ${fasterxml.jackson.version}
org.apache.spark:spark-streaming_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-tags_${scala.binary.version}
com.amazonaws:amazon-kinesis-producer ${aws.kinesis.producer.version} test
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-streaming_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-tags_${scala.binary.version} test
org.mockito:mockito-core test
org.scalacheck:scalacheck_${scala.binary.version} test

connector/kinesis-asl-assembly/pom.xml maven

com.fasterxml.jackson.core:jackson-databind provided
commons-lang:commons-lang provided
org.apache.avro:avro-mapred provided
org.apache.curator:curator-recipes provided
org.apache.hadoop:hadoop-client-api ${hadoop.version} provided
org.apache.hadoop:hadoop-client-runtime ${hadoop.version} provided
org.apache.logging.log4j:log4j-1.2-api provided
org.apache.logging.log4j:log4j-api provided
org.apache.logging.log4j:log4j-core provided
org.apache.logging.log4j:log4j-slf4j2-impl ${log4j.version} provided
org.apache.spark:spark-streaming_${scala.binary.version} 4.0.0-SNAPSHOT provided
org.apache.zookeeper:zookeeper provided
org.glassfish.jersey.core:jersey-client provided
org.glassfish.jersey.core:jersey-common provided
org.glassfish.jersey.core:jersey-server provided
org.slf4j:slf4j-api provided
org.xerial.snappy:snappy-java provided
com.google.protobuf:protobuf-java 2.6.1
org.apache.spark:spark-streaming-kinesis-asl_${scala.binary.version} 4.0.0-SNAPSHOT

connector/protobuf/pom.xml maven

com.google.protobuf:protobuf-java compile
com.google.protobuf:protobuf-java-util compile
org.apache.spark:spark-sql_${scala.binary.version} 4.0.0-SNAPSHOT provided
org.apache.spark:spark-tags_${scala.binary.version}
org.scala-lang.modules:scala-parallel-collections_${scala.binary.version}
org.apache.spark:spark-catalyst_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-sql_${scala.binary.version} 4.0.0-SNAPSHOT test
org.scalacheck:scalacheck_${scala.binary.version} test

connector/spark-ganglia-lgpl/pom.xml maven

info.ganglia.gmetric4j:gmetric4j 1.0.10
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT

core/pom.xml maven

com.google.protobuf:protobuf-java compile
org.eclipse.jetty:jetty-client compile
org.eclipse.jetty:jetty-continuation compile
org.eclipse.jetty:jetty-http compile
org.eclipse.jetty:jetty-plus compile
org.eclipse.jetty:jetty-proxy compile
org.eclipse.jetty:jetty-security compile
org.eclipse.jetty:jetty-server compile
org.eclipse.jetty:jetty-servlet compile
org.eclipse.jetty:jetty-servlets compile
org.eclipse.jetty:jetty-util compile
com.clearspring.analytics:stream
com.fasterxml.jackson.core:jackson-databind
com.fasterxml.jackson.module:jackson-module-scala_${scala.binary.version}
com.github.luben:zstd-jni
com.google.code.findbugs:jsr305
com.google.guava:guava
com.ning:compress-lzf
com.twitter:chill-java
com.twitter:chill_${scala.binary.version}
commons-codec:commons-codec
commons-collections:commons-collections
commons-io:commons-io
io.dropwizard.metrics:metrics-core
io.dropwizard.metrics:metrics-graphite
io.dropwizard.metrics:metrics-jmx
io.dropwizard.metrics:metrics-json
io.dropwizard.metrics:metrics-jvm
io.netty:netty-all
io.netty:netty-transport-native-epoll
io.netty:netty-transport-native-kqueue
jakarta.servlet:jakarta.servlet-api ${jakartaservlet.version}
javax.activation:activation
net.razorvine:pickle 1.3
net.sf.py4j:py4j 0.10.9.7
org.apache.avro:avro
org.apache.avro:avro-mapred
org.apache.commons:commons-collections4
org.apache.commons:commons-compress
org.apache.commons:commons-crypto
org.apache.commons:commons-lang3
org.apache.commons:commons-math3
org.apache.commons:commons-text
org.apache.curator:curator-recipes
org.apache.hadoop:hadoop-client-api ${hadoop.version}
org.apache.hadoop:hadoop-client-runtime ${hadoop.version}
org.apache.ivy:ivy
org.apache.spark:spark-common-utils_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-kvstore_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-launcher_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-network-common_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-network-shuffle_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-tags_${scala.binary.version}
org.apache.spark:spark-unsafe_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.xbean:xbean-asm9-shaded
org.apache.zookeeper:zookeeper
org.glassfish.jersey.containers:jersey-container-servlet
org.glassfish.jersey.containers:jersey-container-servlet-core
org.glassfish.jersey.core:jersey-client
org.glassfish.jersey.core:jersey-common
org.glassfish.jersey.core:jersey-server
org.glassfish.jersey.inject:jersey-hk2
org.json4s:json4s-jackson_${scala.binary.version}
org.lz4:lz4-java
org.roaringbitmap:RoaringBitmap
org.scala-lang.modules:scala-parallel-collections_${scala.binary.version}
org.scala-lang.modules:scala-xml_${scala.binary.version}
org.scala-lang:scala-library
org.scala-lang:scala-reflect
org.xerial.snappy:snappy-java
oro:oro ${oro.version}
com.github.jnr:jnr-posix test
net.sourceforge.htmlunit:htmlunit test
net.sourceforge.htmlunit:htmlunit-core-js test
org.apache.curator:curator-test test
org.apache.derby:derby test
org.apache.hadoop:hadoop-aws ${hadoop.version} test
org.apache.hadoop:hadoop-minikdc test
org.apache.httpcomponents:httpclient test
org.apache.httpcomponents:httpcore test
org.apache.httpcomponents:httpmime test
org.apache.spark:spark-launcher_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-network-shuffle_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-tags_${scala.binary.version} test
org.glassfish.jersey.test-framework.providers:jersey-test-framework-provider-simple test
org.mockito:mockito-core test
org.scalacheck:scalacheck_${scala.binary.version} test
org.seleniumhq.selenium:htmlunit-driver test
org.seleniumhq.selenium:selenium-java test
xml-apis:xml-apis test

examples/pom.xml maven

org.apache.commons:commons-math3 provided
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT provided
org.apache.spark:spark-graphx_${scala.binary.version} 4.0.0-SNAPSHOT provided
org.apache.spark:spark-hive_${scala.binary.version} 4.0.0-SNAPSHOT provided
org.apache.spark:spark-mllib_${scala.binary.version} 4.0.0-SNAPSHOT provided
org.apache.spark:spark-sql-kafka-0-10_${scala.binary.version} 4.0.0-SNAPSHOT provided
org.apache.spark:spark-streaming-kafka-0-10_${scala.binary.version} 4.0.0-SNAPSHOT provided
org.apache.spark:spark-streaming_${scala.binary.version} 4.0.0-SNAPSHOT provided
org.scala-lang:scala-library provided
org.spark-project.spark:unused 1.0.0 provided
com.github.scopt:scopt_${scala.binary.version} 3.7.1
org.scalacheck:scalacheck_${scala.binary.version} test

graphx/pom.xml maven

com.google.guava:guava
dev.ludovic.netlib:blas
net.sourceforge.f2j:arpack_combined_all 0.1
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-mllib-local_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-tags_${scala.binary.version}
org.apache.xbean:xbean-asm9-shaded
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-tags_${scala.binary.version} test
org.scalacheck:scalacheck_${scala.binary.version} test

hadoop-cloud/pom.xml maven

com.fasterxml.jackson.core:jackson-annotations ${hadoop.deps.scope}
com.fasterxml.jackson.core:jackson-databind ${hadoop.deps.scope}
joda-time:joda-time ${hadoop.deps.scope}
org.apache.hadoop:hadoop-aws ${hadoop.version} ${hadoop.deps.scope}
org.apache.hadoop:hadoop-azure ${hadoop.version} ${hadoop.deps.scope}
org.apache.hadoop:hadoop-cloud-storage ${hadoop.version} ${hadoop.deps.scope}
org.apache.httpcomponents:httpclient ${hadoop.deps.scope}
org.apache.httpcomponents:httpcore ${hadoop.deps.scope}
org.eclipse.jetty:jetty-util ${hadoop.deps.scope}
org.eclipse.jetty:jetty-util-ajax ${jetty.version} ${hadoop.deps.scope}
org.apache.hadoop:hadoop-client-api ${hadoop.version} provided
org.apache.spark:spark-sql_${scala.binary.version} 4.0.0-SNAPSHOT provided
com.fasterxml.jackson.dataformat:jackson-dataformat-cbor ${fasterxml.jackson.version}
com.google.cloud.bigdataoss:gcs-connector ${gcs-connector.version}
org.apache.hadoop:hadoop-client-runtime ${hadoop.version}
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-sql_${scala.binary.version} 4.0.0-SNAPSHOT test

launcher/pom.xml maven

org.apache.spark:spark-tags_${scala.binary.version}
org.apache.hadoop:hadoop-client-api ${hadoop.version} test
org.apache.hadoop:hadoop-client-runtime ${hadoop.version} test
org.apache.logging.log4j:log4j-1.2-api test
org.apache.logging.log4j:log4j-api test
org.apache.logging.log4j:log4j-core test
org.apache.logging.log4j:log4j-slf4j2-impl test
org.apache.spark:spark-tags_${scala.binary.version} test
org.mockito:mockito-core test
org.slf4j:jul-to-slf4j test
org.slf4j:slf4j-api test

mllib/pom.xml maven

org.jpmml:pmml-model compile
dev.ludovic.netlib:arpack
dev.ludovic.netlib:blas
dev.ludovic.netlib:lapack
org.apache.commons:commons-math3
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-graphx_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-mllib-local_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-sql_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-streaming_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-tags_${scala.binary.version}
org.glassfish.jaxb:jaxb-runtime
org.scala-lang.modules:scala-parallel-collections_${scala.binary.version}
org.scala-lang.modules:scala-parser-combinators_${scala.binary.version}
org.scalanlp:breeze_${scala.binary.version}
org.apache.spark:spark-catalyst_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-mllib-local_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-sql_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-streaming_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-tags_${scala.binary.version} test
org.mockito:mockito-core test
org.mockito:mockito-inline test
org.scalacheck:scalacheck_${scala.binary.version} test

repl/pom.xml maven

org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-mllib_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-sql_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-tags_${scala.binary.version}
org.apache.xbean:xbean-asm9-shaded
org.eclipse.jetty:jetty-http
org.eclipse.jetty:jetty-plus
org.eclipse.jetty:jetty-server
org.eclipse.jetty:jetty-util
org.scala-lang:scala-compiler ${scala.version}
org.scala-lang:scala-library
org.scala-lang:scala-reflect ${scala.version}
org.slf4j:jul-to-slf4j
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-tags_${scala.binary.version} test
org.mockito:mockito-core test
org.scalacheck:scalacheck_${scala.binary.version} test

resource-managers/kubernetes/core/pom.xml maven

com.fasterxml.jackson.dataformat:jackson-dataformat-yaml ${fasterxml.jackson.version}
com.google.guava:guava
io.fabric8:kubernetes-client ${kubernetes-client.version}
io.fabric8:kubernetes-httpclient-okhttp ${kubernetes-client.version}
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-tags_${scala.binary.version} test
org.jmock:jmock-junit4 test
org.mockito:mockito-core test

resource-managers/kubernetes/integration-tests/pom.xml maven

io.fabric8:kubernetes-client ${kubernetes-client.version}
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-tags_${scala.binary.version}
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-kubernetes_${scala.binary.version} 4.0.0-SNAPSHOT test

resource-managers/yarn/pom.xml maven

${hive.group}:hive-exec provided
${hive.group}:hive-metastore provided
org.apache.thrift:libfb303 provided
org.apache.thrift:libthrift provided
com.google.guava:guava
org.apache.hadoop:hadoop-client-api ${hadoop.version}
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT
org.eclipse.jetty:jetty-http
org.eclipse.jetty:jetty-plus
org.eclipse.jetty:jetty-server
org.eclipse.jetty:jetty-servlet
org.eclipse.jetty:jetty-servlets
org.eclipse.jetty:jetty-util
com.sun.jersey.contribs:jersey-guice 1.19 test
com.sun.jersey:jersey-core 1.19 test
com.sun.jersey:jersey-json 1.19 test
com.sun.jersey:jersey-server 1.19 test
com.sun.jersey:jersey-servlet 1.19 test
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-network-yarn_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-tags_${scala.binary.version} test
org.eclipse.jetty.orbit:javax.servlet.jsp 2.2.0.v201112011158 test
org.eclipse.jetty.orbit:javax.servlet.jsp.jstl 1.2.0.v201105211821 test
org.mockito:mockito-core test

sql/api/pom.xml maven

org.antlr:antlr4-runtime
org.apache.arrow:arrow-memory-netty
org.apache.arrow:arrow-vector
org.apache.spark:spark-common-utils_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-unsafe_${scala.binary.version} 4.0.0-SNAPSHOT
org.json4s:json4s-jackson_${scala.binary.version} 3.7.0-M11
org.scala-lang.modules:scala-parser-combinators_${scala.binary.version}
org.scala-lang:scala-reflect

sql/catalyst/pom.xml maven

com.univocity:univocity-parsers
commons-codec:commons-codec
org.apache.datasketches:datasketches-java 3.3.0
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-sketch_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-sql-api_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-tags_${scala.binary.version}
org.apache.spark:spark-unsafe_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.ws.xmlschema:xmlschema-core
org.codehaus.janino:commons-compiler
org.codehaus.janino:janino
org.scala-lang.modules:scala-parallel-collections_${scala.binary.version}
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-tags_${scala.binary.version} test
org.mockito:mockito-core test
org.scalacheck:scalacheck_${scala.binary.version} test

sql/core/pom.xml maven

com.fasterxml.jackson.core:jackson-databind
com.google.protobuf:protobuf-java
com.univocity:univocity-parsers
org.apache.hive:hive-storage-api
org.apache.orc:orc-core
org.apache.orc:orc-mapreduce
org.apache.parquet:parquet-column
org.apache.parquet:parquet-hadoop
org.apache.spark:spark-catalyst_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-sketch_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-tags_${scala.binary.version}
org.apache.ws.xmlschema:xmlschema-core
org.apache.xbean:xbean-asm9-shaded
org.eclipse.jetty:jetty-servlet
org.glassfish.jaxb:txw2
org.rocksdb:rocksdbjni
org.scala-lang.modules:scala-parallel-collections_${scala.binary.version}
com.h2database:h2 2.2.220 test
com.ibm.db2:jcc test
com.microsoft.sqlserver:mssql-jdbc test
com.oracle.database.jdbc:ojdbc8 test
org.apache.derby:derby test
org.apache.parquet:parquet-avro test
org.apache.parquet:parquet-column test
org.apache.parquet:parquet-common test
org.apache.parquet:parquet-encoding test
org.apache.spark:spark-catalyst_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-tags_${scala.binary.version} test
org.mariadb.jdbc:mariadb-java-client test
org.mockito:mockito-core test
org.mockito:mockito-inline test
org.postgresql:postgresql test
org.scalacheck:scalacheck_${scala.binary.version} test
org.seleniumhq.selenium:htmlunit-driver test
org.seleniumhq.selenium:selenium-java test

sql/hive/pom.xml maven

org.apache.hadoop:hadoop-client-runtime ${hadoop.deps.scope}
${hive.group}:hive-common ${hive.common.scope}
org.apache.hive:hive-llap-client ${hive.llap.scope}
org.apache.hive:hive-llap-common ${hive.llap.scope}
${hive.group}:hive-serde ${hive.serde.scope}
${hive.group}:hive-shims ${hive.shims.scope}
${hive.group}:hive-exec
${hive.group}:hive-metastore
com.google.code.findbugs:jsr305
commons-codec:commons-codec
joda-time:joda-time
org.apache.avro:avro
org.apache.avro:avro-mapred
org.apache.derby:derby
org.apache.httpcomponents:httpclient
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-sql_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.thrift:libfb303
org.apache.thrift:libthrift
org.codehaus.jackson:jackson-mapper-asl
org.datanucleus:datanucleus-core
org.jodd:jodd-core
org.scala-lang.modules:scala-parallel-collections_${scala.binary.version}
org.apache.parquet:parquet-hadoop ${parquet.version} test
org.apache.spark:spark-catalyst_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-sql_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-tags_${scala.binary.version} test
org.scala-lang:scala-compiler test
org.scalacheck:scalacheck_${scala.binary.version} test

sql/hive-thriftserver/pom.xml maven

org.eclipse.jetty:jetty-server provided
org.eclipse.jetty:jetty-servlet provided
${hive.group}:hive-beeline
${hive.group}:hive-cli
${hive.group}:hive-jdbc
${hive.group}:hive-service-rpc
com.google.guava:guava
commons-cli:commons-cli
net.sf.jpam:jpam
org.apache.httpcomponents:httpcore
org.apache.spark:spark-hive_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-tags_${scala.binary.version}
org.scala-lang.modules:scala-parallel-collections_${scala.binary.version}
org.apache.spark:spark-catalyst_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-hive_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-sql_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-tags_${scala.binary.version} test
org.mockito:mockito-core test
org.seleniumhq.selenium:htmlunit-driver test
org.seleniumhq.selenium:selenium-java test

streaming/pom.xml maven

com.google.guava:guava
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-tags_${scala.binary.version}
org.eclipse.jetty:jetty-http
org.eclipse.jetty:jetty-plus
org.eclipse.jetty:jetty-server
org.eclipse.jetty:jetty-servlet
org.eclipse.jetty:jetty-servlets
org.eclipse.jetty:jetty-util
org.scala-lang.modules:scala-parallel-collections_${scala.binary.version}
org.scala-lang:scala-library
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-tags_${scala.binary.version} test
org.mockito:mockito-core test
org.scalacheck:scalacheck_${scala.binary.version} test
org.seleniumhq.selenium:htmlunit-driver test
org.seleniumhq.selenium:selenium-java test

tools/pom.xml maven

org.clapper:classutil_${scala.binary.version} 1.5.1
org.ow2.asm:asm ${asm.version}
org.ow2.asm:asm-commons ${asm.version}
org.ow2.asm:asm-util ${asm.version}
org.scala-lang:scala-compiler
org.scala-lang:scala-reflect

dev/package-lock.json npm

112 dependencies

dev/package.json npm

ansi-regex ^5.0.1 development
eslint ^7.25.0 development
minimatch ^3.1.2 development

dev/pyproject.toml pypi

dev/requirements.txt pypi

PyGithub * development
black ==23.9.1 development
coverage * development
deepspeed * development
docutils <0.18.0 development
flake8 ==3.9.0 development
googleapis-common-protos ==1.56.4 development
googleapis-common-protos-stubs ==2.2.0 development
grpc-stubs ==1.24.11 development
grpcio >=1.48,<1.57 development
grpcio-status >=1.48,<1.57 development
ipython * development
jinja2 <3.0.0 development
jira >=3.5.2 development
markupsafe ==2.0.1 development
matplotlib * development
memory-profiler ==0.60.0 development
mkdocs * development
mlflow >=2.3.1 development
mypy ==0.982 development
mypy-protobuf ==3.3.0 development
nbsphinx * development
numpy * development
numpydoc * development
openpyxl * development
pandas * development
pandas-stubs <1.2.0.54 development
plotly * development
protobuf ==3.20.3 development
py * development
py4j * development
pyarrow * development
pydata_sphinx_theme * development
pytest-mypy-plugins ==1.9.3 development
scikit-learn * development
scipy * development
sphinx <3.1.0 development
sphinx-plotly-directive * development
torch * development
torcheval * development
torchvision * development
unittest-xml-reporting * development

docs/Gemfile rubygems

ffi = 1.15.5
jekyll = 4.3.2
jekyll-redirect-from = 0.16.0
rouge = 3.26.0
webrick = 1.8.1

docs/Gemfile.lock rubygems

addressable 2.8.5
bundler 2.3.8
colorator 1.1.0
concurrent-ruby 1.2.2
em-websocket 0.5.3
eventmachine 1.2.7
ffi 1.15.5
forwardable-extended 2.6.0
google-protobuf 3.24.2
http_parser.rb 0.8.0
i18n 1.14.1
jekyll 4.3.2
jekyll-redirect-from 0.16.0
jekyll-sass-converter 3.0.0
jekyll-watch 2.2.1
kramdown 2.4.0
kramdown-parser-gfm 1.1.0
liquid 4.0.4
listen 3.8.0
mercenary 0.4.0
pathutil 0.16.2
public_suffix 5.0.3
rake 13.0.6
rb-fsevent 0.11.2
rb-inotify 0.10.1
rexml 3.2.6
rouge 3.26.0
safe_yaml 1.0.5
sass-embedded 1.63.6
terminal-table 3.0.2
unicode-display_width 2.4.2
webrick 1.8.1

.github/workflows/build_maven_java21.yml actions

core/src/main/resources/org/apache/spark/ui/static/package.json npm

ui-test/package-lock.json npm

331 dependencies

ui-test/package.json npm

jest ^29.7.0 development
jest-environment-jsdom ^29.7.0 development
jquery ^3.7.1 development

connector/profiler/pom.xml maven

org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT provided
me.bechberger:ap-loader-all 2.9-7

.github/workflows/build_sparkr_window.yml actions

actions/cache v4 composite
actions/checkout v4 composite
actions/setup-java v4 composite
actions/setup-python v5 composite
r-lib/actions/setup-r v2 composite

common/variant/pom.xml maven

com.fasterxml.jackson.core:jackson-core
org.apache.spark:spark-common-utils_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.spark:spark-tags_${scala.binary.version}
org.apache.spark:spark-tags_${scala.binary.version} test

.github/workflows/build_python_connect.yml actions

actions/cache v4 composite
actions/checkout v4 composite
actions/setup-java v4 composite
actions/setup-python v5 composite
actions/upload-artifact v4 composite

python/packaging/classic/setup.py pypi

py4j ==0.10.9.7

python/packaging/connect/setup.py pypi

googleapis-common-protos >=
grpcio >=
grpcio-status >=
numpy >=
pandas >=
pyarrow >=

.github/workflows/build_branch35_python.yml actions

.github/workflows/build_maven_java21_macos15.yml actions

.github/workflows/build_non_ansi.yml actions

.github/workflows/build_python_3.10.yml actions

.github/workflows/build_python_3.12.yml actions

.github/workflows/build_python_3.13.yml actions

.github/workflows/build_python_connect35.yml actions

actions/cache v4 composite
actions/checkout v4 composite
actions/setup-java v4 composite
actions/setup-python v5 composite
actions/upload-artifact v4 composite

.github/workflows/build_python_pypy3.10.yml actions

.github/workflows/pages.yml actions

actions/checkout v4 composite
actions/configure-pages v5 composite
actions/deploy-pages v4 composite
actions/setup-java v4 composite
actions/setup-python v5 composite
actions/upload-pages-artifact v3 composite
ruby/setup-ruby v1 composite

binder/Dockerfile docker

python 3.10-slim build

sql/connect/common/pom.xml maven

com.google.protobuf:protobuf-java
io.grpc:grpc-inprocess ${io.grpc.version}
io.grpc:grpc-netty ${io.grpc.version}
io.grpc:grpc-protobuf ${io.grpc.version}
io.grpc:grpc-services ${io.grpc.version}
io.grpc:grpc-stub ${io.grpc.version}
io.netty:netty-codec-http2 ${netty.version}
io.netty:netty-handler-proxy ${netty.version}
io.netty:netty-transport-native-unix-common ${netty.version}
org.apache.spark:spark-sql-api_${scala.binary.version} 4.0.0-SNAPSHOT
org.apache.tomcat:annotations-api ${tomcat.annotations.api.version}
org.scala-lang:scala-library
org.apache.spark:spark-tags_${scala.binary.version} test

sql/connect/server/pom.xml maven

com.google.guava:failureaccess ${guava.failureaccess.version} compile
com.google.guava:guava ${connect.guava.version} compile
com.google.protobuf:protobuf-java compile
com.google.protobuf:protobuf-java-util compile
io.netty:netty-codec-http2 ${netty.version} provided
io.netty:netty-handler-proxy ${netty.version} provided
io.netty:netty-transport-native-unix-common ${netty.version} provided
org.apache.spark:spark-catalyst_${scala.binary.version} 4.0.0-SNAPSHOT provided
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT provided
org.apache.spark:spark-mllib_${scala.binary.version} 4.0.0-SNAPSHOT provided
org.apache.spark:spark-sql_${scala.binary.version} 4.0.0-SNAPSHOT provided
org.apache.spark:spark-tags_${scala.binary.version} 4.0.0-SNAPSHOT provided
org.apache.tomcat:annotations-api ${tomcat.annotations.api.version} provided
io.grpc:grpc-netty ${io.grpc.version}
io.grpc:grpc-protobuf ${io.grpc.version}
io.grpc:grpc-services ${io.grpc.version}
io.grpc:grpc-stub ${io.grpc.version}
jakarta.servlet:jakarta.servlet-api
javax.servlet:javax.servlet-api
org.apache.spark:spark-connect-common_${scala.binary.version} 4.0.0-SNAPSHOT
org.scala-lang.modules:scala-parallel-collections_${scala.binary.version}
com.h2database:h2 2.3.232 test
net.bytebuddy:byte-buddy test
net.bytebuddy:byte-buddy-agent test
org.apache.spark:spark-avro_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-catalyst_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-connect-common_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-core_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-protobuf_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-repl_${scala.binary.version} 4.0.0-SNAPSHOT test
org.apache.spark:spark-sql_${scala.binary.version} 4.0.0-SNAPSHOT test
org.mockito:mockito-core test
org.scalacheck:scalacheck_${scala.binary.version} test

sql/connect/shims/pom.xml maven

org.scala-lang:scala-library

.github/workflows/build_branch40.yml actions

.github/workflows/build_branch40_java21.yml actions

.github/workflows/build_branch40_maven.yml actions

.github/workflows/build_branch40_maven_java21.yml actions

.github/workflows/build_branch40_non_ansi.yml actions

.github/workflows/build_branch40_python.yml actions

.github/workflows/build_branch40_python_pypy3.10.yml actions

.github/workflows/build_maven_java21_arm.yml actions

.github/workflows/build_python_3.11_arm.yml actions

.github/workflows/build_python_3.11_macos.yml actions

.github/workflows/build_python_3.13_nogil.yml actions