Data

Tools

Indexes

Applications

Experiments

Open Source Science

pysyft

Perform data science on data that remains in someone else's server

https://github.com/openmined/pysyft

Science Score: 46.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ✓
    Academic publication links
    Links to: arxiv.org
  • ✓
    Committers with academic emails
    28 of 493 committers (5.7%) from academic institutions
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (15.5%) to scientific vocabulary

Keywords

cryptography deep-learning federated-learning hacktoberfest privacy python pytorch secure-computation syft

Keywords from Contributors

distributed autograd tensor transformer jax deep-neural-networks cryptocurrencies speech-recognition pretrained-models audio
Last synced: 6 months ago · JSON representation

Repository

Perform data science on data that remains in someone else's server

Basic Info
  • Host: GitHub
  • Owner: OpenMined
  • License: apache-2.0
  • Language: Python
  • Default Branch: dev
  • Homepage: https://www.openmined.org/
  • Size: 736 MB
Statistics
  • Stars: 9,771
  • Watchers: 195
  • Forks: 1,999
  • Open Issues: 53
  • Releases: 178
Topics
cryptography deep-learning federated-learning hacktoberfest privacy python pytorch secure-computation syft
Created over 8 years ago · Last pushed 7 months ago
Metadata Files
Readme License

README.md



Syft Logo

Data Science on data you are not allowed to see

PySyft enables a new way to do data science, where you can use non-public information, without seeing nor obtaining a copy of the data itself. All you need is to connect to a Datasite! Datasites are like websites, but for data. Designed with the principles of structured transparency, they enable data owners to control how their data is protected and data scientists to use data without obtaining a copy. PySyft supports any statistical analysis or machine learning, offering support for directly running Python code - even using third-party Python libraries.

Supported on:

✅ Linux ✅ macOS ✅ Windows ✅ Docker ✅ Kubernetes # Quickstart Try out your first query against a live demo Datasite! ## Install Client ```bash pip install -U "syft[data_science]" ``` More instructions are available here. ## Launch Server Launch a development server directly in your Jupyter Notebook: ```python import syft as sy sy.requires(">=0.9.5,<0.9.6") server = sy.orchestra.launch( name="my-datasite", port=8080, create_producer=True, n_consumers=1, dev_mode=False, reset=True, # resets database ) ``` or from the command line: ```bash $ syft launch --name=my-datasite --port=8080 --reset=True Starting syft-datasite server on 0.0.0.0:8080 ``` Datasite servers can be deployed as a single container using Docker or directly in Kubernetes. Check out our deployment guide. ## Launch Client Main way to use a Datasite is via our Syft client, in a Jupyter Notebook. Check out our PySyft client guide: ```python import syft as sy sy.requires(">=0.9.5,<0.9.6") datasite_client = sy.login( port=8080, email="info@openmined.org", password="changethis" ) ``` ## PySyft - Getting started 📝 Learn about PySyft via our getting started guide: - PySyft from the ground up - Part 1: Datasets & Assets - Part 2: Client and Datasite Access - Part 3: Propose the research study - Part 4: Review Code Requests - Part 5: Retrieving Results # PySyft In-depth 📚 Check out our docs website. Quick PySyft components links: - DataSite Server - Syft Client - Datasets API (`.datasets`) - Users API (`.users`) - Request API (`.requests`) - Code API (`.code`) - Syft Policies API (`.policy`) - Settings API (`.settings`) - Notifications API (`.notifications`) - Sync API (`.sync`) ## Why use PySyft? In a variety of domains across society, data owners have **valid concerns about the risks associated with sharing their data**, such as legal risks, privacy invasion (_misuing the data_), or intellectual property (_copying and redistributing it_). Datasites enable data scientists to **answer questions** without even seeing or acquiring a copy of the data, **within the data owners's definition of acceptable use**. We call this process Remote Data Science. This means that the **current risks** of sharing information with someone will **no longer prevent** the vast benefits such as innovation, insights and scientific discovery. With each Datasite, data owners are able to enable `1000x more accesible data` in each scientific field and lead, together with data scientists, breakthrough innovation. Learn more about our work on our website. ## Support For questions about PySyft, reach out via `#support` on Slack. ## Syft Versions :exclamation: PySyft and Syft Server must use the same `version`. **Latest Stable** - `0.9.5` (Stable) - Docs - Install PySyft (Stable): `pip install -U syft` Find more about previous releases here. # Community Supported by the OpenMined Foundation, the OpenMined Community is an online network of over 17,000 technologists, researchers, and industry professionals keen to _unlock 1000x more data in every scientific field and industry_. # Courses

Contributors

OpenMined and Syft appreciates all contributors, if you would like to fix a bug or suggest a new feature, please reach out via Github or Slack!

Contributors

About OpenMined

OpenMined is a non-profit foundation creating technology infrastructure that helps researchers get answers from data without needing a copy or direct access. Our community of technologists is building Syft.

Supporters

License

Apache License 2.0
Person icons created by Freepik - Flaticon

Owner

  • Name: OpenMined
  • Login: OpenMined
  • Kind: organization

GitHub Events

Total
  • Create event: 32
  • Release event: 11
  • Issues event: 6
  • Watch event: 336
  • Delete event: 11
  • Issue comment event: 17
  • Push event: 68
  • Pull request review event: 4
  • Pull request event: 37
  • Fork event: 38
Last Year
  • Create event: 32
  • Release event: 11
  • Issues event: 6
  • Watch event: 336
  • Delete event: 11
  • Issue comment event: 17
  • Push event: 68
  • Pull request review event: 4
  • Pull request event: 37
  • Fork event: 38

Committers

Last synced: 10 months ago

All Time
  • Total Commits: 24,630
  • Total Committers: 493
  • Avg Commits per committer: 49.959
  • Development Distribution Score (DDS): 0.894
Past Year
  • Commits: 4,062
  • Committers: 28
  • Avg Commits per committer: 145.071
  • Development Distribution Score (DDS): 0.891
Top Committers
Name Email Commits
Madhava Jay me@m****m 2,620
rasswanth-s 4****s 2,419
iamtrask l****k@g****m 2,176
Ionesio Junior i****r@g****m 2,028
Shubham Gupta s****1@g****m 1,659
Yash Gorana y****a@h****m 821
Koen van der Veen k****n@g****m 815
khoaguin d****k@p****m 801
Thiago Costa Porto t****o@g****m 797
teo t****7@g****m 778
Kien Dang m****l@k****i 682
IshanMi m****n@g****m 626
eelcovdw e****w@g****m 623
Theo t****r@g****m 533
bitsofsteve c****x@g****m 525
Aziz Berkay Yesilyurt a****t@g****m 461
Madhava Jay m****a@o****g 369
alfred-openmined-bot 1****t 289
Tudor Cebere t****e@g****m 220
Marianne Linhares m****m@g****m 212
Olivier DEBAUCHE o****e@u****e 178
Bogdan Cebere b****e@g****m 175
George-Cristian Muraru m****c@g****m 164
Bobby Wagner r****1@c****u 164
Brendan Schell b****1@g****m 128
Sameer Wagh s****h@g****m 125
Tauquir 3****q 114
Silvia Gandy s****a@m****m 104
kamathhrishi@gmail.com k****i@g****m 101
Karl Higley k****y@g****m 100
and 463 more...
Committer Domains (Top 20 + Academic)
ccc.ufcg.edu.br: 6 ncsu.edu: 2 yahoo.it: 2 gmail.com”: 1 lebensold.ca: 1 snyk.io: 1 terpmail.umd.edu: 1 genbu.ai: 1 gmx.de: 1 iitrpr.ac.in: 1 felfel.ch: 1 ruchibhathia.x1vk4lbpnxoebio5knk4zw1cha.ax.internal.cloudapp.net: 1 vit.edu: 1 google.com: 1 queenslab.se: 1 benfielding.org: 1 kerat.dock: 1 michael-nolan.com: 1 explee.com: 1 adobe.com: 1 case.edu: 1 napier.ac.uk: 1 alumni.stanford.edu: 1 iitk.ac.in: 1 broadinstitute.org: 1 ed.ac.uk: 1 u.northwestern.edu: 1 alumni.cmu.edu: 1 gwmail.gwu.edu: 1 comp.nus.edu.sg: 1 anu.edu.au: 1 sic-install2-ubuntu.lille.inria.fr: 1 goa.bits-pilani.ac.in: 1 r-39-107-25-172.comp.nus.edu.sg: 1 lsd.ufcg.edu.br: 1 ruc.edu.cn: 1 unsa.edu.pe: 1

Issues and Pull Requests

Last synced: 6 months ago

All Time
  • Total issues: 155
  • Total pull requests: 1,566
  • Average time to close issues: 6 months
  • Average time to close pull requests: 12 days
  • Total issue authors: 93
  • Total pull request authors: 88
  • Average comments per issue: 2.05
  • Average comments per pull request: 0.8
  • Merged pull requests: 1,164
  • Bot issues: 0
  • Bot pull requests: 36
Past Year
  • Issues: 9
  • Pull requests: 128
  • Average time to close issues: 10 days
  • Average time to close pull requests: 2 days
  • Issue authors: 7
  • Pull request authors: 19
  • Average comments per issue: 0.89
  • Average comments per pull request: 0.49
  • Merged pull requests: 98
  • Bot issues: 0
  • Bot pull requests: 6
View more stats
Top Authors
Issue Authors
  • rav1kantsingh (12)
  • koenvanderveen (11)
  • madhavajay (10)
  • iamtrask (8)
  • rasswanth-s (4)
  • teo-milea (4)
  • khoaguin (4)
  • shubham3121 (3)
  • petermchale (3)
  • KamalGalrani (3)
  • IshanMi (3)
  • Am0stafa (3)
  • rj3d (2)
  • dhreb (2)
  • jyotichandel279 (2)
Pull Request Authors
  • madhavajay (305)
  • rasswanth-s (290)
  • shubham3121 (216)
  • koenvanderveen (147)
  • eelcovdw (141)
  • khoaguin (126)
  • yashgorana (119)
  • IonesioJunior (108)
  • teo-milea (105)
  • Smartappli (79)
  • abyesilyurt (74)
  • kiendang (63)
  • dependabot[bot] (58)
  • BrendanSchell (54)
  • itstauq (53)
Top Labels
Issue Labels
Type: Bug :bug: (54) Type: Question :grey_question: (23) Awaiting Response (23) Type: Improvement :chart_with_upwards_trend: (21) Future (18) Type: New Feature :heavy_plus_sign: (16) Type: Documentation :books: (9) HAGrid (8) Status: Stale :bread: (8) Type: Epic :call_me_hand: (7) Priority: 3 - Medium :unamused: (6) Syft (6) 0.8.4 (3) Good first issue :mortar_board: (3) Type: Testing :test_tube: (2) Priority: 1 - Immediate :fire: (2) 0.7 (2) Red Team (2) 0.8.7 (2) Docs (2) Yellow Team (2) 0.5 (2) 0.9.2 (1) Enclave (1) TFF (1) Priority: 4 - Low :sunglasses: (1) 0.4 (1) Help Wanted :wave: (1) Rescope (1) Coming Soon (1)
Pull Request Labels
Red Team (181) Purple Team (167) Yellow Team (165) Blue Team (98) 0.8.7 (96) 0.8.5 (85) 0.8.4 (66) dependencies (58) Enclave (53) 0.8.2 (46) Black Team (37) 0.3 (35) 0.8.6 (30) github_actions (29) 0.9.2 (28) Green Team (28) 0.9 (25) Type: Bug :bug: (24) Awaiting Response (19) javascript (18) Future (15) 0.8.1 (14) Type: New Feature :heavy_plus_sign: (14) Type: Improvement :chart_with_upwards_trend: (13) 0.9.1 (13) Product Review (10) 0.2.x (10) Status: Stale :bread: (8) 0.8.3 (8) python (6)

Packages

  • Total packages: 5
  • Total downloads:
    • pypi 6,281 last-month
  • Total docker downloads: 420
  • Total dependent packages: 0
    (may contain duplicates)
  • Total dependent repositories: 59
    (may contain duplicates)
  • Total versions: 358
  • Total maintainers: 5
pypi.org: syft

Perform numpy-like analysis on data that remains in someone elses server

  • Versions: 328
  • Dependent Packages: 0
  • Dependent Repositories: 56
  • Downloads: 5,971 Last month
  • Docker Downloads: 420
Rankings
Stargazers count: 0.3%
Forks count: 0.3%
Dependent repos count: 2.0%
Docker downloads count: 2.2%
Average: 2.6%
Downloads: 3.7%
Dependent packages count: 7.4%
Maintainers (4)
iamtrask madhavajay cyberdroidmann OpenMinedReleaseBot
Last synced: 6 months ago
proxy.golang.org: github.com/openmined/pysyft
  • Versions: 27
  • Dependent Packages: 0
  • Dependent Repositories: 0
Rankings
Dependent packages count: 7.0%
Average: 8.2%
Dependent repos count: 9.3%
Last synced: 6 months ago
pypi.org: pygrid

A Library for Private, Secure Deep Learning

  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 1
  • Downloads: 77 Last month
Rankings
Stargazers count: 0.3%
Forks count: 0.3%
Dependent packages count: 7.4%
Average: 9.3%
Downloads: 16.0%
Dependent repos count: 22.2%
Maintainers (2)
iamtrask bobby_wagner
Last synced: 6 months ago
pypi.org: pysyft

A Library for Private, Secure Deep Learning

  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 1
  • Downloads: 219 Last month
Rankings
Stargazers count: 0.3%
Forks count: 0.3%
Dependent packages count: 7.4%
Average: 10.8%
Dependent repos count: 22.2%
Downloads: 23.9%
Maintainers (2)
iamtrask bobby_wagner
Last synced: 6 months ago
pypi.org: pygryd

A Library for Private, Secure Deep Learning

  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 1
  • Downloads: 14 Last month
Rankings
Stargazers count: 0.3%
Forks count: 0.3%
Dependent packages count: 7.4%
Average: 18.7%
Dependent repos count: 22.2%
Downloads: 63.1%
Maintainers (2)
iamtrask bobby_wagner
Last synced: 6 months ago

Dependencies

docs/requirements.txt pypi
  • ipython ==8.1.0
  • markupsafe ==2.0.1
  • pydata-sphinx-theme ==0.7.2
  • sphinx ==4.3.0
  • sphinx-autoapi ==1.8.4
  • sphinx-code-include ==1.1.1
  • sphinx-copybutton ==0.4.0
  • sphinx-panels ==0.6.0
  • syft *