https://github.com/dsfsi/covid19za

Coronavirus COVID-19 (2019-nCoV) Data Repository and Dashboard for South Africa

https://github.com/dsfsi/covid19za

Science Score: 46.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
  • DOI references
    Found 14 DOI reference(s) in README
  • Academic publication links
    Links to: scholar.google, ieee.org, zenodo.org
  • Committers with academic emails
    5 of 75 committers (6.7%) from academic institutions
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (10.8%) to scientific vocabulary

Keywords

coronavirus covid-19 covid-data covid19 covid19-data dashboard data-science dataset doh doi dsfsi-datasets health nicd south-africa

Keywords from Contributors

transformer sequencing genome dynamic projection interactive cameratrap sustainability distributed parallel
Last synced: 6 months ago · JSON representation

Repository

Coronavirus COVID-19 (2019-nCoV) Data Repository and Dashboard for South Africa

Basic Info
Statistics
  • Stars: 254
  • Watchers: 31
  • Forks: 199
  • Open Issues: 43
  • Releases: 0
Topics
coronavirus covid-19 covid-data covid19 covid19-data dashboard data-science dataset doh doi dsfsi-datasets health nicd south-africa
Created almost 6 years ago · Last pushed about 2 years ago
Metadata Files
Readme License Code of conduct

README.md

Coronavirus COVID-19 (2019-nCoV) Data Repository for South Africa

DOI dsJournal

Give Feedback 📑: DSFSI Resource Feedback Form{:target="_blank"}

Coronavirus COVID-19 (2019-nCoV) Data Repository for South Africa created, maintained and hosted by Data Science for Social Impact research group, led by Dr. Vukosi Marivate, at the University of Pretoria.

Disclaimer: We have worked to keep the data as accurate as possible. We collate the COVID 19 reporting data from NICD and DoH. We only update that data once there is an official report or statement. For the other data, we work to keep the data as accurate as possible. If you find errors. Make a pull request.

If you use this repo for any research/development/innovation, please contact us (see contacts below)

See our blog posts: * Why we built this and how we are working, * How this is a call to action across the African continent * A few weeks in, Data Science thoughts on COVID-19 in South Africa

If you are interested in the *Africa-wide effort*: Go to https://github.com/dsfsi/covid19africa

For information on daily updates on the repo, go to https://twitter.com/vukosi/status/1239184086633242630?s=20

Licenses

Code License: MIT | Data License: CC BY-SA 4.0

Data Available [/data]

Please note that these reports are the daily reports as released by the National Department of Health or the NICD. The new cases reported are based on new positive test reports released. However, there may be significant lag from when the patient was tested. As an example in epidemiological Week 1 of 2021 (3-9 Jan) approximately 33k new cases were reported on the daily announcement. However, the NICD Testing Summary Report for Week 3 of 2021 (which also reports the two previous weeks) shows that the number of positive tests was 43635 for Week 1 of 2021. The difference is due to the lag in testing being done -- some of the 33k cases reported on the daily announcments were actually from prior weeks while a large number of people were tested between 3-9 January, but the cases were only reported from the 10th onwards. Care needs to be taken in doing some analyses to take this into account.

Active

| dataset | url | rawurl[file] | |-----------------|-----|---------------| | provincialcumulativetimelineconfirmed| provincialcumulativetimeline_confirmed | provincialcumulativetimeline_confirmed.csv | | provincialcumulativetimelinerecoveries| provincialcumulativetimeline_recoveries | provincialcumulativetimeline_recoveries.csv | | provincialcumulativetimelinetesting| provincialcumulativetimeline_testing | provincialcumulativetimeline_testing.csv | | provincialcumulativetimelinedeaths| provincialcumulativetimeline_deaths | provincialcumulativetimeline_deaths.csv | | vaccination | covid19zatimelinevaccination | covid19zatimelinevaccination.csv | | deathstatistics | covid19zatimelinedeath_statistics | covid19zatimelinedeath_statistics.csv | | transmissiontype | covid19zatimelinetransmission_type | covid19zatimelinetransmission_type.csv | | testing | covid19zatimelinetesting | covid19zatimelinetesting.csv | | districtdata | district_data | | | DoH PDFs and Extracted CSVs | doh_pdf | | | DoH Whatsapp case update archive | doh_whatsapp | | | health facility data [public and private] | healthsystemzahospitalsv1 | healthsystemzahospitalsv1.csv | | nicddailynationalreport | nicddailynational_report | nicddailynational_report.csv | | nicdhospitalsurveillancedata | nicdhospitalsurveillance_data | nicdhospitalsurveillance_data.csv | | samrcexcessdeaths_province | samrcexcessdeaths_province | samrcexcessdeaths_province.csv | | Apple, Google, Facebook Mobility Data | mobility | |

Deprecated

NOTE: Since around 24 March 2020, we have not gotten individual case data from DoH or NICD. For now if you need provincial counts use the provincialcumulativetimeline. For individual cases up to 25 March 2020, use the confirmed_cases. | dataset | url | rawurl[file] | |-----------------|-----|---------------| | confirmedcases* [updated to 25 March 2020] | covid19zatimelineconfirmed | covid19zatimelineconfirmed.csv | | deaths | covid19zatimelinedeaths | covid19zatimelinedeaths.csv |

* NICD no longer gives individual case data. Please use provincialcumulativetimeline from 26 March 2020 onwards.

Dashboard

Data Sources:

  • NICD - South Africa URL
  • Department of Health - South Africa Main Site, Twitter
  • South African Government Media Statements URL
  • National Department of Health Data Dictionary URL
  • MedPages URL
  • Statistics South Africa URL

Contributing

Options

  • I want to help, but don't have an idea: You can take a look at the issues to see which one you might be interested in tackling.
  • I have an idea or new feature: Create a new issue first, assign it to yourself and then fork the repo.

Adopting a file

Once you have chosen how you are going to contribute, you must list which files you will be working on by adding your name to the adopt-a-file csv file. Edit covid19zavolunteeradopted_file.

Submitting Changes [Pull Request]

Contact

  • Vukosi Marivate - vukosi.marivate@cs.up.ac.za, @vukosi

Citing the dataset

On a visualisation/notebook/webapp:

Data Science for Social Impact Research Group @ University of Pretoria, Coronavirus COVID-19 (2019-nCoV) Data Repository for South Africa. Available on: https://github.com/dsfsi/covid19za.

In a publication

Data Science Journal

@article{marivate2020use, Author = {Vukosi Marivate and Herkulaas MvE Combrink}, Journal = {Data Science Journal}, Number = {1}, Pages = {1-7}, Title = {Use of Available Data To Inform The COVID-19 Outbreak in South Africa: A Case Study.}, Volume = {19}, Year = {2020}, url = {https://doi.org/10.5334/dsj-2020-019} }

and Dataset

@dataset{marivatevukosi2020_3819126, author = {Marivate, Vukosi and Arbi, Riaz and Combrink, Herkulaas and de Waal, Alta and Dryza, Henkho and Egersdorfer, Derrick and Garnett, Shaun and Gordon, Brent and Greyling, Lizel and Lebogo, Ofentswe and Mackie, Dave and Merry, Bruce and Mkhondwane, S'busiso and Mokoatle, Mpho and Moodley, Shivan and Mtsweni, Jabu and Mtsweni, Nompumelelo and Myburgh, Paul and Richter, Jannik and Rikhotso, Vuthlari and Rosen, Simon and Sefara, Joseph and van der Walt, Anelda and van Heerden, Schalk and Welsh, Jay and Hazelhurst, Scott and Petersen, Chad and Mbuvha, Rendani and Dhlamini, Nelisiwe and James, Vaibhavi}, title = {{Coronavirus disease (COVID-19) case data - South Africa}}, month = mar, year = 2020, publisher = {Zenodo}, doi = {10.5281/zenodo.3819126}, url = {https://doi.org/10.5281/zenodo.3819126} }

Showcase

Web Projects

Some of COVID-19 Data for South Africa (data in this repo) is currently being used by other independent projects shown in the table below :

| Project Name | Project Description | Project Demo | Project owner | Country | | ------------- | ------------- |------------|-----------------|------------------| | 1. Covid-19 SA Data | Data visualizations corresponding to the current Covid-19 outbreak in South Africa | [Website],[GitHub Repo]| Simon Rosen| South Africa | | 2. Covid-19 testing areas| A Covid-19 Testing Facilities Map |[Website],[GitHub Repo]| Yannick Zehnder | Switzerland | | 3. Covid-19 Map| A Coronavirus Map | [Website] [GitHub Repo] | Jay Welsh | South Africa | | 4. Covid-19 Telegram Bot| Corona virus statistics via Telegram | Link | CodeChap | South Africa | | 5. Covid-19 Xitsonga Dashboard | Xitsonga Dashboard | Link | xitsonga.org | South Africa | | 6. Hospitals' capacity to respond to Covid-19 | Data visualization mapping local hospitals (private ad public) in South Africa | [Map Viz] ,[Repo] |Nompumelelo|South Africa | | 7. Covid-19 Trends | Covid-19 analytics dashboard for South Africa | [Website] [Repo] | Schalk van Heerden | South Africa | | 8. Covid-19 Tshivenda Dashboard | Tshivenda Dashboard | Link | luvenda.com | South Africa | | 9. Map of Health facilites around me | Map showing comparable details of hospitals around my location in response to Covid-19 | [Webpage] , [GitHub Repo] | These authors | South Africa | |10. R-based Interactive health facilties Map | Afrimapr, mapping health facilities using R-building blocks |[Webpage] [Repo] | Dr Andy South | United Kingdom | |11. Estimating the Reproductive Number of COVID-19 | Estimating effective reproductive number for SA, it's provinces and other countries. | [Website] | Louis Rossouw | South Africa | |12. Modelling COVID-19 in South Africa at a Provincial Level | Modelling COVID-19 in South Africa at a Provincial Level using reported and excess deaths. | [Website] | Louis Rossouw | South Africa | |13. South African Provincial COVID-19 Visualization | Visualize deaths, cases and recoveries alongside mobility data on a provincial level. Additionally, visualize cahnge of cases over a weekly basis. | [Website] | Christopher Marais | South Africa | |14. Differential Evolution to Optimize A Long-term Multi-strain Model of COVID-19 in South Africa | Uses Differential Evolution (an Evolutionary Optimization Algorithm) for data fitting and parameter estimation. | [Website] | CJ Pretorius and MC du Plessis | South Africa |

Scholarly Work

See Google Scholar

Support

We want to acknowledge support from these organisations

Owner

  • Name: Data Science for Social Impact Research Group @ University of Pretoria
  • Login: dsfsi
  • Kind: organization
  • Email: vukosi.marivate@cs.up.ac.za
  • Location: University of Pretoria, South Africa

We are the Data Science for Social Impact research group at the Computer Science Department, University of Pretoria.

GitHub Events

Total
  • Watch event: 2
Last Year
  • Watch event: 2

Committers

Last synced: 9 months ago

All Time
  • Total Commits: 7,496
  • Total Committers: 75
  • Avg Commits per committer: 99.947
  • Development Distribution Score (DDS): 0.7
Past Year
  • Commits: 0
  • Committers: 0
  • Avg Commits per committer: 0.0
  • Development Distribution Score (DDS): 0.0
Top Committers
Name Email Commits
krokkie k****e 2,248
github-actions a****n@g****m 1,599
Louis Rossouw l****w@g****m 1,418
Vukosi v****e@c****a 731
Scott.Hazelhurst s****t@w****a 243
Lizel Greyling l****g@m****m 204
HMVE Combrink 4****e 157
Nompumelelo 3****o 124
Schalk van Heerden s****v@h****m 98
Chad Petersen p****6@m****a 77
Vaibhavi J 4****s 56
Shaun Garnett s****t@g****m 48
Dave Mackie d****e@g****m 48
Jay Welsh t****s@g****m 37
Joseph Sefara s****j@g****m 36
Simon Rosen s****3@g****m 31
HMVE Combrink 4****k 29
Shaun Garnett s****t@u****a 28
Dennis 3****l 27
Bruce Merry b****y@g****m 19
Ofentswe Lebogo o****l@g****m 17
Richard Young r****2@i****m 16
S'busiso Mkhondwane s****e@g****m 15
NELI D n****n@g****m 15
Jannik Richter j****1@g****m 14
Karthik k****v@g****m 13
cishiv s****n@g****m 12
Gerhard Bijker g****h@r****a 11
CodeChap h****o@c****m 9
Dave Mackie d****m@d****a 8
and 45 more...

Issues and Pull Requests

Last synced: 9 months ago

All Time
  • Total issues: 18
  • Total pull requests: 85
  • Average time to close issues: 20 days
  • Average time to close pull requests: 3 days
  • Total issue authors: 10
  • Total pull request authors: 11
  • Average comments per issue: 9.33
  • Average comments per pull request: 0.15
  • Merged pull requests: 76
  • Bot issues: 0
  • Bot pull requests: 5
Past Year
  • Issues: 1
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 1
  • Pull request authors: 0
  • Average comments per issue: 0.0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
  • vukosim (8)
  • HerkulaasCombrink (2)
  • lrossouw (1)
  • go4cas (1)
  • maximeLpt (1)
  • rudigiesler (1)
  • IvdBout (1)
  • brendentaylor22 (1)
  • yuval-harpaz (1)
  • Diederikjh (1)
Pull Request Authors
  • lizelgreyling (40)
  • krokkie (19)
  • richardyoung00 (10)
  • dependabot[bot] (5)
  • camappel (3)
  • cjpretorius (2)
  • codeChap (2)
  • janvdl (1)
  • dmackie (1)
  • naturofix (1)
  • mtsnel006 (1)
Top Labels
Issue Labels
enhancement (10) data (9) bug (5) help wanted (3) documentation (2) hacktoberfest (2) good first issue (1)
Pull Request Labels
dependencies (5) go (4) python (1)

Packages

  • Total packages: 3
  • Total downloads: unknown
  • Total dependent packages: 0
    (may contain duplicates)
  • Total dependent repositories: 0
    (may contain duplicates)
  • Total versions: 44
proxy.golang.org: github.com/dsfsi/covid19za
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 0
Rankings
Forks count: 1.2%
Stargazers count: 2.0%
Average: 4.9%
Dependent packages count: 7.0%
Dependent repos count: 9.3%
Last synced: 7 months ago
proxy.golang.org: github.com/dsfsi/covid19za/api
  • Versions: 41
  • Dependent Packages: 0
  • Dependent Repositories: 0
Rankings
Dependent packages count: 7.0%
Average: 8.2%
Dependent repos count: 9.3%
Last synced: 6 months ago
proxy.golang.org: github.com/dsfsi/covid19za/scraper
  • Versions: 2
  • Dependent Packages: 0
  • Dependent Repositories: 0
Rankings
Dependent packages count: 9.4%
Average: 10.0%
Dependent repos count: 10.6%
Last synced: 9 months ago

Dependencies

api/go.mod go
  • github.com/dgrijalva/jwt-go v3.2.0+incompatible
  • github.com/gocarina/gocsv v0.0.0-20200330101823-46266ca37bd3
  • github.com/labstack/echo v3.3.10+incompatible
  • github.com/labstack/gommon v0.3.0
  • github.com/mattn/go-colorable v0.1.6
  • github.com/stretchr/testify v1.5.1
  • github.com/valyala/fasttemplate v1.1.0
  • golang.org/x/crypto v0.0.0-20200311171314-f7b00557c8c4
  • golang.org/x/net v0.0.0-20200301022130-244492dfa37a
  • golang.org/x/sys v0.0.0-20200316230553-a7d97aace0b0
  • golang.org/x/text v0.3.2
api/go.sum go
  • github.com/davecgh/go-spew v1.1.0
  • github.com/dgrijalva/jwt-go v3.2.0+incompatible
  • github.com/gocarina/gocsv v0.0.0-20200330101823-46266ca37bd3
  • github.com/labstack/echo v3.3.10+incompatible
  • github.com/labstack/gommon v0.3.0
  • github.com/mattn/go-colorable v0.1.2
  • github.com/mattn/go-colorable v0.1.6
  • github.com/mattn/go-isatty v0.0.8
  • github.com/mattn/go-isatty v0.0.9
  • github.com/mattn/go-isatty v0.0.12
  • github.com/pmezard/go-difflib v1.0.0
  • github.com/stretchr/objx v0.1.0
  • github.com/stretchr/testify v1.4.0
  • github.com/stretchr/testify v1.5.1
  • github.com/valyala/bytebufferpool v1.0.0
  • github.com/valyala/fasttemplate v1.0.1
  • github.com/valyala/fasttemplate v1.1.0
  • golang.org/x/crypto v0.0.0-20190308221718-c2843e01d9a2
  • golang.org/x/crypto v0.0.0-20200311171314-f7b00557c8c4
  • golang.org/x/net v0.0.0-20190404232315-eb5bcb51f2a3
  • golang.org/x/net v0.0.0-20200301022130-244492dfa37a
  • golang.org/x/sys v0.0.0-20190215142949-d0b11bdaac8a
  • golang.org/x/sys v0.0.0-20190222072716-a9d3bda3a223
  • golang.org/x/sys v0.0.0-20190412213103-97732733099d
  • golang.org/x/sys v0.0.0-20190813064441-fde4db37ae7a
  • golang.org/x/sys v0.0.0-20200116001909-b77594299b42
  • golang.org/x/sys v0.0.0-20200223170610-d5e6a3e2c0ae
  • golang.org/x/sys v0.0.0-20200316230553-a7d97aace0b0
  • golang.org/x/text v0.3.0
  • golang.org/x/text v0.3.2
  • golang.org/x/tools v0.0.0-20180917221912-90fa682c2a6e
  • gopkg.in/check.v1 v0.0.0-20161208181325-20d25e280405
  • gopkg.in/yaml.v2 v2.2.2
.github/workflows/codeql-analysis.yml.disabled actions
  • actions/checkout v2 composite
  • github/codeql-action/analyze v1 composite
  • github/codeql-action/autobuild v1 composite
  • github/codeql-action/init v1 composite
.github/workflows/dailyhospital_scraper.yml actions
  • actions/checkout master composite
.github/workflows/dailystats_scraper.yml actions
  • actions/checkout master composite
.github/workflows/mobility_scraper.yml actions
  • actions/checkout v2 composite
  • actions/setup-python v1 composite
.github/workflows/realtime_rt_action.yaml.disabled actions
  • actions/checkout v2 composite
  • actions/setup-python v1 composite
.github/workflows/rtlive-model-za.yml actions
  • actions/checkout v2 composite
  • actions/setup-python v1 composite
  • stefanzweifel/git-auto-commit-action v4 composite
.github/workflows/vaccinations_scraper.yml actions
  • actions/checkout v2 composite
  • actions/setup-python v1 composite
Dockerfile docker
  • alpine latest build
  • golang alpine build
scraper/go.mod go
  • github.com/PuerkitoBio/goquery v1.5.1
scraper/go.sum go
  • github.com/PuerkitoBio/goquery v1.5.1
  • github.com/andybalholm/cascadia v1.1.0
  • golang.org/x/crypto v0.0.0-20190308221718-c2843e01d9a2
  • golang.org/x/net v0.0.0-20180218175443-cbe0f9307d01
  • golang.org/x/net v0.0.0-20200202094626-16171245cfb2
  • golang.org/x/sys v0.0.0-20190215142949-d0b11bdaac8a
  • golang.org/x/text v0.3.0
notebooks/covid-model/requirements.txt pypi
  • boto3 *
  • numpy *
  • pandas *
  • pymc3 *
  • requests *
  • s3fs *
  • scipy *
  • xarray *
scripts/mobility_requirements.txt pypi
  • beautifulsoup4 ==4.8.2
  • pandas ==1.0.3
  • requests ==2.26.0
  • urllib3 ==1.26.6
  • xlsxwriter ==1.2.8