Data

Tools

Indexes

Applications

Experiments

Open Source Science

https://github.com/civicdatalab/hp-fiscal-data-explorer-backend

Backend for Himachal Pradesh Fiscal Data explorer for Open Budgets India Platform.

https://github.com/civicdatalab/hp-fiscal-data-explorer-backend

Science Score: 13.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ○
    .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (8.9%) to scientific vocabulary

Keywords

budget expenditures hacktoberfest open-budgets-india open-source open-spending scraper spending-tracker
Last synced: 5 months ago · JSON representation

Repository

Backend for Himachal Pradesh Fiscal Data explorer for Open Budgets India Platform.

Basic Info
  • Host: GitHub
  • Owner: CivicDataLab
  • License: agpl-3.0
  • Language: Python
  • Default Branch: master
  • Homepage:
  • Size: 598 KB
Statistics
  • Stars: 0
  • Watchers: 4
  • Forks: 1
  • Open Issues: 1
  • Releases: 0
Topics
budget expenditures hacktoberfest open-budgets-india open-source open-spending scraper spending-tracker
Created almost 7 years ago · Last pushed almost 2 years ago
Metadata Files
Readme License

README.md

Backend for Himachal Pradesh Fiscal Data explorer

License: AGPLv3.0

Himachal Pradesh Fiscal Data explorer for Open Budgets India Platform.

Setup Instructions for the Scraper

To setup the env, type the following commands in that order:

  • git clone https://github.com/CivicDataLab/hp-fiscal-data-explorer.git
  • pip install pipenv
  • cd scraper
  • cp scraper/settings/settings.py scraper/settings/local.py
  • pipenv install --three --ignore-pipfile
  • cp scraper/settings/settings.py scraper/settings/local.py
  • Edit the scraper/settings/local.py with setting values you want to keep like DOWNLOAD_DELAY, CONCURRENT_REQUESTS and custom settings like DATASETS_PATH etc.
  • create a datasets directory at the path specified by DATASET_PATH variable. e.g. hp-fiscal-data-explorer/scraper/datasets if you didn't update the default value of the variable DATASET_PATH.

To Activate the environment once setup.

  • . $(pipenv --venv)/bin/activate

Run the scraper for collecting ddo codes.

  • scrapy crawl ddo_collector

Run the scraper for collecting datasets.

For Treasury Expenditure. - scrapy crawl treasury_expenditures -a start=20190501 -a end=20190531

For Treasury Receipts. - scrapy crawl treasury_receipts -a start=20190501 -a end=20190531

For Budget Expenditure. - scrapy crawl budget_expenditures -a date=20190531

NOTES: - the arguments start and end specifies the date range for datasets. The date format is yyyymmdd. - the datasets will be CSV files with name in the format: treasury_expenditures_<treasury>_<ddo>_<timestamp>.csv for expenditures.

Owner

  • Name: CivicDataLab
  • Login: CivicDataLab
  • Kind: organization
  • Email: info@civicdatalab.in
  • Location: India

Harnessing Data, Tech, Design and Social Science to strengthen the course of Civic Engagements in India.

GitHub Events

Total
Last Year

Issues and Pull Requests

Last synced: 12 months ago

All Time
  • Total issues: 57
  • Total pull requests: 74
  • Average time to close issues: over 1 year
  • Average time to close pull requests: about 1 year
  • Total issue authors: 5
  • Total pull request authors: 5
  • Average comments per issue: 0.37
  • Average comments per pull request: 0.54
  • Merged pull requests: 32
  • Bot issues: 0
  • Bot pull requests: 31
Past Year
  • Issues: 2
  • Pull requests: 2
  • Average time to close issues: 27 days
  • Average time to close pull requests: N/A
  • Issue authors: 1
  • Pull request authors: 1
  • Average comments per issue: 0.0
  • Average comments per pull request: 0.0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
  • curioswati (17)
  • shreyaagrawal0809 (13)
  • gggodhwani (3)
  • Deepthi-Chand (1)
  • apoorv74 (1)
Pull Request Authors
  • dependabot[bot] (23)
  • curioswati (18)
  • shreyaagrawal0809 (11)
  • najeebkp (2)
  • gggodhwani (1)
Top Labels
Issue Labels
enhancement (7) feature (7) bug (7) documentation (6) wip (5) hacktoberfest (4) help wanted (3) good first issue (1) needs-review (1)
Pull Request Labels
dependencies (23) needs-review (7) enhancement (3) wip (3) bug (1) documentation (1)

Dependencies

scraper/Pipfile pypi
  • apache-airflow *
  • psycopg2 *
  • pylint *
  • scrapy *
  • twisted *
scraper/Pipfile.lock pypi
  • 107 dependencies