assam-tenders-data

Data mining repo for Open Contracting - Assam

https://github.com/civicdatalab/assam-tenders-data

Science Score: 26.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
  • Academic publication links
  • Academic email domains
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (7.7%) to scientific vocabulary

Keywords

ocds open-data public-data public-finance tenders
Last synced: 6 months ago · JSON representation

Repository

Data mining repo for Open Contracting - Assam

Basic Info
Statistics
  • Stars: 1
  • Watchers: 7
  • Forks: 1
  • Open Issues: 7
  • Releases: 0
Topics
ocds open-data public-data public-finance tenders
Created over 2 years ago · Last pushed 8 months ago
Metadata Files
Readme Citation

README.md

Assam Public Procurement Data [2016 - 2022]

About

The fiscal ecosystem operates as a hierarchical system facilitating the flow of funds. At its most granular level, the process involves tendering, where government departments solicit bids for various projects, such as constructing a ramp for a school. In our efforts to enhance the efficiency and transparency of this system, we have created the Assam Public Procurement Platform, specifically for the state of Assam in India. This platform is designed to promote transparency by consolidating all tender information in one central location.

The Assam government regularly uploads contract data on the etenders platform, with new data added almost daily. Unfortunately, the data on this platform is fragmented and often protected by captchas, creating significant hurdles for users attempting to analyze it effectively. To address this issue, we have employed web scraping techniques to collect and organize the data in a user-friendly and comprehensible format. This involved developing multiple scrapers and implementing various data transformations to achieve our goal.

Directory Structure

  • code
    • scraper
    • transformation_scripts
  • data
    • ProcessedData
    • RawData

Process

Data Update Frequecy

We update the platform with new data in every 3 months

License

All scripts are published under the GPL v2 license and all datasets are published under the Open Data Commons Open Database License (ODbL).

Contact Us:

In case of any queries or concerns reach out at open-contracting@civicdatalab.in

Owner

  • Name: CivicDataLab
  • Login: CivicDataLab
  • Kind: organization
  • Email: info@civicdatalab.in
  • Location: India

Harnessing Data, Tech, Design and Social Science to strengthen the course of Civic Engagements in India.

GitHub Events

Total
  • Issues event: 2
  • Push event: 6
Last Year
  • Issues event: 2
  • Push event: 6

Issues and Pull Requests

Last synced: 11 months ago

All Time
  • Total issues: 14
  • Total pull requests: 12
  • Average time to close issues: about 1 month
  • Average time to close pull requests: 7 days
  • Total issue authors: 5
  • Total pull request authors: 3
  • Average comments per issue: 0.86
  • Average comments per pull request: 0.0
  • Merged pull requests: 12
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 3
  • Pull requests: 1
  • Average time to close issues: about 1 month
  • Average time to close pull requests: about 17 hours
  • Issue authors: 2
  • Pull request authors: 1
  • Average comments per issue: 0.0
  • Average comments per pull request: 0.0
  • Merged pull requests: 1
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
  • ndrhzn (4)
  • apoorv74 (3)
  • shreyaagrawal0809 (3)
  • bhavabhuthi (2)
  • gggodhwani (1)
  • AakashGandhi1 (1)
Pull Request Authors
  • shreyaagrawal0809 (7)
  • apoorv74 (4)
  • bhavabhuthi (2)
Top Labels
Issue Labels
documentation (3) bug (2)
Pull Request Labels

Dependencies

code/scraper/requirements.txt pypi
  • Requests ==2.31.0
  • django_recaptcha ==3.0.0
  • pandas ==1.5.0
  • selenium ==4.11.2
  • urllib3 ==1.26.12
code/transformation_scripts/requirements.txt pypi
  • pandas ==1.5.0