Data

Tools

Indexes

Applications

Experiments

Open Source Science

https://github.com/akiomik/squawks

A cli tool to get old tweets as csv

https://github.com/akiomik/squawks

Science Score: 26.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Committers with academic emails
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (8.7%) to scientific vocabulary

Keywords

csv old-tweets tweets-extraction tweets-scraper twitter

Keywords from Contributors

distributed serial interactive projection archival sequences genomics observability autograding hacking
Last synced: 5 months ago · JSON representation

Repository

A cli tool to get old tweets as csv

Basic Info
  • Host: GitHub
  • Owner: akiomik
  • License: apache-2.0
  • Language: Go
  • Default Branch: main
  • Homepage:
  • Size: 243 KB
Statistics
  • Stars: 5
  • Watchers: 2
  • Forks: 0
  • Open Issues: 2
  • Releases: 5
Topics
csv old-tweets tweets-extraction tweets-scraper twitter
Created over 3 years ago · Last pushed 10 months ago
Metadata Files
Readme Funding License

README.md

squawks

Go CodeQL

A cli tool to get old tweets on twitter (inspired by Jefferson-Henrique/GetOldTweets-python).

  • Download your search results to a csv file
  • No authentication required
  • Works out-of-the-box

Install

  • Download the latest release from the release page. Supported platforms are Windows, macOS and linux.
  • Extract the downloaded .tar.gz file.

Usage

Search for tweets

``` Usage: squawks search tweets --out FILENAME [flags]

Flags: --exclude strings exclude tweets by type of tweet hashtags|nativeretweets|retweets|replies --filter strings find tweets by type of account or tweet verified|follows|media|images|twimg|videos|periscope|vine|consumervideo|provideo|native_video|links|hashtags|nativeretweets|retweets|replies|safe|news --from string find tweets sent from a certain user --geocode string find tweets sent from certain coordinates (e.g. 35.6851508,139.7526768,0.1km) -h, --help help for tweets --include strings include tweets by type of tweet hashtags|nativeretweets|retweets|replies --lang string find tweets by a certain language (e.g. en, es, fr) --near string find tweets nearby a certain location (e.g. tokyo) -o, --out string output csv filename (required) -q, --query string query text to search --since string find tweets since a certain day (e.g. 2014-07-21) --to string find tweets sent in reply to a certain user --top find top tweets --until string find tweets until a certain day (e.g. 2020-09-06) --url string find tweets containing a certain url (e.g. www.example.com) --user-agent string set custom user-agent --within string find tweets nearby a certain location (e.g. 1km) ```

Example

Get tweets by username:

sh squawks --from 'barackobama' -o out.csv

Get tweets by query search:

sh squawks -q 'europe refugees' -o out.csv

Get tweets by username and bound dates:

sh squawks --from 'barackobama' --since 2015-09-10 --until 2015-09-12 -o out.csv

Get top tweets by username:

sh squawks --from 'barackobama' --top -o out.csv

Output CSV schema

  • id (int)
  • username (str)
  • created_at (datetime)
  • full_text (str)
  • retweet_count (int)
  • favorite_count (int)
  • reply_count (int)
  • quote_count (int)
  • latitude (float)
  • longitude (float)
  • lang (str)
  • source (str)

Build

sh make build

Test

sh make test

Owner

  • Name: Akiomi KAMAKURA
  • Login: akiomik
  • Kind: user
  • Location: Japan

Bird lover.

GitHub Events

Total
  • Delete event: 14
  • Issue comment event: 4
  • Push event: 13
  • Pull request event: 27
  • Create event: 12
Last Year
  • Delete event: 14
  • Issue comment event: 4
  • Push event: 13
  • Pull request event: 27
  • Create event: 12

Committers

Last synced: 8 months ago

All Time
  • Total Commits: 128
  • Total Committers: 2
  • Avg Commits per committer: 64.0
  • Development Distribution Score (DDS): 0.227
Past Year
  • Commits: 13
  • Committers: 2
  • Avg Commits per committer: 6.5
  • Development Distribution Score (DDS): 0.154
Top Committers
Name Email Commits
Akiomi Kamakura a****k@g****m 99
dependabot[bot] 4****] 29

Issues and Pull Requests

Last synced: 6 months ago

All Time
  • Total issues: 2
  • Total pull requests: 50
  • Average time to close issues: N/A
  • Average time to close pull requests: 6 days
  • Total issue authors: 2
  • Total pull request authors: 2
  • Average comments per issue: 1.0
  • Average comments per pull request: 0.2
  • Merged pull requests: 40
  • Bot issues: 0
  • Bot pull requests: 44
Past Year
  • Issues: 0
  • Pull requests: 26
  • Average time to close issues: N/A
  • Average time to close pull requests: 5 days
  • Issue authors: 0
  • Pull request authors: 2
  • Average comments per issue: 0
  • Average comments per pull request: 0.27
  • Merged pull requests: 19
  • Bot issues: 0
  • Bot pull requests: 22
View more stats
Top Authors
Issue Authors
  • sanojkl (1)
  • 1268 (1)
Pull Request Authors
  • dependabot[bot] (54)
  • akiomik (6)
Top Labels
Issue Labels
documentation (1) bug (1)
Pull Request Labels
dependencies (54) go (7)

Dependencies

.github/workflows/codeql.yml actions
  • actions/checkout v3 composite
  • github/codeql-action/analyze v2 composite
  • github/codeql-action/autobuild v2 composite
  • github/codeql-action/init v2 composite
.github/workflows/go.yml actions
  • actions/cache v2 composite
  • actions/checkout v2 composite
  • actions/setup-go v2 composite
  • dominikh/staticcheck-action v1.2.0 composite
.github/workflows/goreleaser.yml actions
  • actions/checkout v2 composite
  • actions/setup-go v2 composite
  • goreleaser/goreleaser-action v2 composite
go.mod go
  • github.com/go-resty/resty/v2 v2.7.0
  • github.com/inconshreveable/mousetrap v1.0.0
  • github.com/jarcoal/httpmock v1.2.0
  • github.com/spf13/cobra v1.5.0
  • github.com/spf13/pflag v1.0.5
  • golang.org/x/net v0.0.0-20220805013720-a33c5aa5df48
go.sum go
  • github.com/cpuguy83/go-md2man/v2 v2.0.2
  • github.com/davecgh/go-spew v1.1.1
  • github.com/go-resty/resty/v2 v2.7.0
  • github.com/inconshreveable/mousetrap v1.0.0
  • github.com/jarcoal/httpmock v1.2.0
  • github.com/maxatome/go-testdeep v1.11.0
  • github.com/russross/blackfriday/v2 v2.1.0
  • github.com/spf13/cobra v1.5.0
  • github.com/spf13/pflag v1.0.5
  • golang.org/x/net v0.0.0-20211029224645-99673261e6eb
  • golang.org/x/net v0.0.0-20220805013720-a33c5aa5df48
  • golang.org/x/sys v0.0.0-20201119102817-f84b799fce68
  • golang.org/x/sys v0.0.0-20210423082822-04245dca01da
  • golang.org/x/term v0.0.0-20201126162022-7de9c90e9dd1
  • golang.org/x/text v0.3.6
  • golang.org/x/tools v0.0.0-20180917221912-90fa682c2a6e
  • gopkg.in/check.v1 v0.0.0-20161208181325-20d25e280405
  • gopkg.in/yaml.v2 v2.4.0