sport-activities-features --- A minimalistic toolbox for extracting features from sports activity files written in Python

🔍 Detailed insights • 📦 Installation • 📮 API • 💻 Graphical User Interface • 🌦️ Historical weather data • 🧩 Overpass API, Open Elevation API & OpenTopoData integration 🚀 Examples • 🔑 License • 📄 Cite us • 📖 Further read • 🔗 Related frameworks • 🫂 Contributors

Unleashing the Power of Sports Activity Analysis: A Framework Beyond Ordinary Metrics 🚀

Prepare to dive into the thrilling world of sports activity analysis, where hidden geographic, topological, and personalized data await their grand unveiling. In this captivating journey, we embark on a quest to extract the deepest insights from the wealth of information generated by monitoring sports activities. Brace yourself for a framework that transcends the limitations of conventional analysis techniques. 💪🔍

Traditional approaches often rely on integral metrics like total duration, total distance, and average heart rate, but they fall victim to the dreaded "overall metrics problem." These metrics fail to capture the essence of sports activities, omitting crucial components and leading to potentially flawed and misleading conclusions. They lack the ability to recognize distinct stages and phases of the activity, such as the invigorating warm-up, the endurance-testing main event, and the heart-pounding intervals. ⏱️🚴‍♀️📈

Fortunately, our sport-activities-framework rises above these limitations, revealing a comprehensive panorama of your sports activity files. This framework combines the power of identification and extraction methods to unlock a treasure trove of valuable data. Picture this :camera: : effortlessly identifying the number of hills, extracting average altitudes of these remarkable formations, measuring the total distance conquered on those inclines, and even deriving climbing ratios for a true measure of accomplishment (total distance of hills vs. total distance). But that's just the tip of the iceberg! The framework seamlessly integrates a multitude of extensions, including historical weather parsing, statistical evaluations, and ex-post visualizations that bring your data to life. 🗻📊🌦️

For those seeking to venture further, we invite you to explore the realms of scientific papers on data mining that delve into these captivating topics. Discover how our framework complements the world of generating and predicting automated sport training sessions, creating a harmonious synergy between theory and practice. 📚🔬💡

• Free software: MIT license
• Python versions: 3.8.x, 3.9.x, 3.10.x, 3.11.x, 3.12.x
• Documentation: https://sport-activities-features.readthedocs.io/en/latest
• Tested OS: Windows, Ubuntu, Debian, Fedora, Alpine, Arch, macOS. However, that does not mean it does not work on others.

🔍 Detailed insights

Prepare to be astounded by the capabilities of the sport-activities-features framework. It effortlessly handles TCX & GPX activity files and harnesses the power of the Overpass API nodes. Presenting the range of functions at your disposal:

• Unleash the integral metrics: From total distance to total duration and even calorie count, witness the extraction of these vital statistics with a single glance. 📏⏰🔥 (See example)

• Conquer the peaks: Ascend to new heights by extracting topographic features like the number of hills, their average altitudes, the total distance covered on these majestic slopes, and the thrilling climbing ratio. Prepare for a breathtaking adventure! ⛰️📈🧗‍♂️ (See example)

• Embark on a visual journey: Immerse yourself in the beauty of your accomplishments as you plot the identified hills on a mesmerizing map. Witness the landscape come alive before your eyes. 🗺️🏞️🖌️ (See example)

• Embrace the rhythm of intervals: Explore the intervals within your sports activities, uncovering their numbers, durations, distances, and heart rates. Unveil the heartbeat of your performance! 🏃‍♀️📊💓 (See example)

• Calculate the training loads: Dive deep into the intricate world of training loads and discover the Banister TRIMP and Lucia TRIMP methods. Gain invaluable insights into optimizing your training regimen. 📈⚖️🏋️‍♂️ (See example)

• Weather the storm: Unlock the power of historical weather data from external services, adding a fascinating layer of context to your sports activities. ☀️🌧️⛈️

• Unveil the secrets within coordinates: Explore the integral metrics of your activities within specific geographical areas, uncovering valuable data on distance, heart rate, and speed. Peer into the depths of your performance! 🌍📍📉 (See example)

• Embrace randomness: Extract activities from CSV files and indulge in the excitement of randomly selecting a specific number of activities. Embrace the element of surprise! 🎲📂🎉 (See example)

• Conquer the dead ends: Unravel the mysteries of your sports activities by identifying the dead ends. Prepare to navigate the uncharted territories of your performance! 🚧🗺️🔍 (See example)

• Unlock the format: Seamlessly convert TCX files to GPX, opening doors to even more possibilities. Adapt and conquer! ⚙️🔄✨ (See example)

And that's just the beginning! The sport-activities-framework holds countless other features, awaiting your exploration. Brace yourself for an exhilarating journey of discovery, where the ordinary becomes extraordinary, and your sports activities come alive like never before. 🌟🔥🏃‍♂️

The framework comes with two (testing) benchmark datasets, which are freely available to download from: DATASET1, DATASET2.

📦 Installation

pip

Install sport-activities-features with pip:

sh pip install sport-activities-features

Alpine Linux

To install sport-activities-features on Alpine, use:

sh $ apk add py3-sport-activities-features

Fedora Linux

To install sport-activities-features on Fedora, use:

sh $ dnf install python3-sport-activities-features

Arch Linux

To install sport-activities-features on Arch Linux, please use an AUR helper:

sh $ yay -Syyu python-sport-activities-features

📮 API

There is a simple API for remote work with the sport-activities-features package available here.

💻 Graphical User Interface

There is a simple Graphical User Interface for the sport-activities-features package available here.

🌦️ Historical weather data

Weather data parsed is collected from the Visual Crossing Weather API. Please note that this is an external unaffiliated service, and users must register to use the API. The service has a free tier (1000 Weather reports/day) but is otherwise operating on a pay-as-you-go model. For pricing and terms of use, please read the official documentation of the API provider.

🧩 Overpass API, Open Elevation API & OpenTopoData integration

Without performing activities, we can use the OpenStreetMap for the identification of hills, total ascent, and descent. This is done using the Overpass API which is a read-only API that allows querying of OSM map data. In addition to that altitude, data is retrieved by using the Open-Elevation API or OpenTopoData API which are open-source and free alternatives to the Google Elevation API. Both of the solutions can be used by using free publicly acessible APIs (Overpass, Open-Elevation, OpenTopoData) or can be self hosted on a server or as a Docker container (Overpass, Open-Elevation, OpenTopoData).

🚀 Examples

Reading files

(*.TCX)

```python from sportactivitiesfeatures.tcx_manipulation import TCXFile

Class for reading TCX files

tcxfile=TCXFile() tcxexercise = tcxfile.readonefile("pathtothefile") data = tcxfile.extractactivitydata(tcxexercise) # Represents data as dictionary of lists

Alternative choice

data = tcxfile.extractactivitydata(tcxexercise, numpy_array= True) # Represents data as dictionary of numpy.arrays

```

(*.GPX)

```python from sportactivitiesfeatures.gpx_manipulation import GPXFile

Class for reading GPX files

gpx_file=GPXFile()

Read the file and generate a dictionary with

gpxexercise = gpxfile.readonefile("pathtothefile") data = gpxfile.extractactivitydata(gpx_exercise) # Represents data as dictionary of lists

Alternative choice

data = gpxfile.extractactivitydata(gpxexercise, numpy_array= True) # Represents data as dictionary of numpy.arrays

```

Extraction of topographic features

```python from sportactivitiesfeatures.hillidentification import HillIdentification from sportactivitiesfeatures.tcxmanipulation import TCXFile from sportactivitiesfeatures.topographicfeatures import TopographicFeatures from sportactivitiesfeatures.plotdata import PlotData

Read TCX file

tcxfile = TCXFile() tcxexercise = tcxfile.readonefile("pathtothefile") activity = tcxfile.extractactivitydata(tcxexercise)

Detect hills in data

Hill = HillIdentification(activity['altitudes'], 30) Hill.identifyhills() allhills = Hill.return_hills()

Extract features from data

Top = TopographicFeatures(allhills) numhills = Top.numofhills() avgaltitude = Top.avgaltitudeofhills(activity['altitudes']) avgascent = Top.avgascentofhills(activity['altitudes']) distancehills = Top.distanceofhills(activity['positions']) hillsshare = Top.shareofhills(distancehills, activity['totaldistance']) ```

Extraction of intervals

```python import sys sys.path.append('../')

from sportactivitiesfeatures.intervalidentification import IntervalIdentificationByPower, IntervalIdentificationByHeartrate from sportactivitiesfeatures.tcxmanipulation import TCXFile

Reading the TCX file

tcxfile = TCXFile() tcxexercise = tcxfile.readonefile("pathtothefile") activity = tcxfile.extractactivitydata(tcxexercise)

Identifying the intervals in the activity by power

Intervals = IntervalIdentificationByPower(activity["distances"], activity["timestamps"], activity["altitudes"], 70) Intervals.identifyintervals() allintervals = Intervals.return_intervals()

Identifying the intervals in the activity by heart rate

Intervals = IntervalIdentificationByHeartrate(activity["timestamps"], activity["altitudes"], activity["heartrates"]) Intervals.identifyintervals() allintervals = Intervals.return_intervals() ```

Parsing of Historical weather data from an external service

```python from sportactivitiesfeatures import WeatherIdentification from sportactivitiesfeatures import TCXFile

Read TCX file

tcxfile = TCXFile() tcxexercise = tcxfile.readonefile("pathtothefile") tcxdata = tcxfile.extractactivitydata(tcx_exercise)

Configure visual crossing api key

visualcrossingapikey = "weatherapi_key" # https://www.visualcrossing.com/weather-api

Explanation of elements - https://www.visualcrossing.com/resources/documentation/weather-data/weather-data-documentation/

weather = WeatherIdentification(tcxdata['positions'], tcxdata['timestamps'], visualcrossingapikey) weatherlist = weather.getweather(timedelta=30) tcxweather = weather.getaverageweatherdata(timestamps=tcxdata['timestamps'],weather=weatherlist)

Add weather to TCX data

tcxdata.update({'weather':tcxweather}) ```

The weather list is of the following type: json [ { "temperature": 14.3, "maximum_temperature": 14.3, "minimum_temperature": 14.3, "wind_chill": null, "heat_index": null, "solar_radiation": null, "precipitation": 0.0, "sea_level_pressure": 1021.6, "snow_depth": null, "wind_speed": 6.9, "wind_direction": 129.0, "wind_gust": null, "visibility": 40.0, "cloud_cover": 54.3, "relative_humidity": 47.6, "dew_point": 3.3, "weather_type": "", "conditions": "Partially cloudy", "date": "2016-04-02T17:26:09+00:00", "location": [ 46.079871179535985, 14.738618675619364 ], "index": 0 }, ... ]

Extraction of integral metrics

```python import sys sys.path.append('../')

from sportactivitiesfeatures.tcx_manipulation import TCXFile

Read TCX file

tcxfile = TCXFile() tcxexercise = tcxfile.readonefile("pathtothefile") integralmetrics = tcxfile.extractintegralmetrics(tcx_exercise)

print(integral_metrics)

```

Weather data extraction

```python from sportactivitiesfeatures.weatheridentification import WeatherIdentification from sportactivitiesfeatures.tcxmanipulation import TCXFile

read TCX file

tcxfile = TCXFile() tcxexercise = tcxfile.readonefile("pathtothefile") tcxdata = tcxfile.extractactivitydata(tcx_exercise)

configure visual crossing api key

visualcrossingapikey = "APIKEY" # https://www.visualcrossing.com/weather-api

return weather objects

weather = WeatherIdentification(tcxdata['positions'], tcxdata['timestamps'], visualcrossingapikey) weatherlist = weather.getweather() ```

Using Overpass queried Open Street Map nodes

```python import overpy from sportactivitiesfeatures.overpynodemanipulation import OverpyNodesReader

External service Overpass API (https://wiki.openstreetmap.org/wiki/Overpass_API) (can be self-hosted)

overpass_api = "https://lz4.overpass-api.de/api/interpreter"

External service Open Elevation API (https://api.open-elevation.com/api/v1/lookup) (can be self-hosted)

openelevationapi = "https://api.open-elevation.com/api/v1/lookup"

OSM Way (https://wiki.openstreetmap.org/wiki/Way)

openstreetmap_way = 164477980

overpassapi = overpy.Overpass(url=overpassapi)

Get an example Overpass way

q = f"""(way({openstreetmapway});<;);out geom;""" query = overpassapi.query(q)

Get nodes of an Overpass way

nodes = query.ways[0].getnodes(resolvemissing=True)

Extract basic data from nodes (you can, later on, use Hill Identification and Hill Data Extraction on them)

overpyreader = OverpyNodesReader(openelevationapi=openelevation_api)

Returns {

'positions': positions, 'altitudes': altitudes, 'distances': distances, 'totaldistance': totaldistance

}

data = overpyreader.readnodes(nodes) ```

Extraction of data inside the area

```python import numpy as np import sys sys.path.append('../')

from sportactivitiesfeatures.areaidentification import AreaIdentification from sportactivitiesfeatures.tcxmanipulation import TCXFile

Reading the TCX file.

tcxfile = TCXFile() tcxexercise = tcxfile.readonefile("pathtothefile") activity = tcxfile.extractactivitydata(tcxexercise)

Converting the read data to arrays.

positions = np.array([activity['positions']]) distances = np.array([activity['distances']]) timestamps = np.array([activity['timestamps']]) heartrates = np.array([activity['heartrates']])

Area coordinates should be given in clockwise orientation in the form of 3D array (numberofhulls, hull_coordinates, 2).

Holes in area are permitted.

area_coordinates = np.array([[[10, 10], [10, 50], [50, 50], [50, 10]], [[19, 19], [19, 21], [21, 21], [21, 19]]])

Extracting the data inside the given area.

area = AreaIdentification(positions, distances, timestamps, heartrates, areacoordinates) area.identifypointsinarea() areadata = area.extractdatainarea() ```

Identify interruptions

```python from sportactivitiesfeatures.interruptions.interruptionprocessor import InterruptionProcessor from sportactivitiesfeatures.tcxmanipulation import TCXFile

""" Identify interruption events from a TCX or GPX file. """

read TCX file (also works with GPX files)

tcxfile = TCXFile() tcxexercise = tcxfile.readonefile("pathtothefile") tcxdata = tcxfile.extractactivitydata(tcx_exercise)

""" Time interval = time before and after the start of an event Min speed = Threshold speed to trigger an event/interruption (trigger when under minspeed) overpassapiurl = Set to something self-hosted, or use a public instance from https://wiki.openstreetmap.org/wiki/OverpassAPI """ interruptionProcessor = InterruptionProcessor(timeinterval=60, minspeed=2, overpassapiurl="urltooverpass_api")

""" If classify is set to true, also discover if interruptions are close to intersections. Returns a list of [ExerciseEvent] """ events = interruptionProcessor.events(tcx_data, True) ```

Overpy (Overpass API) node manipulation

Generate TCXFile parsed like data object from overpy.Node objects ```python import overpy from sportactivitiesfeatures.overpynodemanipulation import OverpyNodesReader

External service Overpass API (https://wiki.openstreetmap.org/wiki/Overpass_API) (can be self-hosted)

overpass_api = "https://lz4.overpass-api.de/api/interpreter"

External service Open Elevation API (https://api.open-elevation.com/api/v1/lookup) (can be self-hosted)

openelevationapi = "https://api.open-elevation.com/api/v1/lookup"

OSM Way (https://wiki.openstreetmap.org/wiki/Way)

openstreetmap_way = 164477980

overpassapi = overpy.Overpass(url=overpassapi)

Get an example Overpass way

q = f"""(way({openstreetmapway});<;);out geom;""" query = overpassapi.query(q)

Get nodes of an Overpass way

nodes = query.ways[0].getnodes(resolvemissing=True)

Extract basic data from nodes (you can, later on, use Hill Identification and Hill Data Extraction on them)

overpyreader = OverpyNodesReader(openelevationapi=openelevation_api)

Returns {

'positions': positions, 'altitudes': altitudes, 'distances': distances, 'totaldistance': totaldistance

}

data = overpyreader.readnodes(nodes) ```

Missing elevation data extraction

```python from sportactivitiesfeatures import ElevationIdentification from sportactivitiesfeatures import TCXFile

tcxfile = TCXFile() tcxexercise = tcxfile.readonefile("pathtothefile") tcxdata = tcxfile.extractactivitydata(tcx_exercise)

elevations = ElevationIdentification(tcxdata['positions']) """Adds tcxdata['elevation'] = eg. [124, 21, 412] for each position""" tcx_data.update({'elevations':elevations}) ```

Example of a visualization of the area detection

Example of visualization of dead-end identification

🔑 License

This package is distributed under the MIT License. This license can be found online at http://www.opensource.org/licenses/MIT.

Disclaimer

This framework is provided as-is, and there are no guarantees that it fits your purposes or that it is bug-free. Use it at your own risk!

📄 Cite us

I. Jr. Fister, L. Lukač, A. Rajšp, I. Fister, L. Pečnik and D. Fister, "A minimalistic toolbox for extracting features from sport activity files", 2021 IEEE 25th International Conference on Intelligent Engineering Systems (INES), 2021, pp. 121-126, doi: 10.1109/INES52918.2021.9512927.

📖 Further read

[1] Awesome Computational Intelligence in Sports

🔗 Related frameworks

[1] AST-Monitor: A wearable Raspberry Pi computer for cyclists

[2] TCXReader.jl: Julia package designed for parsing TCX files

[3] TCXWriter: A Tiny Library for writing/creating TCX files on Arduino

🫂 Contributors

Thanks go to these wonderful people (emoji key):

alenrajsp 💻 ⚠️ 💡 📖 🤔 🐛 🚧	Iztok Fister Jr. 💻 🐛 ⚠️ 💡 📖 🤔 🧑‍🏫 📦 🚧 🔣	luckyLukac 🤔 💻 🐛 ⚠️ 💡	rhododendrom 💻 🎨 📖 🤔	Luka Pečnik 💻 📖 ⚠️ 🐛	spelap 💻	Oromion 🚧 🐛
Luka Koprivc 🐛	Nejc Graj 🐛	MlinaricNejc 🐛	Tatookie 💻 🐛 ⚠️ 💡 🚧	Zala Lahovnik 📖 💻	Tadej Lahovnik 📖	HlisTilen 📖
Miha Mirt 💻

This project follows the all-contributors specification. Contributions of any kind are welcome!