GeoSynth

Sonification of geolocations using an Encoder-Decoder MLP with data collected using Freesound API.

• Visit GeoSynth
• Click on countries on the globe to create a route
• Playhead moves along the route and feeds the co-ordinates to nueral network and produces sound.

Pipeline

flowchart TD
    DB[(Freesound API)] -->|Fetch & process| A[/Audio/]
    DB -->|Fetch & process| G[/Geotags/]

    subgraph "Autoencoder"
      A --> EN[Encoder]
      EN --> LV[/Latent Vector/]
      LV --> DE[Decoder]
      DE --> RA[/Reconstructed Audio/]
      A -.- |MAE Loss| RA
    end

    subgraph "Multi Layer Perceptron"
      G --> MLP[Multi Layer Perceptron]
      MLP --> PLV[/Predicted Latent Vector/]
      PLV --> DE
      LV -.- |MAE Loss| PLV
    end

    HRQ(HTTP Request) ==> MLP
    RA ==> HRS(HTTP Response)

    style DB fill:#334155,stroke:#1e293b,color:#f8fafc
    style A fill:#0ea5e9,stroke:#0284c7,color:#f0f9ff
    style G fill:#0ea5e9,stroke:#0284c7,color:#f0f9ff
    style EN fill:#8b5cf6,stroke:#7c3aed,color:#f5f3ff
    style LV fill:#0ea5e9,stroke:#0284c7,color:#f0f9ff
    style DE fill:#8b5cf6,stroke:#7c3aed,color:#f5f3ff
    style RA fill:#10b981,stroke:#059669,color:#ecfdf5
    style MLP fill:#8b5cf6,stroke:#7c3aed,color:#f5f3ff
    style PLV fill:#0ea5e9,stroke:#0284c7,color:#f0f9ff
    style HRQ fill:#64748b,stroke:#475569,color:#f8fafc
    style HRS fill:#64748b,stroke:#475569,color:#f8fafc
    linkStyle 11,8,9,5,12 stroke:#3b82f6,stroke-width:2px,stroke-dasharray:5 5

Loading

Run locally

Clone repository

git clone https://github.com/vivekvjyn/GeoSynth.git
git cd GeoSynth

Setup

conda create -n geosynth python=3.10 && conda activate geosynth
pip install -r requirements.txt
python flask run

License

This project is licensed under the GNU General Public License. See the LICENSE for details.