- Copy dbtemp.ini to db.ini and update credentials locally
- Ensure you are running python version of at least 3.6.8 Reccomend using pyenv to manage your environment, see https://github.com/pyenv/pyenv-virtualenv
- pip install -r requirements.txt
Here is how to create a virtual environment specific to futres (assuming you already have setup pyenv):
# Create a virtual environment for futres-pyenv
pyenv virtualenv 3.7.2 futres-api
# automatically set futres-api to current directory when you navigate to this directory
pyenv local futres-api
The fetch.py script gets data from GEOME and looks in the vertnet directory for
processed Vertnet scripts and populates JSON files in the data directory as well
as a gzipped data/futres_data_processed.csv.gz which we will use in the loader script.
script.
The loader.py script populates the elasticsearch backend database using the loader.py script See the Loading into ElasticSearch section below.
The FuTRES dynamic data is hosted by the plantphenology nodejs proxy service at: https://github.com/biocodellc/ppo-data-server/blob/master/docs/es_futres_proxy.md
See api.md for the API documentation
When running properties the properties file copy the contents of the dbtemp.ini file to a db.ini file and change the password.
the loader.py script recurses all CSV files in the data directory
- EITHER:
- scp data/futres_data_processed.csv.gz to biscicol which has port 80 access to tarly, a cyverse server. OR
- Run the processing pipeline on biscicol.org
- gunzip data/futres_data_processed.csv.gz
- run
python loader.py