Joint model V1, V2, train + test scripts, and smoke tests#26
Joint model V1, V2, train + test scripts, and smoke tests#26Pranav1006 wants to merge 29 commits into
Conversation
…ised helper utilities, corrected package-relative imports across convolution module, and hardened constructor for CNN1D
…d optional discriminator optimization
…ta loading from disk
There was a problem hiding this comment.
Please rewrite this file so that it modular across datasets. I will upload AMIGOS to the drive in order to do this.
…epare datasets to generated AMIGOS files from csv, and added SLURM scripts for running training scripts
|
joint_v2_data.py was rewritten to load datasets from a config class, and instances were created for DREAMER and AMIGOS. Additionally, prepare_datasets.py from stsnet was modified and used to convert amigos into the .npy files needed to load all data. Two minimal slurm scripts were added for running the training script, one for arousal and one for valence. During data preparation, the script detected NaN values in the CSV file, so the data/labels for AMIGOS may contain NaN values. If no nan values are found in the AMIGOS CSV, then we can go back and inspect the data loading script to see if it somehow manipulates values and turns them into NaNs. |
…sal and 27 emotion labels
Summary
This PR includes two versions of the joint model. The first version uses the joint architecture and optimizes a weighted combination of the reconstruction and VC losses. The second version optimizes the same loss while preserving the optimization of each VC term for explainability (the main model to use for testing). There is also a train + test script that includes smoke tests showing that training steps and gradients work.
Major Changes
Future Considerations
We should double-check whether the optional disc losses are reached by the gradients, and try different training times/amounts of layers, since the VC loss might take longer to converge. Hyperparameters are easily configurable, so we can run different combinations/ablations.