Motivation
Strategic World Models currently assume a single observation language, which limits their applicability in real-world settings where agents must reason and plan across multiple languages and cultural contexts. Enabling multilingual reasoning while preserving strategic consistency would significantly improve generalization and usability.
This feature proposes extending StrategicWM with language-agnostic latent state alignment, allowing identical strategic situations described in different languages to map to the same abstract world state.
Proposed Feature
Introduce Multilingual & Cross-Lingual World Model Alignment by:
-
Multilingual Observation Encoding
- Integrate a multilingual text encoder (e.g., XLM-R, mT5) to process language-based observations.
- Map observations from different languages into a shared latent space.
-
Strategic Latent Alignment Loss
- Enforce similarity between latent states representing the same world configuration across languages.
- Possible approaches:
- Contrastive loss
- KL-divergence
- InfoNCE-style objective
-
Language-Conditioned Decoding
- Decode plans, actions, or explanations in the input language without altering the core planner.
- Supports explainable and human-aligned planning.
Motivation
Strategic World Models currently assume a single observation language, which limits their applicability in real-world settings where agents must reason and plan across multiple languages and cultural contexts. Enabling multilingual reasoning while preserving strategic consistency would significantly improve generalization and usability.
This feature proposes extending StrategicWM with language-agnostic latent state alignment, allowing identical strategic situations described in different languages to map to the same abstract world state.
Proposed Feature
Introduce Multilingual & Cross-Lingual World Model Alignment by:
Multilingual Observation Encoding
Strategic Latent Alignment Loss
Language-Conditioned Decoding