embedder embedder

Constructors

embedder(size_t n_tok, size_t n_embd)

Initializes a new embedding table with n_tok tokens and n_embd dimensions.

embedder(std::filesystem::path input)

Reads a saved embedding table.

---

Basic Info

An embedder that converts a token ID into a long vector of floats.

Instance Variables

Variable	Type
table	utility::matrix
n_tok	size_t
n_embd	size_t
toks	std::forward_list<int>
generator	std::default_random_engine
initDist	std::normal_distribution<float>

---

Functions

• backward()
• changeOne()
• embed()
• getNEmbed()
• getTable()
• init()
• readFromFile()
• saveToFile()

---

Example

// Initializing an embedder
embedder e("./embedder.bin");