Concepts
Embedding recipes and data shapes
Choose losses, prompts, pooling, dimensions, mining, and model-specific boundaries honestly.
Planned entries are structurally configured, not qualified or supported. See Model recipe qualification for exact evidence states, preflight gates, and first-wave blockers.
Loss chooser
| Data shape | Objective | Distillation meaning |
|---|---|---|
| query + positive document | MNRL/InfoNCE | relative in-batch retrieval |
| query + positive + negative | triplet/contrastive | explicit separation |
| pair + teacher score | MarginMSE | graded relevance margin |
| text + teacher vector | cosine/MSE + projection | geometry; projection must be trained on train only |
| candidate list + teacher order/scores | pairwise/listwise KL | ranking distribution |
| sentence pair + similarity | CoSENT/cosine | STS |
| text + class/cluster | supervised classification/clustering | label or grouping structure |
Never coerce scores to Boolean silently, truncate arbitrary teacher vectors, or mix evaluation IDs into generation/mining. Hard-negative mining must use train-only corpora, global IDs, deduplication, and false-negative filtering against positives, same-document groups, and known relevance.
Synthetic multilingual queries must record language, generator/provider, model revision, prompt hash, usage/cost, rights, and source document. Provider generation is opt-in and resumable; the local fixture is synthetic and offline.
Model conventions are lock-driven:
- Arctic: exact asymmetric query/document prompts; evaluate 768 and the lock-published 256 dimension separately.
- BGE-M3: dense-only MVP. Sparse and ColBERT/hybrid fusion are later gated work, not implied by dense export.
- Nomic: preserve
search_query:,search_document:,classification:, andclustering:prefixes. MoE requires expert/router coverage, utilization and save/reload gates; active parameters are not optimizer memory. - GTE:
trust_remote_codeis never implicit. It requires an explicit opt-in to a pinned reviewed commit and a clean offline reload check. - Qwen: query instruction normally applies only to queries; last-token/EOS pooling, left padding, normalization, and allowed dimensions come from the lock.
For air-gapped operation, pre-stage the wheel, NPM tarball, exact model/tokenizer revisions, schemas, locks, licenses/NOTICE, and datasets; set offline modes in the model stack; verify hashes; and reject any missing cache entry. An offline claim is invalid if installation or reload contacts a registry or model hub.