{
 "artifacts": null,
 "category": "initialization",
 "description": "Initialize directional prototypes, cosine-classifier weights, or angular attention directions with a spherical t-design rather than iid random vectors. Exact matching of spherical moments through degree t should provide uniform angular coverage and reduce initialization anisotropy, especially when the number of prototypes is small.",
 "formulas_latex": [
  "$$\\frac{1}{N}\\sum_{i=1}^{N}p(x_i)=\\int_{\\mathbb S^{d-1}}p(x)\\,d\\sigma(x),\\qquad \\deg p\\le t.$$",
  "$$\\frac{1}{N}\\sum_{i=1}^{N}x_i^{\\otimes m}=\\mathbb E_{z\\sim\\sigma}[z^{\\otimes m}],\\qquad 0\\le m\\le t.$$",
  "$$P_X^{\\circ}=\\operatorname{conv}\\{x_i/h_i:1\\le i\\le N\\},\\qquad v_i=\\frac{x_i}{h_i}.$$",
  "$$\\mathcal L_{\\mathrm{mom}}=\\sum_{m=1}^{t}\\beta_m\\left\\|\\frac{1}{N}\\sum_{i=1}^{N}z_i^{\\otimes m}-M_m\\right\\|_F^2,\\qquad M_m=\\mathbb E_{z\\sim\\sigma}[z^{\\otimes m}].$$"
 ],
 "id": 3056,
 "implementation": "Use the construction in a cosine classifier, vector-quantized embedding layer, random-feature MLP, or attention head with N directional prototypes in dimension d. Obtain a spherical t-design X offline, normalize its columns, and initialize the prototype weight matrix W so that row i is x_i. For a sample embedding z, normalize it to z divided by its Euclidean norm and compute directional logits l_i = tau z^T W_i, where tau is a learnable or fixed temperature. During the first warmup period freeze W or permit only tangent-space updates: after each optimizer step replace each row w_i by w_i divided by its norm, preserving the spherical representation. If prototype adaptation is needed, add the moment regularizer L_mom using m = 1 and m = 2 first; for unit vectors the target is M_1 = 0 and M_2 = I divided by d, so the cheapest implementation is L_mom = beta_1 norm(mean_i z_i)^2 + beta_2 norm((1/N) sum_i z_i z_i^T - I/d)_F^2. The mathematical quantities are the exact design moment identities; the choice of t, beta values, temperature, and freezing schedule is empirical. To test it cheaply, train a CIFAR-10 classifier with a 16-dimensional normalized embedding and N = 64 prototypes, comparing iid Gaussian initialization, orthogonal initialization, Fibonacci-sphere initialization, and a spherical 3-design. Use identical optimizers, learning rates, augmentations, and parameter counts. Record training loss at fixed optimizer steps, final accuracy, expected calibration error, sensitivity to random seed, and empirical first- and second-moment errors. Success is lower seed variance or faster early convergence at equal compute, or equal accuracy with fewer prototypes than random initialization.",
 "math_summary": "A spherical t-design is a finite set X = {x_i}_{i=1}^N contained in the unit sphere S^{d-1} such that the equal-weight empirical average matches the uniform spherical probability measure sigma for every polynomial p of degree at most t: (1/N) sum_i p(x_i) = integral_{S^{d-1}} p(x) d sigma(x). Equivalently, for every tensor order m with 0 \u003c= m \u003c= t, (1/N) sum_i x_i^{tensor m} = E_{z sampled from sigma}[z^{tensor m}]. The first-order condition gives zero mean and the second-order condition gives isotropy, while higher orders control angular anisotropy. The paper also uses the polar vertex relation v_i = x_i/h_i, where h_i = h_{P_X}(x_i) is the support number of the associated Minkowski polytope; this provides an optional principled radial rescaling. For an ML module, use the design points as normalized prototype directions and optionally add a penalty measuring deviation from the target low-order moments.",
 "math_tags": [
  "geometry",
  "harmonic-analysis",
  "linear-algebra"
 ],
 "ml_areas": [
  "embedding",
  "initialization",
  "attention",
  "loss"
 ],
 "paper": {
  "arxiv_id": "2609.02439",
  "arxiv_url": "https://arxiv.org/abs/2609.02439",
  "summary_what_math_gives_to_ml": "The paper offers a transferable construction linking spherical designs, polar convex bodies, and structured nonnegative slack matrices. The most promising neural-network use is the factorization A = c hh^T - X^T U^T X, which creates a geometrically constrained interaction kernel from rank-one and low-rank terms while preserving nonnegativity and a meaningful zero pattern. This can replace or bias dense attention and mixture-of-experts routing, with near-zero slack values providing a principled sparse connectivity rule. A lower-risk application is using spherical-design directions as deterministic, moment-matched prototype or attention-head initialization.",
  "title": "Dual Geometry of Spherical Designs: Polarity, Self-Polar Rigidity, and Quadrature Structure",
  "year": "2026"
 },
 "ratings": {
  "difficulty": 4,
  "novelty": 5,
  "usefulness": 5
 },
 "solves": [
  "accuracy",
  "sample-efficiency",
  "stability"
 ],
 "title": "Spherical-Design Prototype Initialization",
 "url": "https://synthcore.org/idea/3056/spherical-design-prototype-initialization",
 "verification": {
  "peer_reviewed": false,
  "status": "unverified",
  "status_label": "Unverified",
  "verdict_source": "deterministic test code (paired-seed permutation statistics)",
  "verification_axes": {
   "benchmark_mechanism": {
    "confirmed": null,
    "tested": false
   },
   "practical_benchmark": {
    "beats_baseline": null,
    "tested": false
   },
   "toy_mechanism_gate": {
    "confirmed": null,
    "tested": false
   }
  }
 }
}