Replace ordinary adversarial training over a fixed perturbation set with adaptive robust training in which the admissible perturbations depend on the current network state. Train on a small active set of hard scenarios, then search for a newly admissible scenario with larger loss or constraint violation and add it only when needed. This should reduce redundant adversarial examples while targeting worst-case regions induced by the current model.
Augment a neural policy with deterministic DFA states for the task objective and safety constraint, then select among objective-specific policy heads using those states. Before either target is reached, execute a mixed policy; after one target is reached, switch permanently to the policy specialized for the remaining target.
Represent an original neural-network block and a proposed rewritten block as constrained optimization formulations over inputs and trainable parameters, then certify that the rewrite preserves feasibility and the ordering of losses over a bounded domain. This gives a compiler or pruning pipeline a formal reject/accept gate instead of relying only on numerical regression tests.
Represent a neural computation or verification pipeline as a directed acyclic graph whose nodes carry cached certificates for tensor shapes, numerical ranges, Lipschitz estimates, quantization error, or equivalence to a reference module. After locally replacing or optimizing one node, compare its old and new interface fingerprints and revoke certificates only along the dependency cone when the interface changed. This enables safe incremental verification during architecture search, compiler…
Represent structured neural masks or routing states as order ideals of a finite prerequisite poset, then use a modular score whose exact minimizers are a desired decomposition-closed family of valid configurations. This replaces many pairwise constraint penalties with one additive potential that gives zero cost to every intended valid state and positive cost to invalid intermediate states.
Replace a fixed weighted sum of normalized neural-network objectives with a differentiable fuzzy scalarizer that assigns every criterion to desirable, tolerable, and undesirable regions. Explicit output consequents turn these semantic classes into a scalar training loss, while localized memberships reduce flat plateaus and make the optimizer distinguish genuine preference minima from arbitrary ties.