When Does Data Value Reduce to Class Balance? A Coverage View of Per-Point Data Valuation
A coverage view of data valuation, studying when selection in the learner's representation is worth the extra cost.
Research details & versions
The full version has been accepted by Transactions on Machine Learning Research (TMLR). The short version, “Whose Geometry? When Learner-Relative Data Selection Beats Input-Space Selection for Efficient Fine-Tuning”, was accepted at the 2026 SIGKDD Workshop on Resource-Efficient Learning for Knowledge Discovery (RelKD 2026). This work studies when it is worth paying for data selection in the learner's representation geometry rather than a cheaper input-space geometry.
The paper gives a kernel-coverage view of efficient fine-tuning: learner-geometry selection helps only when representation non-locality, task non-interpolability in input space, and a binding budget all hold. Experiments across vision and LLM tasks show that a cheap input-learner misalignment diagnostic can predict when learner-relative selection is useful.
Full manuscript
