pipette
ESEspañol

Efficient quadratic entropy with distance sketches

Steve Huntsman

Preprint

In the authors' words

We detail scalable methods for approximating the quadratic entropy for arbitrary distributions and common distances of negative type. We focus on the Euclidean and spherical geodesic cases, which both use random feature embeddings and projections to dramatically improve computational complexity within a simple framework. Amortization of a single large matrix multiplication and control variates further enable computation at large scale with low memory and runtime in situations where is held constant while varies. We demonstrate this with a comparison against direct pair sampling and bibliometric/scientometric examples on Open Graph Benchmark datasets, revealing papers, fields, and institutions with both particularly narrow and broad interdisciplinary reach from their citations and text features alone.

Main resultThe abstract does not state a limitation.

Appeared: Friday, October 9. arXiv. Preprint, not yet peer-reviewed.

Authors' comment: Code for reproducing results in LaTeX comments