TY - JOUR
T1 - Efficient Approximation of Gromov-Wasserstein Distance Using Importance Sparsification
AU - Li, Mengyu
AU - Yu, Jun
AU - Xu, Hongteng
AU - Meng, Cheng
N1 - Publisher Copyright:
© 2023 American Statistical Association and Institute of Mathematical Statistics.
PY - 2023
Y1 - 2023
N2 - As a valid metric of metric-measure spaces, Gromov-Wasserstein (GW) distance has shown the potential for matching problems of structured data like point clouds and graphs. However, its application in practice is limited due to the high computational complexity. To overcome this challenge, we propose a novel importance sparsification method, called Spar-GW, to approximate GW distance efficiently. In particular, instead of considering a dense coupling matrix, our method leverages a simple but effective sampling strategy to construct a sparse coupling matrix and update it with few computations. The proposed Spar-GW method is applicable to the GW distance with arbitrary ground cost, and it reduces the complexity from (Formula presented.) to (Formula presented.) for an arbitrary small (Formula presented.). Theoretically, the convergence and consistency of the proposed estimation for GW distance are established under mild regularity conditions. In addition, this method can be extended to approximate the variants of GW distance, including the entropic GW distance, the fused GW distance, and the unbalanced GW distance. Experiments show the superiority of our Spar-GW to state-of-the-art methods in both synthetic and real-world tasks. Supplementary materials for this article are available online.
AB - As a valid metric of metric-measure spaces, Gromov-Wasserstein (GW) distance has shown the potential for matching problems of structured data like point clouds and graphs. However, its application in practice is limited due to the high computational complexity. To overcome this challenge, we propose a novel importance sparsification method, called Spar-GW, to approximate GW distance efficiently. In particular, instead of considering a dense coupling matrix, our method leverages a simple but effective sampling strategy to construct a sparse coupling matrix and update it with few computations. The proposed Spar-GW method is applicable to the GW distance with arbitrary ground cost, and it reduces the complexity from (Formula presented.) to (Formula presented.) for an arbitrary small (Formula presented.). Theoretically, the convergence and consistency of the proposed estimation for GW distance are established under mild regularity conditions. In addition, this method can be extended to approximate the variants of GW distance, including the entropic GW distance, the fused GW distance, and the unbalanced GW distance. Experiments show the superiority of our Spar-GW to state-of-the-art methods in both synthetic and real-world tasks. Supplementary materials for this article are available online.
KW - Element-wise sampling
KW - Importance sampling
KW - Sinkhorn-scaling algorithm
KW - Unbalanced Gromov-Wasserstein distance
UR - http://www.scopus.com/inward/record.url?scp=85147376419&partnerID=8YFLogxK
U2 - 10.1080/10618600.2023.2165500
DO - 10.1080/10618600.2023.2165500
M3 - Article
AN - SCOPUS:85147376419
SN - 1061-8600
VL - 32
SP - 1512
EP - 1523
JO - Journal of Computational and Graphical Statistics
JF - Journal of Computational and Graphical Statistics
IS - 4
ER -