Interdisciplinary research on high-dimensional quantum data faces significant challenges due to differing interpretive frameworks across physics, mathematics, and data science. Those differences in perspective create a communication gap that slows research progress and prevents deeper interdisciplinary discussions. This paper introduces a visual analytics framework to bridge these disciplinary divides through 2D embedding visualization, which facilitates collaborative discovery and incremental hypothesis testing. Our evaluation systematically compares PCA and UMAP using both absolute values—preserving quantum symmetries in femto scales—and standardized values. We assess the stability of UMAP in both data scenarios, which reveals corresponding class organizations equivalent to those produced by PCA. When applied to absolute values, UMAP is sensitive to the variable N, revealing intrinsic low-variance relationships within the data but sacrificing reproducibility. This often results in unique embeddings accompanied by noisy outliers. Conversely, scaling the data allows UMAP to eliminate fine-scale structures, ensuring more consistent structural convergence. Our framework formalizes these trade-offs, demonstrating how UMAP can function as a hybrid goal-driven tool. Additionally, it can benefit from PCA cross-validation to enhance interpretability, contributing to science and knowledge discovery in complex quantum data even when the ground truth is unknown.
References
[1]
Jolliffe, I. (2002) Principal Component Analysis. 2nd Edition, Springer-Verlag.
[2]
McInnes, L., Healy, J. and Melville, J. (2018) UMAP: Uniform Manifold Ap Proximation and Projection for Dimension Reduction.
[3]
Cunningham, J.P. and Ghahramani, Z. (2015) Linear Dimensionality Reduction: Survey, Insights, and Generalizations. TheJournalofMachineLearningResearch, 16, 2859-2900.
[4]
Venna, J. and Kaski, S. (2007) Non-Linear Dimensionality Reduction as Informational Retrieval. InternationalConferenceonArtificialIntelligenceandStatistics. PMLR, San Juan, 21-24 March 2007, 572-579.
[5]
Chari, T. and Pachter, L. (2023) The Specious Art of Single-Cell Genomics. PLOSComputationalBiology, 19, e1011288. https://doi.org/10.1371/journal.pcbi.1011288
[6]
Sun, Y. and Zhang, F. (2022) Optimization of Classification Results on Gene Expression Datasets Using Dimensionality Reduction. CAIBDA 2022; 2ndInternationalConferenceonArtificialIntelligence, BigDataandAlgorithms. VDE, Nanjing, 17-19 June 2022, 1-11.
[7]
Alhassan, A.M. and Wan Zainon, W.M.N. (2021) Review of Feature Selection, Dimensionality Reduction and Classification for Chronic Disease Diagnosis. IEEE Access, 9, 87310-87317. https://doi.org/10.1109/access.2021.3088613
[8]
Li, X., Ganeshan, S., Pixley, J.H. and Das Sarma, S. (2015) Many-Body Localization and Quantum Nonergodicity in a Model with a Single-Particle Mobility Edge. PhysicalReviewLetters, 115, Article ID: 186601. https://doi.org/10.1103/physrevlett.115.186601
[9]
Hsu, Y., Li, X., Deng, D. and Das Sarma, S. (2018) Machine Learning Many-Body Localization: Search for the Elusive Nonergodic Metal. PhysicalReviewLetters, 121, Article ID: 245701. https://doi.org/10.1103/physrevlett.121.245701
[10]
Ganeshan, S., Pixley, J.H. and Das Sarma, S. (2015) Nearest Neighbor Tight Binding Models with an Exact Mobility Edge in One Dimension. PhysicalReviewLetters, 114, Article ID: 146601. https://doi.org/10.1103/physrevlett.114.146601
[11]
Li, H. and Haldane, F.D.M. (2008) Entanglement Spectrum as a Generalization of Entanglement Entropy: Identification of Topological Order in Non-Abelian Fractional Quantum Hall Effect States. PhysicalReviewLetters, 101, Article ID: 010504. https://doi.org/10.1103/physrevlett.101.010504
[12]
Nonato, L.G. and Aupetit, M. (2019) Multidimensional Projection for Visual Analytics: Linking Techniques with Distortions, Tasks, and Layout Enrichment. IEEE TransactionsonVisualizationandComputerGraphics, 25, 2650-2673. https://doi.org/10.1109/tvcg.2018.2846735
[13]
Bohm, J., Berens, J. and Kobak, J. (2022) Attraction-Repulsion Spectrum in Neighbor Embeddings. JournalofMachineLearningResearch, 23, 1-32.
[14]
O’Keefe, J. and Dostrovsky, J. (1971) The Hippocampus as a Spatial Map. Preliminary Evidence from Unit Activity in the Freely-Moving Rat. BrainResearch, 34, 171-175. https://doi.org/10.1016/0006-8993(71)90358-1
[15]
Beveridge, C., Hart, K., Cristani, C.R., Li, X., Barbierato, E. and Hsu, Y. (2025) Unsupervised Machine Learning for Detecting Mutual Independence among Eigenstate Regimes in Interacting Quasiperiodic Chains. PhysicalReviewB, 111, L140202. https://doi.org/10.1103/physrevb.111.l140202