Portrait de Yimeng Min n'est pas disponible

Yimeng Min

Alumni

Publications

Can Hybrid Geometric Scattering Networks Help Solve the Maximum Clique Problem?
Yimeng Min
Frederik Wenkel
Michael A. Perlmutter
Guy Wolf
We propose a geometric scattering-based graph neural network (GNN) for approximating solutions of the NP-hard maximum clique (MC) problem. W… (voir plus)e construct a loss function with two terms, one which encourages the network to find highly connected nodes and the other which acts as a surrogate for the constraint that the nodes form a clique. We then use this loss to train an efficient GNN architecture that outputs a vector representing the probability for each node to be part of the MC and apply a rule-based decoder to make our final prediction. The incorporation of the scattering transform alleviates the so-called oversmoothing problem that is often encountered in GNNs and would degrade the performance of our proposed setup. Our empirical results demonstrate that our method outperforms representative GNN baselines in terms of solution accuracy and inference speed as well as conventional solvers like Gurobi with limited time budgets. Furthermore, our scattering model is very parameter efficient with only
2022-11-28
Conference on Neural Information Processing Systems (Accept)
doi.org
openreview.net
Geometric Scattering Attention Networks
Yimeng Min
Frederik Wenkel
Guy Wolf
Geometric scattering has recently gained recognition in graph representation learning, and recent work has shown that integrating scattering… (voir plus) features in graph convolution networks (GCNs) can alleviate the typical oversmoothing of features in node representation learning. However, scattering often relies on handcrafted design, requiring careful selection of frequency bands via a cascade of wavelet transforms, as well as an effective weight sharing scheme to combine low- and band-pass information. Here, we introduce a new attention-based architecture to produce adaptive task-driven node representations by implicitly learning node-wise weights for combining multiple scattering and GCN channels in the network. We show the resulting geometric scattering attention network (GSAN) outperforms previous networks in semi-supervised node classification, while also enabling a spectral study of extracted information by examining node-wise attention weights.
2021-12-31
IEEE International Conference on Acoustics, Speech and Signal Processing (inconnu)
doi.org
arxiv.org
Scattering GCN: Overcoming Oversmoothness in Graph Convolutional Networks
Yimeng Min
Frederik Wenkel
Guy Wolf
Graph convolutional networks (GCNs) have shown promising results in processing graph data by extracting structure-aware features. This gave … (voir plus)rise to extensive work in geometric deep learning, focusing on designing network architectures that ensure neuron activations conform to regularity patterns within the input graph. However, in most cases the graph structure is only accounted for by considering the similarity of activations between adjacent nodes, which limits the capabilities of such methods to discriminate between nodes in a graph. Here, we propose to augment conventional GCNs with geometric scattering transforms and residual convolutions. The former enables band-pass filtering of graph signals, thus alleviating the so-called oversmoothing often encountered in GCNs, while the latter is introduced to clear the resulting features of high-frequency noise. We establish the advantages of the presented Scattering GCN with both theoretical results establishing the complementary benefits of scattering and GCN features, as well as experimental results showing the benefits of our method compared to leading graph neural networks for semi-supervised node classification, including the recently proposed GAT network that typically alleviates oversmoothing using graph attention mechanisms.
2020-12-06
Conference on Neural Information Processing Systems (Accept (poster))
doi.org
arxiv.org
Predicting ice flow using machine learning
Yimeng Min
S. Karthik Mukkavilli
Yoshua Bengio
Though machine learning has achieved notable success in modeling sequential and spatial data for speech recognition and in computer vision, … (voir plus)applications to remote sensing and climate science problems are seldom considered. In this paper, we demonstrate techniques from unsupervised learning of future video frame prediction, to increase the accuracy of ice flow tracking in multi-spectral satellite images. As the volume of cryosphere data increases in coming years, this is an interesting and important opportunity for machine learning to address a global challenge for climate change, risk management from floods, and conserving freshwater resources. Future frame prediction of ice melt and tracking the optical flow of ice dynamics presents modeling difficulties, due to uncertainties in global temperature increase, changing precipitation patterns, occlusion from cloud cover, rapid melting and glacier retreat due to black carbon aerosol deposition, from wildfires or human fossil emissions. We show the adversarial learning method helps improve the accuracy of tracking the optical flow of ice dynamics compared to existing methods in climate science. We present a dataset, IceNet, to encourage machine learning research and to help facilitate further applications in the areas of cryospheric science and climate change.
2019-10-19
ArXiv (prépublication)
arxiv.org
arxiv.org