Portrait of Frederik Wenkel is unavailable

Frederik Wenkel

Alumni
Google Scholar

Publications

Taxonomy of Benchmarks in Graph Representation Learning
Renming Liu
Semih Cantürk
Frederik Wenkel
Sarah McGuire
Xinyi Wang
Anna Little
Leslie O’Bray
Michael Perlmutter
Bastian Rieck
Matthew Hirn
Guy Wolf
Ladislav Rampasek
Graph Neural Networks (GNNs) extend the success of neural networks to graph-structured data by accounting for their intrinsic geometry. Whil… (see more)e extensive research has been done on developing GNN models with superior performance according to a collection of graph representation learning benchmarks, it is currently not well understood what aspects of a given model are probed by them. For example, to what extent do they test the ability of a model to leverage graph structure vs. node features? Here, we develop a principled approach to taxonomize benchmarking datasets according to a
2022-11-23
Learning on Graphs Conference (oral)
doi.org
proceedings.mlr.press
Geometric Scattering Attention Networks
Yimeng Min
Frederik Wenkel
Guy Wolf
Geometric scattering has recently gained recognition in graph representation learning, and recent work has shown that integrating scattering… (see more) features in graph convolution networks (GCNs) can alleviate the typical oversmoothing of features in node representation learning. However, scattering often relies on handcrafted design, requiring careful selection of frequency bands via a cascade of wavelet transforms, as well as an effective weight sharing scheme to combine low- and band-pass information. Here, we introduce a new attention-based architecture to produce adaptive task-driven node representations by implicitly learning node-wise weights for combining multiple scattering and GCN channels in the network. We show the resulting geometric scattering attention network (GSAN) outperforms previous networks in semi-supervised node classification, while also enabling a spectral study of extracted information by examining node-wise attention weights.
2021-12-31
IEEE International Conference on Acoustics, Speech and Signal Processing (unknown)
doi.org
arxiv.org
Scattering GCN: Overcoming Oversmoothness in Graph Convolutional Networks
Yimeng Min
Frederik Wenkel
Guy Wolf
Graph convolutional networks (GCNs) have shown promising results in processing graph data by extracting structure-aware features. This gave … (see more)rise to extensive work in geometric deep learning, focusing on designing network architectures that ensure neuron activations conform to regularity patterns within the input graph. However, in most cases the graph structure is only accounted for by considering the similarity of activations between adjacent nodes, which limits the capabilities of such methods to discriminate between nodes in a graph. Here, we propose to augment conventional GCNs with geometric scattering transforms and residual convolutions. The former enables band-pass filtering of graph signals, thus alleviating the so-called oversmoothing often encountered in GCNs, while the latter is introduced to clear the resulting features of high-frequency noise. We establish the advantages of the presented Scattering GCN with both theoretical results establishing the complementary benefits of scattering and GCN features, as well as experimental results showing the benefits of our method compared to leading graph neural networks for semi-supervised node classification, including the recently proposed GAT network that typically alleviates oversmoothing using graph attention mechanisms.
2020-12-06
Conference on Neural Information Processing Systems (Accept (poster))
doi.org
arxiv.org