Graph Machine Learning

Mining and Learning with Graphs Workshop MLG workshop is a regular workshop on various ML solutions for graphs. The videos for each poster can be found here. Keynotes should be available soon (except for Danai Koutra, which is available now).

Graph Machine Learning Books For a long time I was thinking that the community lacks proper books on graph machine learning and even thought maybe I should write one. But luckily there are other active people. With the difference of one day 2 (!) books were announced. Graph Representation Learning Book by Will Hamilton, which so far has 3 main chapters on node embeddings, GNNs, and generative models. While the drafts are ready, there is still a long way to make it comprehensive book and the author promises to work on that. Great start. Deep Learning on Graphs by Yao Ma and Jiliang Tang. This should be available next month and should focus on foundations of GNNs as well as applications. That's great, hopefully they will become handbooks for those who want to start in this area. Now waiting the same but for educational courses 🙏

Fresh picks from ArXiv This week in ArXiv new graph data sets for language recommendation, new optimization methods of GNNs, and applications to RL 🕹 GNN • Optimization of Graph Neural Networks with Natural Gradient Descent • Training Matters: Unlocking Potentials of Deeper Graph Convolutional Neural Networks Data sets • VisualSem: a high-quality knowledge graph for vision and language • COOKIE: A Dataset for Conversational Recommendation over Knowledge Graphs in E-commerce Applications • Multi-Agent Reinforcement Learning with Graph Clustering • SF-GRASS: Solver-Free Graph Spectral Sparsification • Learning Graph Edit Distance by Graph Neural Networks • Community-Aware Graph Signal Processing

KDD 2020 Highlights I haven't found highlights about KDD 2020, so did my own. What's interesting there are many papers on scalability of GNNs, intersection of graphs and recommendation, and clustering algorithms. Paper digest allows you to browse quickly through the papers.

Symposium on Graph Drawing and Network Visualization It's cool to see there is a small conference on how you can visualize graphs. Registration is free until 10 September.

Brief analytics of KDD papers Here are some plots for upcoming KDD 2020 (only research track). It's interesting to compare it against ICML 2020. You can check out git repo with the analysis. Here is highlights: 1. Top affiliations at KDD are different than at ICML, with several "small" names at the top. 2. Leading authors are almost all from China. 3. There are more authors per paper (~4-5) at KDD than at ICML (~3-4). Only a single paper with a single author. 4. There are ~65 graph papers, with a handful batch on pure algorithms. 5. In total there are 217 research papers. Graphs comprise about 30% of all papers. 6. Wordcloud confirms: graphs are the most used word in titles. 7. "Geodesic Forests" is the shortest title appeared.

Node regression problem I asked on twitter what the available node regression data sets there and found quite a few interesting responses. 1. There are pure node regression data sets, but not so many. One can use Wikipedia, Pokec, or data sets from this paper. I hope to release a couple more data sets like these soon. 2. You can also find data sets in spatiotemporal prediction on graphs (eg. traffic forecasting). You are given graph + velocity on each lane and you are asked to predict velocity in the future. My opinion is that the problem is a toy problem: there are no features associated with the nodes (except for a speed). But you can take a look at DCRNN, STGCN, GaAN, Graph WaveNet, STGRAT, etc. models that deal with that. 3. You can find node regression in the work of simulating physics. A node is a particle, it has a few features (eg. position+velocity) you are asked to predict acceleration. This is an interesting problem, but I haven't found data sets. You probably need to write your own simulator. 4. Next scene prediction. Essentially the same as previous, but the objects can be anything: for example, a camera view in a self-driving car. You are asked to predict next position of every object. I don't know if anyone tried to solve this problem. 5. Action prediction for RL agent. NerveNet did it. Each object is a graph and you predict an action for each node.

Fresh picks from ArXiv This week we have novel GNN architectures, Turing test for graph drawing, and graph exploration of git repositories 💻 GNN • Quaternion Graph Neural Networks • Representative Graph Neural Network ECCV 20 • DensE: An Enhanced Non-Abelian Group Representation for Knowledge Graph Embedding Applications • Graph Edit Distance Reward: Learning to Edit Scene Graph • HOSE-Net: Higher Order Structure Embedded Network for Scene Graph Generation • Bipartite Graph Reasoning GANs for Person Image Generation • Graph Polish: A Novel Graph Generation Paradigm for Molecular Optimization • Graph Drawing via Gradient Descent, (GD)2 • The Turing Test for Graph Drawing Algorithms • GraphRepo: Fast Exploration in Software Repository Mining

Temporal Graph Networks Another blog post by Michael Bronstein with Emanuele Rossi on applying graph nets on dynamic graphs (represented as the stream of edges). Apparently this problem is much more realistic in many business contexts such as social networks and it has not been studied at depth until that paper.

Graph Machine Learning research groups: XavierBresson I do a series of posts on the groups in graph research, previous post is here. The 12th is Xavier Bresson, conference and tutorial organizers on graph machine learning. Xavier Bresson (~1975) - Affiliation: NTU Singapore - Education: Ph.D. at EPFL, Switzerland in 2005 (supervised by Jean-Philippe Thiran); - h-index: 38; - Awards: Singapore NRF fellowship, best paper at IVMSP; - Interests: signal processing on graphs, GNN, combinatorial optimization.