DynGraphTrans: Dynamic Graph Embedding via Modified Universal Transformer Networks for Financial Transaction Data

Dynamic graphs representation learning has gradually become a research trend, especially for unsupervised graph embedding learning for numerous graph analytic tasks such as node classification, graph mining and visualization, etc. In this paper, we propose a dynamic embedding method, DynGraphTrans, which leverage powerful modelling capability of universal transformer for temporal evolutionary patterns of financial transaction graph. Real-world transaction graphs are dynamic and continuously evolving over time. According to the characteristics of transaction data, DynGraphTrans computes account node representations by employing smoothed attention layer and time interval-aware relative position embedding mechanism. We demonstrate the advantages of the proposed dynamic network embedding by conducting empirical evaluations on a large synthetic transaction graph dataset for Anti-Money Laundering (AML) task.