FazBrowse GitHub Viewer | Trending |
URL:
| Home
Tools: [Download Repo ZIP]   [Original HTTPS Page]

grisuno/SWAN-Phoenix-Rising: Detecting illicit transactions in evolving financial networks requires models that generalize under severe class imbalance and concept drift. Existing graph neural network (GNN) approaches on the Elliptic dataset often suffer from feature collapse, over-smoothing, or poor temporal generalization. · GitHub

SWAN: Phoenix-Rising Sparse Graph Learning for Temporal Fraud Detection

Abstract

Detecting illicit transactions in evolving financial networks requires models that generalize under severe class imbalance and concept drift. Existing graph neural network (GNN) approaches on the Elliptic dataset often suffer from feature collapse, over-smoothing, or poor temporal generalization, leading to suboptimal performance under strict temporal validation.

We propose SWAN (Spline-Weighted Adaptive Network), a graph learning framework that integrates
(i) a rigorously constrained sparse autoencoder with tied weights,
(ii) a novel Phoenix Mechanism that adaptively regulates sparsity based on effective feature superposition, and
(iii) a topology-aware embedding evolution inspired by E8 lattice geometry.

Under a strict temporal cross-validation protocol, SWAN achieves up to 0.99 AUPRC on the Elliptic dataset, surpassing previously reported results. Our findings demonstrate that controlling effective representation dimensionality is critical for robust temporal generalization in fraud detection.


1. Introduction

Illicit transaction detection in cryptocurrency networks is challenging due to extreme class imbalance, noisy relational structure, and non-stationary data distributions. The Elliptic dataset has become a standard benchmark for this task, yet many reported results rely on random splits or insufficient temporal controls, leading to overly optimistic performance estimates.

Graph neural networks (GNNs) improve relational reasoning but often exhibit representation collapse under long training horizons, especially when sparsity regularization is applied naively. This collapse manifests as a loss of effective feature diversity, harming temporal generalization.

We introduce SWAN, a model explicitly designed to resist feature collapse under concept drift by monitoring and controlling the effective number of active features during training.

Contributions

  • A rigorously defined sparse autoencoder with tied weights for graph representation stabilization.
  • The Phoenix Mechanism, an adaptive sparsity controller driven by effective feature superposition.
  • A local spline-based complexity regularizer to prevent over-fragmentation.
  • State-of-the-art performance on Elliptic under strict temporal validation.

2. Related Work

Early approaches on Elliptic relied on classical machine learning with hand-crafted features. GNNs such as GCN and GAT later improved performance by leveraging transaction graphs. More recent work incorporates temporal modeling and autoencoder-based regularization.

However, prior methods typically apply fixed regularization schedules and do not explicitly measure representational collapse. In contrast, SWAN introduces a closed-loop, information-theoretic control mechanism over sparsity.


3. Methodology

3.1 Problem Setup

We consider a temporal graph:

$$ G_t = (V_t, E_t, X_t) $$

where nodes represent transactions, edges represent fund flows, and node features
$X_t \in \mathbb{R}^d$ are observed at timestep $t$.

The task is binary classification of illicit vs. licit transactions, training on $t' < t$ and evaluating on $t' = t$.


3.2 Model Architecture

SWAN consists of five components:

  1. Topology-Aware Embedding Layer
    A linear embedding with masked weights periodically regenerated using projections derived from an E8 lattice, promoting orthogonality and diversity.

  2. Graph Backbone
    A hybrid GCN–GAT architecture combining efficient message passing with adaptive attention.

  3. Rigid Sparse Autoencoder (SAE)
    A single-encoder autoencoder with tied decoder weights and no decoder bias.

  4. Spline Complexity Manager
    Estimates local decision boundary complexity via near-nonlinearity intersections.

  5. Classification Head
    A shallow MLP optimized with class-balanced loss.


3.3 Rigid Sparse Autoencoder

Given hidden representations $h \in \mathbb{R}^d$, the SAE computes:

$$ z = \mathrm{ReLU}(hW + b) $$

$$ \hat{h} = z W^\top $$

Weights are tied, ensuring identifiability and theoretical stability. Sparsity is encouraged through an $\ell_1$ penalty on $z$.


3.4 Effective Feature Superposition

We define the feature activation probability:

$$ p_i = \frac{\sum_s |z_{s,i}|}{\sum_{j,s} |z_{s,j}|} $$

The Shannon entropy is:

$$ H(p) = -\sum_i p_i \log p_i $$

The effective number of active features is:

$$ F_{\text{eff}} = e^{H(p)} $$

We define the superposition ratio:

$$ \Psi = \frac{F_{\text{eff}}}{d} $$

which measures how much representational capacity is effectively utilized.


3.5 Phoenix Mechanism

The Phoenix Mechanism adaptively regulates the sparsity coefficient $\lambda_{\ell_1}$ based on $\Psi$:

  • If $\Psi$ falls below a threshold, sparsity is relaxed to allow feature revival.
  • Otherwise, sparsity is gently enforced to prevent redundancy.

This feedback loop stabilizes representation dimensionality throughout training.


3.6 Loss Function

The total loss is defined as:

$$ \mathcal{L} = \mathcal{L}_{\text{cls}}

  • \alpha \mathcal{L}_{\text{recon}}
  • \lambda_{\ell_1}(\Psi)\mathcal{L}_{\ell_1}
  • \beta (\Psi - \Psi_0)^2
  • \gamma \mathcal{L}_{\text{LC}}
  • \delta \mathcal{L}_{\text{ortho}} $$

4. Experiments

4.1 Dataset and Protocol

We evaluate on the Elliptic dataset using strict temporal cross-validation. For each timestep $t$, models are trained on all $t' < t$ and evaluated on $t' = t$. Feature scaling is performed using training data only.


4.2 Evaluation Metric

Due to extreme class imbalance, we report Area Under the Precision–Recall Curve (AUPRC) as the primary metric.


4.3 Results

SWAN achieves up to 0.99 AUPRC on timestep T=08, consistently outperforming GCN, GAT, and prior hybrid models under the same protocol. Performance peaks early in training, emphasizing the importance of early stopping under temporal drift.


4.4 Ablation Study

Removing the Phoenix Mechanism leads to rapid collapse of $\Psi$ and a drop of 4–7 AUPRC points. Fixing the sparsity coefficient similarly degrades temporal generalization.


5. Discussion

Our results indicate that controlling effective representational capacity is more important than increasing nominal model size. The Phoenix Mechanism operationalizes a simple principle:

Regularization should respond to representation health, not training time.


6. Conclusion

We presented SWAN, a graph learning framework that achieves state-of-the-art performance on temporal fraud detection by explicitly controlling feature superposition. The proposed principles extend beyond Elliptic to other non-stationary graph learning problems.


References

(Omitted for brevity)

About

Detecting illicit transactions in evolving financial networks requires models that generalize under severe class imbalance and concept drift. Existing graph neural network (GNN) approaches on the Elliptic dataset often suffer from feature collapse, over-smoothing, or poor temporal generalization.

Resources

Code of conduct

Contributing

Security policy

Stars

2 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages

Generated from grisuno/template

Back | FazBrowse Home | New Git URL