2025

• Khalitov, Ruslan. (2025) Beyond Transformer: Scalable Neural Attention Networks for Long Sequential Data. NTNU
  Doctoral dissertation
• Yu, Tong; Cheng, Lei; Khalitov, Ruslan; Yang, Zhirong. (2025) A sparse and wide neural network model for DNA sequences. Neural Networks
  Academic article
• Yu, Tong; Cheng, Lei; Khalitov, Ruslan; Brandser Olsson, Erland; Yang, Zhirong. (2025) Self-distillation improves self-supervised learning for DNA sequence inference. Neural Networks
  Academic article

2024

• Cheng, Lei; Yu, Tong; Khalitov, Ruslan; Yang, Zhirong. (2024) Self-supervised Learning for DNA sequences with circular dilated convolutional networks. Neural Networks
  Academic article

2023

• Cheng, Lei; Khalitov, Ruslan; Yu, Tong; Zhang, Jing; Yang, Zhirong. (2023) Classification of long sequential data using circular dilated convolutional neural networks. Neurocomputing
  Academic article

2022

• Yu, Tong; Khalitov, Ruslan; Cheng, Lei; Yang, Zhirong. (2022) Paramixer: Parameterizing Mixing Links in Sparse Factors Works Better than Dot-Product Self-Attention. Computer Vision and Pattern Recognition
  Academic article
• Khalitov, Ruslan; Yu, Tong; Cheng, Lei; Yang, Zhirong. (2022) Sparse factorization of square matrices with application to neural attention modeling. Neural Networks
  Academic article