Hacker

Building a Transformer From Scratch in Annotated PyTorch

A complete walkthrough of implementing the original Attention Is All You Need encoder-decoder Transformer—no torch. nn.Transformer, no shortcuts. The 2017 paper "Attention Is All You Need" by Vaswani ...
GitHub

RepLKNet-pytorch (CVPR 2022)

This is the official PyTorch implementation of RepLKNet, from the following CVPR-2022 paper: Scaling Up Your Kernels to 31x31: Revisiting Large Kernel Design in CNNs ...
GitHub

huawei-noah/Efficient-AI-Backbones

2024/02/27 The paper of ParameterNet is accepted by CVPR 2024. 2022/12/01 The code of NeurIPS 2022 (Spotlight) GhostNetV2 is released at ./ghostnetv2_pytorch. 2022/11/13 The code of IJCV 2022 G-Ghost ...
Frontiers

Modeling ring current proton distribution using MLP, CNN, LSTM, and transformer networks

This study aims at developing ring current proton flux models using four neural network architectures: a multilayer perceptron (MLP), a convolutional neural network (CNN), a long short-term memory ...
IEEE

Vision Permutator: A Permutable MLP-Like Architecture for Visual Recognition

Abstract: In this paper, we present Vision Permutator, a conceptually simple and data efficient MLP-like architecture for visual recognition. By realizing the importance of the positional information ...