Efficient Hardware Design for Vision transformer
Published in Peer Reviewed Core-A-ranking Computer Architecture Journal, 2024
- Keywords: Vision Transformer, Hardware Acceleration, Data-pipeline Manipulation
- The paper presents an optimized vision transformer (ViT) accelerator aimed at improving computational efficiency on devices with limited resources. By employing lightweight techniques for selecting key image patches, It minimizes the need for intensive computation typically required by ViTs. These techniques use simple, low-cost methods to identify relevant data, enabling more efficient processing. The accelerator further enhances performance through parallelism while maintaining energy efficiency, offering a practical solution for real-time computer vision tasks.