A Survey on Inference Engines for Large Language Models: Perspectives on Optimization and Efficiency
Paper
•
2505.01658
•
Published
•
39
open edge AI SoC Platform
non-profit
AI & ML interests
None defined yet.
leejaymin
authored
a
paper
8 months ago
leejaymin
authored
4
papers
over 1 year ago
A Comprehensive Evaluation of Quantized Instruction-Tuned Large Language Models: An Experimental Analysis up to 405B
Paper
•
2409.11055
•
Published
•
17
Mixed Non-linear Quantization for Vision Transformers
Paper
•
2407.18437
•
Published
Q-HyViT: Post-Training Quantization of Hybrid Vision Transformers with Bridge Block Reconstruction for IoT Systems
Paper
•
2303.12557
•
Published
Quantune: Post-training Quantization of Convolutional Neural Networks using Extreme Gradient Boosting for Fast Deployment
Paper
•
2202.05048
•
Published
leejaymin
updated
a
model
almost 2 years ago