Gabriele Oliaro

goliaro's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

authored 3 papers almost 2 years ago

Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to Systems

Paper • 2312.15234 • Published Dec 23, 2023 • 3

FlexLLM: A System for Co-Serving Large Language Model Inference and Parameter-Efficient Finetuning

Paper • 2402.18789 • Published Feb 29, 2024

Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Models

Paper • 2401.07159 • Published Jan 13, 2024

authored 3 papers over 2 years ago

SpecInfer: Accelerating Generative LLM Serving with Speculative Inference and Token Tree Verification

Paper • 2305.09781 • Published May 16, 2023 • 4

Zero-CPU Collection with Direct Telemetry Access

Paper • 2110.05438 • Published Oct 11, 2021

Direct Telemetry Access

Paper • 2202.02270 • Published Feb 4, 2022