Efficient Inference

AAAI 2025arXiv:2403.14520

#3

Cobra: Extending Mamba to Multi-Modal Large Language Model for Efficient Inference

Han Zhao, Min Zhang, Wei Zhao et al.

106

AAAI 2025arXiv:2412.12639

#4

Falcon: Faster and Parallel Inference of Large Language Models Through Enhanced Semi-Autoregressive Drafting and Custom-Designed Decoding Tree

Xiangxiang Gao, Weisheng Xie, Yiwei Xiang et al.

15

ICLR 2025arXiv:2405.14105

#5

Scaling Inference Time Compute for Diffusion Models

Nanye Ma, Shangyuan Tong, Haolin Jia et al.

Efficient Fine-Tuning and Concept Suppression for Pruned Diffusion Models

Reza Shirkavand, Peiran Yu, Shangqian Gao et al.

Distributed Speculative Inference (DSI): Speculation Parallelism for Provably Faster Lossless Language Model Inference

Nadav Timor, Jonathan Mamou, Daniel Korat et al.

speculative inferencelossless language model inferencedistributed inferencespeculation parallelism+4

6

ICCV 2025arXiv:2506.07725

#8

ETA: Efficiency through Thinking Ahead, A Dual Approach to Self-Driving with Large Models

Shadi Hamdan, Chonghao Sima, Zetong Yang et al.

4

NeurIPS 2025arXiv:2504.17660

#9

Effortless, Simulation-Efficient Bayesian Inference using Tabular Foundation Models

Julius Vetter, Manuel Gloeckler, Daniel Gedon et al.

3

AAAI 2025arXiv:2412.15750

#10

Extracting Interpretable Task-Specific Circuits from Large Language Models for Faster Inference

Jorge García-Carrasco, Alejandro Maté, Juan Trujillo

3

ICML 2025arXiv:2505.05950

#11

FloE: On-the-Fly MoE Inference on Memory-constrained GPU

Yuxin Zhou, Zheng Li, Jun Zhang et al.

3

ICLR 2025arXiv:2410.12982

#12

Flash Inference: Near Linear Time Inference for Long Convolution Sequence Models and Beyond

Costin-Andrei Oncescu, Sanket Jayant Purandare, Stratos Idreos et al.

long convolution sequence modelssubquadratic architecturesattention mechanism alternativessequence generative models+4

2

ICCV 2025arXiv:2412.06458

#13

Pruning All-Rounder: Rethinking and Improving Inference Efficiency for Large Vision Language Models

Wei Suo, Ji Ma, Mengyang Sun et al.

inference efficiencyvision language modelsparameter pruningtoken pruning+3

1

ICCV 2025arXiv:2507.23480

#14

FastPoint: Accelerating 3D Point Cloud Model Inference via Sample Point Distance Prediction

Donghyun Lee, Dawoon Jeong, Jae W. Lee et al.

ICCV 2025arXiv:2508.09262

#15

Harnessing Input-Adaptive Inference for Efficient VLN

Dongwoo Kang, Akhil Perincherry, Zachary Coalson et al.

NeurIPS 2025arXiv:2502.00234

#16

Fewer Denoising Steps or Cheaper Per-Step Inference: Towards Compute-Optimal Diffusion Model Deployment

Zhenbang Du, Yonggan Fu, Lifu Wang et al.

Decoupled Multi-Predictor Optimization for Inference-Efficient Model Tuning

Liwei Luo, Shuaitengyuan Li, Dongwei Ren et al.

Theoretical Insights in Model Inversion Robustness and Conditional Entropy Maximization for Collaborative Inference Systems

Song Xia, Yi Yu, Wenhan Yang et al.

Gaussian Ensemble Belief Propagation for Efficient Inference in High-Dimensional, Black-box Systems

Dan MacKinlay, Russell Tsuchida, Daniel Pagendam et al.

Fast Solvers for Discrete Diffusion Models: Theory and Applications of High-Order Algorithms

Yinuo Ren, Haoxuan Chen, Yuchen Zhu et al.

discrete diffusion modelshigh-order algorithmsnumerical inference schemesgenerative modeling+4

NeurIPS 2025arXiv:2511.05664

#21

KLASS: KL-Guided Fast Inference in Masked Diffusion Models

Seo Hyun Kim, Sunwoo Hong, Hojung Jung et al.

masked diffusion modelsfast inference samplingkl divergence guidancetoken-level stability+4

NeurIPS 2025arXiv:2502.07191

#22

Bag of Tricks for Inference-time Computation of LLM Reasoning

Fan LIU, Wen-Shuo Chao, Naiqiang Tan et al.

ICML 2025arXiv:2411.06360

#23

OCCAM: Towards Cost-Efficient and Accuracy-Aware Classification Inference

Dujian Ding, Bicheng Xu, Laks Lakshmanan

Optimizing Language Models for Inference Time Objectives using Reinforcement Learning

Yunhao Tang, Kunhao Zheng, Gabriel Synnaeve et al.

Analytically Tractable Hidden-States Inference in Bayesian Neural Networks

Luong-Ha Nguyen, James-A. Goulet

An Efficient Matrix Multiplication Algorithm for Accelerating Inference in Binary and Ternary Neural Networks

Mohsen Dehghankar, Mahdi Erfanian, Abolfazl Asudeh

ICML 2025arXiv:2501.17974

#27

Think Smarter not Harder: Adaptive Reasoning with Inference Aware Optimization

Zishun Yu, Tengyu Xu, Di Jin et al.

CVPR 2024arXiv:2405.00984

#28

Jointly-Learned Exit and Inference for a Dynamic Neural Network

Florence Regol, Joud Chataoui, Mark Coates

A Simple Model of Inference Scaling Laws

Noam Levi

FREE: Faster and Better Data-Free Meta-Learning

Yongxian Wei, Zixuan Hu, Zhenyi Wang et al.

AAAI 2025arXiv:2503.03228

#31

Towards Efficient Low-Order Hybrid Optimizer for Language Model Fine-Tuning

Minping Chen, You-Liang Huang, Zeyi Wen

BigMac: A Communication-Efficient Mixture-of-Experts Model Structure for Fast Training and Inference

Zewen Jin, Shengnan Wang, Jiaan Zhu et al.

An Efficient Subgraph-Inferring Framework for Large-Scale Heterogeneous Graphs

Wei Zhou, Hong Huang, Ruize Shi et al.

Path-Adaptive Matting for Efficient Inference Under Various Computational Cost Constraints

Qinglin Liu, Zonglin Li, Xiaoqian Lv et al.

AAAI 2025arXiv:2312.10193

#35

DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models

Muyang Li, Tianle Cai, Jiaxin Cao et al.

Adaptive Computation Modules: Granular Conditional Computation for Efficient Inference

Bartosz Wójcik, Alessio Devoto, Karol Pustelnik et al.

amortized bayesian inferencesimulation-based inferenceprobabilistic diffusion modelstransformer architectures+3

#37

All-in-one simulation-based inference

Manuel Gloeckler, Michael Deistler, Christian Weilbach et al.

ICML 2024

auto-regressive generation modelsinference accelerationdynamic computation allocationconstrained optimization+4

#38

Switchable Decision: Dynamic Neural Generation Networks

Shujian Zhang, Korawat Tanwisuth, Chengyue Gong et al.

ICML 2024

graph contrastive learningfast inferencemessage passingmlp-gnn coupling+3

#39

Efficient Contrastive Learning for Fast and Accurate Inference on Graphs

Teng Xiao, Huaisheng Zhu, Zhiwei Zhang et al.

ICML 2024