Gil Einziger

Senior Academic

Randomized admission policy for efficient top-k, frequency, and volume estimation

Ran Ben Basat, Xiaoqi Chen, Gil Einziger, Roy Friedman, Yaron Kassner

Network management protocols often require timely and meaningful insight about per flow network traffic. This paper introduces Randomized Admission Policy RAP -a novel algorithm for the frequency, top-k, and byte volume estimation problems, which are fundamental in network monitoring. We demonstrate space reductions compared to the alternatives, for the frequency estimation problem, by a factor of up to 32 on real packet traces and up to 128 on heavy-tailed workloads. For top-$k$ identification, RAP exhibits memory savings by a factor of between 4 and 64 depending on the workloads' skewness. These empirical results are backed by formal analysis, indicating the asymptotic space improvement of our probabilistic admission approach. In Addition, we present d-way RAP, a hardware friendly variant of RAP that empirically maintains its space and accuracy benefits.

Publication language English
Pages 1432-1445
Journal IEEE/ACM Transactions on Networking
Volume 27
Issue number 4
Publication status Published - 01.08.2019
3370594

Keywords

Algorithm design and analysis
Approximation algorithms

ASJC Scopus subject areas

Software
Computer Science Applications
Computer Networks and Communications
Electrical and Electronic Engineering
Access to Document
10.1109/TNET.2019.2918929
Other files and links
Link to publication in Scopus