University of Twente Student Theses

Login

Efficient inference with accuracy-preserved integer encoding on tree-based model compiler

Lok, J. (2024) Efficient inference with accuracy-preserved integer encoding on tree-based model compiler.

[img] PDF
465kB
Abstract:In the ever expanding world of machine learning, where advancements continually push the boundaries of what's possible, the efficiency of deploying tree-based ensembles is often a point of interest. Renowned for their interpretability and minimal training data requirements, models such as random forests and extremely random forests have been found as effective tools across many different industries. In this paper, we integrate FLInt, a promising accuracy-preserving technique for accelerating inference speed, into the established TL2cgen framework. Through experimental analysis conducted on both x86 and ARM devices, we empirically demonstrate that FLInt consistently outperforms the baseline across a range of maximum tree depths. Additionally, we examine an established optimization technique, Quantization. However, our findings reveal that Quantization yielded mediocre results, often resulting in slowed inference times across most scenarios.
Item Type:Essay (Bachelor)
Faculty:EEMCS: Electrical Engineering, Mathematics and Computer Science
Subject:54 computer science
Programme:Electrical Engineering BSc (56953)
Link to this item:https://purl.utwente.nl/essays/99075
Export this item as:BibTeX
EndNote
HTML Citation
Reference Manager

 

Repository Staff Only: item control page