Alexandre Yakovlev

• Bhattarai, Bimal; Granmo, Ole-Christoffer; Lei, Jiao; Andersen, Per-Arne; Tunheim, Svein Anders & Shafik, Rishad Ahmed [Show all 7 contributors for this article] (2023). Contracting Tsetlin Machine with Absorbing Automata, 2023 International Symposium on the Tsetlin Machine (ISTM). IEEE conference proceedings. ISSN 979-8-3503-4477-6. doi: 10.1109/ISTM58889.2023.10455040.
• Tarasyuk, Olga; Rahman, Tousif; Shafik, Rishad Ahmed; Yakovlev, Alexandre; Gorbenko, Anatoliy & Granmo, Ole-Christoffer [Show all 7 contributors for this article] (2023). Systematic Search for Optimal Hyper-parameters of the Tsetlin Machine on MNIST Dataset, 2023 International Symposium on the Tsetlin Machine (ISTM). IEEE conference proceedings. ISSN 979-8-3503-4477-6. doi: 10.1109/ISTM58889.2023.10454969.
• Tunheim, Svein Anders; Lei, Jiao; Shafik, Rishad Ahmed; Yakovlev, Alexandre & Granmo, Ole-Christoffer (2023). Convolutional Tsetlin Machine-based Training and Inference Accelerator for 2-D Pattern Classification. Microprocessors and Microsystems: Embedded Hardware Design (MICPRO). ISSN 0141-9331. 103. doi: 10.1016/j.micpro.2023.104949. Full text in Research Archive Show summary

  The Tsetlin Machine (TM) is a machine learning algorithm based on an ensemble of Tsetlin Automata (TAs) that learns propositional logic expressions from Boolean input features. In this paper, the design and implementation of a Field Programmable Gate Array (FPGA) accelerator based on the Convolutional Tsetlin Machine (CTM) is presented. The accelerator performs classification of two pattern classes in 4 × 4 Boolean images with a 2 × 2 convolution window. Specifically, there are two separate TMs, one per class. Each TM comprises 40 propositional logic formulas, denoted as clauses, which are conjunctions of literals. Include/exclude actions from the TAs determine which literals are included in each clause. The accelerator supports full training, including random patch selection during convolution based on parallel reservoir sampling across all clauses. The design is implemented on a Xilinx Zynq XC7Z020 FPGA platform. With an operating clock speed of 40 MHz, the accelerator achieves a classification rate of 4.4 million images per second with an energy per classification of 0.6 J. The mean test accuracy is 99.9% when trained on the 2-dimensional Noisy XOR dataset with 40% noise in the training labels. To achieve this performance, which is on par with the original software implementation, Linear Feedback Shift Register (LFSR) random number generators of minimum 16 bits are required. The solution demonstrates the core principles of a CTM and can be scaled to operate on multi-class systems for larger images.

• Tunheim, Svein Anders; Lei, Jiao; Shafik, Rishad Ahmed; Yakovlev, Alexandre & Granmo, Ole-Christoffer (2022). A Convolutional Tsetlin Machine-based Field Programmable Gate Array Accelerator for Image Classification. In Shafik, Rishad (Eds.), 2022 International Symposium on the Tsetlin Machine (ISTM 2022). IEEE conference proceedings. ISSN 978-1-6654-7116-9. p. 21–28. doi: 10.1109/ISTM54910.2022.00013. Show summary

  This paper presents a Field Programmable Gate Array (FPGA) implementation of an image classification accelerator based on the Convolutional Tsetlin Machine (CTM). The work is a concept design, and the solution demonstrates recognition of two classes in 4 × 4 images with a 2 × 2 convolution window. More specifically, there are two sub-Tsetlin Machines (TMs), one per class. A single sub-TM employs 40 clauses, each controlled by 20 Tsetlin Automata. The accelerator features random patch selection, in parallel for all clauses, based on reservoir sampling. The design is implemented in a Xilinx Zync XC7Z020 FPGA. With an operating clock speed of 30 MHz, the accelerator is capable of inferring at the rate of 3.3 million images per second with an additional power consumption of 20 mW from idle mode. The average test accuracy is 96.7% when trained on data with 10% noise. A training session with 100 epochs and 8192 examples takes 1.5 seconds. Due to the limited hardware resources required, the CTM accelerator represents a promising concept for online learning in energy-frugal systems. The solution can be scaled to multi-class systems and larger images.

View all works in Cristin