Saeed Rahimi Gorji

• Gorji, Saeed Rahimi; Granmo, Ole-Christoffer & Goodwin, Morten (2023). Natural Language Modeling with the Tsetlin Machine. I Fujita, H. (Red.), Advances and Trends in Artificial Intelligence. Theory and Applications. IEA/AIE 2023. . Springer. ISSN 978-3-031-36821-9. s. 141–150. doi: 10.1007/978-3-031-36822-6_12.
• Gorji, Saeed Rahimi & Granmo, Ole-Christoffer (2023). Off-policy and on-policy reinforcement learning with the Tsetlin machine. Applied intelligence (Boston). ISSN 0924-669X. 53, s. 8596–8613. doi: 10.1007/s10489-022-04297-3. Vis sammendrag

  The Tsetlin Machine is a recent supervised learning algorithm that has obtained competitive accuracy- and resource usage results across several benchmarks. It has been used for convolution, classification, and regression, producing interpretable rules in propositional logic. In this paper, we introduce the first framework for reinforcement learning based on the Tsetlin Machine. Our framework integrates the value iteration algorithm with the regression Tsetlin Machine as the value function approximator. To obtain accurate off-policy state-value estimation, we propose a modified Tsetlin Machine feedback mechanism that adapts to the dynamic nature of value iteration. In particular, we show that the Tsetlin Machine is able to unlearn and recover from the misleading experiences that often occur at the beginning of training. A key challenge that we address is mapping the intrinsically continuous nature of state-value learning to the propositional Tsetlin Machine architecture, leveraging probabilistic updates. While accurate off-policy, this mechanism learns significantly slower than neural networks on-policy. However, by introducing multi-step temporal-difference learning in combination with high-frequency propositional logic patterns, we are able to close the performance gap. Several gridworld instances document that our framework can outperform comparable neural network models, despite being based on simple one-level AND-rules in propositional logic. Finally, we propose how the class of models learnt by our Tsetlin Machine for the gridworld problem can be translated into a more understandable graph structure. The graph structure captures the state-value function approximation and the corresponding policy found by the Tsetlin Machine.

• Abeyrathna, Kuruge Darshana; Bhattarai, Bimal; Goodwin, Morten; Gorji, Saeed Rahimi; Granmo, Ole-Christoffer & Lei, Jiao [Vis alle 8 forfattere av denne artikkelen] (2021). Massively Parallel and Asynchronous Tsetlin Machine Architecture Supporting Almost Constant-Time Scaling. Proceedings of Machine Learning Research (PMLR). ISSN 2640-3498. Fulltekst i vitenarkiv Vis sammendrag

  Using logical clauses to represent patterns, Tsetlin Machine (TM) have recently obtained competitive performance in terms of accuracy, memory footprint, energy, and learning speed on several benchmarks. Each TM clause votes for or against a particular class, with classification resolved using a majority vote. While the evaluation of clauses is fast, being based on binary operators, the voting makes it necessary to synchronize the clause evaluation, impeding parallelization. In this paper, we propose a novel scheme for desynchronizing the evaluation of clauses, eliminating the voting bottleneck. In brief, every clause runs in its own thread for massive native parallelism. For each training example, we keep track of the class votes obtained from the clauses in local voting tallies. The local voting tallies allow us to detach the processing of each clause from the rest of the clauses, supporting decentralized learning. This means that the TM most of the time will operate on outdated voting tallies. We evaluated the proposed parallelization across diverse learning tasks and it turns out that our decentralized TM learning algorithm copes well with working on outdated data, resulting in no significant loss in learning accuracy. Furthermore, we show that the approach provides up to 50 times faster learning. Finally, learning time is almost constant for reasonable clause amounts (employing from 20 to 7,000 clauses on a Tesla V100 GPU). For sufficiently large clause numbers, computation time increases approximately proportionally. Our parallel and asynchronous architecture thus allows processing of more massive datasets and operating with more clauses for higher accuracy.

• Gorji, Saeed Rahimi; Granmo, Ole-Christoffer & Wiering, Marco (2021). Explainable Reinforcement Learning with the Tsetlin Machine . I Fujita, Hamido (Red.), Advances and Trends in Artificial Intelligence. Artificial Intelligence Practices. Springer Nature. ISSN 978-3-030-79456-9.
• Gorji, Saeed Rahimi; Granmo, Ole-Christoffer; Glimsdal, Sondre; Edwards, Jonathan & Goodwin, Morten (2020). Increasing the Inference and Learning Speed of Tsetlin Machines with Clause Indexing, Trends in Artificial Intelligence Theory and Applications. Artificial Intelligence Practices.. Springer Nature. ISSN 978-3-030-55789-8. s. 695–708. doi: 10.1007/978-3-030-55789-8_60.
• Gorji, Saeed Rahimi; Granmo, Ole-Christoffer; Phoulady, Adrian & Goodwin, Morten (2019). A Tsetlin Machine with Multigranular Clauses. Lecture Notes in Computer Science (LNCS). ISSN 0302-9743. doi: 10.1007/978-3-030-34885-4_11. Vis sammendrag

  The recently introduced Tsetlin Machine (TM) has provided competitive pattern recognition accuracy in several benchmarks, however, requires a 3-dimensional hyperparameter search. In this paper, we introduce the Multigranular Tsetlin Machine (MTM). The MTM eliminates the specificity hyperparameter, used by the TM to control the granularity of the conjunctive clauses that it produces for recognizing patterns. Instead of using a fixed global specificity, we encode varying specificity as part of the clauses, rendering the clauses multigranular. This makes it easier to configure the TM because the dimensionality of the hyperparameter search space is reduced to only two dimensions. Indeed, it turns out that there is significantly less hyperparameter tuning involved in applying the MTM to new problems. Further, we demonstrate empirically that the MTM provides similar performance to what is achieved with a finely specificity-optimized TM, by comparing their performance on both synthetic and real-world datasets.

Se alle arbeider i Cristin