[论文解读] Fast IDS Computing System Method and its Memristor Crossbar-based Hardware Implementation

Sajad Haghzad Klidbary, Saeed Bagheri Shouraki+1 more|arXiv (Cornell University)|Feb 22, 2016

Advanced Memory and Neural Computing参考文献 23被引用 5

一句话总结

本文提出了一种新型的快速 IDS 计算系统方法，用数学建模函数替代计算成本高昂的油滴扩散（IDS）算子，显著降低内存占用和计算成本。该方法实现了高效的忆阻器交叉阵列实现，将所需忆阻器数量从 O(n²) 减少至 O(3n)，并实现了高速、低功耗运行，适用于聚类和函数逼近等实时应用。

ABSTRACT

Active Learning Method (ALM) is one of the powerful tools in soft computing that is inspired by human brain capabilities in processing complicated information. ALM, which is in essence an adaptive fuzzy learning method, models a Multi-Input Single-Output (MISO) system with several Single-Input Single-Output (SISO) subsystems. Ink Drop Spread (IDS) operator, which is the main processing engine of this method, extracts useful features from the data without complicated computations and provides stability and convergence as well. Despite great performance of ALM in applications such as classification, clustering, and modelling, an efficient hardware implementation has remained a challenging problem. Large amount of memory required to store the information of IDS planes as well as the high computational cost of the IDS computing system are two main barriers to ALM becoming more popular. In this paper, a novel learning method is proposed based on the idea of IDS, but with a novel approach that eliminates the computational cost of IDS operator. Unlike traditional approaches, our proposed method finds functions to describe the IDS plane that eliminates the need for large amount of memory to a great extent. Narrow Path and Spread, which are two main features used in the inference engine of ALM, are then extracted from IDS planes with minimum amount of memory usage and power consumption. Our proposed algorithm is fully compatible with memristor-crossbar implementation that leads to a significant decrease in the number of required memristors (from O(n^2) to O(3n)). Simpler algorithm and higher speed make our algorithm suitable for applications where real-time process, low-cost and small implementation are paramount. Applications in clustering and function approximation are provided, which reveals the effective performance of our proposed algorithm.

研究动机与目标

• 解决传统主动学习方法（ALM）中使用油滴扩散（IDS）算子带来的高内存和高计算成本问题。
• 克服由于内存需求大和处理速度慢导致 ALM 难以在硬件上部署的障碍。
• 开发一种数学建模的 IDS 平面表示方法，消除对完整 IDS 平面存储的需求。
• 实现在忆阻器交叉阵列上的高效实现，以支持低功耗、高速度的实时计算。
• 在保持系统性能的前提下，将忆阻器数量从 O(n²) 显著减少至 O(3n)。

提出的方法

• 用能够建模 IDS 行为的闭式数学函数替代传统的 IDS 平面计算。
• 在新模型中保留窄路径和扩散特征——这些是推理的关键——以维持系统稳定性和收敛性。
• 通过解析函数推导 IDS 平面的参数化表示，避免大规模内存存储。
• 设计算法以完全兼容忆阻器交叉阵列架构，提升硬件效率。
• 通过减少冗余计算，优化系统以实现最低功耗和最高速度处理。
• 使用忆阻器交叉阵列实现系统，利用其固有的内存内计算特性，提升速度和能效。

实验结果

研究问题

• RQ1 能否用数学建模函数替代 IDS 算子，从而消除对大型 IDS 平面存储的需求？
• RQ2 如何在不牺牲准确性或稳定性的前提下，降低 IDS 计算系统的计算成本和内存占用？
• RQ3 在多大程度上可以利用忆阻器交叉阵列架构高效实现所提出的 IDS 方法？
• RQ4 与传统方法相比，新方法在忆阻器数量上可实现的理论和实际减少量是多少？
• RQ5 所提出的方法在聚类和函数逼近等实时应用中的表现如何？

主要发现

• 所提方法将所需忆阻器数量从 O(n²) 减少至 O(3n)，显著提升了硬件效率。
• 对 IDS 平面的数学建模消除了对完整 IDS 平面存储的需求，大幅降低内存使用。
• 由于计算简化和在忆阻器交叉阵列上的直接硬件映射，系统实现了高速运行。
• 该方法保持了原始 ALM 使用 IDS 算子时的关键特性：系统稳定性和收敛性。
• 在聚类和函数逼近等应用中，系统表现出有效性能，且功耗和成本较低。
• 该算法完全兼容忆阻器交叉阵列实现，支持可扩展且能效高的部署。