[Paper Review] Toward Standardized Performance Evaluation of Flow-guided Nanoscale Localization

Arnau Brosa López, Filip Lemić+10 more|arXiv (Cornell University)|Mar 14, 2023

Molecular Communication and Nanonetworks4 citations

TL;DR

This paper proposes a standardized performance evaluation framework for flow-guided nanoscale localization using THz communication in the bloodstream. The open-source simulator models nanodevice mobility, THz communication, energy harvesting, and pulse-based modulation to generate objective benchmarks, revealing that current solutions achieve at most 40% region detection accuracy due to unreliable communication and intermittent operation.

ABSTRACT

Nanoscale devices with Terahertz (THz) communication capabilities are envisioned to be deployed within human bloodstreams. Such devices will enable fine-grained sensing-based applications for detecting early indications (i.e., biomarkers) of various health conditions, as well as actuation-based ones such as targeted drug delivery. Associating the locations of such events with the events themselves would provide an additional utility for precision diagnostics and treatment. This vision yielded a new class of in-body localization coined under the term "flow-guided nanoscale localization". Such localization can be piggybacked on THz communication for detecting body regions in which biological events were observed based on the duration of one circulation of a nanodevice in the bloodstream. From a decades-long research on objective benchmarking of "traditional" indoor localization, as well as its eventual standardization (e.g., ISO/IEC 18305:2016), we know that in early stages the reported performance results were often incomplete (e.g., targeting a subset of relevant performance metrics), carrying out benchmarking experiments in different evaluation environments and scenarios, and utilizing inconsistent performance indicators. To avoid such a "lock-in" in flow-guided localization, in this paper we propose a workflow for standardized performance evaluation of such localization. The workflow is implemented in the form of an open-source simulation framework that is able to jointly account for the mobility of the nanodevices, in-body THz communication between with on-body anchors, and energy-related and other technological constraints (e.g., pulse-based modulation) at the nanodevice level. Accounting for these constraints, the framework is able to generate the raw data that can be streamlined into different flow-guided localization solutions for generating standardized performance benchmarks.

Motivation & Objective

• To address the lack of objective, comparable performance evaluation in early-stage flow-guided nanoscale localization research.
• To prevent the pitfalls seen in early indoor localization research, such as inconsistent metrics, environments, and performance indicators.
• To establish a common evaluation framework using standardized scenarios, metrics, and environments for fair comparison of localization solutions.
• To model realistic constraints including THz communication range, energy harvesting, intermittent operation, and mobility in blood flow.
• To enable the community to benchmark and improve flow-guided localization solutions objectively through a reusable, open-source simulator.

Proposed method

• Develop a simulation workflow that integrates nanodevice mobility in the bloodstream with in-body THz communication to on-body anchors.
• Model energy harvesting and intermittent operation of nanodevices using ZnO nanowires and pulse-based modulation.
• Implement a framework that generates raw data for multiple localization solutions under consistent conditions.
• Use a modified approach from prior work to simulate event detection, including region-based localization with left/right ambiguity resolution.
• Streamline results into standardized performance metrics such as reliability, region detection accuracy, and point accuracy with centroid-based estimation.
• Incorporate time-dependent energy level tracking to support energy-aware task scheduling and optimization.

Figure 1: Nanodevice mobility in the BloodVoyagerS [ 13 ]

Experimental results

Research questions

• RQ1 How can standardized performance evaluation be established for flow-guided nanoscale localization to enable objective comparison?
• RQ2 What impact do unreliable THz communication and energy-harvesting constraints have on localization accuracy?
• RQ3 How does localization delay affect reliability and accuracy in a flow-guided scenario?
• RQ4 To what extent do mobility and path variability lead to missed event detections despite circulation through the target region?
• RQ5 How can performance metrics like region detection accuracy and point accuracy be meaningfully reported when region detection is unreliable?

Key findings

• Region detection accuracy for the evaluated solution is at most 40%, with only a marginal improvement as localization delay increases.
• Reliability of localization increases from below 50% to over 90% when delay increases from 2 to 15 minutes, indicating a strong dependence on observation time.
• Point accuracy is depicted even for incorrectly detected regions, highlighting a methodological flaw in prior benchmarking practices that can mislead performance interpretation.
• The time-dependent energy level of a nanonode shows intermittent operation due to energy-harvesting constraints, affecting sensing and transmission availability.
• Unreliable THz communication and intermittent operation are the primary causes of poor localization performance in the evaluated scenario.
• The proposed framework successfully captures realistic system dynamics and enables objective, repeatable benchmarking across different localization solutions.

Figure 2: Categorization of RF-based in-body localization approaches, corresponding applications, their requirements, and relevant performance metrics