[Paper Review] Extending search facilities via bibliometric-enhanced stratagems

Zeljko Carevic, Philipp Mayr|arXiv (Cornell University)|Mar 23, 2015

Information Retrieval and Search Behavior4 references3 citations

TL;DR

This paper proposes bibliometric-enhanced search stratagems—such as journal runs and citation searches—integrated into digital library interfaces to support complex information retrieval tasks. By leveraging metrics like impact factor and bibliographic coupling, the approach enhances traditional search strategies, enabling context-preserving and context-free ranking of results to improve usability for both novice and expert users.

ABSTRACT

The paper introduces simple bibliometric-enhanced search facilities which are derived from the famous stratagems by Bates. Moves, tactics and stratagems are revisited from a Digital Library perspective. The potential of extended versions of "journal run" or "citation search" for interactive information retrieval is outlined. The authors elaborate on the future implementation and evaluation of new bibliometric-enhanced search services.

Motivation & Objective

• To address the lack of predefined, user-friendly stratagem support in digital libraries like sowiport, which currently require manual query construction.
• To enhance interactive information retrieval by integrating bibliometric metrics (e.g., impact factor, h-index) into search stratagems.
• To support both context-preserving and context-free search modes that align with user tasks and domain-specific information needs.
• To propose and evaluate novel bibliometric-enhanced stratagems that improve retrieval quality and user engagement in digital libraries.

Proposed method

• Proposes two types of journal run stratagems: (1) extended journal run, which re-ranks results by journal impact factor or other bibliometric metrics, and (2) context-preserving journal run, which maintains prior search context when ranking documents within a selected journal.
• Introduces a citation analysis stratagem with three modes: (1) simple citation list, (2) bibliographic coupling-based ranking of citing documents, and (3) context-aware ranking based on semantic similarity between seed document and citations.
• Uses bibliometric indicators such as impact factor, h-index, and g-index to re-rank results in journal-based and citation-based stratagems.
• Employs context-aware ranking by preserving user-defined search context (e.g., query terms, filters) during stratagem execution to maintain relevance.
• Designs an interactive interface that exposes these stratagems as first-class search operations, reducing reliance on manual query composition.
• Outlines evaluation strategies including log-file analysis (e.g., session duration, follow-up actions like printing/bookmarking) and A/B testing with expert users.

Experimental results

Research questions

• RQ1 Which bibliometric-enhanced stratagems (e.g., journal runs, citation searches) are most effective in supporting complex information retrieval tasks in digital libraries?
• RQ2 How can context-preserving and context-free stratagems be implemented to maintain relevance while simplifying complex search workflows?
• RQ3 What bibliometric metrics (e.g., impact factor, h-index, bibliographic coupling) best improve retrieval quality and user satisfaction?
• RQ4 How can the acceptance and effectiveness of these stratagems be measured in real-world user scenarios?

Key findings

• Bibliometric-enhanced stratagems such as extended journal runs and context-preserving citation lists can be implemented using existing digital library data structures, including journal and citation metadata.
• Re-ranking results by journal impact factor or bibliographic coupling improves the relevance of retrieved documents by leveraging structural relationships in scholarly literature.
• Context-preserving stratagems maintain user search context, leading to more targeted and relevant result sets compared to generic re-ranking.
• Preliminary evaluation suggests that log-file analysis and A/B testing can effectively measure user engagement and acceptance of new stratagem features.
• Expert user studies are planned to identify the most useful stratagems and inform interface design for broader adoption.
• The integration of bibliometric metrics into stratagems offers a promising path to bridge the gap between expert search practices and novice usability in digital libraries.