CITATION VISIBILITY VS. CITATION REALITY
(A Case Study of Google Scholar Limitations in Southeastern European Academic Publications)
Željko Stanojević
Institute for Hebrew Language and Literature, Belgrade
Independent Researcher in Hebrew Linguistics and Biblical Philology
ORCID: https://orcid.org/0009-0009-0717-6184
Full PDF Download
Abstract
This study examines the discrepancy between actual scholarly use and algorithmically detected citation counts within contemporary academic indexing systems, with particular emphasis on Google Scholar. Although Google Scholar provides exceptionally broad coverage across disciplines, publication types, and languages, its citation-detection mechanisms depend heavily on automated textual parsing, document structure, metadata consistency, and technical accessibility.
Using a corpus of publications in Hebrew linguistics, Biblical philology, Semitic studies, and related disciplines, the paper investigates how citations appearing in Southeastern European academic publications are frequently underrepresented or remain entirely undetected. Particular attention is given to citations found in doctoral dissertations, university curricula, peer-reviewed articles, edited volumes, scanned publications, multilingual documents, and non-standard bibliographic environments.
The methodological approach combines bibliographic verification, repository-based research, and technical analysis of PDF structure, OCR quality, metadata, author-name variation, reference formatting, and multilingual or multiscript citation practices. The study distinguishes between detected citations, undetected but independently verifiable citations, and the genuine absence of citations.
The findings demonstrate that citation visibility in Google Scholar cannot always be treated as a direct measurement of scholarly influence. Instead, visible citation counts frequently reflect the degree to which publications and citing documents are technically compatible with automated indexing systems. The paper therefore proposes a hybrid model of citation assessment combining automated metrics with repository verification and manual bibliographic validation.
Description
The present study investigates the difference between citation reality—the actual presence of a scholarly reference in an academic document—and citation visibility—the successful identification and attribution of that reference by an automated indexing system.
Google Scholar is widely used for evaluating scholarly impact because it indexes a broad range of journal articles, books, dissertations, conference papers, institutional documents, and repository materials. However, its automated citation-detection procedures may fail when references appear in technically complex or non-standardized documents.
This problem is particularly significant for academic publications from Southeastern Europe. Such materials may contain multiple languages and writing systems, non-standard bibliographies, footnote-based references, scanned pages, incomplete metadata, inconsistent transliteration, and variations in the spelling of author names and publication titles.
The paper analyzes documented examples involving publications in Hebrew linguistics, Biblical studies, theology, lexicography, translation studies, and comparative linguistics. It examines citations found in university syllabi, doctoral dissertations, academic journals, monographs, and interdisciplinary publications that are not consistently reflected in Google Scholar citation counts.
Special attention is devoted to the technical mechanisms that produce citation invisibility. These include defective or absent OCR text layers, incorrect recognition of Serbian diacritics, fragmented author names, inconsistent bibliographic entries, references placed only in footnotes, variations between Latin and Cyrillic scripts, translated titles, and missing DOI or repository metadata.
The study also includes a control case involving a publication for which no independently verifiable academic citations were found. This methodological distinction demonstrates that low citation counts may result either from genuine absence of scholarly reception or from technical failures in automated citation detection.
By distinguishing citation visibility from citation reality, this research contributes to bibliometrics, digital humanities, research evaluation, information science, and the study of regional academic publishing. It argues that responsible evaluation of scholarly influence should combine algorithmic indicators with direct examination of academic sources and institutional repositories.
Keywords
Google Scholar; Citation visibility; Citation reality; Bibliometrics; Citation analysis; Academic indexing; Research evaluation; Scholarly impact; Southeastern Europe; Digital humanities; Optical character recognition; OCR; Academic metadata; Citation detection; Institutional repositories; Multilingual publications; Biblical philology; Hebrew linguistics
Research Areas
Bibliometrics; Citation Analysis; Information Science; Digital Humanities; Research Evaluation; Academic Publishing; Hebrew Linguistics; Biblical Philology; Southeastern European Studies
Citation
Stanojević, Željko.
Citation Visibility vs. Citation Reality: A Case Study of Google Scholar Limitations in Southeastern European Academic Publications.
Belgrade: Institute for Hebrew Language and Literature, 2026.
DOI: https://doi.org/10.5281/zenodo.20123013
Related Works
Stanojević, Ž. Hebrejsko-srpski rečnik. Beograd: Rad; Alfa i Omega, 2001.
DOI: https://doi.org/10.5281/zenodo.19176975
Stanojević, Ž. Kumranski spisi: dokaz verodostojnosti Biblije. Beograd, 2009.
Full text: https://zenodo.org/records/19175087
Stanojević, Ž. O jeziku Srba i Jevreja: trojako prisustvo Jevreja među Slovenima – međusobni uticaji severozapadnih semitskih i slovenskih jezika. Beograd, 2001.
DOI: https://doi.org/10.5281/zenodo.19177576
Additional Information
Language: English
Type: Research Article
Methodology: Bibliometric analysis; Repository-based verification; Document-structure analysis; Manual citation validation
Geographical Focus: Southeastern Europe
Core Concepts: Citation visibility; Citation reality; Google Scholar limitations; automated citation detection; OCR quality; metadata consistency; multilingual citation practices; research evaluation; scholarly impact