A preliminary study on similarity-preserving digital book identifiers

Klemo Vladimir; Marin Silic; Nenad Romic; Goran Delac; Sinisa Srbljic

doi:10.18653/v1/W15-3712

A preliminary study on similarity-preserving digital book identifiers

Klemo Vladimir, Marin Silic, Nenad Romic, Goran Delac, Sinisa Srbljic

University of Zagreb

Research output: Chapter in Book/Report/Conference proceeding › Chapter › peer-review

Abstract

Due to proliferation of digital publishing, e-book catalogs are abundant but noisy and unstructured. Tools for the digital librarian rely on ISBN, metadata embedded into digital files (without accepted standard) and cryptographic hash functions for the identification of coderivative or nearduplicate content. However, unreliability of metadata and sensitivity of hashing to
even smallest changes prevents efficient detection of coderivative or similar digital books. Focus of the study are books with many versions that differ in certain amount of OCR errors and have a number of sentence-length variations. Identification of similar books is performed using small-sized fingerprints that can be easily shared and compared. We created synthetic datasets to evaluate fingerprinting accuracy while providing standard precision and recall measurements.

Original language	English
Title of host publication	Proceedings of the 9th SIGHUM Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities (LaTeCH)
Publisher	Association for Computational Linguistics
Pages	78-83
Number of pages	6
DOIs	https://doi.org/10.18653/v1/W15-3712
Publication status	Published - Jul 2015
Event	9th SIGHUM Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities - Beijing, China Duration: 30 Jul 2015 → 30 Jul 2015 https://www.aclweb.org/portal/content/9th-sighum-workshop-language-technology-cultural-heritage-social-sciences-and-humanities

Conference

Conference	9th SIGHUM Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities
Abbreviated title	LaTeCH 2015
Country/Territory	China
City	Beijing
Period	30/07/15 → 30/07/15
Internet address	https://www.aclweb.org/portal/content/9th-sighum-workshop-language-technology-cultural-heritage-social-sciences-and-humanities

Access to Document

10.18653/v1/W15-3712Licence: CC BY

http://aclweb.org/anthology/W15-3712Licence: CC BY

Cite this

A preliminary study on similarity-preserving digital book identifiers. / Vladimir, Klemo; Silic, Marin; Romic, Nenad et al.
Proceedings of the 9th SIGHUM Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities (LaTeCH). Association for Computational Linguistics, 2015. p. 78-83.

Research output: Chapter in Book/Report/Conference proceeding › Chapter › peer-review

Vladimir, K, Silic, M, Romic, N, Delac, G & Srbljic, S 2015, A preliminary study on similarity-preserving digital book identifiers. in Proceedings of the 9th SIGHUM Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities (LaTeCH). Association for Computational Linguistics, pp. 78-83, 9th SIGHUM Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities, Beijing, China, 30/07/15. https://doi.org/10.18653/v1/W15-3712

@inbook{0236db8f3fb1489f827e5bbd329f2c59,

title = "A preliminary study on similarity-preserving digital book identifiers",

abstract = "Due to proliferation of digital publishing, e-book catalogs are abundant but noisy and unstructured. Tools for the digital librarian rely on ISBN, metadata embedded into digital files (without accepted standard) and cryptographic hash functions for the identification of coderivative or nearduplicate content. However, unreliability of metadata and sensitivity of hashing toeven smallest changes prevents efficient detection of coderivative or similar digital books. Focus of the study are books with many versions that differ in certain amount of OCR errors and have a number of sentence-length variations. Identification of similar books is performed using small-sized fingerprints that can be easily shared and compared. We created synthetic datasets to evaluate fingerprinting accuracy while providing standard precision and recall measurements.",

author = "Klemo Vladimir and Marin Silic and Nenad Romic and Goran Delac and Sinisa Srbljic",

year = "2015",

month = jul,

doi = "10.18653/v1/W15-3712",

language = "English",

pages = "78--83",

booktitle = "Proceedings of the 9th SIGHUM Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities (LaTeCH)",

publisher = "Association for Computational Linguistics",

address = "United States",

note = "9th SIGHUM Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities, LaTeCH 2015 ; Conference date: 30-07-2015 Through 30-07-2015",

url = "https://www.aclweb.org/portal/content/9th-sighum-workshop-language-technology-cultural-heritage-social-sciences-and-humanities",

}

TY - CHAP

T1 - A preliminary study on similarity-preserving digital book identifiers

AU - Vladimir, Klemo

AU - Silic, Marin

AU - Romic, Nenad

AU - Delac, Goran

AU - Srbljic, Sinisa

PY - 2015/7

Y1 - 2015/7

N2 - Due to proliferation of digital publishing, e-book catalogs are abundant but noisy and unstructured. Tools for the digital librarian rely on ISBN, metadata embedded into digital files (without accepted standard) and cryptographic hash functions for the identification of coderivative or nearduplicate content. However, unreliability of metadata and sensitivity of hashing toeven smallest changes prevents efficient detection of coderivative or similar digital books. Focus of the study are books with many versions that differ in certain amount of OCR errors and have a number of sentence-length variations. Identification of similar books is performed using small-sized fingerprints that can be easily shared and compared. We created synthetic datasets to evaluate fingerprinting accuracy while providing standard precision and recall measurements.

AB - Due to proliferation of digital publishing, e-book catalogs are abundant but noisy and unstructured. Tools for the digital librarian rely on ISBN, metadata embedded into digital files (without accepted standard) and cryptographic hash functions for the identification of coderivative or nearduplicate content. However, unreliability of metadata and sensitivity of hashing toeven smallest changes prevents efficient detection of coderivative or similar digital books. Focus of the study are books with many versions that differ in certain amount of OCR errors and have a number of sentence-length variations. Identification of similar books is performed using small-sized fingerprints that can be easily shared and compared. We created synthetic datasets to evaluate fingerprinting accuracy while providing standard precision and recall measurements.

U2 - 10.18653/v1/W15-3712

DO - 10.18653/v1/W15-3712

M3 - Chapter

SP - 78

EP - 83

BT - Proceedings of the 9th SIGHUM Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities (LaTeCH)

PB - Association for Computational Linguistics

T2 - 9th SIGHUM Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities

Y2 - 30 July 2015 through 30 July 2015

ER -

A preliminary study on similarity-preserving digital book identifiers

Abstract

Conference

Access to Document

Fingerprint

Cite this