https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY/Head
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY
http://www.nanopub.org/nschema#hasAssertion
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY/assertion
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY
http://www.nanopub.org/nschema#hasProvenance
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY/provenance
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY
http://www.nanopub.org/nschema#hasPublicationInfo
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY/pubinfo
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY
http://www.w3.org/1999/02/22-rdf-syntax-ns#type
http://www.nanopub.org/nschema#Nanopublication
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY/assertion
https://doi.org/10.1145/3360901.3364434
http://purl.org/dc/terms/abstract
Scientific publishing seems to be at a turning point. Its paradigm has stayed basically the same for 300 years but is now challenged by the increasing volume of articles that makes it very hard for scientists to stay up to date in their respective fields. In fact, many have pointed out serious flaws of current scientific publishing practices, including the lack of accuracy and efficiency of the reviewing process. To address some of these problems, we apply here the general principles of the Web and the Semantic Web to scientific publishing, focusing on the reviewing process. We want to determine if a fine-grained model of the scientific publishing workflow can help us make the reviewing processes better organized and more accurate, by ensuring that review comments are created with formal links and semantics from the start. Our contributions include a novel model called Linkflows that allows for such detailed and semantically rich representations of reviews and the reviewing processes. We evaluate our approach on a manually curated dataset from several recent Computer Science journals and conferences that come with open peer reviews. We gathered ground-truth data by contacting the original reviewers and asking them to categorize their own review comments according to our model. Comparing this ground truth to answers provided by model experts, peers, and automated techniques confirms that our approach of formally capturing the reviewers' intentions from the start prevents substantial discrepancies compared to when this information is later extracted from the plain-text comments. In general, our analysis shows that our model is well understood and easy to apply, and it revealed the semantic properties of such review comments.
https://doi.org/10.1145/3360901.3364434
http://purl.org/dc/terms/date
2019-09-23
https://doi.org/10.1145/3360901.3364434
http://purl.org/dc/terms/isPartOf
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY/kcap-2019
https://doi.org/10.1145/3360901.3364434
http://purl.org/dc/terms/title
Peer Reviewing Revisited: Assessing Research with Interlinked Semantic Comments
https://doi.org/10.1145/3360901.3364434
http://purl.org/ontology/bibo/authorList
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY/author-list
https://doi.org/10.1145/3360901.3364434
http://purl.org/ontology/bibo/pageEnd
187
https://doi.org/10.1145/3360901.3364434
http://purl.org/ontology/bibo/pageStart
179
https://doi.org/10.1145/3360901.3364434
http://www.w3.org/1999/02/22-rdf-syntax-ns#type
http://purl.org/spar/fabio/ConferencePaper
https://orcid.org/0000-0002-1267-0234
http://schema.org/affiliation
https://ror.org/008xxew50
https://orcid.org/0000-0002-1267-0234
http://xmlns.com/foaf/0.1/name
Tobias Kuhn
https://orcid.org/0000-0002-2241-8585
http://schema.org/affiliation
https://ror.org/008xxew50
https://orcid.org/0000-0002-2241-8585
http://xmlns.com/foaf/0.1/name
Cristina-Iulia Bucur
https://orcid.org/0000-0002-3357-9130
http://schema.org/affiliation
https://ror.org/00x7ekv49
https://orcid.org/0000-0002-3357-9130
http://xmlns.com/foaf/0.1/name
Davide Ceolin
https://ror.org/008xxew50
http://xmlns.com/foaf/0.1/name
Department of Computer Science, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
https://ror.org/00x7ekv49
http://xmlns.com/foaf/0.1/name
Centrum Wiskunde & Informatica, Amsterdam, Netherlands
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY/author-list
http://www.w3.org/1999/02/22-rdf-syntax-ns#_1
https://orcid.org/0000-0002-2241-8585
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY/author-list
http://www.w3.org/1999/02/22-rdf-syntax-ns#_2
https://orcid.org/0000-0002-1267-0234
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY/author-list
http://www.w3.org/1999/02/22-rdf-syntax-ns#_3
https://orcid.org/0000-0002-3357-9130
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY/kcap-2019
http://purl.org/dc/terms/title
Proceedings of the 10th International Conference on Knowledge Capture (K-CAP 2019)
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY/provenance
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY/assertion
http://www.w3.org/ns/prov#wasAttributedTo
https://orcid.org/0000-0002-1267-0234
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY/assertion
http://www.w3.org/ns/prov#wasAttributedTo
https://orcid.org/0000-0002-2241-8585
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY/assertion
http://www.w3.org/ns/prov#wasAttributedTo
https://orcid.org/0000-0002-3357-9130
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY/assertion
http://www.w3.org/ns/prov#wasDerivedFrom
https://doi.org/10.1145/3360901.3364434
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY/pubinfo
https://orcid.org/0000-0002-1267-0234
http://xmlns.com/foaf/0.1/name
Tobias Kuhn
https://orcid.org/0000-0002-2241-8585
http://xmlns.com/foaf/0.1/name
Cristina-Iulia Bucur
https://orcid.org/0000-0002-3357-9130
http://xmlns.com/foaf/0.1/name
Davide Ceolin
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY
http://purl.org/dc/terms/created
2026-02-22T17:32:05.000+01:00
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY
http://purl.org/dc/terms/creator
https://w3id.org/np/RAkkUz7qBJ-BIOCHV_4WCTgHCdTyI25_bnRuw166SXjwM/DOI-bot
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY
http://purl.org/dc/terms/license
https://creativecommons.org/publicdomain/zero/1.0/
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY
http://purl.org/nanopub/x/hasNanopubType
http://purl.org/spar/fabio/ScholarlyWork
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY
http://purl.org/nanopub/x/introduces
https://doi.org/10.1145/3360901.3364434
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY
http://www.w3.org/2000/01/rdf-schema#label
Peer Reviewing Revisited: Assessing Research with Interlinked Semantic Comments
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY/sig
http://purl.org/nanopub/x/hasAlgorithm
RSA
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY/sig
http://purl.org/nanopub/x/hasPublicKey
MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEArRL5MjH1KfuE89dpKsIiscF/THrJ4uSvhl0NgaC8x3TdTDrL00kCnlH+2g7PMYhaUQIGWq27TTXHAGp7ehO8yLjRNeDCc8zjUCQJqLbzay3DB51PCiz50OsMgxiZC1+e0bVdk/CAQV4oVo+VgI+awHI1bTT4Yp7pR2I67imf1PIcwczGVhn8EQwtNdWQOZ63wDgUCY+6IubHBQzjLfbYh0828UETEyIV28T7fvf5+y4A5M590InmgkLGpJbRXoL0pnCm1BtFOoxeAVqfivbxIZWPYN2Yd0cSfqwIIUYyaLFpjDrBwc4iJdOus4UQ9OYqkeZDMpU3opU8jWKDIm77jwIDAQAB
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY/sig
http://purl.org/nanopub/x/hasSignature
YhFqu5jFzcQJv/OR3a/Rdj9fWn0+av1LtZqkVFI09Pd00ouMqvw6u3rXkLdHGJ6dYyWA03mx+5Jdz2k+7lWXFPJYz9b941SW8Qrr+QCNKst/G8+QkT6nCmJFs81+sXHh/Q8J3lN7o1/J/D6ZAjXgU18pYx0cE88zMHZjhmj2E4J6HVGgmOcYwszWT1snKxArOnngCNY9W/kbCKsH81YEyYGrM3yMaiokrznzie1WZOKMWNZJtADe9kYvEODMpQKnlgAfJc5UGPt6idaW67HWwjwPqueUfZTQR1nIzRV+HextUVkjczzXGWh+xCXA+/qwZrOgiWUC4cNbke23rY66aQ==
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY/sig
http://purl.org/nanopub/x/hasSignatureTarget
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY
https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY/sig
http://purl.org/nanopub/x/signedBy
https://w3id.org/np/RAkkUz7qBJ-BIOCHV_4WCTgHCdTyI25_bnRuw166SXjwM/DOI-bot