All Stories

  1. Crowdsourcing or AI-Sourcing?

    Article • Communications of the ACM, March 2025, ACM (Association for Computing Machinery)

    Gianluca Demartini

  2. Optimizing LLMs with Direct Preferences: A Data Efficiency Perspective

    Article • December 2024, ACM (Association for Computing Machinery)

    Gianluca Demartini

  3. Hate Speech Detection with Generalizable Target-aware Fairness

    Article • August 2024, ACM (Association for Computing Machinery)

    Gianluca Demartini

  4. Understanding the Barriers to Running Longitudinal Studies on Crowdsourcing Platforms

    Article • ACM Transactions on Social Computing, July 2024, ACM (Association for Computing Machinery)

    Michael Soprano, Kevin Roitero, Gianluca Demartini

  5. Fairness without Sensitive Attributes via Knowledge Sharing

    Article • June 2024, ACM (Association for Computing Machinery)

    Gianluca Demartini

  6. How Good are LLMs in Generating Personalized Advertisements?

    Article • May 2024, ACM (Association for Computing Machinery)

    Gianluca Demartini

  7. Who Determines What Is Relevant? Humans or AI? Why Not Both?

    Article • Communications of the ACM, March 2024, ACM (Association for Computing Machinery)

    Gianluca Demartini

  8. Editorial: Special Issue on Human in the Loop Data Curation

    Article • Journal of Data and Information Quality, March 2024, ACM (Association for Computing Machinery)

    Gianluca Demartini, Jie Yang

  9. On the Impact of Showing Evidence from Peers in Crowdsourced Truthfulness Assessments

    Article • ACM Transactions on Information Systems, January 2024, ACM (Association for Computing Machinery)

    Gianluca Demartini

  10. Data Bias Management

    Article • Communications of the ACM, December 2023, ACM (Association for Computing Machinery)

    Gianluca Demartini, Kevin Roitero

  11. Perspectives on Large Language Models for Relevance Judgment

    Article • August 2023, ACM (Association for Computing Machinery)

    Guglielmo Faggioli, Gianluca Demartini, Prof. Noriko Kando

  12. On the Impact of Data Quality on Image Classification Fairness

    Article • July 2023, ACM (Association for Computing Machinery)

    Gianluca Demartini

  13. How Many Crowd Workers Do I Need? On Statistical Power When Crowdsourcing Relevance Judgments

    Article • ACM Transactions on Information Systems, May 2023, ACM (Association for Computing Machinery)

    Kevin Roitero, Gianluca Demartini, Michael Soprano

  14. Human-in-the-loop Regular Expression Extraction for Single Column Format Inconsistency

    Article • April 2023, ACM (Association for Computing Machinery)

    Gianluca Demartini

  15. The Community Notes Observatory: Can Crowdsourced Fact-Checking be Trusted in Practice?

    Article • April 2023, ACM (Association for Computing Machinery)

    Gianluca Demartini, Luca Righes

  16. Report on the 1st Workshop on Human-in-the-Loop Data Curation (HIL-DC 2022) at CIKM 2022

    Article • ACM SIGIR Forum, December 2022, ACM (Association for Computing Machinery)

    Gianluca Demartini

  17. A Data-Driven Analysis of Behaviors in Data Curation Processes

    Article • ACM Transactions on Information Systems, October 2022, ACM (Association for Computing Machinery)

    Gianluca Demartini

  18. Combining Human and Machine Confidence in Truthfulness Assessment

    Article • Journal of Data and Information Quality, July 2022, ACM (Association for Computing Machinery)

    Kevin Roitero, Gianluca Demartini, Damiano Spina

  19. Using Computers to Fact-Check Text and Justify the Decision

    Article • Journal of Data and Information Quality, July 2022, ACM (Association for Computing Machinery)

    Gianluca Demartini, Erik Brand, Michael Soprano

  20. Socio-Economic Diversity in Human Annotations

    Article • June 2022, ACM (Association for Computing Machinery)

    Gianluca Demartini

  21. Preferences on a Budget: Prioritizing Document Pairs when Crowdsourcing Relevance Judgments

    Article • April 2022, ACM (Association for Computing Machinery)

    Kevin Roitero, Gianluca Demartini

  22. Does Evidence from Peers Help Crowd Workers in Assessing Truthfulness?

    Article • April 2022, ACM (Association for Computing Machinery)

    Gianluca Demartini

  23. Effects of Technological Interventions for Self-regulation: A Control Experiment in Learnersourcing

    Article • March 2022, ACM (Association for Computing Machinery)

    Gianluca Demartini

  24. Hierarchical Clustering of Corals using Image Clustering

    Article • December 2021, ACM (Association for Computing Machinery)

    Gianluca Demartini

  25. An Analysis of the Australian Political Discourse in Sponsored Social Media Content

    Article • December 2021, ACM (Association for Computing Machinery)

    Gianluca Demartini

  26. On the State of Reporting in Crowdsourcing Experiments and a Checklist to Aid Current Practices

    Article • Proceedings of the ACM on Human-Computer Interaction, October 2021, ACM (Association for Computing Machinery)

    Gianluca Demartini

  27. Charting the Design and Analytics Agenda of Learnersourcing Systems

    Article • April 2021, ACM (Association for Computing Machinery)

    Gianluca Demartini

  28. Report on the first workshop on bias in automatic knowledge graph construction at AKBC 2020

    Article • ACM SIGIR Forum, December 2020, ACM (Association for Computing Machinery)

    Gianluca Demartini

  29. Modelling User Behavior Dynamics with Embeddings

    Article • October 2020, ACM (Association for Computing Machinery)

    Gianluca Demartini

  30. The COVID-19 Infodemic

    Article • October 2020, ACM (Association for Computing Machinery)

    Gianluca Demartini, Michael Soprano, Damiano Spina

  31. How to make crowd workers earn an hourly wage

    Article • Proceedings of the ACM on Human-Computer Interaction, October 2020, ACM (Association for Computing Machinery)

    Gianluca Demartini

  32. On Understanding Data Worker Interaction Behaviors

    Article • July 2020, ACM (Association for Computing Machinery)

    Gianluca Demartini

  33. Can The Crowd Identify Misinformation Objectively?

    Article • July 2020, ACM (Association for Computing Machinery)

    Michael Soprano, Gianluca Demartini, Damiano Spina

  34. Representation learning for entity type ranking

    Article • March 2020, ACM (Association for Computing Machinery)

    Gianluca Demartini

  35. Health Card Retrieval for Consumer Health Search

    Article • November 2019, ACM (Association for Computing Machinery)

    Gianluca Demartini

  36. On Transforming Relevance Scales

    Article • November 2019, ACM (Association for Computing Machinery)

    Gianluca Demartini

  37. Understanding Worker Moods and Reactions to Rejection in Crowdsourcing

    Article • September 2019, ACM (Association for Computing Machinery)

    Gianluca Demartini

  38. Quality Control Attack Schemes in Crowdsourcing

    Article • August 2019, International Joint Conferences on Artificial Intelligence

    Gianluca Demartini

  39. Health Cards for Consumer Health Search

    Article • July 2019, ACM (Association for Computing Machinery)

    Gianluca Demartini

  40. Implicit Bias in Crowdsourced Knowledge Graphs

    Article • May 2019, ACM (Association for Computing Machinery)

    Gianluca Demartini

  41. Scalpel-CD: Leveraging Crowdsourcing and Deep Probabilistic Modeling for Debugging Noisy Training Data

    Article • May 2019, ACM (Association for Computing Machinery)

    Gianluca Demartini

  42. Deadline-Aware Fair Scheduling for Multi-Tenant Crowd-Powered Systems

    Article • ACM Transactions on Social Computing, February 2019, ACM (Association for Computing Machinery)

    Gianluca Demartini

  43. All Those Wasted Hours

    Article • January 2019, ACM (Association for Computing Machinery)

    Gianluca Demartini, Ujwal Gadiraju

  44. Novel insights into views towards H1N1 during the 2009 Pandemic: a thematic analysis of Twitter data

    Article • Health Information & Libraries Journal, January 2019, Wiley

    Gianluca Demartini

  45. Non-parametric Class Completeness Estimators for Collaborative Knowledge Graphs—The Case of Wikidata

    Article • January 2019, Springer Science + Business Media

    Gianluca Demartini

  46. Semantic Interlinking

    Article • January 2019, Springer Science + Business Media

    Gianluca Demartini

  47. The Impact of Task Abandonment in Crowdsourcing

    Article • IEEE Transactions on Knowledge and Data Engineering, January 2019, Institute of Electrical & Electronics Engineers (IEEE)

    Gianluca Demartini

  48. The Evolution of Power and Standard Wikidata Editors: Comparing Editing Behavior over Time to Predict Lifespan and Volume of Edits

    Article • Computer Supported Cooperative Work (CSCW), December 2018, Springer Science + Business Media

    Gianluca Demartini

  49. Can User Behaviour Sequences Reflect Perceived Novelty?

    Article • October 2018, ACM (Association for Computing Machinery)

    Gianluca Demartini

  50. Moral Panic through the Lens of Twitter

    Article • July 2018, ACM (Association for Computing Machinery)

    Gianluca Demartini

  51. Investigating User Perception of Gender Bias in Image Search

    Article • June 2018, ACM (Association for Computing Machinery)

    Gianluca Demartini

  52. On Fine-Grained Relevance Scales

    Article • June 2018, ACM (Association for Computing Machinery)

    Gianluca Demartini

  53. On the Volatility of Commercial Search Engines and its Impact on Information Retrieval Research

    Article • June 2018, ACM (Association for Computing Machinery)

    Gianluca Demartini

  54. Crowd Anatomy Beyond the Good and Bad: Behavioral Traces for Crowd Worker Modeling and Pre-selection

    Article • Computer Supported Cooperative Work (CSCW), June 2018, Springer Science + Business Media

    Gianluca Demartini

  55. Measuring the Effect of Public Health Campaigns on Twitter: The Case of World Autism Awareness Day

    Article • January 2018, Springer Science + Business Media

    Gianluca Demartini

  56. Augmenting Intelligence with Humans-in-the-Loop (HumL@WWW2018) Chairs' Welcome & Organization

    Article • January 2018, ACM (Association for Computing Machinery)

    Prof. dr. Lora Aroyo, Anna Lisa Gentile, Christopher Welty, Gianluca Demartini

  57. Chapter 4: Using Twitter as a Data Source: An Overview of Ethical, Legal, and Methodological Challenges

    Article • December 2017, Emerald

    Gianluca Demartini

  58. Understanding Engagement through Search Behaviour

    Article • November 2017, ACM (Association for Computing Machinery)

    Gianluca Demartini

  59. Considering Assessor Agreement in IR Evaluation

    Article • October 2017, ACM (Association for Computing Machinery)

    Gianluca Demartini

  60. Modus Operandi of Crowd Workers

    Article • Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies, September 2017, ACM (Association for Computing Machinery)

    Gianluca Demartini

  61. An Introduction to Hybrid Human-Machine Information Systems

    Article • Foundations and Trends® in Web Science, January 2017, Now Publishers

    Gianluca Demartini

  62. Towards building a standard dataset for Arabic keyphrase extraction evaluation

    Article • November 2016, Institute of Electrical & Electronics Engineers (IEEE)

    Gianluca Demartini

  63. Scheduling Human Intelligence Tasks in Multi-Tenant Crowd-Powered Systems

    Article • April 2016, ACM (Association for Computing Machinery)

    Gianluca Demartini, Philippe Cudre-Mauroux

  64. Contextualized ranking of entity types based on knowledge graphs

    Article • Journal of Web Semantics, March 2016, Elsevier

    Gianluca Demartini

  65. A Tutorial on Leveraging Knowledge Graphs for Web Search

    Article • January 2016, Springer Science + Business Media

    Gianluca Demartini

  66. The Relationship Between User Perception and User Behaviour in Interactive Information Retrieval Evaluation

    Article • January 2016, Springer Science + Business Media

    Gianluca Demartini

  67. Hybrid human–machine information systems: Challenges and opportunities

    Article • Computer Networks, October 2015, Elsevier

    Gianluca Demartini

  68. Pooling-based continuous evaluation of information retrieval systems

    Article • Information Retrieval, September 2015, Springer Science + Business Media

    Gianluca Demartini

  69. Human Beyond the Machine: Challenges and Opportunities of Microtask Crowdsourcing

    Article • IEEE Intelligent Systems, July 2015, Institute of Electrical & Electronics Engineers (IEEE)

    Gianluca Demartini

  70. The Dynamics of Micro-Task Crowdsourcing

    Article • January 2015, ACM (Association for Computing Machinery)

    Gianluca Demartini

  71. Understanding Malicious Behavior in Crowdsourcing Platforms

    Article • January 2015, ACM (Association for Computing Machinery)

    Gianluca Demartini

  72. Correct Me If I'm Wrong

    Article • November 2014, ACM (Association for Computing Machinery)

    Gianluca Demartini

  73. B-hist: Entity-centric search over personal web browsing history

    Article • Journal of Web Semantics, August 2014, Elsevier

    Gianluca Demartini

  74. Hippocampus

    Article • April 2014, ACM (Association for Computing Machinery)

    Gianluca Demartini

  75. Effective named entity recognition for idiosyncratic web collections

    Article • January 2014, ACM (Association for Computing Machinery)

    Gianluca Demartini

  76. Entity disambiguation in tweets leveraging user social profiles

    Article • August 2013, Institute of Electrical & Electronics Engineers (IEEE)

    Gianluca Demartini

  77. Large-scale linked data integration using probabilistic reasoning and crowdsourcing

    Article • The VLDB Journal, July 2013, Springer Science + Business Media

    Gianluca Demartini

  78. NoizCrowd: A Crowd-Based Data Gathering and Management System for Noise Level Data

    Article • January 2013, Springer Science + Business Media

    Gianluca Demartini

  79. Ontology-Based Word Sense Disambiguation for Scientific Literature

    Article • January 2013, Springer Science + Business Media

    Gianluca Demartini

  80. TRank: Ranking Entity Types Using the Web of Data

    Article • January 2013, Springer Science + Business Media

    Gianluca Demartini

  81. The Bowlogna ontology: Fostering open curricula and agile knowledge bases for Europe's higher education landscape

    Article • Semantic Web, January 2013, IOS Press

    Gianluca Demartini

  82. ZenCrowd

    Article • April 2012, ACM (Association for Computing Machinery)

    Gianluca Demartini, Philippe Cudre-Mauroux

  83. BowlognaBench—Benchmarking RDF Analytics

    Article • January 2012, Springer Science + Business Media

    Gianluca Demartini

  84. Combining inverted indices and structured search for ad-hoc object retrieval

    Article • January 2012, ACM (Association for Computing Machinery)

    Gianluca Demartini

  85. Predicting the Future Impact of News Events

    Article • January 2012, Springer Science + Business Media

    Gianluca Demartini

  86. From people to entities

    Article • ACM SIGIR Forum, May 2011, ACM (Association for Computing Machinery)

    Gianluca Demartini

  87. Visual interfaces for stimulating exploratory search

    Article • January 2011, ACM (Association for Computing Machinery)

    Gianluca Demartini

  88. Report on INEX 2009

    Article • ACM SIGIR Forum, August 2010, ACM (Association for Computing Machinery)

    Gianluca Demartini

  89. Why finding entities in Wikipedia is difficult, sometimes

    Article • Information Retrieval, May 2010, Springer Science + Business Media

    Gianluca Demartini

  90. Leveraging personal metadata for Desktop search: The Beagle++ system

    Article • Journal of Web Semantics, March 2010, Elsevier

    Gianluca Demartini

  91. Dear search engine: what's your opinion about...?

    Article • January 2010, ACM (Association for Computing Machinery)

    Gianluca Demartini

  92. Entity summarization of news articles

    Article • January 2010, ACM (Association for Computing Machinery)

    Gianluca Demartini

  93. Exploiting click-through data for entity retrieval

    Article • January 2010, ACM (Association for Computing Machinery)

    Gianluca Demartini

  94. Overview of the INEX 2009 Entity Ranking Track

    Article • January 2010, Springer Science + Business Media

    Gianluca Demartini

  95. Ranking Entities Using Web Search Query Logs

    Article • January 2010, Springer Science + Business Media

    Gianluca Demartini

  96. TAER

    Article • January 2010, ACM (Association for Computing Machinery)

    Gianluca Demartini

  97. The missing links

    Article • January 2010, ACM (Association for Computing Machinery)

    Gianluca Demartini

  98. An Architecture for Finding Entities on the Web

    Article • November 2009, Institute of Electrical & Electronics Engineers (IEEE)

    Gianluca Demartini

  99. Report on INEX 2008

    Article • ACM SIGIR Forum, June 2009, ACM (Association for Computing Machinery)

    Gianluca Demartini

  100. A Vector Space Model for Ranking Entities and Its Application to Expert Search

    Article • January 2009, Springer Science + Business Media

    Gianluca Demartini

  101. How to Trace and Revise Identities

    Article • January 2009, Springer Science + Business Media

    Gianluca Demartini

  102. L3S at INEX 2008: Retrieving Entities Using Structured Information

    Article • January 2009, Springer Science + Business Media

    Gianluca Demartini

  103. Overview of the INEX 2008 Entity Ranking Track

    Article • January 2009, Springer Science + Business Media

    Gianluca Demartini

  104. A Model for Ranking Entities and Its Application to Wikipedia

    Article • October 2008, Institute of Electrical & Electronics Engineers (IEEE)

    Gianluca Demartini

  105. Social recommendations of content and metadata

    Article • January 2008, ACM (Association for Computing Machinery)

    Gianluca Demartini

  106. Leveraging semantic technologies for enterprise search

    Article • January 2007, ACM (Association for Computing Machinery)

    Gianluca Demartini

  107. A Classification of IR Effectiveness Metrics

    Article • January 2006, Springer Science + Business Media

    Gianluca Demartini

  108. L3S at INEX 2007: Query Expansion for Entity Ranking Using a Highly Accurate Ontology

    Article • Springer Science + Business Media

    Gianluca Demartini

  109. Ranking Categories for Web Search

    Article • Springer Science + Business Media

    Gianluca Demartini

  110. Semantically Enhanced Entity Ranking

    Article • Springer Science + Business Media

    Gianluca Demartini