Dr. Gianluca Demartini is an Associate Professor in Data Science at the University of Queensland, Australia. His main research interests include Information Retrieval, Semantic Web, and Human Computation. His research is currently funded by the Australian Research Council, Facebook, and Google. He received Best Paper awards at the AAAI Conference on Human Computation and Crowdsourcing (HCOMP) in 2018, at the European Conference on Information Retrieval (ECIR) in 2016 and 2020, and the Best Demo award at the International Semantic Web Conference (ISWC) in 2011. He has published more than 150 peer-reviewed scientific publications including papers at major venues such as WWW, ACM SIGIR, VLDBJ, ISWC, and ACM CHI. He is an ACM Senior Member, ACM Distinguished Speaker, TEDx speaker, and CIKM 2021 General co-chair.
Before joining the University of Queensland, he was Lecturer at the University of Sheffield in UK, post-doctoral researcher at the eXascale Infolab at the University of Fribourg in Switzerland, visiting researcher at UC Berkeley, junior researcher at the L3S Research Center in Germany, and intern at Yahoo! Research in Spain. In 2011, he obtained a Ph.D. in Computer Science at the Leibniz University of Hanover focusing on Semantic Search.
The research led by A/Prof. Demartini focuses on improving the efficiency and effectiveness of human-in-the-loop artificial intelligence systems. The application domains of his research include text analytics and the intersection between structured (e.g., knowledge graphs) and unstructured (e.g., text) digital content. During his research career he has collaborated with colleagues from several industry and governmental organizations like for example, Facebook, Google, Microsoft, Yahoo!, IBM, SAP, and The National Archives in the UK.
Conference Publication: Preferences on a budget: prioritizing document pairs when crowdsourcing relevance judgments
Roitero, Kevin, Checco, Alessandro, Mizzaro, Stefano and Demartini, Gianluca (2022). Preferences on a budget: prioritizing document pairs when crowdsourcing relevance judgments. ACM Web Conference, Virtual/Lyon, France, 25-29 April 2022. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3485447.3511960
Conference Publication: Modelling User Behavior Dynamics with Embeddings
Han, Lei, Checco, Alessandro, Difallah, Djellel, Demartini, Gianluca and Sadiq, Shazia (2020). Modelling User Behavior Dynamics with Embeddings. 29th ACM International Conference on Information & Knowledge Management, Online, 19-23 October 2020. New York, NY United States: Association for Computing Machinery. doi: 10.1145/3340531.3411985
Journal Article: CrowdCO-OP: sharing risks and rewards in crowdsourcing
Fan, Shaoyang, Gadiraju, Ujwal, Checco, Alessandro and Demartini, Gianluca (2020). CrowdCO-OP: sharing risks and rewards in crowdsourcing. Proceedings of the ACM on Human-Computer Interaction, 4 (CSCW2) 132, 1-24. doi: 10.1145/3415203
Conference Publication: Can the crowd identify misinformation objectively?: The effects of judgment scale and assessor's background
Roitero, Kevin, Soprano, Michael, Fan, Shaoyang, Spina, Damiano, Mizzaro, Stefano and Demartini, Gianluca (2020). Can the crowd identify misinformation objectively?: The effects of judgment scale and assessor's background. International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, China, 25-30 July 2020. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3397271.3401112
Journal Article: Adversarial attacks on crowdsourcing quality control
Checco, Alessandro, Bates, Jo and Demartini, Gianluca (2020). Adversarial attacks on crowdsourcing quality control. Journal of Artificial Intelligence Research, 67, 375-408. doi: 10.1613/jair.1.11332
Conference Publication: Crowd worker strategies in relevance judgment tasks
Han, Lei, Maddalena, Eddy, Checco, Alessandro, Sarasua, Cristina, Gadiraju, Ujwal, Roitero, Kevin and Demartini, Gianluca (2020). Crowd worker strategies in relevance judgment tasks. 13th International Conference on Web Search and Data Mining, Houston, Texas, 3-7 February 2020. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3336191.3371857
Conference Publication: On understanding data worker interaction behaviors
Han, Lei, Chen, Tianwa, Demartini, Gianluca, Indulska, Marta and Sadiq, Shazia (2020). On understanding data worker interaction behaviors. SIGIR '20: The 43rd International ACM SIGIR conference on research and development in Information Retrieval, Virtual Event China, July 2020. New York, NY USA: Association for Computing Machinery. doi: 10.1145/3397271.3401059
Conference Publication: All those wasted hours: on task abandonment in crowdsourcing
Han, Lei, Roitero, Kevin, Gadiraju, Ujwal, Sarasua, Cristina, Checco, Alessandro, Maddalena, Eddy and Demartini, Gianluca (2019). All those wasted hours: on task abandonment in crowdsourcing. 12th ACM International Conference on Web Search and Data Mining, WSDM 2019, Melbourne, VIC Australia , 11-15 February 2019. New York, NY USA: Association for Computing Machinery. doi: 10.1145/3289600.3291035
Conference Publication: Scalpel-CD: leveraging crowdsourcing and deep probabilistic modeling for debugging noisy training data
Yang, Jie, Demartini, Gianluca, Smirnova, Alisa, Lu, Yuan, Yang, Dingqi and Cudré-Mauroux, Philippe (2019). Scalpel-CD: leveraging crowdsourcing and deep probabilistic modeling for debugging noisy training data. World Wide Web Conference (WWW), San Francisco, CA, United States, 13-17 May 2019. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3308558.3313599
Conference Publication: On fine-grained relevance scales
Roitero, Kevin, Maddalena, Eddy, Demartini, Gianluca and Mizzaro, Stefano (2018). On fine-grained relevance scales. 41st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2018, Ann Arbor, MI, United States, 8-12 July 2018. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3209978.3210052
Journal Article: An introduction to hybrid human-machine information systems
Demartini, Gianluca, Difallah, Djellel Eddine, Gadiraju, Ujwal and Catasta, Michele (2017). An introduction to hybrid human-machine information systems. Foundations and Trends in Web Science, 7 (1), 1-87. doi: 10.1561/1800000025
Conference Publication: The dynamics of micro-task crowdsourcing: the case of amazon MTurk
Difallah, Djellel Eddine, Catasta, Michele, Demartini, Gianluca, Ipeirotis, Panagiotis G. and Cudré-Mauroux, Philippe (2015). The dynamics of micro-task crowdsourcing: the case of amazon MTurk. 24th International Conference on World Wide Web, WWW 2015, Florence, Italy, 18 - 22 May 2015. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/2736277.2741685
Conference Publication: Understanding malicious behavior in crowdsourcing platforms: the case of online surveys
Gadiraju, Ujwal, Kawase, Ricardo, Dietze, Stefan and Demartini, Gianluca (2015). Understanding malicious behavior in crowdsourcing platforms: the case of online surveys. 33rd Annual CHI Conference on Human Factors in Computing Systems - CHI'15, Seoul, South Korea, 18 - 23 April 2015. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/2702123.2702443
Measuring the Gender Gap: Attribute-based Class Completeness Estimation
(2023–2024) Wikimedia Foundation (US)
(2022–2025) University of Zurich
Human-in-the-loop Natural Language Processing in GLAM
(2022–2024) Universities Australia - Germany Joint Research Co-operation Scheme
Improving the Work Environment and Data Quality in Micro-Task Crowdsourcing
(2023) Doctor Philosophy
Bias Mitigation in Human in the Loop Decision Systems
Doctor Philosophy
Human-centered Artificial Intelligence for Democracy
Doctor Philosophy
Preferences on a budget: prioritizing document pairs when crowdsourcing relevance judgments
Roitero, Kevin, Checco, Alessandro, Mizzaro, Stefano and Demartini, Gianluca (2022). Preferences on a budget: prioritizing document pairs when crowdsourcing relevance judgments. ACM Web Conference, Virtual/Lyon, France, 25-29 April 2022. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3485447.3511960
Modelling User Behavior Dynamics with Embeddings
Han, Lei, Checco, Alessandro, Difallah, Djellel, Demartini, Gianluca and Sadiq, Shazia (2020). Modelling User Behavior Dynamics with Embeddings. 29th ACM International Conference on Information & Knowledge Management, Online, 19-23 October 2020. New York, NY United States: Association for Computing Machinery. doi: 10.1145/3340531.3411985
CrowdCO-OP: sharing risks and rewards in crowdsourcing
Fan, Shaoyang, Gadiraju, Ujwal, Checco, Alessandro and Demartini, Gianluca (2020). CrowdCO-OP: sharing risks and rewards in crowdsourcing. Proceedings of the ACM on Human-Computer Interaction, 4 (CSCW2) 132, 1-24. doi: 10.1145/3415203
Roitero, Kevin, Soprano, Michael, Fan, Shaoyang, Spina, Damiano, Mizzaro, Stefano and Demartini, Gianluca (2020). Can the crowd identify misinformation objectively?: The effects of judgment scale and assessor's background. International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, China, 25-30 July 2020. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3397271.3401112
Adversarial attacks on crowdsourcing quality control
Checco, Alessandro, Bates, Jo and Demartini, Gianluca (2020). Adversarial attacks on crowdsourcing quality control. Journal of Artificial Intelligence Research, 67, 375-408. doi: 10.1613/jair.1.11332
Crowd worker strategies in relevance judgment tasks
Han, Lei, Maddalena, Eddy, Checco, Alessandro, Sarasua, Cristina, Gadiraju, Ujwal, Roitero, Kevin and Demartini, Gianluca (2020). Crowd worker strategies in relevance judgment tasks. 13th International Conference on Web Search and Data Mining, Houston, Texas, 3-7 February 2020. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3336191.3371857
On understanding data worker interaction behaviors
Han, Lei, Chen, Tianwa, Demartini, Gianluca, Indulska, Marta and Sadiq, Shazia (2020). On understanding data worker interaction behaviors. SIGIR '20: The 43rd International ACM SIGIR conference on research and development in Information Retrieval, Virtual Event China, July 2020. New York, NY USA: Association for Computing Machinery. doi: 10.1145/3397271.3401059
All those wasted hours: on task abandonment in crowdsourcing
Han, Lei, Roitero, Kevin, Gadiraju, Ujwal, Sarasua, Cristina, Checco, Alessandro, Maddalena, Eddy and Demartini, Gianluca (2019). All those wasted hours: on task abandonment in crowdsourcing. 12th ACM International Conference on Web Search and Data Mining, WSDM 2019, Melbourne, VIC Australia , 11-15 February 2019. New York, NY USA: Association for Computing Machinery. doi: 10.1145/3289600.3291035
Yang, Jie, Demartini, Gianluca, Smirnova, Alisa, Lu, Yuan, Yang, Dingqi and Cudré-Mauroux, Philippe (2019). Scalpel-CD: leveraging crowdsourcing and deep probabilistic modeling for debugging noisy training data. World Wide Web Conference (WWW), San Francisco, CA, United States, 13-17 May 2019. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3308558.3313599
On fine-grained relevance scales
Roitero, Kevin, Maddalena, Eddy, Demartini, Gianluca and Mizzaro, Stefano (2018). On fine-grained relevance scales. 41st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2018, Ann Arbor, MI, United States, 8-12 July 2018. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3209978.3210052
An introduction to hybrid human-machine information systems
Demartini, Gianluca, Difallah, Djellel Eddine, Gadiraju, Ujwal and Catasta, Michele (2017). An introduction to hybrid human-machine information systems. Foundations and Trends in Web Science, 7 (1), 1-87. doi: 10.1561/1800000025
The dynamics of micro-task crowdsourcing: the case of amazon MTurk
Difallah, Djellel Eddine, Catasta, Michele, Demartini, Gianluca, Ipeirotis, Panagiotis G. and Cudré-Mauroux, Philippe (2015). The dynamics of micro-task crowdsourcing: the case of amazon MTurk. 24th International Conference on World Wide Web, WWW 2015, Florence, Italy, 18 - 22 May 2015. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/2736277.2741685
Understanding malicious behavior in crowdsourcing platforms: the case of online surveys
Gadiraju, Ujwal, Kawase, Ricardo, Dietze, Stefan and Demartini, Gianluca (2015). Understanding malicious behavior in crowdsourcing platforms: the case of online surveys. 33rd Annual CHI Conference on Human Factors in Computing Systems - CHI'15, Seoul, South Korea, 18 - 23 April 2015. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/2702123.2702443
From people to entities: new semantic search paradigms for the web
Demartini, Gianluca (2014). From people to entities: new semantic search paradigms for the web. Amsterdam, Netherlands: IOS Press.
Artificial intelligence needs human intervention to combat online hate
Demartini, Gianluca and Wilson-Barnao, Caroline (2022). Artificial intelligence needs human intervention to combat online hate. Conflict in My Outlook. (pp. 1-30) edited by Anna Briers, Nicholas Carah and Holly Arden. Melbourne, VIC, Australia: Perimiter.
Demartini, Gianluca (2019). Semantic Interlinking. Encyclopedia of Big Data Technologies. (pp. 1496-1500) Cham, Switzerland: Springer. doi: 10.1007/978-3-319-77525-8_229
Using Twitter as a data source: an overview of ethical, legal, and methodological challenges
Ahmed, Wasim, Bath, Peter A. and Demartini, Gianluca (2018). Using Twitter as a data source: an overview of ethical, legal, and methodological challenges. The ethics of online research. (pp. 79-107) edited by Kandy Woodfield. Bingley, United Kingdom: Emerald Publishing . doi: 10.1108/s2398-601820180000002004
NoizCrowd: A Crowd-Based Data Gathering and Management System for Noise Level Data
Wisniewski, Mariusz, Demartini, Gianluca, Malatras, Apostolos and Cudré-Mauroux, Philippe (2013). NoizCrowd: A Crowd-Based Data Gathering and Management System for Noise Level Data. Mobile Web Information Systems. (pp. 172-186) Heidelberg, Germany: Springer . doi: 10.1007/978-3-642-40276-0_14
Overview of the INEX 2008 Entity Ranking Track
Demartini, Gianluca, de Vries, Arjen P., Iofciu, Tereza and Zhu, Jianhan (2009). Overview of the INEX 2008 Entity Ranking Track. 7th International Workshop of the initiative for the evaluation of XML retrieval, INEX 2008. (pp. 243-252) Berlin, Germany: Springer Berlin Heidelberg. doi: 10.1007/978-3-642-03761-0_25
A data-driven analysis of behaviors in data curation processes
Han, Lei, Chen, Tianwa, Demartini, Gianluca, Indulska, Marta and Sadiq, Shazia (2023). A data-driven analysis of behaviors in data curation processes. ACM Transactions on Information Systems, 41 (3) 72, 1-35. doi: 10.1145/3567419
Human-AI Cooperation to Tackle Misinformation and Polarization
Spina, Damiano, Sanderson, Mark, Angus, Daniel, Demartini, Gianluca, Mckay, Dana, Saling, Lauren L. and White, Ryen W. (2023). Human-AI Cooperation to Tackle Misinformation and Polarization. Communications of the ACM, 66 (7), 40-45. doi: 10.1145/3588431
How Many Crowd Workers Do I Need? On Statistical Power When Crowdsourcing Relevance Judgments
Roitero, Kevin, Barbera, David La, Soprano, Michael, Demartini, Gianluca, Mizzaro, Stefano and Sakai, Tetsuya (2023). How Many Crowd Workers Do I Need? On Statistical Power When Crowdsourcing Relevance Judgments. ACM Transactions on Information Systems, 42 (1), 1-26. doi: 10.1145/3597201
Active learning with feature matching for clinical named entity recognition
Le, Linh, Demartini, Gianluca, Zuccon, Guido, Zhao, Genghong and Zhang, Xia (2023). Active learning with feature matching for clinical named entity recognition. Natural Language Processing Journal, 4 100015, 100015. doi: 10.1016/j.nlp.2023.100015
On the role of human and machine metadata in relevance judgment tasks
Xu, Jiechen, Han, Lei, Sadiq, Shazia and Demartini, Gianluca (2023). On the role of human and machine metadata in relevance judgment tasks. Information Processing and Management, 60 (2) 103177, 1-14. doi: 10.1016/j.ipm.2022.103177
Combining human and machine confidence in truthfulness assessment
Qu, Yunke, Barbera, David La, Roitero, Kevin, Mizzaro, Stefano, Spina, Damiano and Demartini, Gianluca (2022). Combining human and machine confidence in truthfulness assessment. Journal of Data and Information Quality, 15 (1) 5, 1-17. doi: 10.1145/3546916
Report on the 1st Workshop on Human-in-the-Loop Data Curation (HIL-DC 2022) at CIKM 2022
Demartini, Gianluca, Yang, Jie and Sadiq, Shazia (2022). Report on the 1st Workshop on Human-in-the-Loop Data Curation (HIL-DC 2022) at CIKM 2022. ACM SIGIR Forum, 56 (2), 1-8. doi: 10.1145/3582900.3582921
Task design in complex crowdsourcing experiments: Item assignment optimization
Ceschia, Sara, Roitero, Kevin, Demartini, Gianluca, Mizzaro, Stefano, Di Gaspero, Luca and Schaerf, Andrea (2022). Task design in complex crowdsourcing experiments: Item assignment optimization. Computers and Operations Research, 148 105995, 1-13. doi: 10.1016/j.cor.2022.105995
Analytics of learning tactics and strategies in an online learnersourcing environment
Lahza, Hatim, Khosravi, Hassan and Demartini, Gianluca (2022). Analytics of learning tactics and strategies in an online learnersourcing environment. Journal of Computer Assisted Learning, 39 (1), 94-112. doi: 10.1111/jcal.12729
A neural model to jointly predict and explain truthfulness of statements
Brand, Erik, Roitero, Kevin, Soprano, Michael, Rahimi, Afshin and Demartini, Gianluca (2022). A neural model to jointly predict and explain truthfulness of statements. Journal of Data and Information Quality, 15 (1) 4, 1-19. doi: 10.1145/3546917
DataOps-4G: on supporting generalists in data quality discovery
Yu, Shaochen, Chen, Tianwa, Han, Lei, Demartini, Gianluca and Sadiq, Shazia (2022). DataOps-4G: on supporting generalists in data quality discovery. IEEE Transactions on Knowledge and Data Engineering, 35 (5), 4668-4681. doi: 10.1109/tkde.2022.3151605
Information resilience: the nexus of responsible and agile approaches to information use
Sadiq, Shazia, Aryani, Amir, Demartini, Gianluca, Hua, Wen, Indulska, Marta, Burton-Jones, Andrew, Khosravi, Hassan, Benavides-Prado, Diana, Sellis, Timos, Someh, Ida, Vaithianathan, Rhema, Wang, Sen and Zhou, Xiaofang (2022). Information resilience: the nexus of responsible and agile approaches to information use. The VLDB Journal, 31 (5), 1059-1084. doi: 10.1007/s00778-021-00720-2
Soprano, Michael, Roitero, Kevin, La Barbera, David, Ceolin, Davide, Spina, Damiano, Mizzaro, Stefano and Demartini, Gianluca (2021). The many dimensions of truthfulness: crowdsourcing misinformation assessments on a multidimensional scale. Information Processing and Management, 58 (6) 102710, 1-22. doi: 10.1016/j.ipm.2021.102710
On the state of reporting in crowdsourcing experiments and a checklist to aid current practices
Ramírez, Jorge, Sayin, Burcu, Baez, Marcos, Casati, Fabio, Cernuzzi, Luca, Benatallah, Boualem and Demartini, Gianluca (2021). On the state of reporting in crowdsourcing experiments and a checklist to aid current practices. Proceedings of the ACM on Human-Computer Interaction, 5 (CSCW2) 387, 1-34. doi: 10.1145/3479531
Can the crowd judge truthfulness? A longitudinal study on recent misinformation about COVID-19
Roitero, Kevin, Soprano, Michael, Portelli, Beatrice, De Luise, Massimiliano, Spina, Damiano, Mea, Vincenzo Della, Serra, Giuseppe, Mizzaro, Stefano and Demartini, Gianluca (2021). Can the crowd judge truthfulness? A longitudinal study on recent misinformation about COVID-19. Personal and Ubiquitous Computing, 27 (1), 1-31. doi: 10.1007/s00779-021-01604-6
Analyzing Political Trends in the Blogosphere
Demartini, Gianluca, Siersdorfer, Stefan, Chelaru, Sergiu and Nejdl, Wolfgang (2021). Analyzing Political Trends in the Blogosphere. Proceedings of the International AAAI Conference on Web and Social Media, 5 (1), 466-469. doi: 10.1609/icwsm.v5i1.14178
Evaluating the quality of learning resources: a Learnersourcing approach
Abdi, Solmaz, Khosravi, Hassan, Sadiq, Shazia and Demartini, Gianluca (2021). Evaluating the quality of learning resources: a Learnersourcing approach. IEEE Transactions on Learning Technologies, 14 (1) 9353264, 81-92. doi: 10.1109/tlt.2021.3058644
Making AI Machines Work for Humans in FoW
Amer-Yahia, Sihem, Basu Roy, Senjuti, Chen, Lei, Morishima, Atsuyuki, Abello Monedero, James, Bourhis, Pierre, Charoy, François, Danilevsky, Marina, Das, Gautam, Demartini, Gianluca, Dubey, Abhishek, Elbassuoni, Shady, Gross-Amblard, David, Hoareau, Emilie, Inoguchi, Munenari, Kenworthy, Jared, Kitahara, Itaru, Lee, Dongwon, Li, Yunyao, Borromeo, Ria Mae, Papotti, Paolo, Rao, Raghav, Roy, Sudeepa, Senellart, Pierre, Tajima, Keishi, Thirumuruganathan, Saravanan, Tommasi, Marion, Umemoto, Kazutoshi, Wiggins, Andrea and Yoshida, Koichiro (2020). Making AI Machines Work for Humans in FoW. SIGMOD Record, 49 (2), 30-35. doi: 10.1145/3442322.3442327
CrowdCO-OP: sharing risks and rewards in crowdsourcing
Fan, Shaoyang, Gadiraju, Ujwal, Checco, Alessandro and Demartini, Gianluca (2020). CrowdCO-OP: sharing risks and rewards in crowdsourcing. Proceedings of the ACM on Human-Computer Interaction, 4 (CSCW2) 132, 1-24. doi: 10.1145/3415203
Demartini, Gianluca, Mizzaro, Stefano and Spina, Damiano (2020). Human-in-the-loop Artificial Intelligence for Fighting Online Misinformation: Challenges and Opportunities. The Bulletin of the Technical Committee on Data Engineering, 65-74.
Adversarial attacks on crowdsourcing quality control
Checco, Alessandro, Bates, Jo and Demartini, Gianluca (2020). Adversarial attacks on crowdsourcing quality control. Journal of Artificial Intelligence Research, 67, 375-408. doi: 10.1613/jair.1.11332
Platform-Related Factors in Repeatability and Reproducibility of Crowdsourcing Tasks
Qarout, Rehab, Checco, Alessandro, Demartini, Gianluca and Bontcheva, Kalina (2019). Platform-Related Factors in Repeatability and Reproducibility of Crowdsourcing Tasks. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, 7, 135-143. doi: 10.1609/hcomp.v7i1.5264
Sarasua, Cristina, Checco, Alessandro, Demartini, Gianluca, Difallah, Djellel, Feldman, Michael and Pintscher, Lydia (2019). The evolution of power and standard wikidata editors: comparing editing behavior over time to predict lifespan and volume of edits. Computer Supported Cooperative Work: CSCW: An International Journal, 28 (5), 843-882. doi: 10.1007/s10606-018-9344-y
Health cards to assist decision making in consumer health search
Jimmy, , Zuccon, Guido, Demartini, Gianluca and Koopman, Bevan (2019). Health cards to assist decision making in consumer health search. AMIA Annual Symposium. Proceedings, 2019, 1091-1100.
Novel insights into views towards H1N1 during the 2009 Pandemic: a thematic analysis of Twitter data
Ahmed, Wasim, Bath, Peter A., Sbaffi, Laura and Demartini, Gianluca (2019). Novel insights into views towards H1N1 during the 2009 Pandemic: a thematic analysis of Twitter data. Health Information and Libraries Journal, 36 (1), 60-72. doi: 10.1111/hir.12247
Deadline-aware fair scheduling for multi-tenant crowd-powered systems
Difallah, Djellel, Checco, Alessandro, Demartini, Gianluca and Cudré-Mauroux, Philippe (2019). Deadline-aware fair scheduling for multi-tenant crowd-powered systems. ACM Transactions on Social Computing, 2 (1), 1-29. doi: 10.1145/3301003
The Impact of Task Abandonment in Crowdsourcing
Han, Lei, Roitero, Kevin, Gadiraju, Ujwal, Sarasua, Cristina, Checco, Alessandro, Maddalena, Eddy and Demartini, Gianluca (2019). The Impact of Task Abandonment in Crowdsourcing. IEEE Transactions on Knowledge and Data Engineering, 33 (5) 8873609, 1-1. doi: 10.1109/tkde.2019.2948168
Crowd Anatomy Beyond the Good and Bad: Behavioral Traces for Crowd Worker Modeling and Pre-selection
Gadiraju, Ujwal, Demartini, Gianluca, Kawase, Ricardo and Dietze, Stefan (2018). Crowd Anatomy Beyond the Good and Bad: Behavioral Traces for Crowd Worker Modeling and Pre-selection. Computer Supported Cooperative Work: CSCW: An International Journal, 28 (5), 1-27. doi: 10.1007/s10606-018-9336-y
All That Glitters Is Gold — An Attack Scheme on Gold Questions in Crowdsourcing
Checco, Alessandro, Bates, Jo and Demartini, Gianluca (2018). All That Glitters Is Gold — An Attack Scheme on Gold Questions in Crowdsourcing. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, 6, 2-11. doi: 10.1609/hcomp.v6i1.13332
Augmenting intelligence with humansintheloop
Gentile, Anna Lisa, Aroyo, Lora, Demartini, Gianluca and Welty, Chris (2018). Augmenting intelligence with humansintheloop. CEUR Workshop Proceedings, 2169
An introduction to hybrid human-machine information systems
Demartini, Gianluca, Difallah, Djellel Eddine, Gadiraju, Ujwal and Catasta, Michele (2017). An introduction to hybrid human-machine information systems. Foundations and Trends in Web Science, 7 (1), 1-87. doi: 10.1561/1800000025
Let's Agree to Disagree: Fixing Agreement Measures for Crowdsourcing
Checco, Alessandro, Roitero, Kevin, Maddalena, Eddy, Mizzaro, Stefano and Demartini, Gianluca (2017). Let's Agree to Disagree: Fixing Agreement Measures for Crowdsourcing. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, 5, 11-20. doi: 10.1609/hcomp.v5i1.13306
Modus Operandi of Crowd Workers : The Invisible Role of Microtask Work Environments
Gadiraju, Ujwal, Checco, Alessandro, Gupta, Neha and Demartini, Gianluca (2017). Modus Operandi of Crowd Workers : The Invisible Role of Microtask Work Environments. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 1 (3), 1-29. doi: 10.1145/3130914
Crowdsourcing Relevance Assessments: The Unexpected Benefits of Limiting the Time to Judge
Maddalena, Eddy, Basaldella, Marco, De Nart, Dario, Degl'Innocenti, Dante, Mizzaro, Stefano and Demartini, Gianluca (2016). Crowdsourcing Relevance Assessments: The Unexpected Benefits of Limiting the Time to Judge. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, 4, 129-138. doi: 10.1609/hcomp.v4i1.13284
Contextualized ranking of entity types based on knowledge graphs
Tonon, Alberto, Catasta, Michele, Prokofyev, Roman, Demartini, Gianluca, Aberer, Karl and Cudre-Mauroux, Philippe (2016). Contextualized ranking of entity types based on knowledge graphs. Journal of Web Semantics, 37-38, 170-183. doi: 10.1016/j.websem.2015.12.005
Hybrid human-machine information systems: challenges and opportunities
Demartini, Gianluca (2015). Hybrid human-machine information systems: challenges and opportunities. Computer Networks, 90, 5-13. doi: 10.1016/j.comnet.2015.05.018
Pooling-based continuous evaluation of information retrieval systems
Tonon, Alberto, Demartini, Gianluca and Cudre-Mauroux, Philippe (2015). Pooling-based continuous evaluation of information retrieval systems. Information Retrieval Journal, 18 (5), 445-472. doi: 10.1007/s10791-015-9266-y
Human beyond the machine: challenges and opportunities of microtask crowdsourcing
Gadiraju, Ujwal, Demartini, Gianluca, Kawase, Ricardo and Dietze, Stefan (2015). Human beyond the machine: challenges and opportunities of microtask crowdsourcing. IEEE Intelligent Systems, 30 (4) 7156008, 81-85. doi: 10.1109/MIS.2015.66
Large-scale linked data integration using probabilistic reasoning and crowdsourcing
Demartini, Gianluca, Difallah, Djellel Eddine and Cudre-Mauroux, Philippe (2013). Large-scale linked data integration using probabilistic reasoning and crowdsourcing. VLDB Journal, 22 (5), 665-687. doi: 10.1007/s00778-013-0324-z
Demartini, Gianluca, Enchev, Iliya, Gapany, Joel and Cudre-Mauroux, Philippe (2013). The bowlogna ontology: fostering open curricula and agile knowledge bases for europe's higher education landscape. Semantic Web, 4 (1), 53-63. doi: 10.3233/SW-2012-0064
From people to entities : typed search in the enterprise and the web
Demartini, Gianluca (2011). From people to entities : typed search in the enterprise and the web. ACM SIGIR Forum, 45 (1), 73-73. doi: 10.1145/1988852.1988868
Beckers, T., Geva, S., Huang, W.-C., Iofciu, T., Kamps, J., Kazai, G., Koolen, M., Kutty, S., Landoni, M., Lehtonen, M., Moriceau, V., Bellot, P., Nayak, R., Nordlie, R., Pharo, N., SanJuan, E., Schenkel, R., Tannier, X., Theobald, M., Thom, J. A., Trotman, A., de Vries, A. P., Demartini, G., Denoyer, L., De Vries, C. M., Doucet, A., Fachry, K. N., Fuhr, N. and Gallinari, P. (2010). Report on INEX 2009. ACM SIGIR Forum, 44 (1), 38-57. doi: 10.1145/1842890.1842897
Leveraging personal metadata for Desktop search: The Beagle++ system
Minack, Enrico, Paiu, Raluca, Costache, Stefania, Demartini, Gianluca, Gaugaz, Julien, Ioannou, Ekaterini, Chirita, Paul-Alexandru and Nejdl, Wolfgang (2010). Leveraging personal metadata for Desktop search: The Beagle++ system. Journal of Web Semantics, 8 (1), 37-54. doi: 10.1016/j.websem.2009.12.001
Why finding entities in Wikipedia is difficult, sometimes
Demartini, Gianluca, Firan, Claudiu S., Iofciu, Tereza, Krestel, Ralf and Nejdl, Wolfgang (2010). Why finding entities in Wikipedia is difficult, sometimes. Information Retrieval, 13 (5), 534-567. doi: 10.1007/s10791-010-9135-7
Demartini, Gianluca, Denoye, Ludovic, Douce, Antoine, Fachry, Khairun Nisa, Gallinar, Patrick\, Gev, Shlomo, Huang, Wei-Che, Iofciu, Tereza, Kamps, Jaap, Kazai, Gabriella, Koolen, Marijn, Landoni, Monica, Nordlie, Ragnar, Pharo, Nils, Schenkel, Ralf, Theobald, Martin, Trotman, Andrew, de Vries, Arjen P., Woodley, Alan and Zhu, Jianhan (2009). Report on INEX 2008. SIGIR Forum, 43 (1), 17-36. doi: 10.1145/1670598.1670603
Measuring Retrieval Effectiveness with Average Distance Measure (ADM)
Della Mea, Vincenzo, Demartini, Gianluca, Di Gaspero, Luca and Mizzaro, Stefano (2006). Measuring Retrieval Effectiveness with Average Distance Measure (ADM). Information Wissenschaft und Praxis, 57 (8), 433-443.
Perspectives on Large Language Models for Relevance Judgment
Faggioli, Guglielmo, Dietz, Laura, Clarke, Charles L. A., Demartini, Gianluca, Hagen, Matthias, Hauff, Claudia, Kando, Noriko, Kanoulas, Evangelos, Potthast, Martin, Stein, Benno and Wachsmuth, Henning (2023). Perspectives on Large Language Models for Relevance Judgment. New York, NY, USA: ACM. doi: 10.1145/3578337.3605136
On the Impact of Data Quality on Image Classification Fairness
Barry, Aki, Han, Lei and Demartini, Gianluca (2023). On the Impact of Data Quality on Image Classification Fairness. New York, NY, USA: ACM. doi: 10.1145/3539618.3592031
Human-in-the-loop Regular Expression Extraction for Single Column Format Inconsistency
Yu, Shaochen, Han, Lei, Indulska, Marta, Sadiq, Shazia and Demartini, Gianluca (2023). Human-in-the-loop Regular Expression Extraction for Single Column Format Inconsistency. New York, NY, USA: ACM. doi: 10.1145/3543507.3583515
The Community Notes Observatory: Can Crowdsourced Fact-Checking be Trusted in Practice?
Righes, Luca, Saeed, Mohammed, Demartini, Gianluca and Papotti, Paolo (2023). The Community Notes Observatory: Can Crowdsourced Fact-Checking be Trusted in Practice?. New York, NY, USA: ACM. doi: 10.1145/3543873.3587340
Leveraging Semantic Type Dependencies for Clinical Named Entity Recognition
Le, Linh, Zuccon, Guido, Demartini, Gianluca, Zhao, Genghong and Zhang, Xia (2023). Leveraging Semantic Type Dependencies for Clinical Named Entity Recognition. AMIA 2022 Annual Symposium, Washington, DC United States, 5-9 November 2022. Bethesda, MD United States: American Medical Informatics Association.
Automatic identification of 5C vaccine behaviour on social media
Sampath Kumar, Ajay Hemanth, Shausan, Aminath, Demartini, Gianluca and Rahimi, Afshin (2022). Automatic identification of 5C vaccine behaviour on social media. Eighth Workshop on Noisy User-generated Text (W-NUT 2022), Gyeongju, Republic of Korea, 12-17 October 2022. Gyeongju, Republic of Korea: International Conference on Computational Linguistics.
Crowdsourced fact-checking at Twitter : how does the crowd compare with experts?
Saeed, Mohammed, Traub, Nicolas, Nicolas, Maelle, Demartini, Gianluca and Papotti, Paolo (2022). Crowdsourced fact-checking at Twitter : how does the crowd compare with experts?. 31st ACM International Conference on Information & Knowledge, Atlanta, GA USA, 17-21 October 2022. New York, NY, USA: ACM. doi: 10.1145/3511808.3557279
Perikleous, Periklis, Kafkalias, Andreas, Theodosiou, Zenonas, Barlas, Pinar, Christoforou, Evgenia, Otterbacher, Jahna, Demartini, Gianluca and Lanitis, Andreas (2022). How does the crowd impact the model? A tool for raising awareness of social bias in crowdsourced training data. 31st ACM International Conference on Information & Knowledge Management, Atlanta, GA, United States, 17-22 October 2022. New York, NY, United States: ACM. doi: 10.1145/3511808.3557178
Workshop on Human-in-the-loop Data Curation
Demartini, Gianluca, Yang, Jie and Sadiq, Shazia (2022). Workshop on Human-in-the-loop Data Curation. New York, NY, USA: ACM. doi: 10.1145/3511808.3557498
Incorporating AI and Analytics to Derive Insights from E-exam Logs
Lahza, Hatim Fareed, Khosravi, Hassan and Demartini, Gianluca (2022). Incorporating AI and Analytics to Derive Insights from E-exam Logs. 23rd International Conference of Artificial Intelligence in Education AIED 2022, Durham, United Kingdom, 27–31 July 2022. Heidelberg, Germany: Springer. doi: 10.1007/978-3-031-11644-5_78
Socio-economic diversity in human annotations
Fan, Shaoyang, Barlas, Pinar, Christoforou, Evgenia, Otterbacher, Jahna, Sadiq, Shazia and Demartini, Gianluca (2022). Socio-economic diversity in human annotations. WebSci '22: 14th ACM Web Science Conference 2022, Barcelona, Spain, 26-29 June 2022. New York, United States: Association for Computing Machinery. doi: 10.1145/3501247.3531588
Exploring data literacy levels in the crowd – the case of COVID-19
Fan, Shaoyang, Han, Lei, Demartini, Gianluca and Sadiq, Shazia (2022). Exploring data literacy levels in the crowd – the case of COVID-19. Sixteenth International AAAI Conference on Web and Social Media, Atlanta, GA United States, 6–9 June 2022. Palo Alto, CA United States: Association for the Advancement of Artificial Intelligence (AAAI). doi: 10.1609/icwsm.v16i1.19395
Exploring data literacy levels in the crowd – the case of COVID-19
Fan, Shaoyang, Han, Lei, Demartini, Gianluca and Sadiq, Shazia (2022). Exploring data literacy levels in the crowd – the case of COVID-19. The 16th International AAAI Conference on Web and Social Media, Atlanta, GA United States, 6-9 June 2022. Palo Alto, CA United States: AAAI Press.
Does evidence from peers help crowd workers in assessing truthfulness?
Xu, Jiechen, Han, Lei, Fan, Shaoyang, Sadiq, Shazia and Demartini, Gianluca (2022). Does evidence from peers help crowd workers in assessing truthfulness?. WWW '22: The ACM Web Conference 2022, Online, 25 - 29 April, 2022. New York, NY, United States: ACM. doi: 10.1145/3487553.3524236
Preferences on a budget: prioritizing document pairs when crowdsourcing relevance judgments
Roitero, Kevin, Checco, Alessandro, Mizzaro, Stefano and Demartini, Gianluca (2022). Preferences on a budget: prioritizing document pairs when crowdsourcing relevance judgments. ACM Web Conference, Virtual/Lyon, France, 25-29 April 2022. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3485447.3511960
Effects of technological interventions for self-regulation: a control experiment in learnersourcing
Lahza, Hatim, Khosravi, Hassan, Demartini, Gianluca and Gasevic, Dragan (2022). Effects of technological interventions for self-regulation: a control experiment in learnersourcing. LAK22: 12th International Learning Analytics and Knowledge Conference, Virtual, United States, 21 - 25 March 2022. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3506860.3506911
A behavioural analysis of metadata use in evaluating the quality of repurposed data
Zhou, Hui, Han, Lei, Dermatini, Gianluca, Indulska, Marta and Sadiq, Shazia (2022). A behavioural analysis of metadata use in evaluating the quality of repurposed data. 41st International Conference on Conceptual Modeling, ER 2022, Hyderabad, India, 17-20 October 2022. Heidelberg, Germany: Springer International Publishing. doi: 10.1007/978-3-031-17995-2_22
La Barbera, David, Roitero, Kevin, Mackenzie, Joel, Spina, Damiano, Demartini, Gianluca and Mizzaro, Stefano (2022). BUM at CheckThat! 2022: a composite deep learning approach to fake news detection using evidence retrieval. CLEF 2022 – Conference and Labs of the Evaluation Forum,, Bologna, Italy, 5-8 September 2022. Aachen, Germany: Rheinisch-Westfaelische Technische Hochschule Aachen * Lehrstuhl Informatik V.
An Analysis of the Australian Political Discourse in Sponsored Social Media Content
Han, Lei, Sawant, Rudra, Fan, Shaoyang, Kefford, Glenn and Demartini, Gianluca (2021). An Analysis of the Australian Political Discourse in Sponsored Social Media Content. ADCS '21: Australasian Document Computing Symposium, Online, 9 December 2021. Washington, DC United States: Association for Computing Machinery. doi: 10.1145/3503516.3503533
Hierarchical clustering of corals using image clustering
Sawant, Rudra, Demartini, Gianluca and Bridge, Tom (2021). Hierarchical clustering of corals using image clustering. ADCS '21: Proceedings of the 25th Australasian Document Computing Symposium, Online, 9 December 2021. New York, NY United States: ACM. doi: 10.1145/3503516.3503531
Iterative human-in-the-loop discovery of unknown unknowns in image datasets
Han, Lei, Dong, Xiao and Demartini, Gianluca (2021). Iterative human-in-the-loop discovery of unknown unknowns in image datasets. 9th AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2021), Online, 14-18 November 2021. Palo Alto, CA United States: AAAI Press. doi: 10.1609/hcomp.v9i1.18941
Loss-based active learning for named entity recognition
Linh, Le Thai, Nguyen, Minh-Tien, Zuccon, Guido and Demartini, Gianluca (2021). Loss-based active learning for named entity recognition. 2021 International Joint Conference on Neural Networks (IJCNN), Shenzhen, China, 18-22 July, 2021. Piscataway, NJ, United States: Institute of Electrical and Electronics Engineers. doi: 10.1109/ijcnn52387.2021.9533675
Charting the design and analytics agenda of learnersourcing systems
Khosravi, Hassan, Demartini, Gianluca, Sadiq, Shazia and Gasevic, Dragan (2021). Charting the design and analytics agenda of learnersourcing systems. 11th International Learning Analytics and Knowledge Conference, Irvine, CA USA, April 2021. New York, NY, USA: ACM. doi: 10.1145/3448139.3448143
CoralExp: An Explainable System to Support Coral Taxonomy Research
Harding, Jaiden, Bridge, Tom and Demartini, Gianluca (2021). CoralExp: An Explainable System to Support Coral Taxonomy Research. 43rd European Conference on IR Research, ECIR 2021, Online, 28 March – 1 April 2021. Cham, Switzerland: Springer. doi: 10.1007/978-3-030-72240-1_55
Modelling User Behavior Dynamics with Embeddings
Han, Lei, Checco, Alessandro, Difallah, Djellel, Demartini, Gianluca and Sadiq, Shazia (2020). Modelling User Behavior Dynamics with Embeddings. 29th ACM International Conference on Information & Knowledge Management, Online, 19-23 October 2020. New York, NY United States: Association for Computing Machinery. doi: 10.1145/3340531.3411985
The COVID-19 Infodemic: Can the Crowd Judge Recent Misinformation Objectively?
Roitero, Kevin, Soprano, Michael, Portelli, Beatrice, Spina, Damiano, Della Mea, Vincenzo, Serra, Giuseppe, Mizzaro, Stefano and Demartini, Gianluca (2020). The COVID-19 Infodemic: Can the Crowd Judge Recent Misinformation Objectively?. 29th ACM International Conference on Information & Knowledge Management, Online, 19 - 23 October 2020. Washington, DC United States: Association for Computing Machinery. doi: 10.1145/3340531.3412048
A region selection model to identify unknown unknowns in image datasets
Dong, Xiao, Zhang, Huaxiang and Demartini, Gianluca (2020). A region selection model to identify unknown unknowns in image datasets. 24th European Conference on Artificial Intelligence, ECAI 2020, Santiago de Compostela, Spain, 29 August - 8 September 2020. Amsterdam, Netherlands: IOS Press. doi: 10.3233/FAIA200128
QuRVe: Query Refinement for View Recommendation in visual data exploration
Ehsan, Humaira, Sharaf, Mohamed A. and Demartini, Gianluca (2020). QuRVe: Query Refinement for View Recommendation in visual data exploration. 24th European Conference on Advances in Databases and Information Systems, ADBIS 2020, Lyon, France, 25 - 27 August 2020. Heidelberg, Germany: Springer. doi: 10.1007/978-3-030-54623-6_14
Roitero, Kevin, Soprano, Michael, Fan, Shaoyang, Spina, Damiano, Mizzaro, Stefano and Demartini, Gianluca (2020). Can the crowd identify misinformation objectively?: The effects of judgment scale and assessor's background. International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, China, 25-30 July 2020. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3397271.3401112
Representation learning for entity type ranking
Rahman, Md Mostafizur, Takasu, Atsuhiro and Demartini, Gianluca (2020). Representation learning for entity type ranking. SAC '20: The 35th ACM/SIGAPP Symposium on Applied Computing, Brno, Czech Republic, 30 March-3 April 2020. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3341105.3374029
Building data curation processes with crowd intelligence
Chen, Tianwa, Han, Lei, Demartini, Gianluca, Indulska, Marta and Sadiq, Shazia (2020). Building data curation processes with crowd intelligence. CAiSE Forum 2020: Advanced Information Systems Engineering, Grenoble, France, 8 – 12 June 2020. Cham, Switzerland: Springer International Publishing. doi: 10.1007/978-3-030-58135-0_3
Crowd worker strategies in relevance judgment tasks
Han, Lei, Maddalena, Eddy, Checco, Alessandro, Sarasua, Cristina, Gadiraju, Ujwal, Roitero, Kevin and Demartini, Gianluca (2020). Crowd worker strategies in relevance judgment tasks. 13th International Conference on Web Search and Data Mining, Houston, Texas, 3-7 February 2020. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3336191.3371857
Crowdsourcing truthfulness: the impact of judgment scale and assessor bias
La Barbera, David, Roitero, Kevin, Demartini, Gianluca, Mizzaro, Stefano and Spina, Damiano (2020). Crowdsourcing truthfulness: the impact of judgment scale and assessor bias. European Conference on Information Retrieval, Lisbon, Portugal, 14-17 April 2020. Heidelberg, Germany: Springer. doi: 10.1007/978-3-030-45442-5_26
On understanding data worker interaction behaviors
Han, Lei, Chen, Tianwa, Demartini, Gianluca, Indulska, Marta and Sadiq, Shazia (2020). On understanding data worker interaction behaviors. SIGIR '20: The 43rd International ACM SIGIR conference on research and development in Information Retrieval, Virtual Event China, July 2020. New York, NY USA: Association for Computing Machinery. doi: 10.1145/3397271.3401059
Zika outbreak of 2016: insights from twitter
Ahmed, Wasim, Bath, Peter A., Sbaffi, Laura and Demartini, Gianluca (2020). Zika outbreak of 2016: insights from twitter. International Conference on Human-Computer Interaction, Copenhagen, Denmark, 19-24 July 2020. Heidelberg, Germany: Springer. doi: 10.1007/978-3-030-49576-3_32
All those wasted hours: on task abandonment in crowdsourcing
Han, Lei, Roitero, Kevin, Gadiraju, Ujwal, Sarasua, Cristina, Checco, Alessandro, Maddalena, Eddy and Demartini, Gianluca (2019). All those wasted hours: on task abandonment in crowdsourcing. 12th ACM International Conference on Web Search and Data Mining, WSDM 2019, Melbourne, VIC Australia , 11-15 February 2019. New York, NY USA: Association for Computing Machinery. doi: 10.1145/3289600.3291035
Augmenting intelligence with bias-aware humans-in-the-loop (HumBL2019) chairs' welcome
Aroyo, Lora, Gadiraju, Ujwal, Inel, Oana, Checco, Alessandro, Gentile, Anna Lisa, Sarasua, Cristina and Demartini, Gianluca (2019). Augmenting intelligence with bias-aware humans-in-the-loop (HumBL2019) chairs' welcome. 2019 World Wide Web Conference, San Francisco, CA United States, 13 - 17 May 2019. New York, NY United States: Association for Computing Machinery. doi: 10.1145/3308560.3317301
Health card retrieval for consumer health search an empirical investigation of methods
Jimmy,, Zuccon, Guido, Koopman, Bevan and Demartini, Gianluca (2019). Health card retrieval for consumer health search an empirical investigation of methods. CIKM '19: Proceedings of the 28th ACM International Conference on Information and Knowledge Management, Beijing, China, November, 2019. New York, New York, USA: Association for Computing Machinery. doi: 10.1145/3357384.3358128
Health cards for consumer health search
Jimmy, Koopman, Bevan, Zuccon, Guido and Demartini, Gianluca (2019). Health cards for consumer health search. 42nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2019), Paris, France, 21-25 July 2019. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3331184.3331194
Roitero, Kevin, Demartini, Gianluca, Mizzaro, Stefano and Spina, Damiano (2019). How many truth levels? Six? One hundred? Even more? Validating truthfulness of statements via crowdsourcing. CIKM 2018 Workshops, Torino, Italy, 22-26 October 2018. CEUR-WS.
Implicit bias in crowdsourced knowledge graphs
Demartini, Gianluca (2019). Implicit bias in crowdsourced knowledge graphs. World Wide Web Conference (WWW 2019), San Francisco, CA, United States, 13-17 May 2019. New York, NY, United States: Association for Computing Machinery (ACM). doi: 10.1145/3308560.3317307
Jobnow'19 - 1st international workshop on job knowledge discovery on the Web & Social media
Gadiraju, Ujwal, Demartini, Gianluca, Bohlouli, Mahdi and Margaryan, Anoush (2019). Jobnow'19 - 1st international workshop on job knowledge discovery on the Web & Social media. 30th ACM Conference on Hypertext and Social Media, Hof, Germany, 17-20 September 2019. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3342220.3349532
Non-parametric class completeness estimators for collaborative knowledge graphs—the case of Wikidata
Luggen, Michael, Difallah, Djellel, Sarasua, Cristina, Demartini, Gianluca and Cudré-Mauroux, Philippe (2019). Non-parametric class completeness estimators for collaborative knowledge graphs—the case of Wikidata. International Semantic Web Conference, Auckland, New Zealand, 26-30 October 2019. Cham, Switzerland: Springer. doi: 10.1007/978-3-030-30793-6_26
On transforming relevance scales
Han, Lei, Roitero, Kevin, Maddalena, Eddy, Mizzaro, Stefano and Demartini, Gianluca (2019). On transforming relevance scales. 28th ACM International Conference on Information and Knowledge Management, Beijing, China, 3 - 7 November 2019. Washington, DC United States: Association for Computing Machinery. doi: 10.1145/3357384.3357988
Demartini, Gianluca and Thomas, Paul (2019). Preface. 24th Australasian Document Computing Symposium, Sydney, NSW Australia, 5-6 December 2019. New York, NY USA: Association for Computing Machinery.
Quality control attack schemes in crowdsourcing
Checco, Alessandro, Bates, Jo and Demartini, Gianluca (2019). Quality control attack schemes in crowdsourcing. Twenty-Eighth International Joint Conference on Artificial Intelligence (IJCAI-19), Macao, China, 10-16 August 2019. Palo Alto, CA, United States: A A A I Press. doi: 10.24963/ijcai.2019/850
Yang, Jie, Demartini, Gianluca, Smirnova, Alisa, Lu, Yuan, Yang, Dingqi and Cudré-Mauroux, Philippe (2019). Scalpel-CD: leveraging crowdsourcing and deep probabilistic modeling for debugging noisy training data. World Wide Web Conference (WWW), San Francisco, CA, United States, 13-17 May 2019. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3308558.3313599
Tracking user behaviours: Laboratory-based and in-the-wild user studies
Demartini, Gianluca and Sadiq, Shazia (2019). Tracking user behaviours: Laboratory-based and in-the-wild user studies. 24th International Conference on Database Systems for Advanced Applications, DASFAA 2019, Chiang Mai, Thailand, 22-25 April 2019. Cham, Switzerland: Springer Verlag. doi: 10.1007/978-3-030-18590-9a
Understanding worker moods and reactions to rejection in crowdsourcing
Gadiraju, Ujwal and Demartini, Gianluca (2019). Understanding worker moods and reactions to rejection in crowdsourcing. 30th ACM Conference on Hypertext and Social Media, Hof, Germany, 17-20 September 2019. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3342220.3343644
All that glitters is gold -- An attack scheme on gold questions in crowdsourcing
Checco, Alessandro, Bates, Jo and Demartini, Gianluca (2018). All that glitters is gold -- An attack scheme on gold questions in crowdsourcing. The 6th AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2018), Zurich, Switzerland, July 5–8 2018. Palo Alto, CA, United States: AAAI Press.
Can user behaviour sequences reflect perceived novelty?
Zhuang, Mengdie, Toms, Elaine G. and Demartini, Gianluca (2018). Can user behaviour sequences reflect perceived novelty?. 27th ACM International Conference on Information and Knowledge Management, CIKM 2018, Torino, Italy, October 22 - 26, 2018. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3269206.3269243
Investigating user perception of gender bias in image search: the role of sexism
Otterbacher, Jahna, Checco, Alessandro, Demartini, Gianluca and Clough, Paul (2018). Investigating user perception of gender bias in image search: the role of sexism. 41st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2018, Ann Arbor, MI, United States, 8-12 July 2018. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3209978.3210094
Measuring the effect of public health campaigns on twitter: The case of world autism awareness day
Ahmed, Wasim, Bath, Peter A., Sbaffi, Laura and Demartini, Gianluca (2018). Measuring the effect of public health campaigns on twitter: The case of world autism awareness day. 13th International Conference on Transforming Digital Worlds, iConference 2018, Sheffield, U.K., March 25-28, 2018. CHAM: Springer Verlag. doi: 10.1007/978-3-319-78105-1_2
Moral panic through the lens of Twitter: an analysis of infectious disease outbreaks
Ahmed, Wasim, Bath, Peter A., Sbaffi, Laura and Demartini, Gianluca (2018). Moral panic through the lens of Twitter: an analysis of infectious disease outbreaks. 9th International Conference on Social Media and Society, SMSociety 2018, Copenhagen, Denmark, 18-20 July 2018. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3217804.3217915
On fine-grained relevance scales
Roitero, Kevin, Maddalena, Eddy, Demartini, Gianluca and Mizzaro, Stefano (2018). On fine-grained relevance scales. 41st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2018, Ann Arbor, MI, United States, 8-12 July 2018. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3209978.3210052
On the volatility of commercial search engines and its impact on information retrieval research
Jimmy, Zuccon, Guido and Demartini, Gianluca (2018). On the volatility of commercial search engines and its impact on information retrieval research. 41st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2018, Ann Arbor, MI, United States, 8-12 July 2018. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3209978.3210088
Considering assessor agreement in IR evaluation
Maddalena, Eddy, Roitero, Kevin, Demartini, Gianluca and Mizzaro, Stefano (2017). Considering assessor agreement in IR evaluation. ICTIR 2017 - Proceedings of the 2017 ACM SIGIR International Conference on the Theory of Information Retrieva, Amsterdam, Netherlands, 1-4 October 2017. New York, NY USA: ACM Press. doi: 10.1145/3121050.3121060
FashionBrain Project: A Vision for Understanding Europe's Fashion Data Universe
Checco, Alessandro, Demartini, Gianluca, Löser, Alexander, Arous, Ines, Dantone, Matthias, Koopmanschap, Richard, Stalinov, Svetlin, Kersten, Martin and Zhang, Ying (2017). FashionBrain Project: A Vision for Understanding Europe's Fashion Data Universe. 'Machine learning meets fashion' workshop at KDD 2017, Halifax, Nova Scotia, Canada, August 2017.
Let's Agree to Disagree: Fixing Agreement Measures for Crowdsourcing
Checco, Alessandro, Roitero, Kevin, Maddalena, Eddy, Mizzaro, Stefano and Demartini, Gianluca (2017). Let's Agree to Disagree: Fixing Agreement Measures for Crowdsourcing. The 5th AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2017), Quebec City, Canada, October 2017. AAAI Press.
Topics Discussed on Twitter at the Beginning of the 2014 Ebola Epidemic in United States
Ahmed, Wasim , Demartini, Gianluca and Bath, Peter (2017). Topics Discussed on Twitter at the Beginning of the 2014 Ebola Epidemic in United States. iConference, Wuhan, China, March 2017.
Towards building a standard dataset for Arabic keyphrase extraction evaluation
Helmy, Muhammad, Basaldella, Marco, Maddalena, Eddy, Mizzaro, Stefano and Demartini, Gianluca (2017). Towards building a standard dataset for Arabic keyphrase extraction evaluation. 20th International Conference on Asian Language Processing, IALP 2016, Tainan, Taiwan, November 21-23, 2016. NEW YORK: Institute of Electrical and Electronics Engineers . doi: 10.1109/IALP.2016.7875927
Understanding engagement through search behaviour
Zhuang, Mengdie, Demartini, Gianluca and Toms, Elaine G. (2017). Understanding engagement through search behaviour. 26th ACM International Conference on Information and Knowledge Management, CIKM 2017, Singapore, Singapore, 06 - 10 November 2017. New York, New York, United States: Association for Computing Machinery. doi: 10.1145/3132847.3132978
Crowdsourcing Relevance Assessments: The Unexpected Benefits of Limiting the Time to Judge
Maddalena, Eddy, Basaldella, Marco, De Nart, Dario, Degl'Innocenti, Dante, Mizzaro, Stefano and Demartini, Gianluca (2016). Crowdsourcing Relevance Assessments: The Unexpected Benefits of Limiting the Time to Judge. AAAI Press.
A tutorial on leveraging knowledge graphs for web search
Demartini, Gianluca (2016). A tutorial on leveraging knowledge graphs for web search. 9th Russian Summer School in Information Retrieval (RuSSIR), St Petersburg, Russia, 24-28 August 2015. Cham, Switzerland: Springer Verlag. doi: 10.1007/978-3-319-41718-9_2
Crowdsourcing relevance assessments: the unexpected benefits of limiting the time to judge
Maddalena, Eddy, Basaldella, Marco, De Nart, Dario, Degl'Innocenti, Dante, Mizzaro, Stefano and Demartini, Gianluca (2016). Crowdsourcing relevance assessments: the unexpected benefits of limiting the time to judge. The 4th AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2016), Austin, TX, United States, 31 October-2 November 2016. Palo Alto, CA, United States: Association for the Advancement of Artificial Intelligence.
Exploring entity-centric methods in the UK Government Web Archive
Webster, Philip, Clough, Paul, Demartini, Gianluca, Storrar, Tom, Ranade, Sonia and Seaman, Graham (2016). Exploring entity-centric methods in the UK Government Web Archive. 1st International Workshop on Accessing Cultural Heritage at Scale, ACHS 2016, Newark, NJ, United States, 22 June 2016. Aachen, Germany: CEUR-WS.
Modeling task complexity in crowdsourcing
Yang, Jie, Redi, Judith, Demartini, Gianluca and Bozzon, Alessandro (2016). Modeling task complexity in crowdsourcing. The 4th AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2016), Austin, TX, United States, 31 October-2 November 2016. Palo Alto, CA, United States: Association for the Advancement of Artificial Intelligence.
Scheduling human intelligence tasks in multi-tenant crowd-powered systems
Difallah, Djellel Eddine, Demartini, Gianluca and Cudré-Mauroux, Philippe (2016). Scheduling human intelligence tasks in multi-tenant crowd-powered systems. 25th International World Wide Web Conference, WWW 2016, Montreal, QC, Canada, 11-15 April 2016. Geneva, Switzerland: International World Wide Web Conferences Steering Committee. doi: 10.1145/2872427.2883030
Search behaviour before and after search success
Zhuang, Mengdie, Toms, Elaine G. and Demartini, Gianluca (2016). Search behaviour before and after search success. 2nd International Workshop on Search as Learning, SAL 2016, Pisa, Italy, 21 July 21 2016. Aachen, Germany: Rheinisch-Westfaelische Technische Hochschule Aachen * Lehrstuhl Informatik V.
Zhuang, Mengdie, Toms, Elaine G. and Demartini, Gianluca (2016). The relationship between user perception and user behaviour in interactive information retrieval evaluation. 38th European Conference on IR Research, ECIR 2016, Padua, Italy, 20-23 March 2016. Cham, Switzerland: Springer. doi: 10.1007/978-3-319-30671-1_22
Fixing the domain and range of properties in linked data by context disambiguation
Tonon, Alberto, Catasta, Michele, Demartini, Gianluca and Cudré-Mauroux, Philippe (2015). Fixing the domain and range of properties in linked data by context disambiguation. Proceedings of the Workshop on Linked Data on the Web co-located with the 24th International World Wide Web Conference (WWW 2015), Florence, Italy, 19 May 2015. Aachen, Germany: CEUR-WS.
The dynamics of micro-task crowdsourcing: the case of amazon MTurk
Difallah, Djellel Eddine, Catasta, Michele, Demartini, Gianluca, Ipeirotis, Panagiotis G. and Cudré-Mauroux, Philippe (2015). The dynamics of micro-task crowdsourcing: the case of amazon MTurk. 24th International Conference on World Wide Web, WWW 2015, Florence, Italy, 18 - 22 May 2015. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/2736277.2741685
Understanding malicious behavior in crowdsourcing platforms: the case of online surveys
Gadiraju, Ujwal, Kawase, Ricardo, Dietze, Stefan and Demartini, Gianluca (2015). Understanding malicious behavior in crowdsourcing platforms: the case of online surveys. 33rd Annual CHI Conference on Human Factors in Computing Systems - CHI'15, Seoul, South Korea, 18 - 23 April 2015. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/2702123.2702443
B-hist: entity-centric search over personal web browsing history
Catasta, Michele, Tonon, Alberto, Demartini, Gianluca, Ranvier, Jean-Eudes, Aberer, Karl and Cudre-Mauroux, Philippe (2014). B-hist: entity-centric search over personal web browsing history. Amsterdam, Netherlands: Elsevier BV. doi: 10.1016/j.websem.2014.07.003
Correct me if I'm wrong: fixing grammatical errors by preposition ranking
Prokofyev, Roman, Mavlyutov, Ruslan, Grund, Martin, Demartini, Gianluca and Cudré-Mauroux, Philippe (2014). Correct me if I'm wrong: fixing grammatical errors by preposition ranking. 23rd ACM International Conference on Conference on Information and Knowledge Management - CIKM, Shanghai, China, 3 - 7 November 2014. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/2661829.2661942
Effective named entity recognition for idiosyncratic web collections
Prokofyev, Roman, Demartini, Gianluca and Cudré-Mauroux, Philippe (2014). Effective named entity recognition for idiosyncratic web collections. 23rd International Conference on World Wide Web, WWW 2014, Seoul, Korea , April 07 - 11, 2014 . New York, NY, USA: Association for Computing Machinery. doi: 10.1145/2566486.2568013
Hippocampus: answering memory queries using transactive search
Catasta, Michele, Tonon, Alberto, Difallah, Djellel Eddine, Demartini, Gianluca, Aberer, Karl and Cudre-Mauroux, Philippe (2014). Hippocampus: answering memory queries using transactive search. International Conference on World Wide Web, Seoul, Korea, 7-11 April 2014. New York, NY, United States: ACM Press. doi: 10.1145/2567948.2576946
Scaling-up the crowd: micro-task pricing schemes for worker retention and latency improvement
Difallah, Djellel Eddine, Catasta, Michele, Demartini, Gianluca and Cudré-Mauroux, Philippe (2014). Scaling-up the crowd: micro-task pricing schemes for worker retention and latency improvement. Second AAAI Conference on Human Computation and Crowdsourcing (HCOMP-2014), Pittsburgh, PA, United States, 2 - 4 November 2014. Palo Alto, CA, United States: A A A I Press.
TransactiveDB: Tapping into collective human memories
Catastay, Michele, Tonon, Alberto, Difallah, Djellel Eddine, Demartini, Gianluca, Aberery, Karl and CudreMauroux, Philippe (2014). TransactiveDB: Tapping into collective human memories. 3rd Workshop on Spatio-Temporal Database Management, STDBM 2006, Co-located with the 32nd International Conference on Very Large Data Bases, VLDB 2006, Seoul, Korea, September 11, 2006. New York, NY United States: Association for Computing Machinery.
CrowdQ: Crowdsourced Query Understanding
Demartini, Gianluca , Trushkowsky, Beth , Kraska, Tim and Franklin, Michael (2013). CrowdQ: Crowdsourced Query Understanding. 6th Biennial Conference on Innovative Data Systems Research (CIDR 2013), Asilomar, CA, United States, 6-9 January 2013. Conference on Innovative Data Systems Research (CIDR).
Entity disambiguation in tweets leveraging user social profiles
Yerva, Surender Reddy, Catasta, Michele, Demartini, Gianluca and Aberer, Karl (2013). Entity disambiguation in tweets leveraging user social profiles. 2013 IEEE 14th International Conference on Information Reuse and Integration, IEEE IRI 2013, San Francisco, CA, Unites States, 14 - 16 August 2013. Piscataway, NJ, United States: Institute of Electrical and Electronics Engineers. doi: 10.1109/IRI.2013.6642462
Ontology-based word sense disambiguation for scientific literature
Prokofyev, Roman, Demartini, Gianluca, Boyarsky, Alexey, Ruchayskiy, Oleg and Cudré-Mauroux, Philippe (2013). Ontology-based word sense disambiguation for scientific literature. 35th European Conference on IR Research, ECIR 2013, Moscow, Russia, 24-27 March 2013. Berlin, Germany: Springer. doi: 10.1007/978-3-642-36973-5_50
Difallah, Djellel Eddine, Demartini, Gianluca and Cudré-Mauroux, Philippe (2013). Pick-a-crowd: tell me what you like, and I'll tell you what to do: a crowdsourcing platform for personalized human intelligence task assignment based on social networks. 22nd International Conference on World Wide Web, WWW 2013, Rio de Janeiro, Brazil, 13 - 17 May 2013. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/2488388.2488421
TRank: ranking entity types using the web of data
Tonon, Alberto, Catasta, Michele, Demartini, Gianluca, Mauroux, Philippe Cudre and Aberer, Karl (2013). TRank: ranking entity types using the web of data. 12th International Semantic Web Conference (ISWC), Sydney, Australia, 21-25 October, 2013. Berlin, Germany: Springer-Verlag. doi: 10.1007/978-3-642-41335-3_40
BowlognaBench-Benchmarking RDF analytics
Demartini, Gianluca, Enchev, Iliya, Wylot, Marcin, Gapany, Joel and Cudre-Mauroux, Philippe (2012). BowlognaBench-Benchmarking RDF analytics. First International Symposium on Data-Driven Process Discovery and Analysis (SIMPDA 2011), Campione D’Italia, Italy, 29 June - 1 July, 2011. Heidelberg, Germany: Springer. doi: 10.1007/978-3-642-34044-4_5
Combining inverted indices and structured search for ad-hoc object retrieval
Tonon, Alberto, Demartini, Gianluca and Cudré-Mauroux, Philippe (2012). Combining inverted indices and structured search for ad-hoc object retrieval. 35th Annual ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2012, Portland, OR, United States, 12 - 16 August 2012. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/2348283.2348304
Downscaling Entity Registries for Ad-Hoc Environments
Cudré-Mauroux, Philippe , Demartini, Gianluca , Enchev, Iliya , Guéret, Christophe and Perroud, Benoit (2012). Downscaling Entity Registries for Ad-Hoc Environments. First International Workshop on Downscaling the Semantic Web co-located with the 9th Extended Semantic Web conference, Heraklion, Greece, May 2012.
Mechanical cheat: Spamming schemes and adversarial techniques on crowdsourcing platforms
Difallah, Djellel Eddine, Demartini, Gianluca and Cudré-Mauroux, Philippe (2012). Mechanical cheat: Spamming schemes and adversarial techniques on crowdsourcing platforms. 1st International Workshop on Crowdsourcing Web Search, CrowdSearch 2012 - Workshop Held in Conjunction with WWW 2012 Conference, Lyon; France, April 17, 2012.
Predicting the future impact of news events
Gaugaz, Julien, Siehndel, Patrick, Demartini, Gianluca, Iofciu, Tereza, Georgescu, Mihai and Henze, Nicola (2012). Predicting the future impact of news events. 34th European Conference on IR Research, ECIR 2012, Barcelona, Spain, 1-5 April 2012. Berlin, Germany: Springer. doi: 10.1007/978-3-642-28997-2_5
Tag recommendation for large-scale ontology-based information systems
Prokofyev, Roman, Boyarsky, Alexey, Ruchayskiy, Oleg, Aberer, Karl, Demartini, Gianluca and Cudré-Mauroux, Philippe (2012). Tag recommendation for large-scale ontology-based information systems. International Semantic Web Conference, Boston, MA, USA, November 11-15, 2012. Heidelberg, Germany: Springer. doi: 10.1007/978-3-642-35173-0-22
Demartini, Gianluca, Difallah, Djellel Eddine and Cudré-Mauroux, Philippe (2012). ZenCrowd: Leveraging probabilistic reasoning and crowdsourcing techniques for large-scale entity linking. 21st Annual Conference on World Wide Web, WWW'12, Lyon, France, 16-20 April 2012. New York, NY, United States: ACM. doi: 10.1145/2187836.2187900
Demartini, Gianluca (2011). ARES: A Retrieval Engine based on Sentiments: sentiment-based search result annotation and diversification. 33rd European Conference on Information Retrieval (ECIR 2011), Dublin, Ireland, 18-21 April, 2011. Heidelberg, Germany: Springer. doi: 10.1007/978-3-642-20161-5_91
An Integrated Socio-Technical Crowdsourcing Platform for Accelerating Returns in eScience
Aberer, Karl, Boyarsky, Alexey, Cudré-Mauroux, Philippe, Demartini, Gianluca and Ruchayskiy, Oleg (2011). An Integrated Socio-Technical Crowdsourcing Platform for Accelerating Returns in eScience. 10th International Semantic Web Conference (ISWC 2011 - Outrageous Ideas), Bonn, Germany, October 2011.
Analyzing Political Trends in the Blogosphere
Demartini, Gianluca , Siersdorfer, Stefan , Chelaru, Sergiu and Nejdl, Wolfgang (2011). Analyzing Political Trends in the Blogosphere. Fifth International AAAI Conference on Weblogs and Social Media (ICWSM 2011), Barcelona, Spain, July 2011. AAAI Press.
ReFER: effective relevance feedback for entity ranking
Iofciu, Tereza, Demartini, Gianluca, Craswell, Nick and de Vries, Arjen P. (2011). ReFER: effective relevance feedback for entity ranking. 33rd European Conference on Information Retrieval (ECIR 2011), Dublin, Ireland, 18-21 April, 2011. Heidelberg, Germany: Springer. doi: 10.1007/978-3-642-20161-5_26
ScienceWISE: A Web-based Interactive Semantic Platform for Scientific Collaboration
Cudré-Mauroux, Philippe, Demartini, Gianluca, Eddine Difallah, Djellel, Elsayed Mostafa, Ahmed, Russo, Vincenzo and Thomas, Matthew (2011). ScienceWISE: A Web-based Interactive Semantic Platform for Scientific Collaboration. 10th International Semantic Web Conference (ISWC 2011 - Demo), Bonn, Germany, October 2011.
Visual interfaces for stimulating exploratory search
Krestel, Ralf, Demartini, Gianluca and Herder, Eelco (2011). Visual interfaces for stimulating exploratory search. 11th annual international ACM/IEEE joint conference on Digital libraries, Ottawa, Ontario, Canada , June 13 - 17, 2011 . Piscataway, NJ United States: Institute of Electrical and Electronics Engineers. doi: 10.1145/1998076.1998151
Demartini, Gianluca and Siersdorfer, Stefan (2010). Dear search engine: What's your opinion about...? Sentiment analysis for semantic enrichment of web search results. 3rd International Semantic Search Workshop, SEMSEARCH '10, Co-located with the 19th International World Wide Web (WWW) Conference 2010, North Carolina, USA, April 26, 2010. New York, NY, USA: Association for Computing Machinery. doi: 10.1145/1863879.1863883
Entity Summarization of News Articles
Demartini, Gianluca, Missen, Malik Muhammad Saad, Blanco, Roi and Zaragoza, Hugo (2010). Entity Summarization of News Articles. 33rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Geneva Switzerland, Jul 19-23, 2010. New York, NY, USA: ASSOC COMPUTING MACHINERY. doi: 10.1145/1835449.1835620
Exploiting Click-Through Data for Entity Retrieval
Billerbeck, Bodo, Demartini, Gianluca, Firan, Claudiu S., Iofciu, Tereza and Krestel, Ralf (2010). Exploiting Click-Through Data for Entity Retrieval. 33rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Geneva Switzerland, Jul 19-23, 2010. New York, NY, USA: ASSOC COMPUTING MACHINERY. doi: 10.1145/1835449.1835624
Overview of the INEX 2009 entity ranking track
Demartini, Gianluca, Iofciu, Tereza and De Vries, Arjen P. (2010). Overview of the INEX 2009 entity ranking track. 8th International Workshop of the Initiative for the Evaluation of XML Retrieval, INEX 2009, Brisbane, AUSTRALIA, December 7-9, 2009. doi: 10.1007/978-3-642-14556-8_26
Ranking Entities Using Web Search Query Logs
Billerbeck, Bodo, Demartini, Gianluca, Firan, Claudiu S., Iofciu, Teresa and Krestel, Ralf (2010). Ranking Entities Using Web Search Query Logs. 14th European Conference on Research and Advanced Technology for Digital Libraries, Glasgow Scotland, Sep 06-10, 2010. SPRINGER-VERLAG BERLIN. doi: 10.1007/978-3-642-15464-5_28
TAER : time-aware entity retrieval-exploiting the past to find relevant entities in news articles
Demartini, Gianluca, Missen, Malik Muhammad Saad, Blanco, Roi and Zaragoza, Hugo (2010). TAER : time-aware entity retrieval-exploiting the past to find relevant entities in news articles. 19th ACM international conference on Information and knowledge management, Toronto, ON, Canada , October 26 - 30, 2010 . New York, New York, USA: ACM Press. doi: 10.1145/1871437.1871661
The missing links : discovering hidden same-as links among a billion of triples
Papadakis, George, Demartini, Gianluca, Fankhauser, Peter and Kärger, Philipp (2010). The missing links : discovering hidden same-as links among a billion of triples. 12th International Conference on Information Integration and Web-based Applications & Services, Paris, France, November 08 - 10, 2010 . New York, New York, USA: ACM Press. doi: 10.1145/1967486.1967557
A Vector Space Model for Ranking Entities and Its Application to Expert Search
Demartini, Gianluca, Gaugaz, Julien and Nejdl, Wolfgang (2009). A Vector Space Model for Ranking Entities and Its Application to Expert Search. 31st European Conference on Information Research, Toulouse France, Apr 06-09, 2009. SPRINGER-VERLAG BERLIN. doi: 10.1007/978-3-642-00958-7_19
An architecture for finding entities on the web
Demartini, Gianluca, Firan, Claudiu S., Georgescu, Mihai, Iofciu, Tereza, Krestel, Ralf and Nejdl, Wolfgang (2009). An architecture for finding entities on the web. 7th Joint LA-WEB/CLIHC Conference 2009, Merida Mexico, Nov 09-11, 2009. doi: 10.1109/LA-WEB.2009.14
Current approaches to search result diversification
Minack, Enrico , Demartini, Gianluca and Nejdl, Wolfgang (2009). Current approaches to search result diversification. 1st International Workshop on Living Web: Making Web Diversity a true asset at ISWC 2009, Washington, DC, United States, October 2009.
How to Trace and Revise Identities
Gaugaz, Julien, Zakrzewski, Jakub, Demartini, Gianluca and Nejdl, Wolfgang (2009). How to Trace and Revise Identities. 6th European Sematic Web Conference, Heraklion Greece, May 31-Jun 04, 2009. SPRINGER-VERLAG BERLIN. doi: 10.1007/978-3-642-02121-3_32
L3S at INEX 2008: Retrieving Entities Using Structured Information
Craswell, Nick, Demartini, Gianluca, Gaugaz, Julien and Iofciu, Tereza (2009). L3S at INEX 2008: Retrieving Entities Using Structured Information. 7th International Workshop of the Initiative for the Evaluation of XML Retrieval, Dagstuhl Germany, Dec 15-18, 2008. SPRINGER-VERLAG BERLIN. doi: 10.1007/978-3-642-03761-0_26
Time based tag recommendation using direct and extended users sets
Iofciu, Tereza and Demartini, Gianluca (2009). Time based tag recommendation using direct and extended users sets. International Workshop on Discovery Challenge, DC 2009 at the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, ECML PKDD 2009, Bled, Slovenia, September 7, 2009. Aachen, Germany: Rheinisch-Westfaelische Technische Hochschule Aachen.
A model for Ranking entities and its application to Wikipedia
Demartini, Gianluca, Firan, Claudiu S., Iofciu, Tereza, Krestel, Ralf and Nejdl, Wolfgang (2008). A model for Ranking entities and its application to Wikipedia. 6th Latin American Web Conference, Vitoria Brazil, Oct 28-30, 2008. doi: 10.1109/LA-WEB.2008.8
Comparing People in the Enterprise
Demartini, Gianluca (2008). Comparing People in the Enterprise. 10th International Conference on Enterprise Information Systems, Barcelona Spain, Jun 12-16, 2008. INSTICC-INST SYST TECHNOLOGIES INFORMATION CONTROL & COMMUNICATION.
Entity identifiers for lineage preservation
Gaugaz, Julien and Demartini, Gianluca (2008). Entity identifiers for lineage preservation. 1st International Workshop on Identity and Reference on the Semantic Web, IRSW 2008, Tenerife, Spain, June 2 2008. Aachen, Germany: Lehrstuhl Informatik V, Rheinisch-Westfaelische Technische Hochschule Aachen.
Evaluating Personal Information Management Using an Activity Logs Enriched Desktop Dataset
Chernov, Sergey , Demartini, Gianluca , Herder, Eelco , Kopycki, Michał and Nejdl, Wolfgang (2008). Evaluating Personal Information Management Using an Activity Logs Enriched Desktop Dataset. "Personal Information Management Workshop at CHI 2008" PIM 2008, Florence, Italy, April, 2008.
Evaluating Relation Retrieval for Entities and Experts
Zhu, Jianhan, de Vries, Arjen P., Demartini, Gianluca and Iofciu, Tereza (2008). Evaluating Relation Retrieval for Entities and Experts. Future Challenges in Expertise Retrieval (fCHER 2008), SIGIR 2008 Workshop, Singapore, 24 July 2008. New York, NY United States: Association for Computing Machinery.
Finding experts on the semantic desktop
Demartini, Gianluca and Niederée, Claudia (2008). Finding experts on the semantic desktop. 3rd Expert Finder Workshop on Personal Identification and Collaborations: Knowledge Mediation and Extraction, PICKME 2008, Karlsruhe, Germany, October 27 2008. Aachen, Germany: Lehrstuhl Informatik V, Rheinisch-Westfaelische Technische Hochschule Aachen.
How Many Experts? - A New Task for Enterprise Search Evaluation
Demartini, Gianluca (2008). How Many Experts? - A New Task for Enterprise Search Evaluation. Workshop on Novel Methodologies for Evaluation in Information Retrieval at the 30th European Conference on IR Research, ECIR 2008, Glasgow, Scotland, April, 2008.
L3S at INEX 2007: Query Expansion for Entity Ranking Using a Highly Accurate Ontology
Demartini, Gianluca, Firan, Claudiu S. and Iofciu, Tereza (2008). L3S at INEX 2007: Query Expansion for Entity Ranking Using a Highly Accurate Ontology. 6th International Workshop of the Initiative for the Evaluation of XML Retrieval, Dagstuhl Germany, Dec 17-19, 2007. SPRINGER-VERLAG BERLIN. doi: 10.1007/978-3-540-85902-4_23
Ranking categories for web search
Demartini, Gianluca, Chirita, Paul-Alexandru, Brunkhorst, Ingo and Nejdl, Wolfgang (2008). Ranking categories for web search. 30th European Conference on Information Retrieval (ECIR 2008), Glasgow Scotland, Mar 30-Apr 03, 2008. SPRINGER-VERLAG BERLIN. doi: 10.1007/978-3-540-78646-7_56
Semantically Enhanced Entity Ranking
Demartini, Gianluca, Firan, Claudiu S., Iofciu, Tereza and Nejdl, Wolfgang (2008). Semantically Enhanced Entity Ranking. International Workshop on Web Information Systems Engineering (WISE 2008), Auckland New Zealand, Sep 01-04, 2008. SPRINGER-VERLAG BERLIN. doi: 10.1007/978-3-540-85481-4_15
Social recommendations of content and metadata
Stecher, Rodolfo, Demartini, Gianluca and Niederée, Claudia (2008). Social recommendations of content and metadata. 10th International Conference on Information Integration and Web-based Applications & Services, Linz, Austria, 24 - 26 November 2008. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/1497308.1497329
Building a desktop search test-bed
Chernov, Sergey, Serdyukov, Pavel, Chirita, Paul-Alexandru, Demartini, Gianluca and Nejdl, Wolfgang (2007). Building a desktop search test-bed. 29th European Conference in Information Retrieval Research (ECIR 2007), Rome Italy, Apr 02-05, 2007. SPRINGER-VERLAG BERLIN. doi: 10.1007/978-3-540-71496-5_69
Finding Experts Using Wikipedia
Demartini, Gianluca (2007). Finding Experts Using Wikipedia. "Finding Experts on the Web with Semantics Workshop at ISWC 2007 + ASWC 2007" FEWS 2007, Busan, South Korea, November, 2007..
Leveraging semantic technologies for enterprise search
Demartini, Gianluca (2007). Leveraging semantic technologies for enterprise search. International Conference on Information and Knowledge Management, Lisbon, Portugal , November 09 - 09, 2007 . New York, NY, USA: ACM. doi: 10.1145/1316874.1316879
A classification of IR effectiveness metrics
Demartini, Gianluca and Mizzaro, Stefano (2006). A classification of IR effectiveness metrics. European Conference on Information Retrieval ECIR 2006, London, United Kingdom , April 10-12, 2006. Heidelberg, Germany: Springer. doi: 10.1007/11735106_48
Experiments on average distance measure
Della Mea, Vincenzo, Demartini, Gianluca, Di Gaspero, Luca and Mizzaro, Stefano (2006). Experiments on average distance measure. 28th European Conference on IR research, ECIR 2006, London, United Kingdom, 10-12 April 2006. Berlin, Germany: Springer.
L3S research center at TREC 2006 enterprise track
Chernov, Sergey, Demartini, Gianluca and Gaugaz, Julien (2006). L3S research center at TREC 2006 enterprise track. 15th Text REtrieval Conference, TREC 2006, Gaithersburg, MD; United States, November 14-17, 2006.
UQ Single Column Format Inconsistency Datasets
Demartini, Gianluca, Chen, Tianwa, Sadiq, Shazia, Fan, Shaoyang, Xu, Jiechen, Han, Lei and Yu, Shaochen (2023). UQ Single Column Format Inconsistency Datasets. The University of Queensland. (Dataset) doi: 10.48610/0ab54e7
Measuring the Gender Gap: Attribute-based Class Completeness Estimation
(2023–2024) Wikimedia Foundation (US)
(2022–2025) University of Zurich
Human-in-the-loop Natural Language Processing in GLAM
(2022–2024) Universities Australia - Germany Joint Research Co-operation Scheme
Monitoring and Modeling Human Annotator Behaviors in Mephisto
(2022–2023) Meta AI Mephisto Dataset Collection Tool
ARC Training Centre for Information Resilience
(2021–2026) ARC Industrial Transformation Training Centres
Human-in-the-loop Chimpanzee Identification
(2021–2023) Google AI for Social Good
Crowdsourcing an Online Safety Benchmark for Fake News Identification
(2019–2024) Facebook Online Safety Benchmark Research Award
Building crowd sourced data curation processes
(2019–2023) ARC Discovery Projects
Collaborative Lab of Health Informatics with Neusoft
(2019–2022) Neusoft Research of Intelligent Healthcare Technology, Co Ltd
DESCANT : DEtecting Stereotypes in human ComputAtioN Tasks
(2019–2022) CYENS Centre of Excellence
Artificial Intelligence with Humans in the Loop
(2019) UQ Early Career Researcher
Bias Mitigation in Human in the Loop Decision Systems
Doctor Philosophy — Principal Advisor
Other advisors:
Human-centered Artificial Intelligence for Democracy
Doctor Philosophy — Principal Advisor
Customer Data Stories
Doctor Philosophy — Principal Advisor
Other advisors:
Investigation of crowd sourced data curation behaviour for repurposed datasets
Doctor Philosophy — Principal Advisor
Other advisors:
Investigation of Micro-Services Architecture for Data Curation
Doctor Philosophy — Principal Advisor
Other advisors:
Human-in-the-loop Quality Management
Doctor Philosophy — Principal Advisor
Other advisors:
Efficient Next-Generation Information Retrieval Systems
Doctor Philosophy — Associate Advisor
Other advisors:
Integrating Human and Machine Intelligence Towards the Development of an Adaptive Learning System
Doctor Philosophy — Associate Advisor
Other advisors:
Extreme Analytics
Doctor Philosophy — Associate Advisor
Other advisors:
AI-driven Effective Query Formulation for Better Systematic Reviews
Doctor Philosophy — Associate Advisor
Other advisors:
Critical Success Factors in Data Driven Value Creation
Doctor Philosophy — Associate Advisor
Other advisors:
Crowd Sourced Data Curation
Doctor Philosophy — Associate Advisor
Other advisors:
Improving the Work Environment and Data Quality in Micro-Task Crowdsourcing
(2023) Doctor Philosophy — Principal Advisor
Other advisors:
(2021) Doctor Philosophy — Principal Advisor
Other advisors:
A Study on Embedding-based Entity Alignment
(2023) Doctor Philosophy — Associate Advisor
Countering Lead Bias in Extractive Document Summarization
(2022) Master Philosophy — Associate Advisor
Search Engines that Help People Make Better Health Decisions
(2020) Doctor Philosophy — Associate Advisor
Other advisors:
View Recommendation for Visual Data Exploration
(2019) Doctor Philosophy — Associate Advisor