Dr. Gianluca Demartini is an Associate Professor in Data Science at the University of Queensland, Australia. His main research interests include Information Retrieval, Semantic Web, and Human Computation. His research is currently funded by the Australian Research Council, Facebook, and Google. He received Best Paper awards at the AAAI Conference on Human Computation and Crowdsourcing (HCOMP) in 2018, at the European Conference on Information Retrieval (ECIR) in 2016 and 2020, and the Best Demo award at the International Semantic Web Conference (ISWC) in 2011. He has published more than 150 peer-reviewed scientific publications including papers at major venues such as WWW, ACM SIGIR, VLDBJ, ISWC, and ACM CHI. He is an ACM Senior Member, ACM Distinguished Speaker, TEDx speaker, and CIKM 2021 General co-chair.
Before joining the University of Queensland, he was Lecturer at the University of Sheffield in UK, post-doctoral researcher at the eXascale Infolab at the University of Fribourg in Switzerland, visiting researcher at UC Berkeley, junior researcher at the L3S Research Center in Germany, and intern at Yahoo! Research in Spain. In 2011, he obtained a Ph.D. in Computer Science at the Leibniz University of Hanover focusing on Semantic Search.
The research led by A/Prof. Demartini focuses on improving the efficiency and effectiveness of human-in-the-loop artificial intelligence systems. The application domains of his research include text analytics and the intersection between structured (e.g., knowledge graphs) and unstructured (e.g., text) digital content. During his research career he has collaborated with colleagues from several industry and governmental organizations like for example, Facebook,m Google, Microsoft, Yahoo!, IBM, SAP, and The National Archives in the UK.
Conference Publication: Modelling User Behavior Dynamics with Embeddings
Han, Lei, Checco, Alessandro, Difallah, Djellel, Demartini, Gianluca and Sadiq, Shazia (2020). Modelling User Behavior Dynamics with Embeddings. 29th ACM International Conference on Information & Knowledge Management, Online, 19-23 October 2020. New York, NY United States: Association for Computing Machinery. doi: 10.1145/3340531.3411985
Journal Article: CrowdCO-OP: sharing risks and rewards in crowdsourcing
Fan, Shaoyang, Gadiraju, Ujwal, Checco, Alessandro and Demartini, Gianluca (2020). CrowdCO-OP: sharing risks and rewards in crowdsourcing. Proceedings of the ACM on Human-Computer Interaction, 4 (CSCW2) 132, 1-24. doi: 10.1145/3415203
Conference Publication: Can the crowd identify misinformation objectively?: The effects of judgment scale and assessor's background
Roitero, Kevin, Soprano, Michael, Fan, Shaoyang, Spina, Damiano, Mizzaro, Stefano and Demartini, Gianluca (2020). Can the crowd identify misinformation objectively?: The effects of judgment scale and assessor's background. International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, China, 25-30 July 2020. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3397271.3401112
Journal Article: Adversarial attacks on crowdsourcing quality control
Checco, Alessandro, Bates, Jo and Demartini, Gianluca (2020). Adversarial attacks on crowdsourcing quality control. Journal of Artificial Intelligence Research, 67, 375-408. doi: 10.1613/jair.1.11332
Conference Publication: Crowd worker strategies in relevance judgment tasks
Han, Lei, Maddalena, Eddy, Checco, Alessandro, Sarasua, Cristina, Gadiraju, Ujwal, Roitero, Kevin and Demartini, Gianluca (2020). Crowd worker strategies in relevance judgment tasks. 13th International Conference on Web Search and Data Mining, Houston, Texas, 3-7 February 2020. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3336191.3371857
Conference Publication: On understanding data worker interaction behaviors
Han, Lei, Chen, Tianwa, Demartini, Gianluca, Indulska, Marta and Sadiq, Shazia (2020). On understanding data worker interaction behaviors. SIGIR '20: The 43rd International ACM SIGIR conference on research and development in Information Retrieval, Virtual Event China, July 2020. New York, NY USA: Association for Computing Machinery. doi: 10.1145/3397271.3401059
Conference Publication: All those wasted hours: on task abandonment in crowdsourcing
Han, Lei, Roitero, Kevin, Gadiraju, Ujwal, Sarasua, Cristina, Checco, Alessandro, Maddalena, Eddy and Demartini, Gianluca (2019). All those wasted hours: on task abandonment in crowdsourcing. 12th ACM International Conference on Web Search and Data Mining, WSDM 2019, Melbourne, VIC Australia , 11-15 February 2019. New York, NY USA: Association for Computing Machinery. doi: 10.1145/3289600.3291035
Conference Publication: Scalpel-CD: leveraging crowdsourcing and deep probabilistic modeling for debugging noisy training data
Yang, Jie, Demartini, Gianluca, Smirnova, Alisa, Lu, Yuan, Yang, Dingqi and Cudré-Mauroux, Philippe (2019). Scalpel-CD: leveraging crowdsourcing and deep probabilistic modeling for debugging noisy training data. World Wide Web Conference (WWW), San Francisco, CA, United States, 13-17 May 2019. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3308558.3313599
Conference Publication: On fine-grained relevance scales
Roitero, Kevin, Maddalena, Eddy, Demartini, Gianluca and Mizzaro, Stefano (2018). On fine-grained relevance scales. 41st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2018, Ann Arbor, MI, United States, 8-12 July 2018. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3209978.3210052
Journal Article: An introduction to hybrid human-machine information systems
Demartini, Gianluca, Difallah, Djellel Eddine, Gadiraju, Ujwal and Catasta, Michele (2017). An introduction to hybrid human-machine information systems. Foundations and Trends in Web Science, 7 (1), 1-87. doi: 10.1561/1800000025
Conference Publication: The dynamics of micro-task crowdsourcing: the case of amazon MTurk
Difallah, Djellel Eddine, Catasta, Michele, Demartini, Gianluca, Ipeirotis, Panagiotis G. and Cudré-Mauroux, Philippe (2015). The dynamics of micro-task crowdsourcing: the case of amazon MTurk. 24th International Conference on World Wide Web, WWW 2015, Florence, Italy, 18 - 22 May 2015. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/2736277.2741685
Conference Publication: Understanding malicious behavior in crowdsourcing platforms: the case of online surveys
Gadiraju, Ujwal, Kawase, Ricardo, Dietze, Stefan and Demartini, Gianluca (2015). Understanding malicious behavior in crowdsourcing platforms: the case of online surveys. 33rd Annual CHI Conference on Human Factors in Computing Systems - CHI'15, Seoul, South Korea, 18 - 23 April 2015. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/2702123.2702443
(2022–2025) University of Zurich
Human-in-the-loop Natural Language Processing in GLAM
(2022–2023) Universities Australia - Germany Joint Research Co-operation Scheme
Monitoring and Modeling Human Annotator Behaviors in Mephisto
(2022–2023) Meta AI Mephisto Dataset Collection Tool
Explainable Machine Learning for Coral Classification
Doctor Philosophy
(2021) Doctor Philosophy
Investigation of Micro-Services Architecture for Data Curation
Doctor Philosophy
Modelling User Behavior Dynamics with Embeddings
Han, Lei, Checco, Alessandro, Difallah, Djellel, Demartini, Gianluca and Sadiq, Shazia (2020). Modelling User Behavior Dynamics with Embeddings. 29th ACM International Conference on Information & Knowledge Management, Online, 19-23 October 2020. New York, NY United States: Association for Computing Machinery. doi: 10.1145/3340531.3411985
CrowdCO-OP: sharing risks and rewards in crowdsourcing
Fan, Shaoyang, Gadiraju, Ujwal, Checco, Alessandro and Demartini, Gianluca (2020). CrowdCO-OP: sharing risks and rewards in crowdsourcing. Proceedings of the ACM on Human-Computer Interaction, 4 (CSCW2) 132, 1-24. doi: 10.1145/3415203
Roitero, Kevin, Soprano, Michael, Fan, Shaoyang, Spina, Damiano, Mizzaro, Stefano and Demartini, Gianluca (2020). Can the crowd identify misinformation objectively?: The effects of judgment scale and assessor's background. International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, China, 25-30 July 2020. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3397271.3401112
Adversarial attacks on crowdsourcing quality control
Checco, Alessandro, Bates, Jo and Demartini, Gianluca (2020). Adversarial attacks on crowdsourcing quality control. Journal of Artificial Intelligence Research, 67, 375-408. doi: 10.1613/jair.1.11332
Crowd worker strategies in relevance judgment tasks
Han, Lei, Maddalena, Eddy, Checco, Alessandro, Sarasua, Cristina, Gadiraju, Ujwal, Roitero, Kevin and Demartini, Gianluca (2020). Crowd worker strategies in relevance judgment tasks. 13th International Conference on Web Search and Data Mining, Houston, Texas, 3-7 February 2020. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3336191.3371857
On understanding data worker interaction behaviors
Han, Lei, Chen, Tianwa, Demartini, Gianluca, Indulska, Marta and Sadiq, Shazia (2020). On understanding data worker interaction behaviors. SIGIR '20: The 43rd International ACM SIGIR conference on research and development in Information Retrieval, Virtual Event China, July 2020. New York, NY USA: Association for Computing Machinery. doi: 10.1145/3397271.3401059
All those wasted hours: on task abandonment in crowdsourcing
Han, Lei, Roitero, Kevin, Gadiraju, Ujwal, Sarasua, Cristina, Checco, Alessandro, Maddalena, Eddy and Demartini, Gianluca (2019). All those wasted hours: on task abandonment in crowdsourcing. 12th ACM International Conference on Web Search and Data Mining, WSDM 2019, Melbourne, VIC Australia , 11-15 February 2019. New York, NY USA: Association for Computing Machinery. doi: 10.1145/3289600.3291035
Yang, Jie, Demartini, Gianluca, Smirnova, Alisa, Lu, Yuan, Yang, Dingqi and Cudré-Mauroux, Philippe (2019). Scalpel-CD: leveraging crowdsourcing and deep probabilistic modeling for debugging noisy training data. World Wide Web Conference (WWW), San Francisco, CA, United States, 13-17 May 2019. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3308558.3313599
On fine-grained relevance scales
Roitero, Kevin, Maddalena, Eddy, Demartini, Gianluca and Mizzaro, Stefano (2018). On fine-grained relevance scales. 41st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2018, Ann Arbor, MI, United States, 8-12 July 2018. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3209978.3210052
An introduction to hybrid human-machine information systems
Demartini, Gianluca, Difallah, Djellel Eddine, Gadiraju, Ujwal and Catasta, Michele (2017). An introduction to hybrid human-machine information systems. Foundations and Trends in Web Science, 7 (1), 1-87. doi: 10.1561/1800000025
The dynamics of micro-task crowdsourcing: the case of amazon MTurk
Difallah, Djellel Eddine, Catasta, Michele, Demartini, Gianluca, Ipeirotis, Panagiotis G. and Cudré-Mauroux, Philippe (2015). The dynamics of micro-task crowdsourcing: the case of amazon MTurk. 24th International Conference on World Wide Web, WWW 2015, Florence, Italy, 18 - 22 May 2015. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/2736277.2741685
Understanding malicious behavior in crowdsourcing platforms: the case of online surveys
Gadiraju, Ujwal, Kawase, Ricardo, Dietze, Stefan and Demartini, Gianluca (2015). Understanding malicious behavior in crowdsourcing platforms: the case of online surveys. 33rd Annual CHI Conference on Human Factors in Computing Systems - CHI'15, Seoul, South Korea, 18 - 23 April 2015. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/2702123.2702443
From people to entities: new semantic search paradigms for the web
Demartini, Gianluca (2014). From people to entities: new semantic search paradigms for the web. Amsterdam, Netherlands: IOS Press.
Artificial intelligence needs human intervention to combat online hate
Demartini, Gianluca and Wilson-Barnao, Caroline (2022). Artificial intelligence needs human intervention to combat online hate. Conflict in My Outlook. (pp. 1-30) edited by Anna Briers, Nicholas Carah and Holly Arden. Melbourne, VIC, Australia: Perimiter.
Demartini, Gianluca (2019). Semantic Interlinking. Encyclopedia of Big Data Technologies. (pp. 1496-1500) Cham, Switzerland: Springer. doi: 10.1007/978-3-319-77525-8_229
Ahmed, Wasim, Bath, Peter A. and Demartini, Gianluca (2017). Chapter 4: Using Twitter as a Data Source: An Overview of Ethical, Legal, and Methodological Challenges. The Ethics of Online Research. (pp. 79-107) Bingley, United Kingdom: Emerald Publishing . doi: 10.1108/s2398-601820180000002004
Zhuang, Mengdie, Toms, Elaine G. and Demartini, Gianluca (2016). The relationship between user perception and user behaviour in interactive information retrieval evaluation. 38th European conference on IR Research, ECIR 2016. (pp. 293-305) Switzerland: Springer Verlag. doi: 10.1007/978-3-319-30671-1_22
NoizCrowd: A Crowd-Based Data Gathering and Management System for Noise Level Data
Wisniewski, Mariusz, Demartini, Gianluca, Malatras, Apostolos and Cudré-Mauroux, Philippe (2013). NoizCrowd: A Crowd-Based Data Gathering and Management System for Noise Level Data. Mobile Web Information Systems. (pp. 172-186) Heidelberg, Germany: Springer . doi: 10.1007/978-3-642-40276-0_14
Ontology-based word sense disambiguation for scientific literature
Prokofyev, Roman, Demartini, Gianluca, Boyarsky, Alexey, Ruchayskiy, Oleg and Cudré-Mauroux, Philippe (2013). Ontology-based word sense disambiguation for scientific literature. Advances in information retrieval: 35th European conference on IR research, ECIR 2013. (pp. 594-605) Berlin, Germany: Springer. doi: 10.1007/978-3-642-36973-5_50
Predicting the future impact of news events
Gaugaz, Julien, Siehndel, Patrick, Demartini, Gianluca, Iofciu, Tereza, Georgescu, Mihai and Henze, Nicola (2012). Predicting the future impact of news events. 34th European conference on IR research, ECIR 2012. (pp. 50-62) Berlin, Germany: Springer. doi: 10.1007/978-3-642-28997-2_5
Overview of the INEX 2008 Entity Ranking Track
Demartini, Gianluca, de Vries, Arjen P., Iofciu, Tereza and Zhu, Jianhan (2009). Overview of the INEX 2008 Entity Ranking Track. 7th International Workshop of the initiative for the evaluation of XML retrieval, INEX 2008. (pp. 243-252) Berlin, Germany: Springer Berlin Heidelberg. doi: 10.1007/978-3-642-03761-0_25
Experiments on average distance measure
Della Mea, Vincenzo, Demartini, Gianluca, Di Gaspero, Luca and Mizzaro, Stefano (2006). Experiments on average distance measure. Advances in information retrieval: 28th European Conference on IR research, ECIR 2006. (pp. 492-495) Berlin, Germany: Springer.
A Neural Model to Jointly Predict and Explain Truthfulness of Statements
Brand, Erik, Roitero, Kevin, Soprano, Michael, Rahimi, Afshin and Demartini, Gianluca (2022). A Neural Model to Jointly Predict and Explain Truthfulness of Statements. Journal of Data and Information Quality. doi: 10.1145/3546917
Information resilience: the nexus of responsible and agile approaches to information use
Sadiq, Shazia, Aryani, Amir, Demartini, Gianluca, Hua, Wen, Indulska, Marta, Burton-Jones, Andrew, Khosravi, Hassan, Benavides-Prado, Diana, Sellis, Timos, Someh, Ida, Vaithianathan, Rhema, Wang, Sen and Zhou, Xiaofang (2022). Information resilience: the nexus of responsible and agile approaches to information use. The VLDB Journal. doi: 10.1007/s00778-021-00720-2
DataOps-4G: On Supporting Generalists in Data Quality Discovery
Yu, Shaochen, Chen, Tianwa, Han, Lei, Demartini, Gianluca and Sadiq, Shazia (2022). DataOps-4G: On Supporting Generalists in Data Quality Discovery. IEEE Transactions on Knowledge and Data Engineering, 1-1. doi: 10.1109/tkde.2022.3151605
Soprano, Michael, Roitero, Kevin, La Barbera, David, Ceolin, Davide, Spina, Damiano, Mizzaro, Stefano and Demartini, Gianluca (2021). The many dimensions of truthfulness: crowdsourcing misinformation assessments on a multidimensional scale. Information Processing and Management, 58 (6) 102710, 1-22. doi: 10.1016/j.ipm.2021.102710
On the state of reporting in crowdsourcing experiments and a checklist to aid current practices
Ramírez, Jorge, Sayin, Burcu, Baez, Marcos, Casati, Fabio, Cernuzzi, Luca, Benatallah, Boualem and Demartini, Gianluca (2021). On the state of reporting in crowdsourcing experiments and a checklist to aid current practices. Proceedings of the ACM on Human-Computer Interaction, 5 (CSCW2) 387, 1-34. doi: 10.1145/3479531
Can the crowd judge truthfulness? A longitudinal study on recent misinformation about COVID-19
Roitero, Kevin, Soprano, Michael, Portelli, Beatrice, De Luise, Massimiliano, Spina, Damiano, Mea, Vincenzo Della, Serra, Giuseppe, Mizzaro, Stefano and Demartini, Gianluca (2021). Can the crowd judge truthfulness? A longitudinal study on recent misinformation about COVID-19. Personal and Ubiquitous Computing, 1-31. doi: 10.1007/s00779-021-01604-6
Evaluating the quality of learning resources: a Learnersourcing approach
Abdi, Solmaz, Khosravi, Hassan, Sadiq, Shazia and Demartini, Gianluca (2021). Evaluating the quality of learning resources: a Learnersourcing approach. IEEE Transactions on Learning Technologies, 14 (1) 9353264, 81-92. doi: 10.1109/tlt.2021.3058644
Making AI Machines Work for Humans in FoW
Amer-Yahia, Sihem, Basu Roy, Senjuti, Chen, Lei, Morishima, Atsuyuki, Abello Monedero, James, Bourhis, Pierre, Charoy, François, Danilevsky, Marina, Das, Gautam, Demartini, Gianluca, Dubey, Abhishek, Elbassuoni, Shady, Gross-Amblard, David, Hoareau, Emilie, Inoguchi, Munenari, Kenworthy, Jared, Kitahara, Itaru, Lee, Dongwon, Li, Yunyao, Borromeo, Ria Mae, Papotti, Paolo, Rao, Raghav, Roy, Sudeepa, Senellart, Pierre, Tajima, Keishi, Thirumuruganathan, Saravanan, Tommasi, Marion, Umemoto, Kazutoshi, Wiggins, Andrea and Yoshida, Koichiro (2020). Making AI Machines Work for Humans in FoW. SIGMOD Record, 49 (2), 30-35. doi: 10.1145/3442322.3442327
CrowdCO-OP: sharing risks and rewards in crowdsourcing
Fan, Shaoyang, Gadiraju, Ujwal, Checco, Alessandro and Demartini, Gianluca (2020). CrowdCO-OP: sharing risks and rewards in crowdsourcing. Proceedings of the ACM on Human-Computer Interaction, 4 (CSCW2) 132, 1-24. doi: 10.1145/3415203
Demartini, Gianluca, Mizzaro, Stefano and Spina, Damiano (2020). Human-in-the-loop Artificial Intelligence for Fighting Online Misinformation: Challenges and Opportunities. The Bulletin of the Technical Committee on Data Engineering, 65-74.
Adversarial attacks on crowdsourcing quality control
Checco, Alessandro, Bates, Jo and Demartini, Gianluca (2020). Adversarial attacks on crowdsourcing quality control. Journal of Artificial Intelligence Research, 67, 375-408. doi: 10.1613/jair.1.11332
Sarasua, Cristina, Checco, Alessandro, Demartini, Gianluca, Difallah, Djellel, Feldman, Michael and Pintscher, Lydia (2019). The evolution of power and standard wikidata editors: comparing editing behavior over time to predict lifespan and volume of edits. Computer Supported Cooperative Work: CSCW: An International Journal, 28 (5), 843-882. doi: 10.1007/s10606-018-9344-y
Novel insights into views towards H1N1 during the 2009 Pandemic: a thematic analysis of Twitter data
Ahmed, Wasim, Bath, Peter A., Sbaffi, Laura and Demartini, Gianluca (2019). Novel insights into views towards H1N1 during the 2009 Pandemic: a thematic analysis of Twitter data. Health Information and Libraries Journal, 36 (1), 60-72. doi: 10.1111/hir.12247
Deadline-aware fair scheduling for multi-tenant crowd-powered systems
Difallah, Djellel, Checco, Alessandro, Demartini, Gianluca and Cudré-Mauroux, Philippe (2019). Deadline-aware fair scheduling for multi-tenant crowd-powered systems. ACM Transactions on Social Computing, 2 (1), 1-29. doi: 10.1145/3301003
The Impact of Task Abandonment in Crowdsourcing
Han, Lei, Roitero, Kevin, Gadiraju, Ujwal, Sarasua, Cristina, Checco, Alessandro, Maddalena, Eddy and Demartini, Gianluca (2019). The Impact of Task Abandonment in Crowdsourcing. IEEE Transactions on Knowledge and Data Engineering, 33 (5) 8873609, 1-1. doi: 10.1109/tkde.2019.2948168
Crowd Anatomy Beyond the Good and Bad: Behavioral Traces for Crowd Worker Modeling and Pre-selection
Gadiraju, Ujwal, Demartini, Gianluca, Kawase, Ricardo and Dietze, Stefan (2018). Crowd Anatomy Beyond the Good and Bad: Behavioral Traces for Crowd Worker Modeling and Pre-selection. Computer Supported Cooperative Work: CSCW: An International Journal, 28 (5), 1-27. doi: 10.1007/s10606-018-9336-y
Augmenting intelligence with humansintheloop
Gentile, Anna Lisa, Aroyo, Lora, Demartini, Gianluca and Welty, Chris (2018). Augmenting intelligence with humansintheloop. CEUR Workshop Proceedings, 2169
An introduction to hybrid human-machine information systems
Demartini, Gianluca, Difallah, Djellel Eddine, Gadiraju, Ujwal and Catasta, Michele (2017). An introduction to hybrid human-machine information systems. Foundations and Trends in Web Science, 7 (1), 1-87. doi: 10.1561/1800000025
Modus Operandi of Crowd Workers : The Invisible Role of Microtask Work Environments
Gadiraju, Ujwal, Checco, Alessandro, Gupta, Neha and Demartini, Gianluca (2017). Modus Operandi of Crowd Workers : The Invisible Role of Microtask Work Environments. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 1 (3), 1-29. doi: 10.1145/3130914
Contextualized ranking of entity types based on knowledge graphs
Tonon, Alberto, Catasta, Michele, Prokofyev, Roman, Demartini, Gianluca, Aberer, Karl and Cudre-Mauroux, Philippe (2016). Contextualized ranking of entity types based on knowledge graphs. Journal of Web Semantics, 37-38, 170-183. doi: 10.1016/j.websem.2015.12.005
Hybrid human-machine information systems: challenges and opportunities
Demartini, Gianluca (2015). Hybrid human-machine information systems: challenges and opportunities. Computer Networks, 90, 5-13. doi: 10.1016/j.comnet.2015.05.018
Pooling-based continuous evaluation of information retrieval systems
Tonon, Alberto, Demartini, Gianluca and Cudre-Mauroux, Philippe (2015). Pooling-based continuous evaluation of information retrieval systems. Information Retrieval Journal, 18 (5), 445-472. doi: 10.1007/s10791-015-9266-y
Human beyond the machine: challenges and opportunities of microtask crowdsourcing
Gadiraju, Ujwal, Demartini, Gianluca, Kawase, Ricardo and Dietze, Stefan (2015). Human beyond the machine: challenges and opportunities of microtask crowdsourcing. IEEE Intelligent Systems, 30 (4) 7156008, 81-85. doi: 10.1109/MIS.2015.66
Large-scale linked data integration using probabilistic reasoning and crowdsourcing
Demartini, Gianluca, Difallah, Djellel Eddine and Cudre-Mauroux, Philippe (2013). Large-scale linked data integration using probabilistic reasoning and crowdsourcing. VLDB Journal, 22 (5), 665-687. doi: 10.1007/s00778-013-0324-z
Demartini, Gianluca, Enchev, Iliya, Gapany, Joel and Cudre-Mauroux, Philippe (2013). The bowlogna ontology: fostering open curricula and agile knowledge bases for europe's higher education landscape. Semantic Web, 4 (1), 53-63. doi: 10.3233/SW-2012-0064
From people to entities : typed search in the enterprise and the web
Demartini, Gianluca (2011). From people to entities : typed search in the enterprise and the web. ACM SIGIR Forum, 45 (1), 73-73. doi: 10.1145/1988852.1988868
Beckers, T., Geva, S., Huang, W.-C., Iofciu, T., Kamps, J., Kazai, G., Koolen, M., Kutty, S., Landoni, M., Lehtonen, M., Moriceau, V., Bellot, P., Nayak, R., Nordlie, R., Pharo, N., SanJuan, E., Schenkel, R., Tannier, X., Theobald, M., Thom, J. A., Trotman, A., de Vries, A. P., Demartini, G., Denoyer, L., De Vries, C. M., Doucet, A., Fachry, K. N., Fuhr, N. and Gallinari, P. (2010). Report on INEX 2009. ACM SIGIR Forum, 44 (1), 38-57. doi: 10.1145/1842890.1842897
Leveraging personal metadata for Desktop search: The Beagle++ system
Minack, Enrico, Paiu, Raluca, Costache, Stefania, Demartini, Gianluca, Gaugaz, Julien, Ioannou, Ekaterini, Chirita, Paul-Alexandru and Nejdl, Wolfgang (2010). Leveraging personal metadata for Desktop search: The Beagle++ system. Journal of Web Semantics, 8 (1), 37-54. doi: 10.1016/j.websem.2009.12.001
Why finding entities in Wikipedia is difficult, sometimes
Demartini, Gianluca, Firan, Claudiu S., Iofciu, Tereza, Krestel, Ralf and Nejdl, Wolfgang (2010). Why finding entities in Wikipedia is difficult, sometimes. Information Retrieval, 13 (5), 534-567. doi: 10.1007/s10791-010-9135-7
Demartini, Gianluca, Denoye, Ludovic, Douce, Antoine, Fachry, Khairun Nisa, Gallinar, Patrick\, Gev, Shlomo, Huang, Wei-Che, Iofciu, Tereza, Kamps, Jaap, Kazai, Gabriella, Koolen, Marijn, Landoni, Monica, Nordlie, Ragnar, Pharo, Nils, Schenkel, Ralf, Theobald, Martin, Trotman, Andrew, de Vries, Arjen P., Woodley, Alan and Zhu, Jianhan (2009). Report on INEX 2008. SIGIR Forum, 43 (1), 17-36. doi: 10.1145/1670598.1670603
Measuring Retrieval Effectiveness with Average Distance Measure (ADM)
Della Mea, Vincenzo, Demartini, Gianluca, Di Gaspero, Luca and Mizzaro, Stefano (2006). Measuring Retrieval Effectiveness with Average Distance Measure (ADM). Information Wissenschaft und Praxis, 57 (8), 433-443.
Socio-Economic Diversity in Human Annotations
Fan, Shaoyang, Barlas, Pinar, Christoforou, Evgenia, Otterbacher, Jahna, Sadiq, Shazia and Demartini, Gianluca (2022). Socio-Economic Diversity in Human Annotations. New York, NY, USA: Association for Computing Machinery. doi: 10.1145/3501247.3531588
Preferences on a budget: prioritizing document pairs when crowdsourcing relevance judgments
Roitero, Kevin, Checco, Alessandro, Mizzaro, Stefano and Demartini, Gianluca (2022). Preferences on a budget: prioritizing document pairs when crowdsourcing relevance judgments. ACM Web Conference, Virtual/Lyon, France, 25-29 April 2022. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3485447.3511960
Effects of Technological Interventions for Self-regulation: A Control Experiment in Learnersourcing
Lahza, Hatim, Khosravi, Hassan, Demartini, Gianluca and Gasevic, Dragan (2022). Effects of Technological Interventions for Self-regulation: A Control Experiment in Learnersourcing. New York, NY, USA: ACM. doi: 10.1145/3506860.3506911
An Analysis of the Australian Political Discourse in Sponsored Social Media Content
Han, Lei, Sawant, Rudra, Fan, Shaoyang, Kefford, Glenn and Demartini, Gianluca (2021). An Analysis of the Australian Political Discourse in Sponsored Social Media Content. ADCS '21: Australasian Document Computing Symposium, Online, 9 December 2021. Washington, DC United States: Association for Computing Machinery. doi: 10.1145/3503516.3503533
Hierarchical clustering of corals using image clustering
Sawant, Rudra, Demartini, Gianluca and Bridge, Tom (2021). Hierarchical clustering of corals using image clustering. ADCS '21: Proceedings of the 25th Australasian Document Computing Symposium, Virtual, Australia, 9 December 2021. New York, NY, United States: ACM. doi: 10.1145/3503516.3503531
Iterative human-in-the-loop discovery of unknown unknowns in image datasets
Han, Lei, Dong, Xiao and Demartini, Gianluca (2021). Iterative human-in-the-loop discovery of unknown unknowns in image datasets. 9th AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2021), Virtual Event, 14-18 November 2021. Palo Alto, CA, United States: The AAAI Press.
Loss-based active learning for named entity recognition
Linh, Le Thai, Nguyen, Minh-Tien, Zuccon, Guido and Demartini, Gianluca (2021). Loss-based active learning for named entity recognition. 2021 International Joint Conference on Neural Networks (IJCNN), Shenzhen, China, 18-22 July, 2021. Piscataway, NJ, United States: Institute of Electrical and Electronics Engineers. doi: 10.1109/ijcnn52387.2021.9533675
Charting the design and analytics agenda of learnersourcing systems
Khosravi, Hassan, Demartini, Gianluca, Sadiq, Shazia and Gasevic, Dragan (2021). Charting the design and analytics agenda of learnersourcing systems. 11th International Learning Analytics and Knowledge Conference, Irvine, CA USA, April 2021. New York, NY, USA: ACM. doi: 10.1145/3448139.3448143
CoralExp: An Explainable System to Support Coral Taxonomy Research
Harding, Jaiden, Bridge, Tom and Demartini, Gianluca (2021). CoralExp: An Explainable System to Support Coral Taxonomy Research. 43rd European Conference on IR Research, ECIR 2021, Online, 28 March – 1 April 2021. Cham, Switzerland: Springer. doi: 10.1007/978-3-030-72240-1_55
Modelling User Behavior Dynamics with Embeddings
Han, Lei, Checco, Alessandro, Difallah, Djellel, Demartini, Gianluca and Sadiq, Shazia (2020). Modelling User Behavior Dynamics with Embeddings. 29th ACM International Conference on Information & Knowledge Management, Online, 19-23 October 2020. New York, NY United States: Association for Computing Machinery. doi: 10.1145/3340531.3411985
The COVID-19 Infodemic: Can the Crowd Judge Recent Misinformation Objectively?
Roitero, Kevin, Soprano, Michael, Portelli, Beatrice, Spina, Damiano, Della Mea, Vincenzo, Serra, Giuseppe, Mizzaro, Stefano and Demartini, Gianluca (2020). The COVID-19 Infodemic: Can the Crowd Judge Recent Misinformation Objectively?. 29th ACM International Conference on Information & Knowledge Management, Online, 19 - 23 October 2020. Washington, DC United States: Association for Computing Machinery. doi: 10.1145/3340531.3412048
A region selection model to identify unknown unknowns in image datasets
Dong, Xiao, Zhang, Huaxiang and Demartini, Gianluca (2020). A region selection model to identify unknown unknowns in image datasets. 24th European Conference on Artificial Intelligence, ECAI 2020, Santiago de Compostela, Spain, 29 August - 8 September 2020. Amsterdam, Netherlands: IOS Press. doi: 10.3233/FAIA200128
QuRVe: Query Refinement for View Recommendation in visual data exploration
Ehsan, Humaira, Sharaf, Mohamed A. and Demartini, Gianluca (2020). QuRVe: Query Refinement for View Recommendation in visual data exploration. 24th European Conference on Advances in Databases and Information Systems, ADBIS 2020, Lyon, France, 25 - 27 August 2020. Heidelberg, Germany: Springer. doi: 10.1007/978-3-030-54623-6_14
Roitero, Kevin, Soprano, Michael, Fan, Shaoyang, Spina, Damiano, Mizzaro, Stefano and Demartini, Gianluca (2020). Can the crowd identify misinformation objectively?: The effects of judgment scale and assessor's background. International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, China, 25-30 July 2020. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3397271.3401112
Representation learning for entity type ranking
Rahman, Md Mostafizur, Takasu, Atsuhiro and Demartini, Gianluca (2020). Representation learning for entity type ranking. SAC '20: The 35th ACM/SIGAPP Symposium on Applied Computing, Brno, Czech Republic, 30 March-3 April 2020. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3341105.3374029
Building data curation processes with crowd intelligence
Chen, Tianwa, Han, Lei, Demartini, Gianluca, Indulska, Marta and Sadiq, Shazia (2020). Building data curation processes with crowd intelligence. CAiSE Forum 2020: Advanced Information Systems Engineering, Grenoble, France, 8 – 12 June 2020. Cham, Switzerland: Springer International Publishing. doi: 10.1007/978-3-030-58135-0_3
Crowd worker strategies in relevance judgment tasks
Han, Lei, Maddalena, Eddy, Checco, Alessandro, Sarasua, Cristina, Gadiraju, Ujwal, Roitero, Kevin and Demartini, Gianluca (2020). Crowd worker strategies in relevance judgment tasks. 13th International Conference on Web Search and Data Mining, Houston, Texas, 3-7 February 2020. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3336191.3371857
Crowdsourcing truthfulness: the impact of judgment scale and assessor bias
La Barbera, David, Roitero, Kevin, Demartini, Gianluca, Mizzaro, Stefano and Spina, Damiano (2020). Crowdsourcing truthfulness: the impact of judgment scale and assessor bias. European Conference on Information Retrieval, Lisbon, Portugal, 14-17 April 2020. Heidelberg, Germany: Springer. doi: 10.1007/978-3-030-45442-5_26
On understanding data worker interaction behaviors
Han, Lei, Chen, Tianwa, Demartini, Gianluca, Indulska, Marta and Sadiq, Shazia (2020). On understanding data worker interaction behaviors. SIGIR '20: The 43rd International ACM SIGIR conference on research and development in Information Retrieval, Virtual Event China, July 2020. New York, NY USA: Association for Computing Machinery. doi: 10.1145/3397271.3401059
Zika outbreak of 2016: insights from twitter
Ahmed, Wasim, Bath, Peter A., Sbaffi, Laura and Demartini, Gianluca (2020). Zika outbreak of 2016: insights from twitter. International Conference on Human-Computer Interaction, Copenhagen, Denmark, 19-24 July 2020. Heidelberg, Germany: Springer. doi: 10.1007/978-3-030-49576-3_32
All those wasted hours: on task abandonment in crowdsourcing
Han, Lei, Roitero, Kevin, Gadiraju, Ujwal, Sarasua, Cristina, Checco, Alessandro, Maddalena, Eddy and Demartini, Gianluca (2019). All those wasted hours: on task abandonment in crowdsourcing. 12th ACM International Conference on Web Search and Data Mining, WSDM 2019, Melbourne, VIC Australia , 11-15 February 2019. New York, NY USA: Association for Computing Machinery. doi: 10.1145/3289600.3291035
Augmenting intelligence with bias-aware humans-in-the-loop (HumBL2019) chairs' welcome
Aroyo, Lora, Gadiraju, Ujwal, Inel, Oana, Checco, Alessandro, Gentile, Anna Lisa, Sarasua, Cristina and Demartini, Gianluca (2019). Augmenting intelligence with bias-aware humans-in-the-loop (HumBL2019) chairs' welcome. 2019 World Wide Web Conference, San Francisco, CA United States, 13 - 17 May 2019. New York, NY United States: Association for Computing Machinery. doi: 10.1145/3308560.3317301
Health card retrieval for consumer health search an empirical investigation of methods
Jimmy,, Zuccon, Guido, Koopman, Bevan and Demartini, Gianluca (2019). Health card retrieval for consumer health search an empirical investigation of methods. CIKM '19: Proceedings of the 28th ACM International Conference on Information and Knowledge Management, Beijing, China, November, 2019. New York, New York, USA: Association for Computing Machinery. doi: 10.1145/3357384.3358128
Health cards for consumer health search
Jimmy, Koopman, Bevan, Zuccon, Guido and Demartini, Gianluca (2019). Health cards for consumer health search. 42nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2019), Paris, France, 21-25 July 2019. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3331184.3331194
Roitero, Kevin, Demartini, Gianluca, Mizzaro, Stefano and Spina, Damiano (2019). How many truth levels? Six? One hundred? Even more? Validating truthfulness of statements via crowdsourcing. CIKM 2018 Workshops, Torino, Italy, 22-26 October 2018. CEUR-WS.
Implicit bias in crowdsourced knowledge graphs
Demartini, Gianluca (2019). Implicit bias in crowdsourced knowledge graphs. World Wide Web Conference (WWW 2019), San Francisco, CA, United States, 13-17 May 2019. New York, NY, United States: Association for Computing Machinery (ACM). doi: 10.1145/3308560.3317307
Jobnow'19 - 1st international workshop on job knowledge discovery on the Web & Social media
Gadiraju, Ujwal, Demartini, Gianluca, Bohlouli, Mahdi and Margaryan, Anoush (2019). Jobnow'19 - 1st international workshop on job knowledge discovery on the Web & Social media. 30th ACM Conference on Hypertext and Social Media, Hof, Germany, 17-20 September 2019. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3342220.3349532
Non-parametric class completeness estimators for collaborative knowledge graphs—the case of Wikidata
Luggen, Michael, Difallah, Djellel, Sarasua, Cristina, Demartini, Gianluca and Cudré-Mauroux, Philippe (2019). Non-parametric class completeness estimators for collaborative knowledge graphs—the case of Wikidata. International Semantic Web Conference, Auckland, New Zealand, 26-30 October 2019. Cham, Switzerland: Springer. doi: 10.1007/978-3-030-30793-6_26
On transforming relevance scales
Han, Lei, Roitero, Kevin, Maddalena, Eddy, Mizzaro, Stefano and Demartini, Gianluca (2019). On transforming relevance scales. 28th ACM International Conference on Information and Knowledge Management, Beijing, China, 3 - 7 November 2019. Washington, DC United States: Association for Computing Machinery. doi: 10.1145/3357384.3357988
Demartini, Gianluca and Thomas, Paul (2019). Preface. 24th Australasian Document Computing Symposium, Sydney, NSW Australia, 5-6 December 2019. New York, NY USA: Association for Computing Machinery.
Quality control attack schemes in crowdsourcing
Checco, Alessandro, Bates, Jo and Demartini, Gianluca (2019). Quality control attack schemes in crowdsourcing. Twenty-Eighth International Joint Conference on Artificial Intelligence (IJCAI-19), Macao, China, 10-16 August 2019. Palo Alto, CA, United States: A A A I Press. doi: 10.24963/ijcai.2019/850
Yang, Jie, Demartini, Gianluca, Smirnova, Alisa, Lu, Yuan, Yang, Dingqi and Cudré-Mauroux, Philippe (2019). Scalpel-CD: leveraging crowdsourcing and deep probabilistic modeling for debugging noisy training data. World Wide Web Conference (WWW), San Francisco, CA, United States, 13-17 May 2019. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3308558.3313599
Tracking user behaviours: Laboratory-based and in-the-wild user studies
Demartini, Gianluca and Sadiq, Shazia (2019). Tracking user behaviours: Laboratory-based and in-the-wild user studies. 24th International Conference on Database Systems for Advanced Applications, DASFAA 2019, Chiang Mai, Thailand, 22-25 April 2019. Cham, Switzerland: Springer Verlag. doi: 10.1007/978-3-030-18590-9a
Understanding worker moods and reactions to rejection in crowdsourcing
Gadiraju, Ujwal and Demartini, Gianluca (2019). Understanding worker moods and reactions to rejection in crowdsourcing. 30th ACM Conference on Hypertext and Social Media, Hof, Germany, 17-20 September 2019. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3342220.3343644
All that glitters is gold -- An attack scheme on gold questions in crowdsourcing
Checco, Alessandro, Bates, Jo and Demartini, Gianluca (2018). All that glitters is gold -- An attack scheme on gold questions in crowdsourcing. The 6th AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2018), Zurich, Switzerland, July 5–8 2018. Palo Alto, CA, United States: AAAI Press.
Can user behaviour sequences reflect perceived novelty?
Zhuang, Mengdie, Toms, Elaine G. and Demartini, Gianluca (2018). Can user behaviour sequences reflect perceived novelty?. 27th ACM International Conference on Information and Knowledge Management, CIKM 2018, Torino, Italy, October 22 - 26, 2018. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3269206.3269243
Investigating user perception of gender bias in image search: the role of sexism
Otterbacher, Jahna, Checco, Alessandro, Demartini, Gianluca and Clough, Paul (2018). Investigating user perception of gender bias in image search: the role of sexism. 41st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2018, Ann Arbor, MI, United States, 8-12 July 2018. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3209978.3210094
Measuring the effect of public health campaigns on twitter: The case of world autism awareness day
Ahmed, Wasim, Bath, Peter A., Sbaffi, Laura and Demartini, Gianluca (2018). Measuring the effect of public health campaigns on twitter: The case of world autism awareness day. 13th International Conference on Transforming Digital Worlds, iConference 2018, Sheffield, U.K., March 25-28, 2018. CHAM: Springer Verlag. doi: 10.1007/978-3-319-78105-1_2
Moral panic through the lens of Twitter: an analysis of infectious disease outbreaks
Ahmed, Wasim, Bath, Peter A., Sbaffi, Laura and Demartini, Gianluca (2018). Moral panic through the lens of Twitter: an analysis of infectious disease outbreaks. 9th International Conference on Social Media and Society, SMSociety 2018, Copenhagen, Denmark, 18-20 July 2018. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3217804.3217915
On fine-grained relevance scales
Roitero, Kevin, Maddalena, Eddy, Demartini, Gianluca and Mizzaro, Stefano (2018). On fine-grained relevance scales. 41st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2018, Ann Arbor, MI, United States, 8-12 July 2018. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3209978.3210052
On the volatility of commercial search engines and its impact on information retrieval research
Jimmy, Zuccon, Guido and Demartini, Gianluca (2018). On the volatility of commercial search engines and its impact on information retrieval research. 41st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2018, Ann Arbor, MI, United States, 8-12 July 2018. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3209978.3210088
Considering assessor agreement in IR evaluation
Maddalena, Eddy, Roitero, Kevin, Demartini, Gianluca and Mizzaro, Stefano (2017). Considering assessor agreement in IR evaluation. ICTIR 2017 - Proceedings of the 2017 ACM SIGIR International Conference on the Theory of Information Retrieva, Amsterdam, Netherlands, 1-4 October 2017. New York, NY USA: ACM Press. doi: 10.1145/3121050.3121060
FashionBrain Project: A Vision for Understanding Europe's Fashion Data Universe
Checco, Alessandro, Demartini, Gianluca, Löser, Alexander, Arous, Ines, Dantone, Matthias, Koopmanschap, Richard, Stalinov, Svetlin, Kersten, Martin and Zhang, Ying (2017). FashionBrain Project: A Vision for Understanding Europe's Fashion Data Universe. 'Machine learning meets fashion' workshop at KDD 2017, Halifax, Nova Scotia, Canada, August 2017.
Let's Agree to Disagree: Fixing Agreement Measures for Crowdsourcing
Checco, Alessandro, Roitero, Kevin, Maddalena, Eddy, Mizzaro, Stefano and Demartini, Gianluca (2017). Let's Agree to Disagree: Fixing Agreement Measures for Crowdsourcing. The 5th AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2017), Quebec City, Canada, October 2017.
Topics Discussed on Twitter at the Beginning of the 2014 Ebola Epidemic in United States
Ahmed, Wasim , Demartini, Gianluca and Bath, Peter (2017). Topics Discussed on Twitter at the Beginning of the 2014 Ebola Epidemic in United States. iConference, Wuhan, China, March 2017.
Towards building a standard dataset for Arabic keyphrase extraction evaluation
Helmy, Muhammad, Basaldella, Marco, Maddalena, Eddy, Mizzaro, Stefano and Demartini, Gianluca (2017). Towards building a standard dataset for Arabic keyphrase extraction evaluation. 20th International Conference on Asian Language Processing, IALP 2016, Tainan, Taiwan, November 21-23, 2016. NEW YORK: Institute of Electrical and Electronics Engineers . doi: 10.1109/IALP.2016.7875927
Understanding engagement through search behaviour
Zhuang, Mengdie, Demartini, Gianluca and Toms, Elaine G. (2017). Understanding engagement through search behaviour. 26th ACM International Conference on Information and Knowledge Management, CIKM 2017, Singapore, Singapore, 06 - 10 November 2017. New York, New York, United States: Association for Computing Machinery. doi: 10.1145/3132847.3132978
A tutorial on leveraging knowledge graphs for web search
Demartini, Gianluca (2016). A tutorial on leveraging knowledge graphs for web search. 9th Russian Summer School in Information Retrieval (RuSSIR), St Petersburg, Russia, 24-28 August 2015. Cham, Switzerland: Springer Verlag. doi: 10.1007/978-3-319-41718-9_2
Crowdsourcing relevance assessments: the unexpected benefits of limiting the time to judge
Maddalena, Eddy, Basaldella, Marco, De Nart, Dario, Degl'Innocenti, Dante, Mizzaro, Stefano and Demartini, Gianluca (2016). Crowdsourcing relevance assessments: the unexpected benefits of limiting the time to judge. The 4th AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2016), Austin, TX, United States, 31 October-2 November 2016. Palo Alto, CA, United States: Association for the Advancement of Artificial Intelligence.
Exploring entity-centric methods in the UK Government Web Archive
Webster, Philip, Clough, Paul, Demartini, Gianluca, Storrar, Tom, Ranade, Sonia and Seaman, Graham (2016). Exploring entity-centric methods in the UK Government Web Archive. 1st International Workshop on Accessing Cultural Heritage at Scale, ACHS 2016, Newark, NJ, United States, 22 June 2016. Aachen, Germany: CEUR-WS.
Modeling task complexity in crowdsourcing
Yang, Jie, Redi, Judith, Demartini, Gianluca and Bozzon, Alessandro (2016). Modeling task complexity in crowdsourcing. The 4th AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2016), Austin, TX, United States, 31 October-2 November 2016. Palo Alto, CA, United States: Association for the Advancement of Artificial Intelligence.
Scheduling human intelligence tasks in multi-tenant crowd-powered systems
Difallah, Djellel Eddine, Demartini, Gianluca and Cudré-Mauroux, Philippe (2016). Scheduling human intelligence tasks in multi-tenant crowd-powered systems. 25th International World Wide Web Conference, WWW 2016, Montreal, QC, Canada, 11-15 April 2016. Geneva, Switzerland: International World Wide Web Conferences Steering Committee. doi: 10.1145/2872427.2883030
Search behaviour before and after search success
Zhuang, Mengdie, Toms, Elaine G. and Demartini, Gianluca (2016). Search behaviour before and after search success. 2nd International Workshop on Search as Learning, SAL 2016, Pisa, Italy, 21 July 21 2016. Aachen, Germany: Rheinisch-Westfaelische Technische Hochschule Aachen * Lehrstuhl Informatik V.
Fixing the domain and range of properties in linked data by context disambiguation
Tonon, Alberto, Catasta, Michele, Demartini, Gianluca and Cudré-Mauroux, Philippe (2015). Fixing the domain and range of properties in linked data by context disambiguation. Proceedings of the Workshop on Linked Data on the Web co-located with the 24th International World Wide Web Conference (WWW 2015), Florence, Italy, 19 May 2015. Aachen, Germany: CEUR-WS.
The dynamics of micro-task crowdsourcing: the case of amazon MTurk
Difallah, Djellel Eddine, Catasta, Michele, Demartini, Gianluca, Ipeirotis, Panagiotis G. and Cudré-Mauroux, Philippe (2015). The dynamics of micro-task crowdsourcing: the case of amazon MTurk. 24th International Conference on World Wide Web, WWW 2015, Florence, Italy, 18 - 22 May 2015. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/2736277.2741685
Understanding malicious behavior in crowdsourcing platforms: the case of online surveys
Gadiraju, Ujwal, Kawase, Ricardo, Dietze, Stefan and Demartini, Gianluca (2015). Understanding malicious behavior in crowdsourcing platforms: the case of online surveys. 33rd Annual CHI Conference on Human Factors in Computing Systems - CHI'15, Seoul, South Korea, 18 - 23 April 2015. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/2702123.2702443
B-hist: entity-centric search over personal web browsing history
Catasta, Michele, Tonon, Alberto, Demartini, Gianluca, Ranvier, Jean-Eudes, Aberer, Karl and Cudre-Mauroux, Philippe (2014). B-hist: entity-centric search over personal web browsing history. Amsterdam, Netherlands: Elsevier BV. doi: 10.1016/j.websem.2014.07.003
Correct me if I'm wrong: fixing grammatical errors by preposition ranking
Prokofyev, Roman, Mavlyutov, Ruslan, Grund, Martin, Demartini, Gianluca and Cudré-Mauroux, Philippe (2014). Correct me if I'm wrong: fixing grammatical errors by preposition ranking. 23rd ACM International Conference on Conference on Information and Knowledge Management - CIKM, Shanghai, China, 3 - 7 November 2014. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/2661829.2661942
Effective named entity recognition for idiosyncratic web collections
Prokofyev, Roman, Demartini, Gianluca and Cudré-Mauroux, Philippe (2014). Effective named entity recognition for idiosyncratic web collections. 23rd International Conference on World Wide Web, WWW 2014, Seoul, Korea , April 07 - 11, 2014 . Association for Computing Machinery. doi: 10.1145/2566486.2568013
Hippocampus: answering memory queries using transactive search
Catasta, Michele, Tonon, Alberto, Difallah, Djellel Eddine, Demartini, Gianluca, Aberer, Karl and Cudre-Mauroux, Philippe (2014). Hippocampus: answering memory queries using transactive search. International Conference on World Wide Web, Seoul, Korea, 7-11 April 2014. New York, NY, United States: ACM Press. doi: 10.1145/2567948.2576946
Scaling-up the crowd: micro-task pricing schemes for worker retention and latency improvement
Difallah, Djellel Eddine, Catasta, Michele, Demartini, Gianluca and Cudré-Mauroux, Philippe (2014). Scaling-up the crowd: micro-task pricing schemes for worker retention and latency improvement. Second AAAI Conference on Human Computation and Crowdsourcing (HCOMP-2014), Pittsburgh, PA, United States, 2 - 4 November 2014. Palo Alto, CA, United States: A A A I Press.
TransactiveDB: Tapping into collective human memories
Catastay, Michele, Tonon, Alberto, Difallah, Djellel Eddine, Demartini, Gianluca, Aberery, Karl and CudreMauroux, Philippe (2014). TransactiveDB: Tapping into collective human memories. 3rd Workshop on Spatio-Temporal Database Management, STDBM 2006, Co-located with the 32nd International Conference on Very Large Data Bases, VLDB 2006, Seoul, Korea, September 11, 2006. New York, NY United States: Association for Computing Machinery.
CrowdQ: Crowdsourced Query Understanding
Demartini, Gianluca , Trushkowsky, Beth , Kraska, Tim and Franklin, Michael (2013). CrowdQ: Crowdsourced Query Understanding. 6th Biennial Conference on Innovative Data Systems Research (CIDR 2013), Asilomar, CA, United States, 6-9 January 2013. Conference on Innovative Data Systems Research (CIDR).
Entity disambiguation in tweets leveraging user social profiles
Yerva, Surender Reddy, Catasta, Michele, Demartini, Gianluca and Aberer, Karl (2013). Entity disambiguation in tweets leveraging user social profiles. 2013 IEEE 14th International Conference on Information Reuse and Integration, IEEE IRI 2013, San Francisco, CA, Unites States, 14 - 16 August 2013. Piscataway, NJ, United States: Institute of Electrical and Electronics Engineers. doi: 10.1109/IRI.2013.6642462
Difallah, Djellel Eddine, Demartini, Gianluca and Cudré-Mauroux, Philippe (2013). Pick-a-crowd: tell me what you like, and I'll tell you what to do: a crowdsourcing platform for personalized human intelligence task assignment based on social networks. 22nd International Conference on World Wide Web, WWW 2013, Rio de Janeiro, Brazil, 13 - 17 May 2013. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/2488388.2488421
TRank: ranking entity types using the web of data
Tonon, Alberto, Catasta, Michele, Demartini, Gianluca, Mauroux, Philippe Cudre and Aberer, Karl (2013). TRank: ranking entity types using the web of data. 12th International Semantic Web Conference (ISWC), Sydney, Australia, 21-25 October, 2013. Berlin, Germany: Springer-Verlag. doi: 10.1007/978-3-642-41335-3_40
BowlognaBench-Benchmarking RDF analytics
Demartini, Gianluca, Enchev, Iliya, Wylot, Marcin, Gapany, Joel and Cudre-Mauroux, Philippe (2012). BowlognaBench-Benchmarking RDF analytics. First International Symposium on Data-Driven Process Discovery and Analysis (SIMPDA 2011), Campione D’Italia, Italy, 29 June - 1 July, 2011. Heidelberg, Germany: Springer. doi: 10.1007/978-3-642-34044-4_5
Combining inverted indices and structured search for ad-hoc object retrieval
Tonon, Alberto, Demartini, Gianluca and Cudré-Mauroux, Philippe (2012). Combining inverted indices and structured search for ad-hoc object retrieval. 35th Annual ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2012, Portland, OR, United States, 12 - 16 August 2012. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/2348283.2348304
Downscaling Entity Registries for Ad-Hoc Environments
Cudré-Mauroux, Philippe , Demartini, Gianluca , Enchev, Iliya , Guéret, Christophe and Perroud, Benoit (2012). Downscaling Entity Registries for Ad-Hoc Environments. First International Workshop on Downscaling the Semantic Web co-located with the 9th Extended Semantic Web conference, Heraklion, Greece, May 2012.
Mechanical cheat: Spamming schemes and adversarial techniques on crowdsourcing platforms
Difallah, Djellel Eddine, Demartini, Gianluca and Cudré-Mauroux, Philippe (2012). Mechanical cheat: Spamming schemes and adversarial techniques on crowdsourcing platforms. 1st International Workshop on Crowdsourcing Web Search, CrowdSearch 2012 - Workshop Held in Conjunction with WWW 2012 Conference, Lyon; France, April 17, 2012.
Tag recommendation for large-scale ontology-based information systems
Prokofyev, Roman, Boyarsky, Alexey, Ruchayskiy, Oleg, Aberer, Karl, Demartini, Gianluca and Cudré-Mauroux, Philippe (2012). Tag recommendation for large-scale ontology-based information systems. International Semantic Web Conference, Boston, MA, USA, November 11-15, 2012. Heidelberg, Germany: Springer. doi: 10.1007/978-3-642-35173-0-22
Demartini, Gianluca, Difallah, Djellel Eddine and Cudré-Mauroux, Philippe (2012). ZenCrowd: Leveraging probabilistic reasoning and crowdsourcing techniques for large-scale entity linking. 21st Annual Conference on World Wide Web, WWW'12, Lyon, France, 16-20 April 2012. New York, NY, United States: ACM. doi: 10.1145/2187836.2187900
Demartini, Gianluca (2011). ARES: A Retrieval Engine based on Sentiments: sentiment-based search result annotation and diversification. 33rd European Conference on Information Retrieval (ECIR 2011), Dublin, Ireland, 18-21 April, 2011. Heidelberg, Germany: Springer. doi: 10.1007/978-3-642-20161-5_91
An Integrated Socio-Technical Crowdsourcing Platform for Accelerating Returns in eScience
Aberer, Karl, Boyarsky, Alexey, Cudré-Mauroux, Philippe, Demartini, Gianluca and Ruchayskiy, Oleg (2011). An Integrated Socio-Technical Crowdsourcing Platform for Accelerating Returns in eScience. 10th International Semantic Web Conference (ISWC 2011 - Outrageous Ideas), Bonn, Germany, October 2011.
Analyzing Political Trends in the Blogosphere
Demartini, Gianluca , Siersdorfer, Stefan , Chelaru, Sergiu and Nejdl, Wolfgang (2011). Analyzing Political Trends in the Blogosphere. Fifth International AAAI Conference on Weblogs and Social Media (ICWSM 2011), Barcelona, Spain, July 2011.
ReFER: effective relevance feedback for entity ranking
Iofciu, Tereza, Demartini, Gianluca, Craswell, Nick and de Vries, Arjen P. (2011). ReFER: effective relevance feedback for entity ranking. 33rd European Conference on Information Retrieval (ECIR 2011), Dublin, Ireland, 18-21 April, 2011. Heidelberg, Germany: Springer. doi: 10.1007/978-3-642-20161-5_26
ScienceWISE: A Web-based Interactive Semantic Platform for Scientific Collaboration
Cudré-Mauroux, Philippe, Demartini, Gianluca, Eddine Difallah, Djellel, Elsayed Mostafa, Ahmed, Russo, Vincenzo and Thomas, Matthew (2011). ScienceWISE: A Web-based Interactive Semantic Platform for Scientific Collaboration. 10th International Semantic Web Conference (ISWC 2011 - Demo), Bonn, Germany, October 2011.
Visual interfaces for stimulating exploratory search
Krestel, Ralf, Demartini, Gianluca and Herder, Eelco (2011). Visual interfaces for stimulating exploratory search. 11th annual international ACM/IEEE joint conference on Digital libraries, Ottawa, Ontario, Canada , June 13 - 17, 2011 . Piscataway, NJ United States: Institute of Electrical and Electronics Engineers. doi: 10.1145/1998076.1998151
Demartini, Gianluca and Siersdorfer, Stefan (2010). Dear search engine: What's your opinion about...? Sentiment analysis for semantic enrichment of web search results. 3rd International Semantic Search Workshop, SEMSEARCH '10, Co-located with the 19th International World Wide Web (WWW) Conference 2010, North Carolina, USA, April 26, 2010. doi: 10.1145/1863879.1863883
Entity Summarization of News Articles
Demartini, Gianluca, Missen, Malik Muhammad Saad, Blanco, Roi and Zaragoza, Hugo (2010). Entity Summarization of News Articles. 33rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Geneva Switzerland, Jul 19-23, 2010. ASSOC COMPUTING MACHINERY. doi: 10.1145/1835449.1835620
Exploiting Click-Through Data for Entity Retrieval
Billerbeck, Bodo, Demartini, Gianluca, Firan, Claudiu S., Iofciu, Tereza and Krestel, Ralf (2010). Exploiting Click-Through Data for Entity Retrieval. 33rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Geneva Switzerland, Jul 19-23, 2010. ASSOC COMPUTING MACHINERY. doi: 10.1145/1835449.1835624
Overview of the INEX 2009 entity ranking track
Demartini, Gianluca, Iofciu, Tereza and De Vries, Arjen P. (2010). Overview of the INEX 2009 entity ranking track. 8th International Workshop of the Initiative for the Evaluation of XML Retrieval, INEX 2009, Brisbane, AUSTRALIA, December 7-9, 2009. doi: 10.1007/978-3-642-14556-8_26
Ranking Entities Using Web Search Query Logs
Billerbeck, Bodo, Demartini, Gianluca, Firan, Claudiu S., Iofciu, Teresa and Krestel, Ralf (2010). Ranking Entities Using Web Search Query Logs. 14th European Conference on Research and Advanced Technology for Digital Libraries, Glasgow Scotland, Sep 06-10, 2010. SPRINGER-VERLAG BERLIN. doi: 10.1007/978-3-642-15464-5_28
TAER : time-aware entity retrieval-exploiting the past to find relevant entities in news articles
Demartini, Gianluca, Missen, Malik Muhammad Saad, Blanco, Roi and Zaragoza, Hugo (2010). TAER : time-aware entity retrieval-exploiting the past to find relevant entities in news articles. 19th ACM international conference on Information and knowledge management, Toronto, ON, Canada , October 26 - 30, 2010 . New York, New York, USA: ACM Press. doi: 10.1145/1871437.1871661
The missing links : discovering hidden same-as links among a billion of triples
Papadakis, George, Demartini, Gianluca, Fankhauser, Peter and Kärger, Philipp (2010). The missing links : discovering hidden same-as links among a billion of triples. 12th International Conference on Information Integration and Web-based Applications & Services, Paris, France, November 08 - 10, 2010 . New York, New York, USA: ACM Press. doi: 10.1145/1967486.1967557
A Vector Space Model for Ranking Entities and Its Application to Expert Search
Demartini, Gianluca, Gaugaz, Julien and Nejdl, Wolfgang (2009). A Vector Space Model for Ranking Entities and Its Application to Expert Search. 31st European Conference on Information Research, Toulouse France, Apr 06-09, 2009. SPRINGER-VERLAG BERLIN. doi: 10.1007/978-3-642-00958-7_19
An architecture for finding entities on the web
Demartini, Gianluca, Firan, Claudiu S., Georgescu, Mihai, Iofciu, Tereza, Krestel, Ralf and Nejdl, Wolfgang (2009). An architecture for finding entities on the web. 7th Joint LA-WEB/CLIHC Conference 2009, Merida Mexico, Nov 09-11, 2009. doi: 10.1109/LA-WEB.2009.14
Current approaches to search result diversification
Minack, Enrico , Demartini, Gianluca and Nejdl, Wolfgang (2009). Current approaches to search result diversification. 1st International Workshop on Living Web: Making Web Diversity a true asset at ISWC 2009, Washington, DC, United States, October 2009.
How to Trace and Revise Identities
Gaugaz, Julien, Zakrzewski, Jakub, Demartini, Gianluca and Nejdl, Wolfgang (2009). How to Trace and Revise Identities. 6th European Sematic Web Conference, Heraklion Greece, May 31-Jun 04, 2009. SPRINGER-VERLAG BERLIN. doi: 10.1007/978-3-642-02121-3_32
L3S at INEX 2008: Retrieving Entities Using Structured Information
Craswell, Nick, Demartini, Gianluca, Gaugaz, Julien and Iofciu, Tereza (2009). L3S at INEX 2008: Retrieving Entities Using Structured Information. 7th International Workshop of the Initiative for the Evaluation of XML Retrieval, Dagstuhl Germany, Dec 15-18, 2008. SPRINGER-VERLAG BERLIN. doi: 10.1007/978-3-642-03761-0_26
Time based tag recommendation using direct and extended users sets
Iofciu, Tereza and Demartini, Gianluca (2009). Time based tag recommendation using direct and extended users sets. International Workshop on Discovery Challenge, DC 2009 at the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, ECML PKDD 2009, Bled, Slovenia, September 7, 2009. Aachen, Germany: Rheinisch-Westfaelische Technische Hochschule Aachen.
A model for Ranking entities and its application to Wikipedia
Demartini, Gianluca, Firan, Claudiu S., Iofciu, Tereza, Krestel, Ralf and Nejdl, Wolfgang (2008). A model for Ranking entities and its application to Wikipedia. 6th Latin American Web Conference, Vitoria Brazil, Oct 28-30, 2008. doi: 10.1109/LA-WEB.2008.8
Comparing People in the Enterprise
Demartini, Gianluca (2008). Comparing People in the Enterprise. 10th International Conference on Enterprise Information Systems, Barcelona Spain, Jun 12-16, 2008. INSTICC-INST SYST TECHNOLOGIES INFORMATION CONTROL & COMMUNICATION.
Entity identifiers for lineage preservation
Gaugaz, Julien and Demartini, Gianluca (2008). Entity identifiers for lineage preservation. 1st International Workshop on Identity and Reference on the Semantic Web, IRSW 2008, Tenerife, Spain, June 2 2008. Aachen, Germany: Lehrstuhl Informatik V, Rheinisch-Westfaelische Technische Hochschule Aachen.
Evaluating Personal Information Management Using an Activity Logs Enriched Desktop Dataset
Chernov, Sergey , Demartini, Gianluca , Herder, Eelco , Kopycki, Michał and Nejdl, Wolfgang (2008). Evaluating Personal Information Management Using an Activity Logs Enriched Desktop Dataset. "Personal Information Management Workshop at CHI 2008" PIM 2008, Florence, Italy, April, 2008.
Evaluating Relation Retrieval for Entities and Experts
Zhu, Jianhan, de Vries, Arjen P., Demartini, Gianluca and Iofciu, Tereza (2008). Evaluating Relation Retrieval for Entities and Experts. Future Challenges in Expertise Retrieval (fCHER 2008), SIGIR 2008 Workshop, Singapore, 24 July 2008. New York, NY United States: Association for Computing Machinery.
Finding experts on the semantic desktop
Demartini, Gianluca and Niederée, Claudia (2008). Finding experts on the semantic desktop. 3rd Expert Finder Workshop on Personal Identification and Collaborations: Knowledge Mediation and Extraction, PICKME 2008, Karlsruhe, Germany, October 27 2008. Aachen, Germany: Lehrstuhl Informatik V, Rheinisch-Westfaelische Technische Hochschule Aachen.
How Many Experts? - A New Task for Enterprise Search Evaluation
Demartini, Gianluca (2008). How Many Experts? - A New Task for Enterprise Search Evaluation. Workshop on Novel Methodologies for Evaluation in Information Retrieval at the 30th European Conference on IR Research, ECIR 2008, Glasgow, Scotland, April, 2008.
L3S at INEX 2007: Query Expansion for Entity Ranking Using a Highly Accurate Ontology
Demartini, Gianluca, Firan, Claudiu S. and Iofciu, Tereza (2008). L3S at INEX 2007: Query Expansion for Entity Ranking Using a Highly Accurate Ontology. 6th International Workshop of the Initiative for the Evaluation of XML Retrieval, Dagstuhl Germany, Dec 17-19, 2007. SPRINGER-VERLAG BERLIN. doi: 10.1007/978-3-540-85902-4_23
Ranking categories for web search
Demartini, Gianluca, Chirita, Paul-Alexandru, Brunkhorst, Ingo and Nejdl, Wolfgang (2008). Ranking categories for web search. 30th European Conference on Information Retrieval (ECIR 2008), Glasgow Scotland, Mar 30-Apr 03, 2008. SPRINGER-VERLAG BERLIN. doi: 10.1007/978-3-540-78646-7_56
Semantically Enhanced Entity Ranking
Demartini, Gianluca, Firan, Claudiu S., Iofciu, Tereza and Nejdl, Wolfgang (2008). Semantically Enhanced Entity Ranking. International Workshop on Web Information Systems Engineering (WISE 2008), Auckland New Zealand, Sep 01-04, 2008. SPRINGER-VERLAG BERLIN. doi: 10.1007/978-3-540-85481-4_15
Social recommendations of content and metadata
Stecher, Rodolfo, Demartini, Gianluca and Niederée, Claudia (2008). Social recommendations of content and metadata. 10th International Conference on Information Integration and Web-based Applications & Services, Linz, Austria, 24 - 26 November 2008. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/1497308.1497329
Building a desktop search test-bed
Chernov, Sergey, Serdyukov, Pavel, Chirita, Paul-Alexandru, Demartini, Gianluca and Nejdl, Wolfgang (2007). Building a desktop search test-bed. 29th European Conference in Information Retrieval Research (ECIR 2007), Rome Italy, Apr 02-05, 2007. SPRINGER-VERLAG BERLIN. doi: 10.1007/978-3-540-71496-5_69
Finding Experts Using Wikipedia
Demartini, Gianluca (2007). Finding Experts Using Wikipedia. "Finding Experts on the Web with Semantics Workshop at ISWC 2007 + ASWC 2007" FEWS 2007, Busan, South Korea, November, 2007..
Leveraging semantic technologies for enterprise search
Demartini, Gianluca (2007). Leveraging semantic technologies for enterprise search. International Conference on Information and Knowledge Management, Lisbon, Portugal , November 09 - 09, 2007 . doi: 10.1145/1316874.1316879
A classification of IR effectiveness metrics
Demartini, Gianluca and Mizzaro, Stefano (2006). A classification of IR effectiveness metrics. European Conference on Information Retrieval ECIR 2006, London, United Kingdom , April 10-12, 2006. Heidelberg, Germany: Springer. doi: 10.1007/11735106_48
L3S research center at TREC 2006 enterprise track
Chernov, Sergey, Demartini, Gianluca and Gaugaz, Julien (2006). L3S research center at TREC 2006 enterprise track. 15th Text REtrieval Conference, TREC 2006, Gaithersburg, MD; United States, November 14-17, 2006.
(2022–2025) University of Zurich
Human-in-the-loop Natural Language Processing in GLAM
(2022–2023) Universities Australia - Germany Joint Research Co-operation Scheme
Monitoring and Modeling Human Annotator Behaviors in Mephisto
(2022–2023) Meta AI Mephisto Dataset Collection Tool
ARC Training Centre for Information Resilience
(2021–2026) ARC Industrial Transformation Training Centres
Human-in-the-loop Chimpanzee Identification
(2021–2023) Google AI for Social Good
Crowdsourcing an Online Safety Benchmark for Fake News Identification
(2019–2024) Facebook Online Safety Benchmark Research Award
Building crowd sourced data curation processes
(2019–2022) ARC Discovery Projects
Collaborative Lab of Health Informatics with Neusoft
(2019–2022) Neusoft Research of Intelligent Healthcare Technology, Co Ltd
DESCANT : DEtecting Stereotypes in human ComputAtioN Tasks
(2019–2022) CYENS Centre of Excellence
Artificial Intelligence with Humans in the Loop
(2019) UQ Early Career Researcher
Explainable Machine Learning for Coral Classification
Doctor Philosophy — Principal Advisor
Investigation of Micro-Services Architecture for Data Curation
Doctor Philosophy — Principal Advisor
Other advisors:
Human-in-the-loop Quality Management
Doctor Philosophy — Principal Advisor
Other advisors:
The effects of irrational behaviours on the crowdsourcing market
Doctor Philosophy — Principal Advisor
Other advisors:
AI-driven Effective Query Formulation for Better Systematic Reviews
Doctor Philosophy — Associate Advisor
Other advisors:
Investigation of crowd sourced data curation behaviour for repurposed datasets
Doctor Philosophy — Associate Advisor
Other advisors:
Critical Success Factors in Data Driven Value Creation
Doctor Philosophy — Associate Advisor
Other advisors:
Automatic Text Summarisation based on Deep learning
Doctor Philosophy — Associate Advisor
Other advisors:
Crowd Sourced Data Curation
Doctor Philosophy — Associate Advisor
Other advisors:
Integrating Human and Machine Intelligence Towards the Development of an Adaptive Learning System
Doctor Philosophy — Associate Advisor
Other advisors:
(2021) Doctor Philosophy — Principal Advisor
Other advisors:
Countering Lead Bias in Extractive Document Summarization
(2022) Master Philosophy — Associate Advisor
Other advisors:
Search Engines that Help People Make Better Health Decisions
(2020) Doctor Philosophy — Associate Advisor
Other advisors:
View Recommendation for Visual Data Exploration
(2019) Doctor Philosophy — Associate Advisor