Collaborative search engine
|Methods and challenges|
Collaborative search engines (CSE) are Web search engines and enterprise searches within company intranets that let users combine their efforts in information retrieval (IR) activities, share information resources collaboratively using knowledge tags, and allow experts to guide less experienced people through their searches. Collaboration partners do so by providing query terms, collective tagging, adding comments or opinions, rating search results, and links clicked of former (successful) IR activities to users having the same or a related information need.
Models of collaboration
Collaborative search engines can be classified along several dimensions: intent (explicit and implicit) and synchronization  and depth of mediation , task vs. trait, and division of labor and sharing of knowledge.
Explicit vs. implicit collaboration
Implicit collaboration characterizes Collaborative filtering and recommendation systems in which the system infers similar information needs. I-Spy, Jumper 2.0, Seeks, the Community Search Assistant, the CSE of Burghardt et al., and the works of Longo et al.    all represent examples of implicit collaboration. Systems that fall under this category identify similar users, queries and links clicked automatically, and recommend related queries and links to the searchers.
Explicit collaboration means that users share an agreed-upon information need and work together toward that goal. For example, in a chat-like application, query terms and links clicked are automatically exchanged. The most prominent example of this class is SearchTogether published in 2007. SearchTogether offers an interface that combines search results from standard search engines and a chat to exchange queries and links. Reddy et al. (2008) follow a similar approach and compares two implementations of their CSE called MUSE and MUST. Reddy et al. focuses on the role of communication required for efficient CSEs. Representatives for the class of implicit collaboration are I-Spy, the Community Search Assistant, and the CSE of Burghardt et al. Cerciamo  supports explicit collaboration by allowing one person to concentrate on finding promising groups of documents, while having the other person make in-depth judgments of relevance on documents found by the first person.
However, in Papagelis et al. terms are used differently: they combine explicitly shared links and implicitly collected browsing histories of users to a hybrid CSE.
Community of practice
Recent work in collaborative filtering and information retrieval has shown that sharing of search experiences among users having similar interests, typically called a community of practice or community of interest, reduces the effort put in by a given user in retrieving the exact information of interest.
Collaborative search deployed within a community of practice deploys novel techniques for exploiting context during search by indexing and ranking search results based on the learned preferences of a community of users. The users benefit by sharing information, experiences and awareness to personalize result-lists to reflect the preferences of the community as a whole. The community representing a group of users who share common interests, similar professions. The best known example is the open-source project ApexKB (previously known as Jumper 2.0).
Depth of mediation
This refers to the degree that the CSE mediates search. SearchTogether is an example of UI-level mediation: users exchange query results and judgments of relevance, but the system does not distinguish among users when they run queries. Cerchiamo and recommendation systems such as I-Spy keep track of each person's search activity independently, and use that information to affect their search results. These are examples of deeper algorithmic mediation.
Task vs. trait
This model classifies people's membership in groups based on the task at hand vs. long-term interests; these may be correlated with explicit and implicit collaboration.
Privacy-aware collaborative search engines
Search terms and links clicked that are shared among users reveal their interests, habits, social relations and intentions. In other words, CSEs put the privacy of the users at risk. Studies have shown that CSEs increase efficiency.    Unfortunately, by the lack of privacy enhancing technologies, a privacy aware user who wants to benefit from a CSE has to disclose their entire search log. (Note, even when explicitly sharing queries and links clicked, the whole (former) log is disclosed to any user that joins a search session). Thus, sophisticated mechanisms that allow on a more fine grained level which information is disclosed to whom are desirable.
As CSEs are a new technology just entering the market, identifying user privacy preferences and integrating Privacy enhancing technologies (PETs) into collaborative search are in conflict. On one hand, PETs have to meet user preferences, on the other hand, one cannot identify these preferences without using a CSE, i.e., implementing PETs into CSEs. Today, the only work addressing this problem comes from Burghardt et al. They implemented a CSE with experts from the information system domain and derived the scope of possible privacy preferences in a user study with these experts. Results show that users define preferences referring to (i) their current context (e.g., being at work), (ii) the query content (e.g., users exclude topics from sharing), (iii) time constraints (e.g., do not publish the query X hours after the query has been issued, do not store longer than X days, do not share between working time), and that users intensively use the option to (iv) distinguish between different social groups when sharing information. Further, users require (v) anonymization and (vi) define reciprocal constraints, i.e., they refer to the behavior of other users, e.g., if a user would have shared the same query in turn.
- Golovchinsky Gene; Pickens Jeremy (2007), "Collaborative Exploratory Search" (PDF), Proceedings of HCIR 2007 workshop
- Pickens Jeremy; Golovchinsky Gene; Shah Chirag; Qvarfordt Pernilla; Back Maribeth (2008), "Algorithmic mediation for collaborative exploratory search", Collaborative Exploratory Search, pp. 315–322, doi:10.1145/1390334.1390389, ISBN 9781605581644
- Morris Meredith; Teevan Jaime (2008), "Understanding Groups' Properties as a Means of Improving Collaborative Search Systems" (PDF), 1st International Workshop on Collaborative Information Retrieval, held in conjunction with JCDL 2008
- Foley Colum (2008), Division of Labour and Sharing of Knowledge for Synchronous Collaborative Information Retrieval (PDF)
- Barry Smyth; Evelyn Balfe; Peter Briggs; Maurice Coyle; Jill Freyne (2003), "Collaborative Web Search", IJCAI: 1417–1419
- Natalie S. Glance (2001), "Community search assistant", Workshop on AI for Web Search AAAI'02
- Thorben Burghardt; Erik Buchmann; Klemens Böhm (2008), "Discovering the Scope of Privacy Needs in Collaborative Search", Web Intelligence (WI): 910, doi:10.1109/WIIAT.2008.165, ISBN 978-0-7695-3496-1
- Longo Luca; Barrett Stephen; Dondio Pierpaolo (2009), "Toward Social Search - From Explicit to Implicit Collaboration to Predict Users' Interests", Webist 2009 - Proceedings of the Fifth International Conference on Web Information Systems and Technologies, Lisbon, Portugal, March 23–26, 2009, 1: 693–696, ISBN 978-989-8111-81-4
- Longo Luca; Barrett Stephen; Dondio Pierpaolo (2010), "Enhancing Social Search: A Computational Collective Intelligence Model of Behavioural Traits, Trust and Time", Transaction Computational Collective Intelligence II, Lecture Notes in Computer Science, 2: 46–69, doi:10.1007/978-3-642-17155-0_3, ISBN 978-3-642-17154-3
- Longo Luca; Barrett Stephen; Dondio Pierpaolo (2009), "Information Foraging Theory as a Form of Collective Intelligence for Social Search", Computational Collective Intelligence. Semantic Web, Social Networks and Multiagent Systems, First International Conference, ICCCI 2009, Wroclaw, Poland, October 5–7, 2009. Proceedings, 1: 63–74, ISBN 978-3-642-04440-3
- Meredith Ringel Morris; Eric Horvitz (2007), "SearchTogether: An Interface for Collaborative Web Search", UIST
- Madhu C. Reddy; Bernhard J. Jansen; Rashmi Krishnappa (2008), "The Role of Communication in Collaborative Information Searching", ASTIS
- Athanasios Papagelis; Christos Zaroliagis (2007), "Searchius: A Collaborative Search Engine", ENC '07: Proceedings of the Eighth Mexican International Conference on Current Trends in Computer Science: 88–98, doi:10.1109/ENC.2007.34, ISBN 0-7695-2899-6
- Rohini U; Vamshi Ambati (2002), "A Collaborative Filtering based Re-ranking Strategy for Search in Digital Libraries" (PDF), ICADL2005: the 8th International Conference on Asian Digital Libraries
- Maurice Coyle & Barry Smyth (2008), Nejdl, Wolfgang; Kay, Judy; Pu, Pearl; et al., eds., "Social Aspects of a Collaborative, Community-Based Search Network", Adaptive Hypermedia and Adaptive Web-Based Systems, 5149/2008: 103–112, doi:10.1007/978-3-540-70987-9, ISBN 978-3-540-70984-8
- Jumper Networks Inc. (2010), "Jumper Networks Releases Jumper 188.8.131.52 Platform with New Community Search Features", Press release
- Data Protection Working Party (2008), "Article 29 EU Data Protection Working Party", EU
- Barry Smyth; Evelyn Balfe; Oisin Boydell; Keith Bradley; Peter Briggs; Maurice Coyle; Jill Freyne (2005), "A Live-User Evaluation of Collaborative Web Search", IJCAI
- Smyth, Barry & Balfe, Evelyn (2005), "Anonymous personalization in collaborative web search", Inf. Retr., 9 (2): 165–190, doi:10.1007/s10791-006-7148-z
- Seikyung Jung; Juntae Kim; Herlocker, JL (2004), "Applying Collaborative Filtering for Efficient Document Search", Inf. Retr.: 640–643
- Thorben Burghardt; Erik Buchmann; Klemens Böhm; Chris Clifton (2008), "Collaborative Search And User Privacy: How Can They Be Reconciled?", CollaborateCom