The Influence of Commercial Intent of Search Results on Their Perceived Relevance

We carried out a retrieval effectiveness test on the three major web search engines (i.e., Google, Microsoft and Yahoo). In addition to relevance judgments, we classified the results according to their commercial intent and whether or not they carried any advertising. We found that all search engines provide a large number of results with a commercial intent. Google provides significantly more commercial results than the other search engines do. However, the commercial intent of a result did not influence jurors in their relevance judgments

Closing the loop: assisting archival appraisal and information retrieval in one sweep

In this article, we examine the similarities between the concept of appraisal, a process that takes place within the archives, and the concept of relevance judgement, a process fundamental to the evaluation of information retrieval systems. More specifically, we revisit selection criteria proposed as result of archival research, and work within the digital curation communities, and, compare them to relevance criteria as discussed within information retrieval's literature based discovery. We illustrate how closely these criteria relate to each other and discuss how understanding the relationships between the these disciplines could form a basis for proposing automated selection for archival processes and initiating multi-objective learning with respect to information retrieval

Creative professional users musical relevance criteria

Although known item searching for music can be dealt with by searching metadata using existing text search techniques, human subjectivity and variability within the music itself make it very difficult to search for unknown items. This paper examines these problems within the context of text retrieval and music information retrieval. The focus is on ascertaining a relationship between music relevance criteria and those relating to relevance judgements in text retrieval. A data-rich collection of relevance judgements by creative professionals searching for unknown musical items to accompany moving images using real world queries is analysed. The participants in our observations are found to take a socio-cognitive approach and use a range of content and context based criteria. These criteria correlate strongly with those arising from previous text retrieval studies despite the many differences between music and text in their actual content

Social and interactional practices for disseminating current awareness information in an organisational setting.

Current awareness services are designed to keep users informed about recent developments based around user need profiles. In organisational settings, they may operate through both electronic and social interactions aimed at delivering information that is relevant, pertinent and current. Understanding these interactions can reveal the tensions in current awareness dissemination and help inform ways of making services more effective and efficient. We report an in-depth, observational study of electronic current awareness use within a large London law firm. The study found that selection, re-aggregation and forwarding of information by multiple actors gives rise to a complex sociotechnical distribution network. Knowledge management staff act as a layer of “intelligent filters” sensitive to complex, local information needs; their distribution decisions address multiple situational relevance factors in a situation fraught with information overload and restrictive time-pressures. Their decisions aim to optimise conflicting constraints of recall, precision and information quantity. Critical to this is the use of dynamic profile updates which propagate back through the network through formal and informal social interactions. This supports changes to situational relevance judgements and so allows the network to ‘self-tune’. These findings lead to design requirements, including that systems should support rapid assessment of information items against an individual’s interests; that it should be possible to organise information for different subsequent uses; and that there should be back-propagation from information consumers to providers, to tune the understanding of their information needs

RELEVANSI LULUSAN SMK KOMPETENSI KEAHLIAN TEKNIK KOMPUTER JARINGAN DENGAN KEBUTUHAN INDUSTRI PENYELENGGARA JASA INTERNET

Lulusan Teknik Komputer dan Jaringan (TKJ) diharapkan mampu mengisi lowongan pekerjaan bidang IT, salah satunya industri penyelenggara jasa internet (ISP). Agar relevan SMK harus menyiapkan lulusan yang mengacu kepada standar dan kebutuhan dari industri. Penelitian ini bertujuan untuk (1) Mengetahui kompetensi yang dibutuhkan oleh industri ISP; (2) Mengetahui relevansi lulusan SMK jurusan TKJ yang menggunakan Kurikulum Tingkat Satuan Pendidikan (KTSP) program produktif dengan kebutuhan industri penyelenggara jasa internet; (3) Mengetahui relevansi lulusan SMK jurusan TKJ yang menggunakan struktur kurikulum K13 (C3) dengan kebutuhan ISP. Standar pembanding yang digunakan adalah KKNI level II TKJ. Penelitian ini menggunakan pendekatan kualitatif deskriptif dengan informan dari ISP dan SMK. Pengumpulan data dengan wawancara, observasi, dokumentasi dan triangulasi. Kebutuhan kompetensi lulusan di ISP, untuk lulusan SMK jurusan TKJ yang belum memiliki pengalaman kerja, lulusan harus memiliki kompetensi teknis Untuk kompetensi teknis lulusan harus minimal mampu merakit, installasi dan implementasi jaringan lokal, termasuk didalamnya kemampuan pengalamatan IP, perancangan topologi dan konfigurasi perangkat sedangkan kompetensi nonteknis 1) Kemampuan berkomunikasi 2) Kemampuan kerjasama tim 3) Bekerja tanpa pengawasan 4) Kreatifitas. Sertifikasi jaringan menjadi nilai tambah bagi lulusan. Relevansi kurikulum TKJ dari hasil pemetaan kurikulum dan KKNI level II TKJ, untuk KTSP 2006 sudah cukup relevan sebesar 49% Sedangkan untuk kurikulum 2013 sebelum revisi kurang relevan sebesar 27%