Abstract:
Web search engines are systems devised to cope with highly dynamic and demanding query rates. These systems are composed by several services, each one dedicated to execute a single operation required to solve a query. Services are allocated into thousand of multi-core processors organized in racks. Some services communicate more than others, so it is desirable to put them in the same rack. In this work, we present and evaluate deployment algorithms for a web search engine. In particular, we focus on vertical search engines with speciffic on-line content which may include shopping, advertisement, etc.. Our goal is to improve the performance of a search engine by reducing communication time. Communication among services is performed by means of a fast and complex network supporting parallel sending and receiving of messages. We propose a communication-graph-based method, in which processors are the nodes of the graph and communication between them is represented as weighted arcs. Results show that our proposal method is able to reduce maximum query response time. © 2013 IEEE.
Registro:
| Documento: |
Conferencia
|
| Título: | Service deployment algorithms for vertical search engines |
| Autor: | Gil-Costa, V.; Inostrosa-Psijas, A.; Marin, M.; Feuestein, E. |
| Ciudad: | Belfast |
| Filiación: | Yahoo Research Latin America, Santiago, Chile
CONICET, University of San Luis, Argentina
DIINF, University of Santiago of Chile, Chile
Departamento de Computación, FCEyN, Universidad de Buenos Aires, Argentina
|
| Palabras clave: | Communication time; Deployment algorithms; Multi-core processor; On-line contents; Query response time; Service deployment; Vertical search engine; Algorithms; Communication; Information retrieval; Parallel processing systems; Websites; Search engines |
| Año: | 2013
|
| Página de inicio: | 140
|
| Página de fin: | 147
|
| DOI: |
http://dx.doi.org/10.1109/PDP.2013.28 |
| Título revista: | 2013 21st Euromicro International Conference on Parallel, Distributed, and Network-Based Processing, PDP 2013
|
| Título revista abreviado: | Proc. Euromicro Int. Conf. Parallel, Distrib., Netw.-Based Process., PDP
|
| Registro: | https://bibliotecadigital.exactas.uba.ar/collection/paper/document/paper_97807695_v_n_p140_GilCosta |
Referencias:
- Al-Fares, M., Loukissas, A., Vahdat, A., A scalable, commodity data center network architecture (2008) SIGCOMM, 38, pp. 63-74
- Badue, C.S., Almeida, J.M., Almeida, V., Baeza-Yates, R.A., Ribeiro-Neto, B.A., Ziviani, A., Ziviani, N., Capacity planning for vertical search engines (2010) CoRR, , abs/1006.5059
- Broder, A.Z., Carmel, D., Herscovici, M., Soffer, A., Zien, J.Y., Efficient query evaluation using a two-level retrieval process (2003) CIKM, pp. 426-434
- Cambazoglu, B.B., Varol, E., Kayaaslan, E., Aykanat, C., Baeza-Yates, R., Query forwarding in geographically distributed search engines (2010) SIGIR, pp. 90-97
- Chen, H., Hariri, S., Kim, B., Zhang, Y., Yousif, M., Self-deployment and self-configuration of pervasive network services (2004) ICPS, pp. 242-242
- Feuerstein, E., Costa, V.G., Mizrahi, M., Marín, M., Performance evaluation of improved web search algorithms (2010) VECPAR, pp. 236-250
- Fitzpatrick, B., Distributed caching with memcached (2004) J. of Linux, 2004, pp. 72-76
- Freire, A., Macdonald, C., Tonellotto, N., Ounis, I., Cacheda, F., Scheduling queries across replicas (2012) SIGIR, pp. 1139-1140
- Gan, Q., Suel, T., Improved techniques for result caching in web search engines (2009) WWW, pp. 431-440
- Karypis, G., Kumar, V., (1998) Metis 4.0: Unstructured Graph Partitioning and Sparse Matrix Ordering System, , Technical report
- Karypis, G., Kumar, V., Multilevelk-way Partitioning Scheme for Irregular Graphs (1998) Journal of Parallel and Distributed Computing, 48 (1), pp. 96-129. , DOI 10.1006/jpdc.1997.1404, PII S0743731597914040
- Marzolla, M., Libcppsim: A simula-like, portable process-oriented simulation library in c++ (2004) ESM
- Ou, S., Liu, D., Yang, K., Dynamic algorithms for self-deployment and self-configuration of pervasive service components (2009) CISIS, pp. 525-530. , march
- Wasserman, K.M., Michailidis, G., Bambos, N., Optimal processor allocation to differentiated job flows (2006) Performance Evaluation, 63 (1), pp. 1-14. , DOI 10.1016/j.peva.2004.11.001, PII S0166531604001518
Citas:
---------- APA ----------
Gil-Costa, V., Inostrosa-Psijas, A., Marin, M. & Feuestein, E.
(2013)
. Service deployment algorithms for vertical search engines. 2013 21st Euromicro International Conference on Parallel, Distributed, and Network-Based Processing, PDP 2013, 140-147.
http://dx.doi.org/10.1109/PDP.2013.28---------- CHICAGO ----------
Gil-Costa, V., Inostrosa-Psijas, A., Marin, M., Feuestein, E.
"Service deployment algorithms for vertical search engines"
. 2013 21st Euromicro International Conference on Parallel, Distributed, and Network-Based Processing, PDP 2013
(2013) : 140-147.
http://dx.doi.org/10.1109/PDP.2013.28---------- MLA ----------
Gil-Costa, V., Inostrosa-Psijas, A., Marin, M., Feuestein, E.
"Service deployment algorithms for vertical search engines"
. 2013 21st Euromicro International Conference on Parallel, Distributed, and Network-Based Processing, PDP 2013, 2013, pp. 140-147.
http://dx.doi.org/10.1109/PDP.2013.28---------- VANCOUVER ----------
Gil-Costa, V., Inostrosa-Psijas, A., Marin, M., Feuestein, E. Service deployment algorithms for vertical search engines. Proc. Euromicro Int. Conf. Parallel, Distrib., Netw.-Based Process., PDP. 2013:140-147.
http://dx.doi.org/10.1109/PDP.2013.28