Abstract:
The Fog and Edge Computing paradigms have emerged as a solution to limitations of the Cloud Computing model to serve a huge amount of connected devices efficiently. These devices have unused computing power that could be exploited to execute parallel applications. In this work we present SherlockFog, a tool to experiment with parallel applications in Fog and Edge network setups, specially focused on the MPI based applications. We propose a methodology to study feasibility of running parallel applications in Fog or Edge environments. We validate this tool contrasting experimental results with theoretical predictions reaching remarkable agreement between both. We analyze the effect of worsening network conditions for several benchmarks of the MPI version of NAS Parallel Benchmarks on fog-like network topologies. Our results show that this impact is sublinear in some cases, opening up opportunities to use distributed, increasingly ubiquitous computational resources. © Springer International Publishing AG 2018.
Registro:
Documento: |
Artículo
|
Título: | Sherlockfog: Finding opportunities for MPI applications in fog and edge computing |
Autor: | Geier, M.; Mocskos, E.; Mocskos E.; Nesmachnow S. |
Filiación: | Departamento de Computación, Facultad de Ciencias Exactas y Naturales, Universidad de Buenos Aires, Buenos Aires, C1428EGA, Argentina Centro de Simulación Computacional p/Aplic. Tecnológicas, CSC-CONICET, Godoy Cruz 2390, Buenos Aires, C1425FQD, Argentina
|
Palabras clave: | Benchmarks; Distributed systems; Fog and edge computing; Parallel applications; Benchmarking; Fog; Computational resources; Distributed systems; Edge computing; MPI applications; NAS parallel benchmarks; Network condition; Network topology; Parallel application; Distributed computer systems |
Año: | 2018
|
Volumen: | 796
|
Página de inicio: | 185
|
Página de fin: | 199
|
DOI: |
http://dx.doi.org/10.1007/978-3-319-73353-1_13 |
Título revista: | 4th Latin American Conference on High Performance Computing, CARLA 2017
|
Título revista abreviado: | Commun. Comput. Info. Sci.
|
ISSN: | 18650929
|
Registro: | https://bibliotecadigital.exactas.uba.ar/collection/paper/document/paper_18650929_v796_n_p185_Geier |
Referencias:
- (2017), http://tools.bsc.es/dimemas, Accessed 2 Dec; (2017), https://www.nsnam.org/overview/projects/directcode-execution/, Accessed 2 Dec; (2017), https://www.nsnam.org/docs/ns-3-overview.pdf, Accessed 2 Dec; Bailey, D., Barszcz, E., Barton, J., Browning, D., Carter, R., Dagum, L., Fatoohi, R., Weeratunga, S., (1994) The NAS Parallel Benchmarks. Report RNR-94-007, Department of Mathematics and Computer Science, , Emory University, March
- Barabási, A.L., Albert, R., Emergence of scaling in random networks (1999) Science, 286, pp. 509-512
- Bonomi, F., Milito, R., Zhu, J., Addepalli, S., Fog computing and its role in the internet of things (2012) In: Proceedings of the First Edition of the MCC Workshop on Mobile Cloud Computing, MCC, pp. 13-16. , http://doi.acm.org/10.1145/2342509.2342513, ACM, New York
- Brandfass, B., Alrutz, T., Gerhold, T., Rank reordering for MPI communication optimization (2013) Comput. Fluids, 80, pp. 372-380. , http://www.sciencedirect.com/science/article/pii/S004579301200028X, Selected Contributions of the 23rd International Conference on Parallel Fluid Dynamics ParCFD2011
- Casanova, H., Giersch, A., Legrand, A., Quinson, M., Suter, F., Versatile, scalable, and accurate simulation of distributed applications and platforms (2014) J. Parallel Distrib. Comput, 74 (10), pp. 2899-2917. , http://hal.inria.fr/hal-01017319
- Degomme, A., Legrand, A., Markomanolis, G., Quinson, M., Stillwell, M., Suter, F., Simulating MPI applications: The SMPI approach (2017) IEEE Trans. Parallel Distrib. Syst. PP(99), p. 1
- Dichev, K., Rychkov, V., Lastovetsky, A., (2010) Two Algorithms of Irregular Scatter/-Gather Operations for Heterogeneous Platforms, 6305, pp. 289-293. , https://doi.org/10.1007/978-3-642-15646-5_31, Keller, R., Gabriel, E., Resch, M., Dongarra, J. (eds.) EuroMPI 2010. LNCS, Springer, Heidelberg
- Gropp, W., Lusk, E., Skjellum, A., (1999) Using MPI: Portable Parallel Programming with the Message-Passing Interface, 2Nd Edn, , MIT Press, Cambridge
- Gropp, W., Lusk, E., Thakur, R., (1999) Using MPI-2: Advanced Features of the Messagepassing Interface, 2Nd Edn, , MIT Press, Cambridge
- Hemminger, S., (2005) Network Emulation with Netem, , http://developer.osdl.org/shemminger/netem/LCA2005paper.pdf, Pool, M. (ed.) LCA, Australia’s 6th National Linux Conference (linux.conf.au). Linux Australia, Sydney (2005)
- Lantz, B., Heller, B., McKeown, N., A network in a laptop: Rapid prototyping for software-defined networks (2010) Proceedings of the 9Th ACM SIGCOMM Workshop on Hot Topics in Networks, Hotnets-Ix, pp. 19:1–19:6. , http://doi.acm.org/10.1145/1868447.1868466, ACM, New York
- Mercier, G., Clet-Ortega, J., (2009) Towards an Efficient Process Placement Policy for MPI Applications in Multicore Environments, 5759, pp. 104-115. , https://doi.org/10.1007/978-3-642-03770-2_17, Ropo, M., Westerholm, J., Dongarra, J. (eds.) EuroPVM/MPI 2009. LNCS, Springer, Heidelberg
- Navaridas, J., Pascual, J.A., Miguel-Alonso, J., Effects of job and task placement on parallel scientific applications performance (2009) 2009 17Th Euromicro International Conference on Parallel, Distributed and Network-Based Processing, pp. 55-61
- Shi, W., Cao, J., Zhang, Q., Li, Y., Xu, L., Edge computing: Vision and challenges (2016) IEEE Int. Things J, 3 (5), pp. 637-646
- Wette, P., Dräxler, M., Schwabe, A., Maxinet: Distributed emulation of software-defined networks (2014) 2014 Networking Conference, IFIP, pp. 1-9
- White, B., Lepreau, J., Stoller, L., Ricci, R., Guruprasad, S., Newbold, M., Hibler, M., Joglekar, A., An integrated experimental environment for distributed systems and networks (2002) Proceedings of the Fifth Symposium on Operating Systems Design and Implementation, pp. 255-270. , USENIX Association, Boston, DecemberA4 -
Citas:
---------- APA ----------
Geier, M., Mocskos, E., Mocskos E. & Nesmachnow S.
(2018)
. Sherlockfog: Finding opportunities for MPI applications in fog and edge computing. 4th Latin American Conference on High Performance Computing, CARLA 2017, 796, 185-199.
http://dx.doi.org/10.1007/978-3-319-73353-1_13---------- CHICAGO ----------
Geier, M., Mocskos, E., Mocskos E., Nesmachnow S.
"Sherlockfog: Finding opportunities for MPI applications in fog and edge computing"
. 4th Latin American Conference on High Performance Computing, CARLA 2017 796
(2018) : 185-199.
http://dx.doi.org/10.1007/978-3-319-73353-1_13---------- MLA ----------
Geier, M., Mocskos, E., Mocskos E., Nesmachnow S.
"Sherlockfog: Finding opportunities for MPI applications in fog and edge computing"
. 4th Latin American Conference on High Performance Computing, CARLA 2017, vol. 796, 2018, pp. 185-199.
http://dx.doi.org/10.1007/978-3-319-73353-1_13---------- VANCOUVER ----------
Geier, M., Mocskos, E., Mocskos E., Nesmachnow S. Sherlockfog: Finding opportunities for MPI applications in fog and edge computing. Commun. Comput. Info. Sci. 2018;796:185-199.
http://dx.doi.org/10.1007/978-3-319-73353-1_13