Analysis of HDFS under HBase: a Facebook messages case study

• Autores: Tyler Harter, Dhruba Borthakur, Siying Dong, Amitanand Aiyer, Liyin Tang, Andrea Arpaci-Dusseau, Remzi Arpaci-Dusseau
• Localización: ;login:: the magazine of USENIX & SAGE, ISSN 1044-6397, Vol. 39, Nº. 3, 2014 (Ejemplar dedicado a: File Systems and storage), págs. 10-16
• Idioma: inglés
• Texto completo no disponible (Saber más ...)
• Resumen

  • Large-scale distributed storage systems are exceedingly complex and time-consuming to design, implement, and operate. As a result, rather than cutting new systems from whole cloth, engineers often opt for layered architectures, building new systems upon already-existing ones to ease the burden of development and deployment. In this article, we examine how layering causes write amplication when HBase is run on top of HDFS and how tighter integration could result in improved write performance. Finally, we take a look at whether it makes sense to include an SSD to improve performance while keeping costs in check.