Publications
FastDAWG: improving data migration in the BigDAWG polystore system
February 21, 2019
Conference Paper
Published in:
Poly 2018/DMAH 2018, LNCS 11470, 2019, pp. 3–15.
Topic:
R&D area:
R&D group:
Summary
The problem of data integration has been around for decades, yet a satisfactory solution has not yet emerged. A new type of system called a polystore has surfaced to partially address the integration problem. Based on experience with our own polystore called Big-DAWG, we identify three major roadblocks to an acceptable commercial solution. We offer a new architecture inspired by these three problems that trades some generality for usability. This architecture also exploits modern hardware (i.e., high-speed networks and RDMA) to gain performance. The paper concludes with some promising experimental results.
Summary
The problem of data integration has been around for decades, yet a satisfactory solution has not yet emerged. A new type of system called a polystore has surfaced to partially address the integration problem. Based on experience with our own polystore called Big-DAWG, we identify three major roadblocks to an...
READ MORE