650 research outputs found
MDCC: Multi-Data Center Consistency
Replicating data across multiple data centers not only allows moving the data
closer to the user and, thus, reduces latency for applications, but also
increases the availability in the event of a data center failure. Therefore, it
is not surprising that companies like Google, Yahoo, and Netflix already
replicate user data across geographically different regions.
However, replication across data centers is expensive. Inter-data center
network delays are in the hundreds of milliseconds and vary significantly.
Synchronous wide-area replication is therefore considered to be unfeasible with
strong consistency and current solutions either settle for asynchronous
replication which implies the risk of losing data in the event of failures,
restrict consistency to small partitions, or give up consistency entirely. With
MDCC (Multi-Data Center Consistency), we describe the first optimistic commit
protocol, that does not require a master or partitioning, and is strongly
consistent at a cost similar to eventually consistent protocols. MDCC can
commit transactions in a single round-trip across data centers in the normal
operational case. We further propose a new programming model which empowers the
application developer to handle longer and unpredictable latencies caused by
inter-data center communication. Our evaluation using the TPC-W benchmark with
MDCC deployed across 5 geographically diverse data centers shows that MDCC is
able to achieve throughput and latency similar to eventually consistent quorum
protocols and that MDCC is able to sustain a data center outage without a
significant impact on response times while guaranteeing strong consistency
Mandator and Sporades: Robust Wide-Area Consensus with Efficient Request Dissemination
Consensus algorithms are deployed in the wide area to achieve high
availability for geographically replicated applications. Wide-area consensus is
challenging due to two main reasons: (1) low throughput due to the high latency
overhead of client request dissemination and (2) network asynchrony that causes
consensus protocols to lose liveness. In this paper, we propose Mandator and
Sporades, a modular state machine replication algorithm that enables high
performance and resiliency in the wide-area setting.
To address the high client request dissemination overhead challenge, we
propose Mandator, a novel consensus-agnostic asynchronous dissemination layer.
Mandator separates client request dissemination from the critical path of
consensus to obtain high performance. Composing Mandator with Multi-Paxos
(Mandator-Paxos) delivers significantly high throughput under synchronous
networks. However, under asynchronous network conditions, Mandator-Paxos loses
liveness which results in high latency. To achieve low latency and robustness
under asynchrony, we propose Sporades, a novel omission fault-tolerant
consensus algorithm. Sporades consists of two modes of operations --
synchronous and asynchronous -- that always ensure liveness. The combination of
Mandator and Sporades (Mandator-Sporades) provides a robust and high-performing
state machine replication system.
We implement and evaluate Mandator-Sporades in a wide-area deployment running
on Amazon EC2. Our evaluation shows that in the synchronous execution,
Mandator-Sporades achieves 300k tx/sec throughput in less than 900ms latency,
outperforming Multi-Paxos, EPaxos and Rabia by 650\% in throughput, at a modest
expense of latency. Furthermore, we show that Mandator-Sporades outperforms
Mandator-Paxos, Multi-Paxos, and EPaxos in the face of targeted distributed
denial-of-service attacks
- …