August 18, 2006
S3 Meets R3 (Reliability, Robustness, and Resilience)Test Case I: Writing Small Files
The first test case involves writing a set of small files to Amazon S3 Web Services and to a remote SCP enabled server. The set of files (10k to 100k) are relatively small in size given that one can write up to 5GB in a single operation to Amazon S3. The objective of this test case to observe how Amazon S3 behaves with files of small size. Figure 2 illustrates the average transfer time it takes to write multiple small files to Amazon S3 and an SCP server.
Figure 2:
Amazon S3 vs. SCP Small Size File Writes (PUT).
Observations: For Small file size writes (PUT), we make the following observations:
¼ Latency increases almost linearly with an increase in file sizes from 10-100k. This linear increase in latency holds true for both Amazon S3 and the SCP.
¼ Throughput ranges from ~ 160 Kbps -- 270 Kbps.
Test Case II: Writing Large Files
The second test case involves writing a set of large files to Amazon S3 Web Services and to a remote SCP enabled server. Figure 3 illustrates the time it takes to write large multiple files to Amazon S3 and an SCP server.
Figure 3:
Amazon S3 vs. SCP Large Size File Writes (PUT).
Observations: For Large File size writes (PUT), we make the following observations:
¼ Latency increases almost linearly with an increase in file sizes from 1-10 MB. This linear increase in latency holds true for both Amazon S3 and the SCP.
¼ Throughput ranges from ~ 256 Kbps -- 347 Kbps.
Test Case III: Reading Small Files
The third test case involves reading a set of small files from Amazon S3 Web Services and from a remote SCP enabled server. Figure 3 illustrates the time it takes to read multiple small files from Amazon S3 and an SCP server.
Figure 4:
Amazon S3 vs. SCP Small Size File Reads (GET).
Observations: For Small file size reads (GET), we make the following observations:
¼ The latency for Amazon S3 service is remarkably lower than SCP reads.
¼ Throughput ranges from ~ 0.8 Mbps -- 1.3 Mbps, well within the advertised download bandwidth of 6-8Mbps.
Test Case IV: Reading Large Files
The fourth test case involves reading a set of large files from Amazon S3 Web Services and from a remote SCP enabled server. Figure 5 illustrates the time it takes to read multiple large files from Amazon S3 and an SCP server.
Figure 5:
Amazon S3 vs. SCP Large Size File Reads (GET).
Observations: For Large file size reads (GET), we make the following observations:
¼ The latency for Amazon S3 service is significantly lower than SCP reads.
¼ Throughput ranges from ~ 4.75 Mbps -- 7.5 Mbps. The S3 reads consume all available bandwidth advertised at 6-8 Mbps. 
Previous Page |
1
|
2 Setting up the Test
|
3 Reading and Writing
|
4 S3: Enterprise Ready
Next Page
|
 |
|
|||||||||||||||||||||||||||||
|
|
|
