Vaishali's blog

AWS Storage

Vaishali Jogdande's photo
Vaishali Jogdande
·

4 min read

AWS Storage

AWS storage has 5 types as below:

  1. S3

  2. EBS

  3. Instance storage

  4. EFS

  5. Snowfall

  1. S3 (Simple storage service)

  • It is Object based storage.

  • It creates 3 Copies of data in the same region.

  • S3 is a global service.

  • You can create bucket to store a data.

  • You can not create a bucket inside a bucket.

  • The maximum capacity of the bucket is unlimited.

  • You can put upto 5TB of data in bucket in single go

  • It is a global service but Whenever you create bucket it will create in specific region

1 TB = 1028 GB

Versioning -

  • If the file name is same then only it will create versioning.

  • We can enable or suspend but cannot disable versioning of bucket.

Storage Classes of Amazon S3-

  1. Amazon S3 standard -

  • S3 std offers high durability, availability and performance object storage for frequently access data.

  • Durability is 99.99999999999%

  • Availability - 99.99% for one year.

  • Support for SSL

  • Storage cost for the object is fairly high, but there is very less charge for accessing the object.

  • Largest object that can be uploaded in a single put is 5TB.

  • Ideal for Transactions upto one month

  1. Amazon S3 Infrequent Access -

  • S3-IA is for data that is accessed less frequently, but required rapid access when needed.

  • The storage cost is much cheaper than S3-std, almost half the price, but you are charged heavily for accessing your objects.

  • Durability is - 99. 999999999%

  • Availability - 99.99%

  • Support for SSL

  • Data that is deleted from S3-IA within 30 days will be charged for a full 30 days.

  • Ideal for Transactions upto 3 to 4 months.

  1. Amazon Intelligent Tiering -

  • The S3 intelligent Tiering storage class is designed to optimze cost by automatically moving data to the most cost effective access-tier.

  • It works by storing objects in two access tiers.

  • If an object in the infrequent access tier is accessed, it is automatcally moved back to the frequent access tier.

  • There are no retrival fees when using S3-intellignet tiering storage class and no additional tiering fee when objects are moved between access tier.

  • Low latency

  • Object less than 128KB can not move to IA.

  • Durability - 99. 9999999999%

  • Availability- 99.9%

  1. Amazon S3 One-Zone-IA -

  • S3 one-Zone-IA is for data that is accessed less frequently, but required rapid access when needed.

  • Data store in single Availability zone.

  • It is good choice for storing secondary backup copies of on-premise data or easily re creatable data.

  • You can use S3 lifecycle.

  • Durability - 99.99999999999%

  • Availability - 99.50

Here you can make manual lifecycle for each period.

  1. Amazon Glacier -

  • S3 Glacier is secure, durable low cost storage class for data archiving.

  • To keep cost low suitable for varying needs.

  • You can upload object directly to Glacier or use S3 lifecycle.

  • Durability - 99.9999999999%

  • Support for SSL

  • You can retrieve 10 GB of your amazon S3 Glacier data per month for free with free tier account.

  • Retrieval will take time of few mins to hours. Transactions upto 1 to 5 years

100 GB -> 10 GB -> 20 GB

  1. Amazon Glacier Deep Archive

  • S3 Glacier Deep Archive is amazon S3 cheapest storage.

  • Designed to retain data for long period ex - 10-15 yrs

  • All object stored in S3-Glacier Deep archive are replicated and stored across at least 3-Availability zone

  • Durability - 99. 9999999999%

  • Ideal alternative for magnetic tape.

  • Retrieval time within 12 hours.

  • Storage cost is upto 75% less than S3-Glacier. Transactions over 10 years Data -> S3 std -> S3 Infrequent Access -> Amazon Glacier -> Amazon Glacier Deep Archive

  1. EBS (Elastic Block Store) - Amazon Elastic block store provides block level storage volumes for use with EC2 instance.

  • Attached to EC2 instance

  • Data stores in block format

  • Default Linux - 8GB, windows- 30GB

  • High performance

  • Scalable, easy to use

  • Persistence volume- even if you start or restart your machine data will be available

Steps -

  1. Create EC2 instance

  2. Describe the EBS volume in AWS

  3. Create an EBS volume.

  4. Attach the EBS volume to an EC2 instance

  5. Create a partition of the volume

  6. Format the partition to the file system

  7. Mount the partition to the directory

  8. Make the mount persistent

Snapshot-> Point at back up

Types of EBS volumes-

  1. Instance Storage -

  • Also known as Ephemeral storage

  • Instance storage is a storage volume that acts as physical drive.

  • It provides temporary storage for EC2 instance.

  • Temporary storage(Non-Persistence)

Difference between Instance storage and EBS-

Instance storage and EC2 must be on same hardware while EBS and EC2 might be on same hardware or on different hardwares.

  1. EFS - Amazon EFS is required for shared, scalable, and persistent file storage that can be accessed by multiple EC2 instances or services simultaneously.

If we add files in EFS it will shared among all machines and vice versa.

storageAWSAWS StorageBackupAmazon S3