Skip to main content

AWS storage details

 

  1. Simple Storage Service S3 (Object level storage any type of data, you can access it anywhere)

  

   2.Elastic file system EFS: (common storage you can share across different regions and VPCs ex: patch files, updated files, Linux files)

   3.Elastic block storage EBS (it is accessible through EC2 only like HDD work in a computer)

   4.Glacier (): now it is part of S3 storage and cost-effective,  not frequently used data.

  1. Snowball :  (Huge amount of data We can transfer one DC to another DC)

Part-2

————————

Block Level v/s Object Lebel Storage:

Block storage:

—> Block starts is suitable for transactional databases, random read/write loads, and structured database storage

—>Block storage divides the data to be stored in evenly sized blocks(data chunks) for instance,   a file can be split into evenly sized blocks before it is stored

—>data blocks stored in block storage would not contain metadata(data created, data modified, content types, etc)

—>Block storage only keep the address (index) where the data blocks are stored it does not care what is in that block just how to retrieve it when required.

Object Storage:
—>Object storage stores the file as a whole and does not divide them

—>In object storage, on object, is

     The file /data itself

     Its metadata

     Object global unique ID

—>the object global unique ID, is a Unique Identifier for the Object and it must be unique such that it can be retrieved disregarding object storage cannot be mounted as a drive.

—> example of object storage solutions- Dropbox AWS S3 Facebook

Part-3

—————

Simple Storage Service (S3):

  —>S3 is a storage for the internet. It has a simple web services interface for simple storing and retrieving any amount of data any time from anywhere on the internet.

—>S3 is  object-based storage

—> You cannot install an operating system on S3.

—>S3 has a distributed data-store architecture where objects are redundantly stored in multiple locations.(3 locations in the same region)

—>Data is stored in Bucket

—>A bucket is a flat container of the object

—>Max capacity of a bucket is 5TB

—>You can create folders in your bucket

—>you cannot create nested Bucket

—>S3 bucket is a region-specific

—>Bucket ownership is non-transferrable

—>you can have up to 100 buckets per account

—>S3 bucket names (keys)are globally Unique across all AWS region

—>Bucket names cannot be changed after they are created

—>if a bucket is deleted its name become available again to you or another account to use

—>Bucket names must be at least 3 and no more than 63 characters long

—>Bucket names are part of the URL used to access a bucket

—>Bucket name must be a series of one or more labels (abc.xyz)

—>Bucket names can contain lowercases numbers and the hyphen cannot use an uppercase letter

—>Bucket name should not be an IP address

—>Each Lebel must start and end with a lowercase letter or a number

—>By default, buckets and its objects are private by default, only can access the bucket’

S3 Buckets – Sub-resources:

——————————————

Sub-resources for S3 bucket includes-

Lifecycle – To decide on objects lifecycle management

Website  To hold configurations related to a static website hosted in an S3 bucket

Versioning:- Keep object versions as its changes 

Access Control List-  Bucket policies 

The name is simply two parts:- Bucket Regions endpoint/bucketname

Example:

For S3 bucket named my bucket in Europe west region

https://s3-eu-west1.amazonaws.com/mybucket

Comments

Popular posts from this blog

HP SMART ARRAY CLI COMMANDS

Show configuration : /opt/hp/hpssacli/bin/hpssacli ctrl all show config Controller status /opt/hp/hpssacli/bin/hpssacli ctrl all show status Show detailed controller information for all controllers /opt/hp/hpssacli/bin/hpssacli ctrl all show detail Show detailed controller information for controller in slot 0 /opt/hp/hpssacli/bin/hpssacli ctrl slot=0 show detail Rescan for New Devices /opt/hp/hpssacli/bin/hpssacli rescan Physical disk status /opt/hp/hpssacli/bin/hpssacli ctrl slot=0 pd all show status Show detailed physical disk information /opt/hp/hpssacli/bin/hpssacli ctrl slot=0 pd all show detail Logical disk status /opt/hp/hpssacli/bin/hpssacli ctrl slot=0 ld all show status View Detailed Logical Drive Status /opt/hp/hpssacli/bin/hpssacli ctrl slot=0 ld 2 show Create New RAID 0 Logical Drive /opt/hp/hpssacli/bin/hpssacli ctrl slot=0 create type=ld drives=1I:1:2 raid=0 Create New RAID 1 Logical Drive /opt/hp/hpssacli/bin/hpssacli ctrl slot=0 create type=ld dri...

Monthly Mksys OS backup AIX

Step-1 Estimate Backup: ================================================================= df -tk `lsvgfs rootvg` | awk ‘{total+=$3}\ END {printf “Estimated mksysb size: %d bytes, %.2f GB\n”, total*1024, total/1024/1024}’ It will give you the estimated time of backup, Step-2 Backup Command: backupios -file /home/padmin/28August2013_TESTVIOI_mksysb ===============> VIO Backup Command mksysb -e -i -X /mksysb/10Nov2013_server-1_mksysb============================>AIX server Backup command Step-3 ================= Pre -checks: => check NFS FS size(Backup file) and root vg FS sizes . Note : if any FS Full Zip old logs => To check performance of the server => To check root VG FS => To check /etc/exclude ========================== Step-4 ================================ server-1 mksysb -e -i -X /mksysb/02March2014_server-1_mksysb server-2 mksysb -e -i -X /mksysb/02March2014_sever-2_mksysb Post checkups: ==> check the process running o...

HP proliant SERVER hardware commands

to check the failed disk, adapter, any physical component on hp prolient server use the below important command. # hpacucli controller all show config———-to See the failed disk in HP proliant server  Smart Array P410i in Slot 0 (Embedded) (sn: 500143802590F6C0) logicaldrive 1 (558.9 GB, RAID 1, Interim Recovery Mode) array A (SAS, Unused Space: 0 MB) physicaldrive 1I:1:1 (port 1I:box 1:bay 1, SAS, 600 GB, OK) physicaldrive 1I:1:2 (port 1I:box 1:bay 2, SAS, 600 GB, Failed)====>indicating the faild drive SEP (Vendor ID PMCSIERA, Model SRC 8x6G) 250 (WWID: 500143802590F6CF) [root@TEST:/root]# hpacucli ctrl slot=0 show Smart Array P410i in Slot 0 (Embedded) Bus Interface: PCI Slot: 0 Serial Number: 500143802590F6C0 Cache Serial Number: PBCDH0CRH1Z6R3 RAID 6 (ADG) Status: Disabled Controller Status: OK Hardware Revision: C Firmware Version: 6.60 Rebuild Priority: Medium Expand Priority: Medium Surface Scan Delay: 3 secs Surface Scan Mode: Idle Queue Depth: Autom...