AWS Commands
# region and codes:
https://awsregion.info/configure my region?
aws configure
$ aws configure
AWS Access Key ID [****************CQU6]:
AWS Secret Access Key [****************dmOQ]:
Default region name [ap-south-1]:
Default output format [json]:aws config location
vi ~/.aws/config
verify
cat ~/.aws/configGet my CLI version
aws --version
aws-cli/2.0.4 Python/3.7.4 Darwin/17.7.0 botocore/2.0.0dev8
aws-cli/1.16.260 Python/2.7.16 Darwin/17.7.0 botocore/1.12.250How to uninstall AWS and install updated version?
which aws
/usr/local/bin/awsls -l /usr/local/bin/aws
sudo rm /usr/local/bin/aws
sudo rm /usr/local/bin/aws_completer
sudo rm -rf /usr/local/aws-cli
https://docs.aws.amazon.com/cli/latest/userguide/install-cliv2-mac.html#cliv2-mac-remove
https://docs.aws.amazon.com/cli/latest/userguide/install-cliv2-mac.html#cliv2-mac-install-confirmHow to install AWS?
curl "https://awscli.amazonaws.com/AWSCLIV2.pkg" -o "AWSCLIV2.pkg"
sudo installer -pkg AWSCLIV2.pkg -target /
verify
aws-cli/2.0.4 Python/3.7.4 Darwin/17.7.0 botocore/2.0.0dev8
https://docs.aws.amazon.com/cli/latest/userguide/install-cliv2-mac.html#cliv2-mac-removeGet My region
aws configure get regionaws ecr get-login --region us-west-2 --no-include-email
aws ecr get-login --region ca-central-1 --no-include-emailCreate VPCs
aws ec2 create-default-vpcDescribe VPCs
aws ec2 describe-vpcsCreate task-definition:
aws ecs register-task-definition --cli-input-json file://task-definition.json
Create security Group:
aws ec2 authorize-security-group-ingress --group-name circleci-flask-demo-sg --protocol tcp --port 1-65535 --source-group circleci-flask-demo-elb-sgaws ecs register-task-definition --cli-input-json file://task-definition.jsonaws ec2 describe-regionsaws ecs describe-task-definition --task-definition dev-kde20-rabbitmq:2
https://docs.aws.amazon.com/cli/latest/reference/ecs/describe-task-definition.htmlaws ecr describe-repositoriesaws ecr describe-repositories --repository-name 943339394358.dkr.ecr.us-west-2.amazonaws.com/dev/kde2.0-apiaws ecr describe-images --repository-name amazonlinux
https://docs.aws.amazon.com/AmazonECR/latest/userguide/docker-pull-ecr-image.htmlaws configure get region
https://stackoverflow.com/questions/31331788/using-aws-cli-what-is-best-way-to-determine-the-current-regionlist ecs clusters
aws ecs list-clustersdelete cluster
aws ecs delete-cluster --cluster khemistry
more:
https://docs.aws.amazon.com/cli/latest/reference/ecr/index.htmlaws ssm get-parameter-history
aws ssm get-parameters \
--names "/KDE/Dev/Api/CENSHARE_CDN_BUCKET_NAME"
Would get:
{
"Parameters": [
{
"Name": "/KDE/Dev/Api/CENSHARE_CDN_BUCKET_NAME",
"Type": "String",
"Value": "kwikee",
"Version": 1,
"LastModifiedDate": "2020-04-15T12:18:19.234000-04:00",
"ARN": "arn:aws:ssm:us-east-1:943339394358:parameter/KDE/Dev/Api/CENSHARE_CDN_BUCKET_NAME"
}
],
"InvalidParameters": []
}
https://docs.aws.amazon.com/cli/latest/reference/ssm/get-parameters.html# s3 commands
# download s3 file
aws s3api get-object --bucket scrapercentral-dev --key cache/armitage/20211015/00/0a/40/4a/0b/c7/a2/e6/af/0f/ce/c9/33/40/cd/44/000a404a0bc7a2e6af0fcec93340cd44.dar.gz abc.dar.gz
# copy s3 file to local
aws s3 cp s3://scrapercentral-dev/cache/armitage/20211015/00/0a/40/4a/0b/c7/a2/e6/af/0f/ce/c9/33/40/cd/44/000a404a0bc7a2e6af0fcec93340cd44.dar.gz a.gz
aws s3 cp s3://amazon-reviews-pds/tsv/amazon_reviews_us_Digital_Software_v1_00.tsv.gz .
#
Get My region
aws configure get region#
Create task-definition:
aws ecs register-task-definition --cli-input-json file://task-definition.json#
Create security Group:
aws ec2 authorize-security-group-ingress --group-name circleci-flask-demo-sg --protocol tcp --port 1-65535 --source-group circleci-flask-demo-elb-sgaws configure list
Name Value Type Location
---- ----- ---- --------
profile <not set> None None
access_key ****************QY5R shared-credentials-file
secret_key ****************DHM1 shared-credentials-file
region us-east-2 config-file ~/.aws/configec2-describe-instanceaws s3 ls
2022-04-26 09:50:06 scrapercentral-dev
2022-04-27 16:51:22 scrapercentral-external
2021-10-24 23:24:26 scrapercentral-frontend-dev
2021-10-24 23:24:42 scrapercentral-frontend-prod
2021-09-04 16:50:14 scrapercentral-prodGive ec2 control as a policy
https://stackoverflow.com/questions/66172211/grant-read-only-iam-permission-to-ec2-resources-based-on-tag-using-custom-policy
{
"Version": "2012-10-17",
"Statement": [
{
"Effect": "Allow",
"Action": [
"ec2-instance-connect:SendSSHPublicKey"
],
"Resource": "arn:aws:ec2:*:7352673452763:instance/*",
"Condition": {
"StringEquals": {
"aws:ResourceTag/Project": "TestProject"
}
}
},
{
"Effect": "Allow",
"Action": "ec2:Describe*",
"Resource": "*"
}
]
}When I upgraded my DB, it creates a new IP addressHow to get the IP of DB?
ping <db_url>
dig A sc-aurora-dev-cluster.cluster-cdep7wseru0n.us-east-2.rds.amazonaws.com +short
Automation pending:
https://github.com/rajasgs/aws-cli-grep
aws --version
aws-cli/2.9.0 Python/3.9.11 Darwin/18.7.0 exe/x86_64 prompt/off
which aws
/usr/local/bin/aws
Run AWS Image pipeline:
https://awscli.amazonaws.com/v2/documentation/api/latest/reference/imagebuilder/start-image-pipeline-execution.html
aws imagebuilder start-image-pipeline-execution \
--image-pipeline-arn arn:aws:imagebuilder:ca-central-1:723675304964:image-pipeline/rajalinuximagepipeline
{
"requestId": "a24daa7b-bb1c-4b25-92a7-26505eb86c00",
"clientToken": "96dcbea7-9ffb-446b-b092-a4007f299514",
"imageBuildVersionArn": "arn:aws:imagebuilder:ca-central-1:723675304964:image/rj-linux-image-recipe/1.0.0/4"
}
List AWS EC2 Image pipelines
aws imagebuilder list-image-pipelines
{
"requestId": "4204bee5-95ba-4f64-ab49-f399363b8c94",
"imagePipelineList": [
{
"arn": "arn:aws:imagebuilder:ca-central-1:723675304964:image-pipeline/rajalinuximagepipeline",
"name": "RajaLinuxImagePipeline",
"description": "Raja Linux Image Pipeline",
"platform": "Linux",
"enhancedImageMetadataEnabled": true,
"imageRecipeArn": "arn:aws:imagebuilder:ca-central-1:723675304964:image-recipe/rj-linux-image-recipe/1.0.0",
"infrastructureConfigurationArn": "arn:aws:imagebuilder:ca-central-1:723675304964:infrastructure-configuration/rj-linux-image-builder-8fb08f31-e6cf-4bfd-bef5-57a93236ebee",
"distributionConfigurationArn": "arn:aws:imagebuilder:ca-central-1:723675304964:distribution-configuration/rj-linux-image-builder-8fb08f31-e6cf-4bfd-bef5-57a93236ebee",
"imageTestsConfiguration": {
"imageTestsEnabled": true,
"timeoutMinutes": 720
},
"status": "ENABLED",
"dateCreated": "2022-11-22T02:11:04.820Z",
"dateUpdated": "2022-11-22T02:11:04.820Z",
"tags": {}
}
]
}
List image recipe:
aws imagebuilder list-image-recipes
{
"requestId": "1e4d9be1-0267-4305-8a31-d1e30cad1f0f",
"imageRecipeSummaryList": [
{
"arn": "arn:aws:imagebuilder:ca-central-1:723675304964:image-recipe/rj-linux-image-recipe/1.0.0",
"name": "RJ-Linux-Image-Recipe",
"platform": "Linux",
"owner": "723675304964",
"parentImage": "arn:aws:imagebuilder:ca-central-1:aws:image/ubuntu-server-20-lts-x86/x.x.x",
"dateCreated": "2022-11-21T17:59:02.810Z",
"tags": {}
}
]
}
list images:
aws imagebuilder list-images
{
"requestId": "a4e22ed2-9659-451e-8580-6e78407647c6",
"imageVersionList": [
{
"arn": "arn:aws:imagebuilder:ca-central-1:723675304964:image/rj-linux-image-recipe/1.0.0",
"name": "RJ-Linux-Image-Recipe",
"type": "AMI",
"version": "1.0.0",
"platform": "Linux",
"osVersion": "Ubuntu 20",
"owner": "723675304964",
"dateCreated": "2022-11-22T10:55:17.929Z",
"buildType": "USER_INITIATED"
},
{
"arn": "arn:aws:imagebuilder:ca-central-1:723675304964:image/rj-scraper-image-recipe/1.0.0",
"name": "rj-scraper-image-recipe",
"type": "AMI",
"version": "1.0.0",
"platform": "Linux",
"osVersion": "Amazon Linux 2",
"owner": "723675304964",
"dateCreated": "2022-11-21T10:37:08.369Z",
"buildType": "USER_INITIATED"
}
]
}
list keypairs
aws ec2 describe-key-pairs
{
"KeyPairs": [
{
"KeyPairId": "key-0838e6463d83e96f3",
"KeyFingerprint": "41:fb:9f:a2:02:4a:08:a8:1a:1d:38:47:20:7b:00:9e:5e:db:c2:39",
"KeyName": "rj-tester-key",
"KeyType": "rsa",
"Tags": [],
"CreateTime": "2022-08-25T01:20:24+00:00"
}
]
}
list security group ids
aws ec2 describe-security-groups
{
"SecurityGroups": [
{
"Description": "launch-wizard-1 created 2022-11-21T17:21:38.416Z",
"GroupName": "launch-wizard-1",
"IpPermissions": [
{
"FromPort": 22,
"IpProtocol": "tcp",
"IpRanges": [
{
"CidrIp": "52.3.141.123/32"
}
],
"Ipv6Ranges": [],
"PrefixListIds": [],
"ToPort": 22,
"UserIdGroupPairs": []
}
],
"OwnerId": "723675304964",
"GroupId": "sg-0049271e54bfd052e",
"IpPermissionsEgress": [
{
"IpProtocol": "-1",
"IpRanges": [
{
"CidrIp": "0.0.0.0/0"
}
],
"Ipv6Ranges": [],
"PrefixListIds": [],
"UserIdGroupPairs": []
}
],
"VpcId": "vpc-4ec5c326"
},
{
"Description": "RJ Tester SG",
"GroupName": "rj-tester-sg",
"IpPermissions": [
{
"FromPort": 22,
"IpProtocol": "tcp",
"IpRanges": [
{
"CidrIp": "52.3.141.123/32"
}
],
"Ipv6Ranges": [],
"PrefixListIds": [],
"ToPort": 22,
"UserIdGroupPairs": []
}
],
"OwnerId": "723675304964",
"GroupId": "sg-0ed5b9b7488b55819",
"IpPermissionsEgress": [
{
"IpProtocol": "-1",
"IpRanges": [
{
"CidrIp": "0.0.0.0/0"
}
],
"Ipv6Ranges": [],
"PrefixListIds": [],
"UserIdGroupPairs": []
}
],
"VpcId": "vpc-4ec5c326"
}
]
}
aws ec2 run-instances --image-id ami-04d38256e475591da --count 1 \
--instance-type t2.micro --key-name rj-tester-key \
--security-group-ids sg-0ed5b9b7488b55819
https://awscli.amazonaws.com/v2/documentation/api/latest/reference/ec2/index.html
{
"Groups": [],
"Instances": [
{
"AmiLaunchIndex": 0,
"ImageId": "ami-04d38256e475591da",
"InstanceId": "i-00a0fe6eaf35227d6",
"InstanceType": "t2.micro",
"KeyName": "rj-tester-key",
"LaunchTime": "2022-11-22T12:01:03+00:00",
"Monitoring": {
"State": "disabled"
},
"Placement": {
"AvailabilityZone": "ca-central-1a",
"GroupName": "",
"Tenancy": "default"
},
"PrivateDnsName": "ip-172-31-20-125.ca-central-1.compute.internal",
"PrivateIpAddress": "172.31.20.125",
"ProductCodes": [],
"PublicDnsName": "",
"State": {
"Code": 0,
"Name": "pending"
},
"StateTransitionReason": "",
"SubnetId": "subnet-27ccf84f",
"VpcId": "vpc-4ec5c326",
"Architecture": "x86_64",
"BlockDeviceMappings": [],
"ClientToken": "5c82ad2a-4dbd-4002-9f41-3bde1962dbe2",
"EbsOptimized": false,
"EnaSupport": true,
"Hypervisor": "xen",
"NetworkInterfaces": [
{
"Attachment": {
"AttachTime": "2022-11-22T12:01:03+00:00",
"AttachmentId": "eni-attach-0c73ba1a2bf25278d",
"DeleteOnTermination": true,
"DeviceIndex": 0,
"Status": "attaching",
"NetworkCardIndex": 0
},
"Description": "",
"Groups": [
{
"GroupName": "rj-tester-sg",
"GroupId": "sg-0ed5b9b7488b55819"
}
],
"Ipv6Addresses": [],
"MacAddress": "02:5b:25:ce:a2:54",
"NetworkInterfaceId": "eni-078b2e3a21136e959",
"OwnerId": "723675304964",
"PrivateDnsName": "ip-172-31-20-125.ca-central-1.compute.internal",
"PrivateIpAddress": "172.31.20.125",
"PrivateIpAddresses": [
{
"Primary": true,
"PrivateDnsName": "ip-172-31-20-125.ca-central-1.compute.internal",
"PrivateIpAddress": "172.31.20.125"
}
],
"SourceDestCheck": true,
"Status": "in-use",
"SubnetId": "subnet-27ccf84f",
"VpcId": "vpc-4ec5c326",
"InterfaceType": "interface"
}
],
"RootDeviceName": "/dev/sda1",
"RootDeviceType": "ebs",
"SecurityGroups": [
{
"GroupName": "rj-tester-sg",
"GroupId": "sg-0ed5b9b7488b55819"
}
],
"SourceDestCheck": true,
"StateReason": {
"Code": "pending",
"Message": "pending"
},
"VirtualizationType": "hvm",
"CpuOptions": {
"CoreCount": 1,
"ThreadsPerCore": 1
},
"CapacityReservationSpecification": {
"CapacityReservationPreference": "open"
},
"MetadataOptions": {
"State": "pending",
"HttpTokens": "optional",
"HttpPutResponseHopLimit": 1,
"HttpEndpoint": "enabled",
"HttpProtocolIpv6": "disabled",
"InstanceMetadataTags": "disabled"
},
"EnclaveOptions": {
"Enabled": false
},
"PrivateDnsNameOptions": {
"HostnameType": "ip-name",
"EnableResourceNameDnsARecord": false,
"EnableResourceNameDnsAAAARecord": false
},
"MaintenanceOptions": {
"AutoRecovery": "default"
}
}
],
"OwnerId": "723675304964",
"ReservationId": "r-090762edd42cef59e"
}
aws ec2 run-instances --image-id ami-04d38256e475591da --count 1 \
--instance-type t2.micro --key-name rj-tester-key \
--security-group-ids sg-0ed5b9b7488b55819
--user-data file://my_script.txt
ssh -i "~/.ssh/rj-tester-key.pem" ubuntu@ec2-99-79-62-107.ca-central-1.compute.amazonaws.com
docker -v
Docker version 20.10.21, build baeda1fApplication Load Balancer
The Application Load Balancer distributes incoming HTTP and HTTPS traffic across multiple targets such as Amazon EC2 instances, microservices, and containers, based on request attributes. When the load balancer receives a connection request, it evaluates the listener rules in priority order to determine which rule to apply, and if applicable, it selects a target from the target group for the rule action.
Your client makes a request to your application.
The listeners in your load balancer receive requests matching the protocol and port that you configure.
The receiving listener evaluates the incoming request against the rules you specify, and if applicable, routes the request to the appropriate target group. You can use an HTTPS listener to offload the work of TLS encryption and decryption to your load balancer.
Healthy targets in one or more target groups receive traffic based on the load balancing algorithm, and the routing rules you specify in the listener.https://stackoverflow.com/questions/31331788/using-aws-cli-what-is-best-way-to-determine-the-current-region
aws configure get region
aws ec2 describe-availability-zones
echo $AWS_DEFAULT_REGION
export AWS_DEFAULT_REGION=us-east-2Last updated
Was this helpful?