DevOps Tasks

1000 tasks on the making

01. Create simple EC2 by using CloudFormation with specific IPs enabled in the security Group.

02. Install Jenkins on EC2 

03. Create a Jenkins Job: Git clone a repo and run a specific file

	Use Groovy for this

04. Jenkins Job: git clone a flask app and run it through jenkins
	Use Groovy for this

05. Create an Image from a running EC2 instance

06. Launch an instance with recently created instance

07. Install Vector on Ubuntu
	https://rajasgs.github.io/wiki/vector.html

08. Create Launch template by using recent EC2 that you have created. 

09. Automate the EC2 new Launch template version with new changes in the Ec2 on specific repository

10. Create S3 folder and upload a multiple files into S3 folder. Show the files with CloudFront

11. Create Aurora-Postgres DB 

12. Provide EC2 Bastion for the DB you have created recently. 

13. Connect your flask logs to Kibana by using Vector 

14. Create Autoscaling group which will scale up based on the SQS messages. 
	Each instance should consume 5 messages per minute.
	Max 3 instances should be used for testing 

15. AWS Alarm should be created when only 20% space in EC2. User should get an email when such situation occurs. 

16. Setup ECS cluster and test 2 Microservices 

17. Add 2 env values in AWS Param store and retrieve them in Python file from EC2 

18. Microservices - Docker compose should consume AWS Param store values. 

19. Apache Flink should be tested on EC2 

20. Pritunl should be setup on EC2 

21. Gitlab should be setup on EC2 (On premise Gitlab) 

22. Journalctl should be analyzed by Apache Flink 

23. Random log file should be analyzed by Apache Flink 

24. Install "pipeline-aws" plugin in Jenkins 

25. Add a credential in Jenkins 

26. Create Github token (instead of a password) and add as a password in Jenkins 

27. Run a simple AWS EC2 CLI command in Jenkins 

28. List all custom port numbers initiated by the developer 

29. 

How to keep Nginx password access to specific server?


first time
sudo htpasswd -c /etc/nginx/.htpasswd admin

# add multiple users
sudo htpasswd /etc/nginx/.htpasswd guest

sudo htpasswd /etc/nginx/.htpasswd admin
	32SC2dmEtlRWvq

view all:
cat /etc/nginx/.htpasswd
	guest:$apr1$q3oQBWt/$OA1A4CrfCVfLPELNcaHas.
	admin:$apr1$QELfA.gD$6gUC9J/wItnP.KzFi0xE5.

https://www.howtogeek.com/devops/how-to-setup-basic-http-authentication-on-nginx/


https://www.cyberciti.biz/faq/nginx-password-protect-directory-with-nginx-htpasswd-authentication/

30.

1. New Cluster
2. MService1 (new repo) to EKS (manual, jenkins)
3. Scaling MS1 from 1 - 4
4. Dev, Prod, QA, Bulk
		new environment
5. Gitlab/Azure web hook to trigger Jenkins deployment
6. How to attach the the subdomain (abc2.scrapercentral.com)
7. How to get into the POd and check Logs
8. Kibana Logs (end to end)

31.

Convert your flask to autorunning when the instance is restarted

cd /home/ubuntu/etlbase/simple-flask && nohup /home/ubuntu/miniconda3/envs/etl38/bin/python ./application.py &


ssh-keygen -t rsa -b 4096 -C "[e-mail]"


http://0.0.0.0:5000/


18.222.100.144:5000

http://18.222.100.144:5000/


/home/ubuntu/etlbase/simple-flask

sudo lsof -i tcp:5000


sudo systemctl start server1    
sudo systemctl status server1


https://stackoverflow.com/questions/37211115/how-to-enable-a-virtualenv-in-a-systemd-service-unit

sudo apt install python3-venv -y
virtualenv -p /usr/bin/python3 venv
source venv/bin/activate

{{ venv_home }}/bin/python -m site


https://linuxize.com/post/how-to-create-python-virtual-environments-on-ubuntu-18-04/

32

Install Zabbix and monitor another instance

33

Configure Slack notification from Jenkins and send success/failure notifications from Jenkins Job

34

Send emkil from Jenkins upon failed jobs