Знання

• Amazon Q and CodeWhisperer
• How to use AWS CloudWatch agent for better monitoring - mine
• Secrets Manager
• IAM policies
• CDK
• Boto3 new project template
• Як підключитися до EC2 інстанса у приватному сабнеті за допомогою SSM
• Як моніторити мережеве навантаження

• AWS Whitepapers
• The Amazon Builders' Library - How Amazon builds and operates software (intro-1, intro-2)
• Top 10 Architecture Blog Posts of 2019
• Top Resources for API Architects and Developers
• One to Many: Evolving VPC Design

• Taking Advantage of Amazon EC2 Spot Instance Interruption Notices (09 MAR 2018)
• Running high-scale web applications on Amazon EC2 Spot Instances (02 OCT 2018)

• Tips and Tricks for Building and Deploying Serverless Apps In Minutes (April 24, 2018)
• Productionize Serverless Application Building and Deployments with AWS SAM (June 19, 2018)
• Getting Started with Serverless Computing Using AWS Lambda (July 24, 2018)
• Serverless Streams, Topics, Queues, & APIs! How to Pick the Right Serverless Application Pattern (August 21, 2018)
• AWS Serverless Application Model (SAM) Command Line Interface – Build, Test, and Debug Serverless Apps Locally (26 OCT 2018)
• Serverless Application Debugging and Delivery (September 19, 2018)
• Simplifying serverless best practices with Lambda Powertools (22 JUN 2020)
• Python packages with AWS layers — The right way
• Your AWS Lambda Function Failed, What Now?
• Jump-starting your serverless development environment (02 SEP 2020)
• Operating Lambda: Building a solid security foundation: part 1, part 2 (Feb-Mar 2021)
• Operating Lambda: Using CloudWatch Logs Insights (Mar 2021)
• Operating Lambda: Debugging code - part 1, Debugging configurations – Part 2, Debugging configurations – Part 3 (Mar 2021)
• Operating Lambda: Isolating and resolving issues (12 APR 2021)
• AWS Lambda Best Practices
• Getting started with serverless for developers: Part 1, Part 2 – The business logic, Part 3 – The front door, Part 4 – Local developer workflow, Part 5 - Sandbox developer account
• Serverless Patterns Collection - a repository of serverless examples that demonstrate integrating two or more AWS services. Each pattern uses either the AWS Serverless Application Model (AWS SAM) or AWS Cloud Development Kit (AWS CDK); Learn how to integrate AWS services with the Serverless Patterns Collection
• Use Python SQLAlchemy ORM to interact with an Amazon Aurora database from a serverless application
• A Practical Guide to Surviving AWS SAM:

1. part 1 - beginning,
2. part 2,
3. part 3 - Lambda layers,
4. part 4 - release change,
5. part 5 - parameters

• Sessions with SAM
• Optimizing serverless development with samconfig

• Accelerate Database Development and Testing on AWS (August 21, 2018)
• Search Your DynamoDB Data with Amazon Elasticsearch Service (November 12, 2018)
• Secure Your Amazon Elasticsearch Service Domain (September 17, 2018)
• Integrating Amazon Elasticsearch with your DevOps Tooling (May 21, 2018)
• ElastiCache: Deep Dive Best Practices and Usage Patterns (April 23, 2018)
• Amazon DynamoDB – Features to Power Your Enterprise (27 AUG 2018)
• Monitor Amazon ElastiCache for Redis (cluster mode disabled) read replica endpoints using AWS Lambda, Amazon Route 53, and Amazon SNS (28 Aug 2018)
• Best Practices for Amazon DocumentDB (February 17, 2020)
• A Best Practices Checklist for Using Amazon Elasticsearch Service (July 28, 2020)
• Enhanced Security with Amazon Elasticsearch Service (February 21, 2020)
• Using IAM authentication to connect with pgAdmin Amazon Aurora PostgreSQL or Amazon RDS for PostgreSQL (05 MAR 2020)

• Deep Dive on Amazon Redshift (August 22, 2018)
• Best Practices for Scaling Amazon Redshift (November 15, 2018)
• Running Cost Effective Batch Workloads with AWS Batch and Amazon EC2 Spot Instances (Oct 2018)

• Deep Dive on Amazon Athena (August 23, 2018)
• Deep Dive on Amazon S3 Security and Management (November 20, 2018)
• Best Practices for Security in Amazon S3 (July 30, 2018)
• Deep Dive on Amazon Elastic File System (EFS): Scalable, Reliable, and Elastic File Storage for the AWS Cloud (September 25, 2018)
• 8 Must-Know Tricks to Use S3 More Effectively in Python (August 2, 2021)

• Understanding AWS Secrets Manager (June 26, 2018)
• Amazon Inspector Now Supports Security Assessments for Debian
• Introduction to AWS Security Hub
• Encryption and Key Management in AWS
• AWS re:Invent 2017: A Deep Dive into AWS Encryption Services (SID329)
• Use AWS Fargate and Prowler to send security configuration findings about AWS services to Security Hub (26 NOV 2019)
• Using VPC endpoint policies to control Amazon ECR access (06 NOV 2019)
• Native Container Image Scanning in Amazon ECR (28 OCT 2019)
• Using AWS KMS for data protection, access control, and audit (SEC340-R1) - AWS re:Invent 2019
• Why Rewind Said Hello to AWS Session Manager and Goodbye to SSH
• Techniques for writing least privilege IAM policies (02 DEC 2020)
• Strengthen the security of sensitive data stored in Amazon S3 by using additional AWS services (26 JUL 2021)

• Переадресация портов инстансов Amazon EC2 с помощью AWS Systems Manager
• Use port forwarding in AWS Systems Manager Session Manager to connect to remote hosts

• Get Started with Real-Time Streaming Data in Under 5 Minutes (June 18, 2018)
• Streaming Data Pipelines for Real-Time Analytics – Are You Ready? (August 20, 2020) - best practices to create a low-latency, highly scalable, performant, and cost-effective data pipeline using Amazon Kinesis Data Streams

• Gaining Better Observability of Your VMs with Amazon CloudWatch (May 21, 2018)
• Understand Lambda Logging and Unlock CloudWatch Logs
• Collecting, storing, and analyzing your DevOps workloads with open-source Telegraf, Amazon Timestream, and Grafana (25 NOV 2020)

• Monitoring Serverless Applications Using CloudWatch ServiceLens (March 25, 2020) - how Amazon CloudWatch and its latest features, such as ServiceLens and Synthetics, enable you to visualize and analyze the health, performance, and availability of your applications in a single place.
• Making better decisions about Amazon RDS with Amazon CloudWatch metrics (06 APR 2020)

• Infrastructure as Code on AWS (20 April, 2020) about AWS CloudFormation and the AWS Cloud Development Kit (CDK)
• Build Resilient, Easy to Manage Continuous Integration Workflows with AWS CodeBuild and AWS Step Functions (August 20, 2020)
• Supercharging Your ECS Applications with the AWS CDK (July 30, 2020)
• Understanding AWS CloudFormation !Sub Syntax
• How to create a VPC with AWS CDK with Python (Aug 15, 2020)
• 8 best practices when automating your deployments with AWS CloudFormation (22 SEP 2020)
• Best practices for developing cloud applications with AWS CDK (01 APR 2021)
• Deploying Your App With ECS & Gitlab CI/CD (8 Sep 2020)
• Secure CDK deployments with IAM permission boundaries (10 JAN 2023)
• How to import existing resources into AWS CDK Stacks (21 SEP 2023)
• Terraform CI/CD and testing on AWS with the new Terraform Test Framework (02 APR 2024)

• How Amazon ECS manages CPU and memory resources (21 OCT 2019)
• Amazon ECS availability best practices (08 NOV 2019)
• Under the hood: FireLens for Amazon ECS Tasks (18 NOV 2019)
• AWS Fargate Spot Now Generally Available (03 DEC 2019)
• Deep Dive on Amazon ECS Cluster Auto Scaling (03 JAN 2020)
• Build and Deploy Full-Stack Containerized Applications with the New Amazon ECS CLI (March 23, 2020)
• Introducing Instance Refresh for EC2 Auto Scaling (16 JUN 2020)
• ECS Cluster Auto Scaling Deep Dive (July 28, 2020)
• Deploy applications on Amazon ECS using Docker Compose (19 NOV 2020)
• AWS Copilot is now generally available (23 NOV 2020) with links to useful articles - INVESTIGATE!
• Refreshing an Amazon ECS Container Instance Cluster With a New AMI (14 AUG 2018)
• Using Amazon ECS Exec to access your containers on AWS Fargate and Amazon EC2 (16 MAR 2021)

• Microsoft Active Directory on AWS (2020)
• Advanced VPC Design and New Capabilities for Amazon VPC (May 21, 2020)
• Amazon Managed Workflowsfor Apache Airflow - User Guide

• AWS, Serverless, Developer Experience, and More - serverless with Jetbrains
• Building a Data Lake on AWS вебинар
• Deploying a Data Lake on AWS - March 2017 AWS Online Tech Talks
• Best Practices for Building a Data Lake with Amazon S3 - August 2016 Monthly Webinar Series
• AWS re:Invent 2015 | (BDT317) Building a Data Lake on AWS
• AWS re:Invent 2015 | (BDT208) A Technical Introduction to Amazon Elastic MapReduce
• Big Data Technology Fundamentals Заложите основу для работы с сервисами AWS при создании решений для больших данных.
• Send Fanout Event Notifications with Amazon Simple Queue Service (SQS) and Amazon Simple Notification Service (SNS)
• Filter Messages Published to Topics
• Building Real Time Applications using WebSocket APIs Supported by Amazon API Gateway
• Keeping Ansible effortless with AWS Systems Manager
• Overview on Data Lakes - Learning Path

Deep Dive on Amazon DynamoDB - AWS Online Tech Talks

How to use AWS WAF to Mitigate OWASP Top 10 attacks - 2017 AWS Online Tech Talks

Are You Well-Architected? - 2017 AWS Online Tech Talks Learn AWS architectural best practices

• Debian
• CentOS
• Fedora
• Ubuntu Server
• Amazon Linux (version 1, soon will be deprecated]]
• Amazon Linux 2 - здесь устаревшие ami id.

Latest Amazon Linux 2023 AMI arm64

aws ec2 describe-images --owners amazon --filters 'Name=name,Values=al2023-ami-2023*' \
"Name=architecture,Values=arm64" 'Name=state,Values=available' "Name=virtualization-type,Values=hvm" \
--output json | jq -r '.Images | sort_by(.CreationDate) | last(.[]).ImageId'

Latest Amazon Linux 2 AMI x86_64

aws ec2 describe-images --owners amazon --filters 'Name=name,Values=amzn2-ami-*-x86_64-gp2' \
"Name=architecture,Values=x86_64" 'Name=state,Values=available' "Name=virtualization-type,Values=hvm" \
--output json | jq -r '.Images | sort_by(.CreationDate) | last(.[]).ImageId'

Latest Debian 12 (bookworm) x86_64

aws ec2 describe-images --owners 136693071363 --filters 'Name=name,Values=debian-12-amd64-*' \
"Name=architecture,Values=x86_64" 'Name=state,Values=available' "Name=virtualization-type,Values=hvm" \
--output json | jq -r '.Images | sort_by(.CreationDate) | last(.[]).ImageId'

Latest Debian 11 (bullseye) x86_64

aws ec2 describe-images --owners 136693071363 --filters 'Name=name,Values=debian-11-*' \
"Name=architecture,Values=x86_64" 'Name=state,Values=available' "Name=virtualization-type,Values=hvm" \
--output json | jq -r '.Images | sort_by(.CreationDate) | last(.[]).ImageId'

Latest Ubuntu 24.04 server x86_64

aws ec2 describe-images --region us-east-1 --owners 099720109477 \
--filters "Name=virtualization-type,Values=hvm" \
'Name=name,Values=ubuntu/images/hvm-ssd-gp3/ubuntu-noble-24.04-*-server-*' \
"Name=architecture,Values=x86_64" 'Name=state,Values=available'  \
--output json | jq -r '.Images | sort_by(.CreationDate) | last(.[]).ImageId'

Latest Ubuntu 22.04 server x86_64

aws ec2 describe-images --region us-east-1 --owners 099720109477 \
--filters "Name=virtualization-type,Values=hvm" \
'Name=name,Values=ubuntu/images/hvm-ssd/ubuntu-jammy-22.04-*-server-*' \
"Name=architecture,Values=x86_64" 'Name=state,Values=available'  \
--output json | jq -r '.Images | sort_by(.CreationDate) | last(.[]).ImageId'

Run specified ami in region eu-west-1

https://console.aws.amazon.com/ec2/v2/home?region=eu-west-1#LaunchInstanceWizard:ami=ami-0ae0cb89fc578cd9c

You must use PEM format and RSA type:

ssh-keygen -t rsa -b 4096 -f ~/.ssh/project -C "Project key"
mv ~/.ssh/project ~/.ssh/project.pem 

ed25519 keys are also available now

• Run your Kubernetes Workloads on Amazon EC2 Spot Instances with Amazon EKS
• Kubernetes Logging powered by AWS for Fluent Bit (04 FEB 2020)

• Keeping Time With Amazon Time Sync Service NTP for AWS
• Introducing AWS CodeArtifact (July 24, 2020) - fully managed artifact repository service
• My “can’t fail” training method for passing AWS certifications

• How to Use Amazon EventBridge to Build Decoupled, Event-Driven Architectures - learning path