Difference between revisions of "AWS Tutorial"
From Simson Garfinkel
Jump to navigationJump to search
| (6 intermediate revisions by the same user not shown) | |||
| Line 11: | Line 11: | ||
* [https://www.youtube.com/watch?v=RYpQ1BTmV_o Building A Modern Data Architecture on AWS (Level 200)], Dec. 21, 2017. 23 min | * [https://www.youtube.com/watch?v=RYpQ1BTmV_o Building A Modern Data Architecture on AWS (Level 200)], Dec. 21, 2017. 23 min | ||
* [https://www.youtube.com/watch?v=dfEcd3zqPOA&feature=youtu.be AWS re:Invent 2017 Keynote], Nov. 29, 2017. 1 hour, 48 min | * [https://www.youtube.com/watch?v=dfEcd3zqPOA&feature=youtu.be AWS re:Invent 2017 Keynote], Nov. 29, 2017. 1 hour, 48 min | ||
* [https://drive.google.com/open?id=0BxHgV8c-kki8dkpPSEJIcFNOcDQ | * Georgetown University ANLY 502 Massive Data Fundamentals, Spring 2017 [https://drive.google.com/open?id=0BxHgV8c-kki8dkpPSEJIcFNOcDQ (slides on Google Drive )] ([http://simson.net/ref/2017/ANLY502/ slides2)] | ||
==Specific AWS Services== | ==Specific AWS Services== | ||
You may wish to review: | |||
* [https://drive.google.com/open?id=0BxHgV8c-kki8ZjVWNTQ2aS1zV0U Lecture 1: Massive Data and AWS, Jan. 11, 2017] | |||
You should understand the following AWS services: | You should understand the following AWS services: | ||
===EC2 — Elastic Compute Cloud=== | ===EC2 — Elastic Compute Cloud=== | ||
Usernames: | |||
Fedora: fedora@ipaddress | |||
AWS Linux: ec2-user@ipaddress | |||
Spark: hadoop@ipaddress | |||
Ubuntu: ubuntu@ipaddress | |||
===EBS — Elastic Block Service=== | ===EBS — Elastic Block Service=== | ||
* [https://www.youtube.com/watch?v=AnLCr99kFcY AWS re:Invent 2017: Deep Dive on Amazon EBS (CMP310)] | * [https://www.youtube.com/watch?v=AnLCr99kFcY AWS re:Invent 2017: Deep Dive on Amazon EBS (CMP310)] | ||
| Line 48: | Line 59: | ||
* [https://www.youtube.com/watch?v=UYy-UeQ29jo AWS Quick Start for SQL Server 2017 on Amazon EC2] Feb 15, 2018 | * [https://www.youtube.com/watch?v=UYy-UeQ29jo AWS Quick Start for SQL Server 2017 on Amazon EC2] Feb 15, 2018 | ||
* [https://www.youtube.com/watch?v=GzrMMjzK_nY Migrating Databases to Amazon Aurora (Level 200)], Dec. 21, 2017. 25 min | * [https://www.youtube.com/watch?v=GzrMMjzK_nY Migrating Databases to Amazon Aurora (Level 200)], Dec. 21, 2017. 25 min | ||
==pip install== | |||
Don't forget: use <tt>pip install awscli</tt> and not <tt>pip install aws</tt>, otherwise you will get this: | |||
<pre> | |||
% aws | |||
Traceback (most recent call last): | |||
File "/Users/simsong/opt/anaconda3/bin/aws", line 5, in <module> | |||
from aws.main import main | |||
File "/Users/simsong/opt/anaconda3/lib/python3.8/site-packages/aws/main.py", line 23 | |||
print '%(name)s: %(endpoint)s' % { | |||
^ | |||
SyntaxError: invalid syntax | |||
% | |||
</pre> | |||
Latest revision as of 15:14, 17 February 2022
Welcome to Simson's Amazon Web Services tutorial. Below are the key topics that you need to know about Amazon Web Services, and a curated set of articles and videos that will teach you the concepts.
General AWS Information
- Before you do anything else, understand the AWS billing model:
- On-Demand, Spot and Reserved Pricing.
- Storage Pricing
- Understand users and authentication: AWS root users, IAM users, ACCESS_KEY
- Your First Hour With AWS, Dec. 21, 2017. 28 min
- Switch From Tape to Cloud Backups – AWS Storage Gateway - AWS Tech Tips, Feb 20, 2018
- Building A Modern Data Architecture on AWS (Level 200), Dec. 21, 2017. 23 min
- AWS re:Invent 2017 Keynote, Nov. 29, 2017. 1 hour, 48 min
- Georgetown University ANLY 502 Massive Data Fundamentals, Spring 2017 (slides on Google Drive ) (slides2)
Specific AWS Services
You may wish to review:
You should understand the following AWS services:
EC2 — Elastic Compute Cloud
Usernames:
Fedora: fedora@ipaddress AWS Linux: ec2-user@ipaddress Spark: hadoop@ipaddress Ubuntu: ubuntu@ipaddress
EBS — Elastic Block Service
Challenge question:
- EBS is part of EC2. Why?
S3 — Simple Storage Service
EMR — Elastic Map Reduce
Challenge questions:
- What makes Elastic Map Reduce **Elastic**?
- What's the difference between a Master, Core, and Task node?
- Some EMR nodes only support EBS, some support both EBS and SSD. Why?
EFS — Elastic File System
- https://aws.amazon.com/efs/
- https://aws.amazon.com/efs/pricing/
- https://aws.amazon.com/blogs/aws/category/amazon-elastic-file-system/
Lambda and Serverless Technologies
- AWS Builders' Day | Serverless Development Deep Dive, Feb 14, 2018, 1 hour
- Live Coding with AWS | Building AWS Lambda Powered Twitter Bots, Feb. 14, 2018
- Live Coding with AWS | Reading Web Pages with Amazon Polly & Chrome Extensions, Feb 14, 2018
- AWS Builders' Day | Deep Dive on Amazon Elastic Container Service (Amazon ECS), Feb 14, 2018. 1 hour
- AWS Builders' Day | Amazon Elastic Container Service for Kubernetes (Amazon EKS), Feb 14, 2018. 1 hour (Follow up of previous)
Artificial Intelligence
- Chat Bots with Amazon Lex (Level 300), Dec. 21, 2017. 26 min
Databases
- AWS Quick Start for SQL Server 2017 on Amazon EC2 Feb 15, 2018
- Migrating Databases to Amazon Aurora (Level 200), Dec. 21, 2017. 25 min
pip install
Don't forget: use pip install awscli and not pip install aws, otherwise you will get this:
% aws
Traceback (most recent call last):
File "/Users/simsong/opt/anaconda3/bin/aws", line 5, in <module>
from aws.main import main
File "/Users/simsong/opt/anaconda3/lib/python3.8/site-packages/aws/main.py", line 23
print '%(name)s: %(endpoint)s' % {
^
SyntaxError: invalid syntax
%
