Register
Login
Resources
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Product
Data Engine LLMs Platform Enterprise
Pricing Explore
Connect to our Discord channel
047d973b4a
dvc added
3 months ago
166e997b09
folder structure
3 months ago
a00e572c42
requirements installed
3 months ago
047d973b4a
dvc added
3 months ago
75f604f1fb
model added
3 months ago
047d973b4a
dvc added
3 months ago
src
75f604f1fb
model added
3 months ago
f33b7e3754
application created
3 months ago
047d973b4a
dvc added
3 months ago
047d973b4a
dvc added
3 months ago
c83e295032
AWS steps
3 months ago
f33b7e3754
application created
3 months ago
047d973b4a
dvc added
3 months ago
047d973b4a
dvc added
3 months ago
f33b7e3754
application created
3 months ago
047d973b4a
dvc added
3 months ago
047d973b4a
dvc added
3 months ago
a00e572c42
requirements installed
3 months ago
047d973b4a
dvc added
3 months ago
a00e572c42
requirements installed
3 months ago
166e997b09
folder structure
3 months ago
Storage Buckets
Data Pipeline
Legend
DVC Managed File
Git Managed File
Metric
Stage File
External File

README.md

You have to be logged in to leave a comment. Sign In

Create the venv

  • python -m venv Kidney

activate the venv

  • C:\Users\user\Desktop\Kidney_Disease\Kidney\Scripts\activate.bat

create a new repository on the command line

create .gitignore(python) file in repository and pull in folder

git pull

push an existing repository from the command line

template.py

setup.py

requirements.txt

  • pip install -r requirements.txt

src/init.py logger

utils common.py

dagshub

Run this to export as env variables:

dvc

  • dvc init
  • dvc repro
  • dvc dag

Updating lock file 'dvc.lock'

To track the changes with git, run:

- git add dvc.lock

To enable auto staging, run:

- dvc config core.autostage true
Use dvc push to send your updates to remote storage.

DVC

  • Its very lite weight for POC only
  • lite weight expriements tracker
  • It can perform Orchestration (Creating Pipelines)
  • AWS-CICD-Deployment-with-Github-Actions
  1. Login to AWS console.
  2. Create IAM user for deployment

with specific access

  1. EC2 access : It is virtual machine

  2. ECR: Elastic Container registry to save your docker image in aws

####Description: About the deployment

  1. Build docker image of the source code

  2. Push your docker image to ECR

  3. Launch Your EC2

  4. Pull Your image from ECR in EC2

  5. Lauch your docker image in EC2

####Policy:

  1. AmazonEC2ContainerRegistryFullAccess

  2. AmazonEC2FullAccess

  3. Create ECR repo to store/save docker image

  • Save the URI: 566373416292.dkr.ecr.us-east-1.amazonaws.com/chicken
  1. Create EC2 machine (Ubuntu)
  2. Open EC2 and Install docker in EC2 Machine: ####optinal
  • sudo apt-get update -y

  • sudo apt-get upgrade

####required

newgrp docker 6. Configure EC2 as self-hosted runner: setting>actions>runner>new self hosted runner> choose os> then run command one by one 7. Setup github secrets:

  • AWS_ACCESS_KEY_ID=

  • AWS_SECRET_ACCESS_KEY=

  • AWS_REGION = us-east-1

  • AWS_ECR_LOGIN_URI = demo>> 566373416292.dkr.ecr.ap-south-1.amazonaws.com

  • ECR_REPOSITORY_NAME = simple-app

Tip!

Press p or to see the previous file or, n or to see the next file

About

No description

Collaborators 1

Comments

Loading...