glennlum/xetra-ETL-pipeline

Topics

Type dataset

General open-data-registry

Integration aws s3

General aws-pds

General sustainability

General agriculture

General earth observation

General geospatial

General life sciences

General machine learning

General climate

Data Domain computer vision

General genomic

General weather

General satellite imagery

General meteorological

Type model

General biology

General genetic

General environmental

Task disaster response

General deep learning

General bioinformatics

General hacktoberfest

Data Domain audio

General natural resource

Task classification

General imaging

Data Domain nlp

General mlops

General natural language processing

General cancer

Integration mlflow

General image processing

General health

Task image classification

Data Domain tabular

General oceans

General hacktoberfest 2023

Integration dvc

General python

General mapping

General coastal

Framework tensorflow

General whole genome sequencing

General data science

General biodiversity

General atmosphere

General covid-19

General elevation

General cog

General strides

General neuroscience

General global

General cities

General open source software

General coronavirus

General lidar

General neuroimaging

Integration git

General ecosystems

General climate model

General water

Framework pytorch

Task object detection

General csv

General neurobiology

General aerial imagery

General archives

General machine learning project

General land

General astronomy

General air quality

General transcriptomics

General urban

General data science project

General analytics

General food security

General energy

General bam

General internet

General parquet

General gps

Framework scikit-learn

General continuously operating reference station - cors

General homo sapiens

General tutorial

General conservation

General medicine

General stac

General cell imaging

General fastq

Data Domain 3d model

General cell biology

General encyclopedic

General broadcast ephemeris

General gnss

General robotics

General infrastructure

General nara

General gene expression

General earthquakes

General json

General chemistry

General census

General solar

Data Domain medical imaging

General biotech blueprint

General cyber security

General magnetic resonance imaging

General statistics

General signal processing

General mlflow-serving

General labeled

General cnn

General demography

General molecule

General protein

General ice

General reference index

Task autonomous vehicles

Task machine translation

General vcf

General financial markets

General neural network

General llm

Task vision

General mus musculus

General chemical biology

General neurophysiology

General geoscience

General transportation

General 1940 census

General video

General genetic maps

Task information retrieval

General multimedia

General floods

General fasta

General medical

General computer security

General wine quality prediction

General ml pipelines

Task anomaly detection

General regulatory

General marine navigation

General planetary

General microscopy

General population genetics

General electron microscopy

General deeplearning

General osm

General biomolecular modeling

General population

Task time series forecasting

General artificial-intelligence

General streamlit

Task chatbot

General data visualization

General reproducibility-challenge

General dagshub

Integration arxiv

General predictive analysis

General smd ai

General civic

General genelab

General xgboost

Task text generation

General regression

Task semantic segmentation

Task denoising

General data analytics

General market data

General digital preservation

General fast5

General metadata

General healthcare

General broadband

General government records

General metagenomics

Integration github

General survey

General commerce

General short read sequencing

General blockchain

General mers

General sars

General traffic

General fluorescence imaging

General nifti

General computer forensics

General copyright monitoring

General seismology

General random forests

General molecular docking

General epigenomics

General us-dc

General demographics

General digital forensics

General amino acid

Integration label studio

General bathymetry

General genome wide association study

General long read sequencing

General transformers

Task text classification

General llms

General kaggle

General text analysis

General segmentation

General economics

Task sentiment analysis

General rag

Task language modelling

General deployment

General events

General projects

General datamanipulation

General research

General network traffic

General music

Task medical image segmentation

General kidney

General electrophysiology

General data cleaning

Framework huggingface transformers

General bitcoin

General cars

General speech processing

General intrusion detection

General data

General cloud computing

Task text-to-image generation

Task music information retrieval

General forecast

General predictive modelling

General x-ray tomography

General free software

General wildlife

General test

General complaints

General trading

General covid

General txt

General data analysis

General mining software repositories

General education

General space biology

Task speech recognition

Data Domain graph

General sklearn

General movies

General source code

General ensemble learning

General github actions

General 1950 census

General hiring

General pediatric

General science

General organelle

General museum

General radiation

General openfold

General music features dataset

General green aviation

General seafloor

Task face recognition

General emotion

General speaker identification

General vep

General live song identification

General art

General structural variation

General near-surface air temperature

General national archives catalog

General prediction

General geothermal

General simulations

General cultural preservation

General protein template

General histopathology

General privacy

General enzyme

General ransomware

General geophysics

General meta learning

General hpc

General cell painting

General datascience

General structural biology

General foldingathome

General tiles

General fewshot

General acoustics

General fisheries

General disease

General precipitation

General elasticnet

General space weather

Data Domain reinforcement learning

General mining

General culture

General virus

General autism spectrum disorder

General cmip5

General datacenter

General japanese

General high-throughput imaging

Task active learning

General pharmaceutical

General protein folding

General history

General whole exome sequencing

General recombination maps

General timho

General alphafold

Task named entity recognition

General malware

Task question answering

General cover song identification

General data assimilation

General computational fluid dynamics

General marine mammals

General sqlite

General turbulence

General detection

General workload analysis

General flask

General alchemical free energy calculations

General ukraine

General benchmark

General cram

General variant annotation

General msa

General hydrography

General loftee

General tertiary analysis

General mixed file dataset

Task audio classification

General netcdf

General media

General industrial

General microbiome

Task activity recognition

General keras

Task recommendation systems

General near-surface specific humidity

General automatic speech recognition

General wine

General xml

General ai personal assistant

General pandas

General marine

General finance

General cmip6

General molecular dynamics

General low-pressure turbine

General scholarly communication

General csi

General price

Task object classification

General coco

General huggingface

General snowflake

General gans

General monitoring

General analysis

General mnist

General sports

General ml deployment

General price prediction

General text

Task text summarization

General ai mlops

General ai planning

General python library

General autoencoder

Framework pycaret

General generative ai

General eda

General x-ray

Task image captioning

Task image generation

General linear regression

General aws

General pipeline

Task depth estimation

Task explainable artificial intelligence

General credit card

General image

General end to end

General hebrew

General dagshub as a my favourite data science tool

General data pipelines

General matplotlib

Task sequence-to-sequence language modeling

General ai voice clone app

General cml

Task video object segmentation

General chapter 1

General nltk

General vector embeddings

General chest x-ray

General docker

General data mining

General convolutional neural network

General unet

General gender debiasing

General codepeak

Task text-to-speech synthesis

General master

General chest cancer predition

General annotations

General bot

General toy

General banking

General vector database

Task time series

Task music generation

General credit card defaulter prediction

General loan application

General fire

Task reading comprehension

Task federated learning

General evidently

General python pakage

General malaria

General web

Task classification with binary neural network

General mri

General modular coding

Task 3d human pose estimation

Task pedestrian detection

General database

General java

General jupyter notebook

General medical image classification

General bento ml

General ai voice assistant

General heroku

General medical terminology

General numpy

General version control

General social good

Task text matching

General julia

General customer churn

Framework ultralytics yolo

General medical classification

General npc

General fastai

Task food recognition

General spider

General gradient boosting

General vector embedding database

General catboost

Task minecraft

General numeric arrays

General transactional data

General customer sentiment analysis

General example

General forest

General labelling

General mammography

General llama2

General data version control

General bias

General instruction following

General evaluation

General colab

General noaa cors network - ncn

General development

General chat llama

General chatgpt plugins

Task zero-shot object detection

Task automl

General continuous integration

General news

General mlops zoomcamp

General zomato

General aiops

General forecasting

General machine

Integration bitbucket

Task real-time object detection

General api

General quantitative

Task object detection in aerial images

General images

General interpretability

General minecraft shapes

General captioning

Task open information extraction

General ditmodel

General computer-aided design

General orchest

General healt

General kagle

General gru

General author dwaipayan chakroborti

General random sampling

General weights and biases

General hello-world

General futbol

General the blogger

Task brain tumor segmentation

General short

General ggs

General liberia

General man is ugli

General seaborn

Task face detection

General dubai

General churn

General vascular tissue engineering

General webapps

General runners

General giskard

General its

General friendship

General abc analysis

General insurance

General disease classification

General man is nervous

General clustering

General ner

General azure

General tasks

General manipu

Task network intrusion detection

Task edge detection

General africa

General albumentations

General agent

General gradio

Task hand gesture recognition

General pytest

Task link prediction

General fdffwfwf

General tutorials

General naive bayes

General weather impacts

General open-cv

General action video games

General computing

General stroke prediction

General notebook

General yolov8

General document image

General text-to-video

General imporoving logistics and optimizing routing

General triathlon

Task word embeddings

Task pedestrian attribute recognition

General coding

General microcontroller

General ecr

General marketing

General annotation

General modern portfolio theory

General ai voice cloning

General epu index

General smiles

General violence detection

Task audio source separation

General dagsub

General chest cancer

General obesity

General minecraft blocks

General script

General pickle

General digital pathology

General human computer interaction

General devices

General fauna

Task remote sensing image classification

General best pune escorts

General production optimization

General heart valve prosthesis

Task data augmentation

General animals

General vsdvsdvsdvssf

Task answer selection

General finite element method

General histological segmentation

Task object counting

General chest disease

General illegal deforestation

General singapore

General fdfwsf

General shap

General argument

General caption

General cracks and potholes

General 2022 data science related notes

General mongodb

Task face identification

General documents

General portfolio

General kyc

General minecraft circle generator

General first

General fast

General http traffic data

Task dimensionality reduction

Task transfer learning

General awesome list

General tactical decision

Task face reenactment

General semantic search

General project

General flood prediction

General shopping

Task learning-to-rank

General alpaca

General clot

Task scientific document summarization

General trial

General engineer

Task salient object detection

Task document layout analysis

General covid19 vaccine

General oracle

General msr

General datellite imagery

Integration jenkins

General telecom

General chandigarh escorts services

General bug

General books

Task rgb-d salient object detection

Task domain generalization

General visualization

General auth

Task table detection

Task meta-learning

General asv

Task colorization

General triplet loss

General fastapi

General academic

General cell segmentation

General notes

General generative design

General brain

General book

Task news classification

General siamese network

Task face sketch synthesis

General sad

General time prediction

General 2023 data science collection repo

General sea

General individuals

General get data

General product webscraping on food systesms

General image caption

General html

General cloud

General quack

General credit-risk

General cat

General patientss

General sometopic

General plant

General adsadad asdsadsa -dsadsadsadasdasdasdasdasd

General face shape classification for improving styling

General ctr

General accidents

General payments

General art generation

General food time delivery

General heart disease predicton

General challenge

General parser

General apple

General designing

General bark

General malware detection

General lungs

Task few-shot learning

Task covid- diagnosis

General naive-bayes

General dsd

General large language mode

Task domain adaptation

Task content-based image retrieval

General anaomaly detection

General omdena-milan chapter mirrored from github repo

General understanding

General contrastive loss

General classifier

General ai4 sustainable agri-food

General agents

General bank

General diabetes

General reviewer recommendation

Task face reconstruction

General type

General scientific documents

General discount

General game

General credit card default prediction

General dinosaurs

General recipe

General taxi fare prediction

Framework flax

General bug localization

Task gesture recognition

General sdsd

General explainable ai

General fitnes

General nextjs

Task biomedical information retrieval

General suicide rates analysis

General tracking

General lora

General data review

General vscode

Task 3d pose estimation

General happy

General vaccine

General engine

General optical coherence tomography

General unit testing

General skeleton

General operating theatre

General mosquito

Task face verification

Task time series analysis

General preverified

General mode

General javaml

General skimage

General automation

Task sentence embeddings

General instruct chatgpt

General new upcoming data science projects for 2020

General scw

General inventory turnover

General eye

Task object recognition

General representation learning

Task text-image retrieval

Task image-to-image translation

General optimization

General encryption

General seo

General tinyml

Task network embedding

General ec2

Task multi-task learning

General defaulter

General bark voice cloning

Task sentence classification

Task generalized zero-shot learning

General movie

General alguae

General trip

General voice enabled

General titanic

General duckdb

General insect

General soup

Task license plate recognition

General speech

General oci

Framework langchain

General pytorch2

Task visual tracking

General video-object-segmentation

General neutral

General credit card risk

General car service

General vessel segmentation

General object

General man naked on ice

Task neural architecture search

General language

General wdl

General cybersecurity

General sql

General tiger

General mouse

General pil

General soccer

General digital marketing

General swiggy

Task feature engineering

General iamges

General moldova

General fashion images

General edema

General dynamic time warpping

General supermarket website scraping

General discord

General assistant

General seagrass

General latent diffusion models

General security

General default customer

General exercise videos

Task visual question answering

General code review

General exp

General credit finance fraud

General moez

Task clustering algorithms evaluation

General airflow

General cps

General deno

General beginner

Task object skeleton detection

General physics

General wealth

General fraud

General remote working file system

Task pose estimation

General pune escorts services

Task music classification

General chatgpt

General data streaming

General openai

General dialogpt bot

General corpus

Task style transfer

General data extraction of deed of trust

General number recognition

General tagging

General image to audio

General video-object-segmentatino

Framework jax

General xyz analysis

General experiment tracking

Task speech enhancement

General yvual

General house

General mikrocontrollers

General gis data

General bark voice clone

General gaming

General torchdata

General jitter click test

General sdw

General geb

General vls

General phitoplankton

General search

General chexnet

General lstm

General tumo

General women

General cognitive control

General digital ocean

General dental

General hyperspectral imaging

General spam-classifier

General integration

General power bi

General prevention

General neural search

General scorecard

General marketing analytics

General tarantula

General olympics

General paper

General radiometric data

General image complexity

Task drug discovery

General extract mfccs

General gemini

General snails

Task aesthetics quality assessment

General reels

Task autonomous driving

Task face model

General woman

Task classification with binary weight network

General emoji

General tim ho

Task panoptic segmentation

General baseline

General alzheimers

General jigsaw

General diffusion

Task natural language understanding

General seaborg

General query

General detection of gaps

General mlpipelines

Task machine reading comprehension

Task fine-grained image classification

General coronary plaque analysis

General dataframe

General precious stones

General wordle

General food

Task multi-label text classification

General similarity detection

General wav

General parkinson disease

Task stance detection

Task density estimation

Task autonomous navigation

Task multi-object tracking

Task opinion mining

Task scientific results extraction

Task slot filling

Task dialogue generation

Task image enhancement

Task abusive language

Task topic models

Task lesion segmentation

Task video prediction

Task structured prediction

Task weakly-supervised named entity recognition

Task text style transfer

Task acoustic scene classification

Task goal-oriented dialog

Task weakly-supervised semantic segmentation

Task image/document clustering

Task keypoint detection

Task conditional image generation

Task table-to-text generation

Task unsupervised facial landmark detection

Task cross-modal retrieval

Task lexical entailment

Task action recognition

Task sign language translation

Task out-of-distribution detection

Task emotion recognition

Task matrix completion

Task video captioning

Task keyword spotting

Task semantic textual similarity

Task crowd counting

Task sarcasm detection

Task speech separation

Task scene text detection

Task image restoration

Task saliency prediction

Task unsupervised anomaly detection

Task dense pixel correspondence estimation

Task outlier detection

Task sign language recognition

Task image compression

Task action detection

Task open-domain question answering

Task vision-language navigation

Task semantic role labeling

Task tumor segmentation

Task document ranking

Task gaze estimation

Task real-time strategy games

Task homography estimation

Task audio tagging

Task intent detection

General newreposistory for to learning - how dagshub works

Task robust object detection

Task event extraction

Task imputation

Task core set discovery

Task scene flow estimation

Task human robot interaction

Task document classification

Task head pose estimation

Task scene understanding

Task task-oriented dialogue systems

Task deepfake detection

Task document summarization

Task face presentation attack detection

Task lesion classification

Task intent classification

Task image cropping

Task face anti-spoofing

Task binarization

Task traffic sign recognition

Data Domain point cloud

Task zero-shot learning

Task object tracking

Task aspect-based sentiment analysis

Task ssim

Task depth completion

Task depression detection

Task rgb salient object detection

Task tokenization

Task action quality assessment

Task optical flow estimation

Task multi-agent reinforcement learning

Task saliency detection

Task music source separation

Task action classification

Task weather forecasting

Task action anticipation

Task decision making

Task 3d multi-object tracking

Task 3d object recognition

Task jpeg artifact correction

Task video segmentation

Task music modeling

Task stereo matching

Task community detection

Task node classification

Task facial landmark detection

Task optical character recognition

Task computed tomography (ct)

Task contrastive learning

Task hand pose estimation

Task partial domain adaptation

Task 3d semantic segmentation

Task super-resolution

Task robot navigation

Task egocentric activity recognition

Task 3d face animation

Task dense video captioning

Task novel view synthesis

Task feature selection

Task 3d shape representation

Task 3d shape reconstruction

Task morphological analysis

Task trajectory forecasting

Task patch matching

Task visual reasoning

Task cross-lingual question answering

Task graph classification

Task weakly supervised object detection

Task lane detection

Task structure from motion

Task multimodal unsupervised image-to-image translation

Task referring expression segmentation

Task abstractive text summarization

Task color image denoising

Task code generation

Task graph embedding

Task video description

Task online multi-object tracking

Task scene text

Task small data image classification

Task change point detection

Task hate speech detection

Task long-tail learning

Task relational reasoning

Task clique prediction

Task semantic similarity

Task multimodal activity recognition

Task vision and language navigation

Task probabilistic deep learning

Task action recognition in videos

Task unsupervised object segmentation

Task scene graph detection

Task graph matching

Task 3d multi-person pose estimation

Task image registration

Task offline rl

Task feature importance

Task unsupervised machine translation

Task few-shot image classification

Task 3d reconstruction

Task robotic grasping

Task human action generation

Task video generation

Task interactive segmentation

Task paraphrase identification

Task whole slide images

Task 3d hand pose estimation

Task image denoising

Task speech synthesis

Task line segment detection

Task misinformation

Task abnormal event detection in video

Task anomaly detection in surveillance videos

Task general reinforcement learning

Task stochastic optimization

Task action localization

Task relation classification

Task sketch-based image retrieval

Task adversarial attack

Task video inpainting

Task fine-grained visual recognition

Task imitation learning

Task weakly supervised action localization

Task monocular depth estimation

Task product recommendation

Task image matting

Task starcraft

Task joint entity and relation extraction

Task multimodal machine translation

Task graph generation

Task word sense disambiguation

Task scene generation

Task video super-resolution

Task dialogue understanding

Task data-to-text generation

Task simultaneous localization and mapping

Task face swapping

Task video salient object detection

Task chunking

Task 3d human reconstruction

Framework tf lite

Task text simplification

Task multimodal sentiment analysis

Task 3d point cloud classification

Task dialogue state tracking

Task eeg

Task scene classification

Task action segmentation

Task image clustering

Task atari games

Task colorectal polyps characterization

Task visual localization

Task incremental learning

Task gaussian processes

Task unsupervised video object segmentation

Task abuse detection

Task variational inference

Task video question answering

Integration s3 compatible storage

Task compressive sensing

Task dependency parsing

Task boundary detection

Task motion capture

Task motion estimation

Task age estimation

Task adversarial defense

Task node clustering

Task semantic correspondence

Task activity detection

Task cross-view image-to-image translation

Task visual place recognition

Task person search

Task deblurring

Task semi-supervised image classification

Task metric learning

Task hyperspectral image classification

Task graph representation learning

Task motion segmentation

Task multi-label classification

Task emotion recognition in conversation

Task real-time semantic segmentation

Task spoken language understanding

Task chinese named entity recognition

Task entity linking

Task mathematical question answering

Task 3d absolute human pose estimation

Task visual object tracking

Task video frame interpolation

Task visual navigation

Task knowledge graphs

Task genre classification

Task 3d object tracking

Task continuous control

Integration new relic

Task 3d pose estimation using rgb

Task multi-person pose estimation

Task multivariate time series forecasting

Task math word problem solving

Task low-light image enhancement

Task video retrieval

Task audio generation

Task video recognition

Task region proposal

Task fact verification

Task continual learning

Task image super-resolution

Task keyword extraction

Task facial expression recognition

Task quantization

Task video-based person re-identification

Task video understanding

Task fact checking

Task multi-future trajectory prediction

Task automated theorem proving

Task natural language inference

Task entity typing

Task language identification

Task coreference resolution

Task lipreading

Task action unit detection

Task common sense reasoning

Task grammatical error correction

Task emotion classification

Task compositional zero-shot learning

Task graph clustering

Task self-driving cars

Integration gitlab

Task click-through rate prediction

Task scene recognition

Task image inpainting

Task one-shot learning

Task text-to-sql

Task multi-class classification

Task nested named entity recognition

Task question generation

Task graph regression

Task animal pose estimation

Task multiple instance learning

Task image quality assessment

Task sentence embedding

Task 3d instance segmentation

Task passage retrieval

Task fake news detection

Task vehicle re-identification

Task virtual try-on

Task semi-supervised video object segmentation

Task paraphrase generation

Task network pruning

Task fairness

Task image retrieval

Task retinal vessel segmentation

Task sound event detection

Task skeleton based action recognition

Task automatic post-editing

Task face alignment

Task object localization

Task point cloud registration

Task unsupervised domain adaptation

Task single image dehazing

Task 3d object detection

Task human-object interaction detection

Task video object detection

Task video classification

Task human part segmentation

Task chinese reading comprehension

Task motion prediction

Task image dehazing

Task relation extraction

Task action spotting

Task synthetic-to-real translation

Task community question answering

Task instance segmentation

Task video semantic segmentation

Task handwriting recognition

Integration google cloud storage

Task source code summarization

Task part-of-speech tagging

Task 3d pose estimation using rgbd

Task transliteration

Task knowledge base question answering

Task cross-lingual transfer

Task multiple object tracking

Task multi-document summarization

Task fine-grained visual categorization

Task handwriting generation

Task causal inference

Task unsupervised image classification

Task hand segmentation

Task rectification

Task discourse parsing

Framework spacy

Task cross-lingual ner

Task kg-to-text generation

Task bias detection

Task defect detection

Task scene text recognition

Task speaker diarization

Task semantic parsing

Task eye tracking

Task video reconstruction

Task grasp contact prediction

Task stereo matching hand

Task dictionary learning

Task human detection

Task latent variable models

Task trajectory prediction

Task conversational response selection

Task entity disambiguation

Task person re-identification

Task color constancy

Task visual dialog

Task knowledge graph completion

Task program repair

Task 3d action recognition

Task constituency parsing

Task temporal action localization

Task monocular 3d object detection

Task music transcription

Task visual odometry

Task image stitching

Task bayesian inference

Task video summarization

Task code search

Task scene segmentation

Task curriculum learning

Task event-based vision

Task self-supervised learning

Task disparity estimation

Task self-supervised action recognition

New topics will be added to the General category. Only displaying topics that weren't autoscanned from topics file

etl_functional.ipynb

5595deff5a

feat: initial quick and dirty code

1 month ago

etl_oop.ipynb

5595deff5a

feat: initial quick and dirty code

1 month ago

etl_quick.ipynb

5595deff5a

feat: initial quick and dirty code

1 month ago

Comments

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

glennlum / xetra-ETL-pipeline

Comments

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

glennlum
/
xetra-ETL-pipeline