Register
Login
Resources
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Product
Data Engine LLMs Platform Enterprise
Pricing Explore
Connect to our Discord channel
TalMalka123 9e9ba5c1b9
Merge pull request #476 from DagsHub/thumbnails-samll-fix
1 day ago
cacc97ac85
Created example DVC pipelines
4 years ago
0980b531de
async invalidate cache
1 month ago
9e9ba5c1b9
Merge pull request #476 from DagsHub/thumbnails-samll-fix
1 day ago
acb2c643c7
Update sphinx-autobuild from 2024.2.4 to 2024.4.16
1 week ago
029ea0e053
fixes for PR
2 months ago
14118ea63d
Add test for the datapoint url encoding
2 weeks ago
c697c73c1e
Formatting fixes
1 year ago
31a4763630
Add s3 upload functionality in `dagshub.upload` and in cli `dagshub upload`
2 months ago
420d08cd2a
Create .pyup.yml
4 years ago
1e0250bf6e
Initial commit
4 years ago
ce2fe48918
Include the plugin dist in the package (fix)
9 months ago
383b2a32b5
Add python 3.12 ticker to README.md
2 months ago
2b0b743394
update client image
4 months ago
842c531655
Add pyproject.toml with black config
7 months ago
b86c3a7a29
Add metadata upload validation, upload new long strings as documents
3 weeks ago
13b4220fe3
Update datasets from 2.18.0 to 2.19.0
1 week ago
2eb5e976a9
Drop Python 3.7 polyfills
1 month ago
Storage Buckets
Data Pipeline
Legend
DVC Managed File
Git Managed File
Metric
Stage File
External File

README.md

You have to be logged in to leave a comment. Sign In

DagsHub Client


Tests pip License Python Version DagsHub Docs DagsHub Client Docs

DagsHub Sign Up Discord DagsHub on Twitter

What is DagsHub?

DagsHub is a platform where machine learning and data science teams can build, manage, and collaborate on their projects. With DagsHub you can:

  1. Version code, data, and models in one place. Use the free provided DagsHub storage or connect it to your cloud storage
  2. Track Experiments using Git, DVC or MLflow, to provide a fully reproducible environment
  3. Visualize pipelines, data, and notebooks in and interactive, diff-able, and dynamic way
  4. Label your data directly on the platform using Label Studio
  5. Share your work with your team members
  6. Stream and upload your data in an intuitive and easy way, while preserving versioning and structure.

DagsHub is built firmly around open, standard formats for your project. In particular:

Therefore, you can work with DagsHub regardless of your chosen programming language or frameworks.

DagsHub Client API & CLI

This client library is meant to help you get started quickly with DagsHub. It is made up of Experiment tracking and Direct Data Access (DDA), a component to let you stream and upload your data.

For more details on the different functions of the client, check out the docs segments:

  1. Installation & Setup
  2. Data Streaming
  3. Data Upload
  4. Experiment Tracking
    1. Autologging
  5. Data Engine

Some functionality is supported only in Python.

To read about some of the awesome use cases for Direct Data Access, check out the relevant doc page.

Installation

pip install dagshub

Direct Data Access (DDA) functionality requires authentication, which you can easily do by running the following command in your terminal:

dagshub login

Quickstart for Data Streaming

The easiest way to start using DagsHub is via the Python Hooks method. To do this:

  1. Your DagsHub project,
  2. Copy the following 2 lines of code into your Python code which accesses your data:
    from dagshub.streaming import install_hooks
    install_hooks()
    
  3. That’s it! You now have streaming access to all your project files.

🤩 Check out this colab to see an example of this Data Streaming work end to end:

Open In Colab

Next Steps

You can dive into the expanded documentation, to learn more about data streaming, data upload and experiment tracking with DagsHub


Analytics

To improve your experience, we collect analytics on client usage. If you want to disable analytics collection, set the DAGSHUB_DISABLE_ANALYTICS environment variable to any value.

Made with 🐶 by DagsHub.

Tip!

Press p or to see the previous file or, n or to see the next file

About

DagsHub client libraries

https://dagshub.com/docs/client/
Collaborators 4

Comments

Loading...