Register
Login
Resources
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Product
Data Engine LLMs Platform Enterprise
Pricing Explore
Connect to our Discord channel

conf.py 979 B

You have to be logged in to leave a comment. Sign In
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
  1. import os
  2. from pathlib import Path
  3. from urllib.parse import urlparse
  4. from dvc.repo import Repo
  5. dvc_repo = Repo('.')
  6. # Specify the name of your DVC remote
  7. DVC_REMOTE_NAME = 'ahsoka'
  8. # Specify the name of your remote DVC data directory for this project
  9. PROJECT_NAME = 'dvc_dask_use_case'
  10. # Get DVC remote URL to your remote work directory
  11. remote_work_path = urlparse(
  12. dvc_repo.config.config[f'remote "{DVC_REMOTE_NAME}"']['url']).path
  13. remote_work_path = Path(remote_work_path)
  14. # Specify the paths to the DVC stage dependencies and ourputs
  15. data_dir = remote_work_path/PROJECT_NAME/'data'
  16. source_xml = os.path.join(data_dir, 'Posts.xml')
  17. source_tsv = os.path.join(data_dir, 'Posts.tsv')
  18. train_tsv = os.path.join(data_dir, 'Posts-train.tsv')
  19. test_tsv = os.path.join(data_dir, 'Posts-test.tsv')
  20. train_matrix = os.path.join(data_dir, 'matrix-train.p')
  21. test_matrix = os.path.join(data_dir, 'matrix-test.p')
  22. model = os.path.join(data_dir, 'model.p')
  23. metrics_file = 'eval.txt'
Tip!

Press p or to see the previous file or, n or to see the next file

Comments

Loading...