Register
Login
Resources
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Product
Data Engine LLMs Platform Enterprise
Pricing Explore
Connect to our Discord channel
Resources  
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Explore Pricing
Product  
Data Engine LLMs Platform Enterprise
Connect to Dagshub Discord channel
Register
Login

Rishav-hub
/
dvc-nlp-demo
mirror of https://github.com/Rishav-hub/dvc-nlp-demo.git

Watch 1
Issues   Discussions 0

dvc.lock 3.7 KB
Permalink History Raw

You have to be logged in to leave a comment. Sign In
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126 
  1. schema: '2.0'
    2. 

  2. stages:
    3. 

  3.   prepare_data:
    4. 

  4.     cmd: python src/stage_01_prepare.py -c config/config.yaml -p params.yaml
    5. 

  5.     deps:
    6. 

  6.     - path: config/config.yaml
    7. 

  7.       md5: 112c87df5586d99d93f4f3688adc199e
    8. 

  8.       size: 448
    9. 

  9.     - path: data/data.xml
    10. 

  10.       md5: a304afb96060aad90176268345e10355
    11. 

  11.       size: 37891850
    12. 

  12.     - path: params.yaml
    13. 

  13.       md5: ae23e8828b372ad8da616690418d0685
    14. 

  14.       size: 211
    15. 

  15.     - path: src/stage_01_prepare.py
    16. 

  16.       md5: c3831a3f29b7a507e6959d5ac99ea577
    17. 

  17.       size: 2233
    18. 

  18.     - path: src/utils/all_utils.py
    19. 

  19.       md5: 5d4c594bde3524a3605f7904f51536b0
    20. 

  20.       size: 1500
    21. 

  21.     - path: src/utils/data_management.py
    22. 

  22.       md5: 8f711eb8c63e4d2072f508a9df3dc58e
    23. 

  23.       size: 890
    24. 

  24.     params:
    25. 

  25.       params.yaml:
    26. 

  26.         prepare.seed: 2021
    27. 

  27.         prepare.split: 0.2
    28. 

  28.     outs:
    29. 

  29.     - path: artifacts/prepared/test.tsv
    30. 

  30.       md5: 60c757f3b30604473de7fa775dfc00d9
    31. 

  31.       size: 4899778
    32. 

  32.     - path: artifacts/prepared/train.tsv
    33. 

  33.       md5: 553034c4cf40efc63c99c19fe98610d0
    34. 

  34.       size: 18986541
    35. 

  35.   featurize:
    36. 

  36.     cmd: python src/stage_02_featurization.py -c config/config.yaml -p params.yaml
    37. 

  37.     deps:
    38. 

  38.     - path: artifacts/prepared/test.tsv
    39. 

  39.       md5: 60c757f3b30604473de7fa775dfc00d9
    40. 

  40.       size: 4899778
    41. 

  41.     - path: artifacts/prepared/train.tsv
    42. 

  42.       md5: 553034c4cf40efc63c99c19fe98610d0
    43. 

  43.       size: 18986541
    44. 

  44.     - path: config/config.yaml
    45. 

  45.       md5: 112c87df5586d99d93f4f3688adc199e
    46. 

  46.       size: 448
    47. 

  47.     - path: params.yaml
    48. 

  48.       md5: ae23e8828b372ad8da616690418d0685
    49. 

  49.       size: 211
    50. 

  50.     - path: src/stage_02_featurization.py
    51. 

  51.       md5: fcf2abbba85c0cdf95ffc9fb9022993e
    52. 

  52.       size: 2918
    53. 

  53.     - path: src/utils/all_utils.py
    54. 

  54.       md5: 5d4c594bde3524a3605f7904f51536b0
    55. 

  55.       size: 1500
    56. 

  56.     - path: src/utils/featurize.py
    57. 

  57.       md5: 171a7f328095b3481da169ef3f02de44
    58. 

  58.       size: 531
    59. 

  59.     params:
    60. 

  60.       params.yaml:
    61. 

  61.         featurize.max_features: 3000
    62. 

  62.         featurize.ngrams: 2
    63. 

  63.     outs:
    64. 

  64.     - path: artifacts/features/test.pkl
    65. 

  65.       md5: 81164fa4daecfc05da4ad928f4144482
    66. 

  66.       size: 2597441
    67. 

  67.     - path: artifacts/features/train.pkl
    68. 

  68.       md5: 30c0f34f19273c212412655d72e44c2a
    69. 

  69.       size: 10134729
    70. 

  70.   train:
    71. 

  71.     cmd: python src/stage_03_training.py -c config/config.yaml -p params.yaml
    72. 

  72.     deps:
    73. 

  73.     - path: artifacts/prepared/train.tsv
    74. 

  74.       md5: 553034c4cf40efc63c99c19fe98610d0
    75. 

  75.       size: 18986541
    76. 

  76.     - path: config/config.yaml
    77. 

  77.       md5: 112c87df5586d99d93f4f3688adc199e
    78. 

  78.       size: 448
    79. 

  79.     - path: params.yaml
    80. 

  80.       md5: ae23e8828b372ad8da616690418d0685
    81. 

  81.       size: 211
    82. 

  82.     - path: src/stage_03_training.py
    83. 

  83.       md5: 53840f24ee000d88a604b929f40bcf4b
    84. 

  84.       size: 2268
    85. 

  85.     - path: src/utils/all_utils.py
    86. 

  86.       md5: 5d4c594bde3524a3605f7904f51536b0
    87. 

  87.       size: 1500
    88. 

  88.     params:
    89. 

  89.       params.yaml:
    90. 

  90.         train.min_split: 8
    91. 

  91.         train.n_est: 70
    92. 

  92.         train.seed: 2021
    93. 

  93.     outs:
    94. 

  94.     - path: artifacts/model/model.pkl
    95. 

  95.       md5: 202ccb916b5aaa8579dd6f6cdf86f9f7
    96. 

  96.       size: 2969105
    97. 

  97.   evaluate:
    98. 

  98.     cmd: python src/stage_04_evaluate.py --config=config/config.yaml
    99. 

  99.     deps:
    100. 

  100.     - path: artifacts/features/test.pkl
    101. 

  101.       md5: 81164fa4daecfc05da4ad928f4144482
    102. 

  102.       size: 2597441
    103. 

  103.     - path: artifacts/model/model.pkl
    104. 

  104.       md5: 202ccb916b5aaa8579dd6f6cdf86f9f7
    105. 

  105.       size: 2969105
    106. 

  106.     - path: config/config.yaml
    107. 

  107.       md5: 112c87df5586d99d93f4f3688adc199e
    108. 

  108.       size: 448
    109. 

  109.     - path: src/stage_04_evaluate.py
    110. 

  110.       md5: ee77051bf4823bfb0ecc354f485e12c2
    111. 

  111.       size: 3018
    112. 

  112.     - path: src/utils/all_utils.py
    113. 

  113.       md5: 5d4c594bde3524a3605f7904f51536b0
    114. 

  114.       size: 1500
    115. 

  115.     outs:
    116. 

  116.     - path: prc.json
    117. 

  117.       md5: 2788a1e2d5c917eede57e4c3d3c1ac14
    118. 

  118.       size: 84199
    119. 

  119.     - path: roc.json
    120. 

  120.       md5: 62e00f72c338ecb4cc54cc1198ba3d95
    121. 

  121.       size: 68090
    122. 

  122.     - path: scores.json
    123. 

  123.       md5: 4fa854edc79b984e3a79086d6b32b1d6
    124. 

  124.       size: 76
    125. 

  125.   run_plots_command:
    126. 

  126.     cmd: dvc plots diff
    127.
Prev
Next
Tip!

Press p or to see the previous file or, n or to see the next file

Comments

Write Preview
Loading...
Integrate Google Cloud Storage
Use Google Storage
Select bucket
Upload key
Finish

Use Google Cloud Storage!

Browsing data directories saved to Google Cloud Storage is possible with DAGsHub. Let's configure your repository to easily display your data in the context of any commit!

Specify your Google Storage bucket

Service Account Key

Congratulations!

dvc-nlp-demo is now integrated with Google Cloud Storage!

Delete Storage Key

Are you sure you want to delete this access key?

No
Yes
Integrate AWS S3
Use S3 remote
Select bucket
Access key
Finish

Use AWS S3 as storage!

Browsing data directories saved to S3 is possible with DAGsHub. Let's configure your repository to easily display your data in the context of any commit!

Specify your S3 bucket

Access key (If needed)

Congratulations!

dvc-nlp-demo is now integrated with AWS S3!

Delete Storage Key

Are you sure you want to delete this access key?

No
Yes
Integrate S3 compatible storage
Use S3 like remote
Select bucket
Access key
Finish

Use any S3 compatible storage!

Browsing data directories saved to S3 compatible storage is possible with DAGsHub. Let's configure your repository to easily display your data in the context of any commit!

Specify your S3 bucket

Access key (If needed)

Congratulations!

dvc-nlp-demo is now integrated with your S3 compatible storage!

Delete Storage Key

Are you sure you want to delete this access key?

No
Yes
Integrate Azure Cloud Storage
Use Azure Storage
Select bucket
Set key
Finish

Use Azure Cloud Storage!

Browsing data directories saved to Azure Cloud Storage is possible with DAGsHub. Let's configure your repository to easily display your data in the context of any commit!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

dvc-nlp-demo is now integrated with Azure Cloud Storage!

Delete Storage Key

Are you sure you want to delete this access key?

No
Yes