Register
Login
Resources
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Product
Data Engine LLMs Platform Enterprise
Pricing Explore
Connect to our Discord channel
Resources  
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Explore Pricing
Product  
Data Engine LLMs Platform Enterprise
Connect to Dagshub Discord channel
Register
Login

khuyentran1401
/
prefect-dvc
connected to https://github.com/khuyentran1401/prefect-dvc.git

Watch 1
Issues 1 Pull Requests 0 Discussions 0

dvc.lock 2.2 KB
Permalink History Raw

You have to be logged in to leave a comment. Sign In
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94 
  1. schema: '2.0'
    2. 

  2. stages:
    3. 

  3.   process_data:
    4. 

  4.     cmd: python src/process_data.py
    5. 

  5.     deps:
    6. 

  6.     - path: data/raw
    7. 

  7.       md5: 10c3f643286f509fa7f6b4675d9efbad.dir
    8. 

  8.       size: 222379
    9. 

  9.       nfiles: 1
    10. 

  10.     - path: src/process_data.py
    11. 

  11.       md5: 226c85778c491537192725b557f070cf
    12. 

  12.       size: 2763
    13. 

  13.     params:
    14. 

  14.       config/process/process_1.yaml:
    15. 

  15.         family_size:
    16. 

  16.           Married: 2
    17. 

  17.           Together: 2
    18. 

  18.           Absurd: 1
    19. 

  19.           Widow: 1
    20. 

  20.           YOLO: 1
    21. 

  21.           Divorced: 1
    22. 

  22.           Single: 1
    23. 

  23.           Alone: 1
    24. 

  24.         keep_columns:
    25. 

  25.         - Income
    26. 

  26.         - Recency
    27. 

  27.         - NumWebVisitsMonth
    28. 

  28.         - AcceptedCmp3
    29. 

  29.         - AcceptedCmp4
    30. 

  30.         - AcceptedCmp5
    31. 

  31.         - AcceptedCmp1
    32. 

  32.         - AcceptedCmp2
    33. 

  33.         - Complain
    34. 

  34.         - Response
    35. 

  35.         - age
    36. 

  36.         - total_purchases
    37. 

  37.         - enrollment_years
    38. 

  38.         - family_size
    39. 

  39.         name: process_1
    40. 

  40.         remove_outliers_threshold:
    41. 

  41.           age: 84
    42. 

  42.           Income: 600000
    43. 

  43.     outs:
    44. 

  44.     - path: data/intermediate
    45. 

  45.       md5: 9503e800e9c4e01a93c29eafc53f63c4.dir
    46. 

  46.       size: 621318
    47. 

  47.       nfiles: 1
    48. 

  48.   train:
    49. 

  49.     cmd: python src/segment.py
    50. 

  50.     deps:
    51. 

  51.     - path: data/intermediate
    52. 

  52.       md5: 9503e800e9c4e01a93c29eafc53f63c4.dir
    53. 

  53.       size: 621318
    54. 

  54.       nfiles: 1
    55. 

  55.     - path: src/segment.py
    56. 

  56.       md5: a6ab7e068dbbc4eba3d95aa17441c4aa
    57. 

  57.       size: 3263
    58. 

  58.     params:
    59. 

  59.       config/main.yaml:
    60. 

  60.         defaults:
    61. 

  61.         - process: process_1
    62. 

  62.         - _self_
    63. 

  63.         final:
    64. 

  64.           dir: data/final
    65. 

  65.           name: segmented.csv
    66. 

  66.           path: ${final.dir}/${final.name}
    67. 

  67.         flow: all
    68. 

  68.         hydra:
    69. 

  69.           output_subdir:
    70. 

  70.           run:
    71. 

  71.             dir: .
    72. 

  72.         image:
    73. 

  73.           kmeans: image/elbow.png
    74. 

  74.           clusters: image/cluster.png
    75. 

  75.         intermediate:
    76. 

  76.           dir: data/intermediate
    77. 

  77.           name: scale_features.csv
    78. 

  78.           path: ${intermediate.dir}/${intermediate.name}
    79. 

  79.         model:
    80. 

  80.           path: model/cluster.pkl
    81. 

  81.         raw_data:
    82. 

  82.           path: data/raw/marketing_campaign.csv
    83. 

  83.     outs:
    84. 

  84.     - path: data/final
    85. 

  85.       md5: a62d537a11caea4087e895ad51602d8a.dir
    86. 

  86.       size: 609138
    87. 

  87.       nfiles: 1
    88. 

  88.     - path: image
    89. 

  89.       md5: a3c9e1b4b81e4908e67defb4a7be786b.dir
    90. 

  90.       size: 185039
    91. 

  91.       nfiles: 2
    92. 

  92.     - path: model/cluster.pkl
    93. 

  93.       md5: e57f7e4db1a0be99bdc1fc2d82c843c9
    94. 

  94.       size: 9703
    95.
Prev
Next
Tip!

Press p or to see the previous file or, n or to see the next file

Comments

Write Preview
Loading...
Integrate Google Cloud Storage
Use Google Storage
Select bucket
Upload key
Finish

Use Google Cloud Storage!

Browsing data directories saved to Google Cloud Storage is possible with DAGsHub. Let's configure your repository to easily display your data in the context of any commit!

Specify your Google Storage bucket

Service Account Key

Congratulations!

prefect-dvc is now integrated with Google Cloud Storage!

Delete Storage Key

Are you sure you want to delete this access key?

No
Yes
Integrate AWS S3
Use S3 remote
Select bucket
Access key
Finish

Use AWS S3 as storage!

Browsing data directories saved to S3 is possible with DAGsHub. Let's configure your repository to easily display your data in the context of any commit!

Specify your S3 bucket

Access key (If needed)

Congratulations!

prefect-dvc is now integrated with AWS S3!

Delete Storage Key

Are you sure you want to delete this access key?

No
Yes
Integrate S3 compatible storage
Use S3 like remote
Select bucket
Access key
Finish

Use any S3 compatible storage!

Browsing data directories saved to S3 compatible storage is possible with DAGsHub. Let's configure your repository to easily display your data in the context of any commit!

Specify your S3 bucket

Access key (If needed)

Congratulations!

prefect-dvc is now integrated with your S3 compatible storage!

Delete Storage Key

Are you sure you want to delete this access key?

No
Yes
Integrate Azure Cloud Storage
Use Azure Storage
Select bucket
Set key
Finish

Use Azure Cloud Storage!

Browsing data directories saved to Azure Cloud Storage is possible with DAGsHub. Let's configure your repository to easily display your data in the context of any commit!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

prefect-dvc is now integrated with Azure Cloud Storage!

Delete Storage Key

Are you sure you want to delete this access key?

No
Yes