Register
Login
Resources
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Product
Data Engine LLMs Platform Enterprise
Pricing Explore
Connect to our Discord channel
Resources  
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Explore Pricing
Product  
Data Engine LLMs Platform Enterprise
Connect to Dagshub Discord channel
Register
Login

avatar Dean
/
Bookdata-tools
mirror of https://github.com/BoiseState/bookdata-tools

Watch 2
Issues   Discussions 0

dvc.lock 3.1 KB
Permalink History Raw

You have to be logged in to leave a comment. Sign In
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107 
  1. schema: '2.0'
    2. 

  2. stages:
    3. 

  3.   scan-ratings:
    4. 

  4.     cmd: cargo run --release -- amazon scan-ratings -o ratings.parquet --swap-id-columns
    5. 

  5.       ../data/az2018/Books.csv
    6. 

  6.     deps:
    7. 

  7.     - path: ../data/az2018/Books.csv
    8. 

  8.       md5: bcdcbbf336eb0d410e7a7894efa904ab
    9. 

  9.       size: 2140933459
    10. 

  10.     - path: ../src/amazon.rs
    11. 

  11.       hash: md5
    12. 

  12.       md5: 21b5d02a0fcb3f494163ed41cb6dd295
    13. 

  13.       size: 1345
    14. 

  14.     - path: ../src/cli/amazon/
    15. 

  15.       hash: md5
    16. 

  16.       md5: a7dffc6b923be125d80365fa51520376.dir
    17. 

  17.       size: 5736
    18. 

  18.       nfiles: 4
    19. 

  19.     outs:
    20. 

  20.     - path: ratings.parquet
    21. 

  21.       hash: md5
    22. 

  22.       md5: fdc3832ac453570056ca27500f9d4033
    23. 

  23.       size: 342486205
    24. 

  24.   schema@ratings:
    25. 

  25.     cmd: python ../run.py --rust pq-info -o ratings.json ratings.parquet
    26. 

  26.     deps:
    27. 

  27.     - path: ratings.parquet
    28. 

  28.       md5: 060809287f39a08c63724a1e8ae0fd8d
    29. 

  29.       size: 316701214
    30. 

  30.     outs:
    31. 

  31.     - path: ratings.json
    32. 

  32.       md5: e122a398de9e64654720f792598b7e1e
    33. 

  33.       size: 427
    34. 

  34.   cluster-ratings:
    35. 

  35.     cmd: cargo run --release -- amazon cluster-ratings -o az2018/az-cluster-ratings.parquet
    36. 

  36.       az2018/ratings.parquet
    37. 

  37.     deps:
    38. 

  38.     - path: az2018/ratings.parquet
    39. 

  39.       hash: md5
    40. 

  40.       md5: 293d4ebd867bc7dd126a052572477e38
    41. 

  41.       size: 342513929
    42. 

  42.     - path: book-links/isbn-clusters.parquet
    43. 

  43.       hash: md5
    44. 

  44.       md5: 1a87f47db64785678a022a264c8603be
    45. 

  45.       size: 487825142
    46. 

  46.     - path: src/cli/amazon
    47. 

  47.       hash: md5
    48. 

  48.       md5: a7dffc6b923be125d80365fa51520376.dir
    49. 

  49.       size: 5736
    50. 

  50.       nfiles: 4
    51. 

  51.     outs:
    52. 

  52.     - path: az2018/az-cluster-ratings.parquet
    53. 

  53.       hash: md5
    54. 

  54.       md5: 334d5e45ada5091f895dff4bc3a084ae
    55. 

  55.       size: 452366669
    56. 

  56.   schema@az-cluster-ratings:
    57. 

  57.     cmd: python ../run.py --rust pq-info -o az-cluster-ratings.json az-cluster-ratings.parquet
    58. 

  58.     deps:
    59. 

  59.     - path: az-cluster-ratings.parquet
    60. 

  60.       md5: c9ecf365a84cfb2ff36b87ec9c393c35
    61. 

  61.       size: 661901612
    62. 

  62.     outs:
    63. 

  63.     - path: az-cluster-ratings.json
    64. 

  64.       md5: da713f0303e3384dfb8624edf8924005
    65. 

  65.       size: 702
    66. 

  66.   cluster-ratings-5core:
    67. 

  67.     cmd: cargo run --release -- kcore -o az-cluster-ratings-5core.parquet az-cluster-ratings.parquet
    68. 

  68.     deps:
    69. 

  69.     - path: ../src/cli/kcore.rs
    70. 

  70.       hash: md5
    71. 

  71.       md5: 9a64f2beb19d2053d9c2386609beafe9
    72. 

  72.       size: 4874
    73. 

  73.     - path: az-cluster-ratings.parquet
    74. 

  74.       hash: md5
    75. 

  75.       md5: 334d5e45ada5091f895dff4bc3a084ae
    76. 

  76.       size: 452366669
    77. 

  77.     outs:
    78. 

  78.     - path: az-cluster-ratings-5core.parquet
    79. 

  79.       hash: md5
    80. 

  80.       md5: 3631bd4d445e9a2da927d053af94d419
    81. 

  81.       size: 241092593
    82. 

  82.   scan-reviews:
    83. 

  83.     cmd: cargo run --release -- amazon scan-reviews --rating-output ratings.parquet
    84. 

  84.       --review-output reviews.parquet ../data/az2018/Books.json.gz
    85. 

  85.     deps:
    86. 

  86.     - path: ../data/az2018/Books.json.gz
    87. 

  87.       hash: md5
    88. 

  88.       md5: 38bd00a67dd98902741eebfaf64f08dc
    89. 

  89.       size: 11813848069
    90. 

  90.     - path: ../src/amazon.rs
    91. 

  91.       hash: md5
    92. 

  92.       md5: 21b5d02a0fcb3f494163ed41cb6dd295
    93. 

  93.       size: 1345
    94. 

  94.     - path: ../src/cli/amazon/
    95. 

  95.       hash: md5
    96. 

  96.       md5: a7dffc6b923be125d80365fa51520376.dir
    97. 

  97.       size: 5736
    98. 

  98.       nfiles: 4
    99. 

  99.     outs:
    100. 

  100.     - path: ratings.parquet
    101. 

  101.       hash: md5
    102. 

  102.       md5: 293d4ebd867bc7dd126a052572477e38
    103. 

  103.       size: 342513929
    104. 

  104.     - path: reviews.parquet
    105. 

  105.       hash: md5
    106. 

  106.       md5: edde381af20b17f6012af7c5315d1286
    107. 

  107.       size: 9477326910
    108.
Prev
Next
Tip!

Press p or to see the previous file or, n or to see the next file

Comments

Write Preview
Loading...
Integrate Google Cloud Storage
Use Google Storage
Select bucket
Upload key
Finish

Use Google Cloud Storage!

Browsing data directories saved to Google Cloud Storage is possible with DAGsHub. Let's configure your repository to easily display your data in the context of any commit!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Bookdata-tools is now integrated with Google Cloud Storage!

Delete Storage Key

Are you sure you want to delete this access key?

No
Yes
Integrate AWS S3
Use S3 remote
Select bucket
Access key
Finish

Use AWS S3 as storage!

Browsing data directories saved to S3 is possible with DAGsHub. Let's configure your repository to easily display your data in the context of any commit!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Bookdata-tools is now integrated with AWS S3!

Delete Storage Key

Are you sure you want to delete this access key?

No
Yes
Integrate S3 compatible storage
Use S3 like remote
Select bucket
Access key
Finish

Use any S3 compatible storage!

Browsing data directories saved to S3 compatible storage is possible with DAGsHub. Let's configure your repository to easily display your data in the context of any commit!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Bookdata-tools is now integrated with your S3 compatible storage!

Delete Storage Key

Are you sure you want to delete this access key?

No
Yes
Integrate Azure Cloud Storage
Use Azure Storage
Select bucket
Set key
Finish

Use Azure Cloud Storage!

Browsing data directories saved to Azure Cloud Storage is possible with DAGsHub. Let's configure your repository to easily display your data in the context of any commit!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

Bookdata-tools is now integrated with Azure Cloud Storage!

Delete Storage Key

Are you sure you want to delete this access key?

No
Yes