Register
Login
Resources
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Product
Data Engine LLMs Platform Enterprise
Pricing Explore
Connect to our Discord channel
Resources  
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Explore Pricing
Product  
Data Engine LLMs Platform Enterprise
Connect to Dagshub Discord channel
Register
Login

avatar Dean
/
Bookdata-tools
mirror of https://github.com/BoiseState/bookdata-tools

Watch 2
Issues   Discussions 0 Invite collaborators

dvc.lock 6.6 KB
Permalink History Raw

You have to be logged in to leave a comment. Sign In
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215 
  1. schema: '2.0'
    2. 

  2. stages:
    3. 

  3.   scan-authors:
    4. 

  4.     cmd: python ../run.py --rust openlib scan-authors ../data/openlib/ol_dump_authors.txt.gz
    5. 

  5.     deps:
    6. 

  6.     - path: ../data/openlib/ol_dump_authors.txt.gz
    7. 

  7.       md5: 364e02a44e9e9a572e88692fc78fef27
    8. 

  8.       size: 306408477
    9. 

  9.     - path: ../src/cli/openlib.rs
    10. 

  10.       md5: 5156a840bf850593d05006d3cd2b795d
    11. 

  11.       size: 1728
    12. 

  12.     - path: ../src/openlib/
    13. 

  13.       md5: cc4d6b7d203f2b03db2a3b1e7466aff9.dir
    14. 

  14.       size: 10947
    15. 

  15.       nfiles: 5
    16. 

  16.     outs:
    17. 

  17.     - path: author-names.parquet
    18. 

  18.       md5: bbe41b19f31882eb0128142b351cc077
    19. 

  19.       size: 126448846
    20. 

  20.     - path: authors.parquet
    21. 

  21.       md5: a7a63a22986e56ed079110637002e9cc
    22. 

  22.       size: 136995072
    23. 

  23.   scan-editions:
    24. 

  24.     cmd: python ../run.py --rust openlib scan-editions ../data/openlib/ol_dump_editions.txt.gz
    25. 

  25.     deps:
    26. 

  26.     - path: ../data/openlib/ol_dump_editions.txt.gz
    27. 

  27.       md5: e105295bf5f8025ecd7e43838ed0739c
    28. 

  28.       size: 6081278291
    29. 

  29.     - path: ../src/cli/openlib.rs
    30. 

  30.       md5: 5156a840bf850593d05006d3cd2b795d
    31. 

  31.       size: 1728
    32. 

  32.     - path: ../src/openlib/
    33. 

  33.       md5: cc4d6b7d203f2b03db2a3b1e7466aff9.dir
    34. 

  34.       size: 10947
    35. 

  35.       nfiles: 5
    36. 

  36.     - path: author-ids-after-works.parquet
    37. 

  37.       md5: 7470b0bfe14d26c4e2fd4241c41e56ac
    38. 

  38.       size: 53257918
    39. 

  39.     - path: authors.parquet
    40. 

  40.       md5: a7a63a22986e56ed079110637002e9cc
    41. 

  41.       size: 136995072
    42. 

  42.     - path: works.parquet
    43. 

  43.       md5: 0b3b554a640a13697089feb9d0b8c509
    44. 

  44.       size: 520931169
    45. 

  45.     outs:
    46. 

  46.     - path: all-authors.parquet
    47. 

  47.       md5: e7ee0593c3bbdfb8ec1ff3466084f77f
    48. 

  48.       size: 54577902
    49. 

  49.     - path: all-works.parquet
    50. 

  50.       md5: 43534d6324f0021769fdd8ed3287c48b
    51. 

  51.       size: 147842482
    52. 

  52.     - path: edition-authors.parquet
    53. 

  53.       md5: 52d351f649c6cce481da4b4df6393940
    54. 

  54.       size: 136280002
    55. 

  55.     - path: edition-isbns.parquet
    56. 

  56.       md5: 4aae4d3eaf2ff663d71b9965ccf59133
    57. 

  57.       size: 132821740
    58. 

  58.     - path: edition-works.parquet
    59. 

  59.       md5: 295d170711290ac99b92e60e179bcf7f
    60. 

  60.       size: 146555043
    61. 

  61.     - path: editions.parquet
    62. 

  62.       md5: 48972480e58c663c3feff6e3d698c2ba
    63. 

  63.       size: 723946186
    64. 

  64.   scan-works:
    65. 

  65.     cmd: python ../run.py --rust openlib scan-works ../data/openlib/ol_dump_works.txt.gz
    66. 

  66.     deps:
    67. 

  67.     - path: ../data/openlib/ol_dump_works.txt.gz
    68. 

  68.       md5: 84e236955e5f683adde6a677d80475a0
    69. 

  69.       size: 1666325144
    70. 

  70.     - path: ../src/cli/openlib.rs
    71. 

  71.       md5: 5156a840bf850593d05006d3cd2b795d
    72. 

  72.       size: 1728
    73. 

  73.     - path: ../src/openlib/
    74. 

  74.       md5: cc4d6b7d203f2b03db2a3b1e7466aff9.dir
    75. 

  75.       size: 10947
    76. 

  76.       nfiles: 5
    77. 

  77.     - path: authors.parquet
    78. 

  78.       md5: a7a63a22986e56ed079110637002e9cc
    79. 

  79.       size: 136995072
    80. 

  80.     outs:
    81. 

  81.     - path: author-ids-after-works.parquet
    82. 

  82.       md5: 7470b0bfe14d26c4e2fd4241c41e56ac
    83. 

  83.       size: 53257918
    84. 

  84.     - path: work-authors.parquet
    85. 

  85.       md5: 8084752354258af9ec4c62fe24764b7f
    86. 

  86.       size: 110065483
    87. 

  87.     - path: works.parquet
    88. 

  88.       md5: 0b3b554a640a13697089feb9d0b8c509
    89. 

  89.       size: 520931169
    90. 

  90.   edition-isbn-ids:
    91. 

  91.     cmd: python ../run.py --rust fusion edition-isbn-ids.tcl
    92. 

  92.     deps:
    93. 

  93.     - path: ../book-links/all-isbns.parquet
    94. 

  94.       md5: 29cc7ae0b86b0e0f5aa7389fdea7de5b
    95. 

  95.       size: 193709539
    96. 

  96.     - path: edition-isbn-ids.tcl
    97. 

  97.       md5: 68869c0bf2dfde39bf8552c2d9d3774d
    98. 

  98.       size: 200
    99. 

  99.     - path: edition-isbns.parquet
    100. 

  100.       md5: 4aae4d3eaf2ff663d71b9965ccf59133
    101. 

  101.       size: 132821740
    102. 

  102.     outs:
    103. 

  103.     - path: edition-isbn-ids.parquet
    104. 

  104.       md5: f1bb7e35d883c19e733608ae58d8981b
    105. 

  105.       size: 127237646
    106. 

  106.   schema@edition-isbn-ids:
    107. 

  107.     cmd: python ../run.py --rust pq-info -o edition-isbn-ids.json edition-isbn-ids.parquet
    108. 

  108.     deps:
    109. 

  109.     - path: edition-isbn-ids.parquet
    110. 

  110.       md5: f1bb7e35d883c19e733608ae58d8981b
    111. 

  111.       size: 127237646
    112. 

  112.     outs:
    113. 

  113.     - path: edition-isbn-ids.json
    114. 

  114.       md5: 306fb83f07a9bae9a2be56e2ed9ec1d0
    115. 

  115.       size: 355
    116. 

  116.   schema@works:
    117. 

  117.     cmd: python ../run.py --rust pq-info -o works.json works.parquet
    118. 

  118.     deps:
    119. 

  119.     - path: works.parquet
    120. 

  120.       md5: 0b3b554a640a13697089feb9d0b8c509
    121. 

  121.       size: 520931169
    122. 

  122.     outs:
    123. 

  123.     - path: works.json
    124. 

  124.       md5: 3e293095cf0b7f0697cea06aab5ccfdb
    125. 

  125.       size: 483
    126. 

  126.   schema@all-works:
    127. 

  127.     cmd: python ../run.py --rust pq-info -o all-works.json all-works.parquet
    128. 

  128.     deps:
    129. 

  129.     - path: all-works.parquet
    130. 

  130.       md5: 43534d6324f0021769fdd8ed3287c48b
    131. 

  131.       size: 147842482
    132. 

  132.     outs:
    133. 

  133.     - path: all-works.json
    134. 

  134.       md5: e94f61a362e300b8a7c65ad2a26ed24d
    135. 

  135.       size: 345
    136. 

  136.   schema@editions:
    137. 

  137.     cmd: python ../run.py --rust pq-info -o editions.json editions.parquet
    138. 

  138.     deps:
    139. 

  139.     - path: editions.parquet
    140. 

  140.       md5: 48972480e58c663c3feff6e3d698c2ba
    141. 

  141.       size: 723946186
    142. 

  142.     outs:
    143. 

  143.     - path: editions.json
    144. 

  144.       md5: 3050dc7e9f8a8d1d2a6913d1691afb3d
    145. 

  145.       size: 483
    146. 

  146.   schema@work-authors:
    147. 

  147.     cmd: python ../run.py --rust pq-info -o work-authors.json work-authors.parquet
    148. 

  148.     deps:
    149. 

  149.     - path: work-authors.parquet
    150. 

  150.       md5: 8084752354258af9ec4c62fe24764b7f
    151. 

  151.       size: 110065483
    152. 

  152.     outs:
    153. 

  153.     - path: work-authors.json
    154. 

  154.       md5: 8f577e723cab81055c2217ef91c3f818
    155. 

  155.       size: 487
    156. 

  156.   schema@author-names:
    157. 

  157.     cmd: python ../run.py --rust pq-info -o author-names.json author-names.parquet
    158. 

  158.     deps:
    159. 

  159.     - path: author-names.parquet
    160. 

  160.       md5: bbe41b19f31882eb0128142b351cc077
    161. 

  161.       size: 126448846
    162. 

  162.     outs:
    163. 

  163.     - path: author-names.json
    164. 

  164.       md5: 4d24bb1eb561ebed36700c491b79b617
    165. 

  165.       size: 487
    166. 

  166.   schema@edition-authors:
    167. 

  167.     cmd: python ../run.py --rust pq-info -o edition-authors.json edition-authors.parquet
    168. 

  168.     deps:
    169. 

  169.     - path: edition-authors.parquet
    170. 

  170.       md5: 52d351f649c6cce481da4b4df6393940
    171. 

  171.       size: 136280002
    172. 

  172.     outs:
    173. 

  173.     - path: edition-authors.json
    174. 

  174.       md5: e0d0267072e94376707bdb4f2f183f75
    175. 

  175.       size: 492
    176. 

  176.   schema@edition-isbns:
    177. 

  177.     cmd: python ../run.py --rust pq-info -o edition-isbns.json edition-isbns.parquet
    178. 

  178.     deps:
    179. 

  179.     - path: edition-isbns.parquet
    180. 

  180.       md5: 4aae4d3eaf2ff663d71b9965ccf59133
    181. 

  181.       size: 132821740
    182. 

  182.     outs:
    183. 

  183.     - path: edition-isbns.json
    184. 

  184.       md5: 3ff89b24df48e700eb66d2714ef92378
    185. 

  185.       size: 351
    186. 

  186.   schema@edition-works:
    187. 

  187.     cmd: python ../run.py --rust pq-info -o edition-works.json edition-works.parquet
    188. 

  188.     deps:
    189. 

  189.     - path: edition-works.parquet
    190. 

  190.       md5: 295d170711290ac99b92e60e179bcf7f
    191. 

  191.       size: 146555043
    192. 

  192.     outs:
    193. 

  193.     - path: edition-works.json
    194. 

  194.       md5: af623428eea7d2b3f88f1c235baf8012
    195. 

  195.       size: 352
    196. 

  196.   schema@all-authors:
    197. 

  197.     cmd: python ../run.py --rust pq-info -o all-authors.json all-authors.parquet
    198. 

  198.     deps:
    199. 

  199.     - path: all-authors.parquet
    200. 

  200.       md5: e7ee0593c3bbdfb8ec1ff3466084f77f
    201. 

  201.       size: 54577902
    202. 

  202.     outs:
    203. 

  203.     - path: all-authors.json
    204. 

  204.       md5: e0586bd29b2cee34720bf0ce462b3e06
    205. 

  205.       size: 343
    206. 

  206.   schema@authors:
    207. 

  207.     cmd: python ../run.py --rust pq-info -o authors.json authors.parquet
    208. 

  208.     deps:
    209. 

  209.     - path: authors.parquet
    210. 

  210.       md5: a7a63a22986e56ed079110637002e9cc
    211. 

  211.       size: 136995072
    212. 

  212.     outs:
    213. 

  213.     - path: authors.json
    214. 

  214.       md5: e738a0b4bc862bd74cc123e319233c10
    215. 

  215.       size: 481
    216.
Prev
Next
Tip!

Press p or to see the previous file or, n or to see the next file

Comments

Write Preview
Loading...
Integrate Google Cloud Storage
Use Google Storage
Select bucket
Upload key
Finish

Use Google Cloud Storage!

Browsing data directories saved to Google Cloud Storage is possible with DAGsHub. Let's configure your repository to easily display your data in the context of any commit!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Bookdata-tools is now integrated with Google Cloud Storage!

Delete Storage Key

Are you sure you want to delete this access key?

No
Yes
Integrate AWS S3
Use S3 remote
Select bucket
Access key
Finish

Use AWS S3 as storage!

Browsing data directories saved to S3 is possible with DAGsHub. Let's configure your repository to easily display your data in the context of any commit!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Bookdata-tools is now integrated with AWS S3!

Delete Storage Key

Are you sure you want to delete this access key?

No
Yes
Integrate S3 compatible storage
Use S3 like remote
Select bucket
Access key
Finish

Use any S3 compatible storage!

Browsing data directories saved to S3 compatible storage is possible with DAGsHub. Let's configure your repository to easily display your data in the context of any commit!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Bookdata-tools is now integrated with your S3 compatible storage!

Delete Storage Key

Are you sure you want to delete this access key?

No
Yes
Integrate Azure Cloud Storage
Use Azure Storage
Select bucket
Set key
Finish

Use Azure Cloud Storage!

Browsing data directories saved to Azure Cloud Storage is possible with DAGsHub. Let's configure your repository to easily display your data in the context of any commit!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

Bookdata-tools is now integrated with Azure Cloud Storage!

Delete Storage Key

Are you sure you want to delete this access key?

No
Yes