Register
Login
Resources
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Product
Data Engine LLMs Platform Enterprise
Pricing Explore
Connect to our Discord channel

dvc.yaml 831 B

You have to be logged in to leave a comment. Sign In
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
  1. stages:
  2. book-isbn-ids:
  3. cmd: cargo run --release -- link-isbn-ids -R rec_id -o loc-mds/book-isbn-ids.parquet loc-mds/book-isbns.parquet
  4. deps:
  5. - loc-mds/book-isbns.parquet
  6. - book-links/all-isbns.parquet
  7. outs:
  8. - loc-mds/book-isbn-ids.parquet
  9. wdir: ..
  10. scan-books:
  11. cmd: cargo run --release -- scan-marc --book-mode --glob "../data/loc-books/BooksAll.2016*.xml.gz"
  12. deps:
  13. - ../src/cli/scan_marc.rs
  14. - ../src/marc
  15. - ../data/loc-books
  16. outs:
  17. - book-fields.parquet
  18. - book-ids.parquet
  19. - book-isbns.parquet
  20. - book-authors.parquet
  21. scan-names:
  22. cmd: cargo run --release -- scan-marc --glob "../data/loc-names/Names.2016*.xml.gz" -o name-fields.parquet
  23. deps:
  24. - ../src/cli/scan_marc.rs
  25. - ../src/marc
  26. - ../data/loc-names
  27. outs:
  28. - name-fields.parquet
Tip!

Press p or to see the previous file or, n or to see the next file

Comments

Loading...