Register
Login
Resources
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Product
Data Engine LLMs Platform Enterprise
Pricing Explore
Connect to our Discord channel

preprocess.py 364 B

You have to be logged in to leave a comment. Sign In
1
2
3
4
5
6
7
8
9
10
11
12
  1. # USeful Libraries
  2. import yaml
  3. from packages.preprocess_utilities import data_preprocessor
  4. from os.path import join
  5. params = yaml.safe_load(open("params.yaml"))["preprocess"]
  6. raw_path = join("data", "raw")
  7. processed_path = join("data", "processed")
  8. processed_file_name = params['final_file_name']
  9. data_preprocessor(raw_path, processed_path, processed_file_name)
Tip!

Press p or to see the previous file or, n or to see the next file

Comments

Loading...