|
feat: refactor entire pipeline to remove data redundency across cores
|
Emmanuel M. Smith
|
|
2 years ago |
|
feat: refactor entire pipeline and improve performance/readability
|
Emmanuel M. Smith
|
|
2 years ago |
|
revert: remove numexpr as it doesnt work well with new nullable dtypes
|
Emmanuel M. Smith
|
|
2 years ago |
|
feat: use numexpr for error calucations for performance improvements
|
Emmanuel M. Smith
|
|
2 years ago |
|
feat: start investigating data issues
|
Emmanuel M. Smith
|
|
2 years ago |
|
Add ability to reduce worker count dependent on task memory usage
|
Emmanuel M. Smith
|
|
2 years ago |
|
Update pipeline to inlude different error metrics
|
Emmanuel M. Smith
|
|
2 years ago |
|
Refactor parameters to be managed by DVC pipeline
|
Emmanuel M. Smith
|
|
2 years ago |
|
Update dependencies for extra pre-commit options
|
Emmanuel M. Smith
|
|
2 years ago |
|
Add dvc as dependency and fix path import in pipeline
|
Emmanuel M. Smith
|
|
2 years ago |
|
Update dependencies to latest versions.
|
Emmanuel M. Smith
|
|
2 years ago |
|
Update clean data generation scripts.
|
Emmanuel M. Smith
|
|
2 years ago |
|
Run code formatters
|
Emmanuel M. Smith
|
|
2 years ago |
|
Update dependencies and prepare files for LFS removal
|
Emmanuel M. Smith
|
|
2 years ago |
|
Remove undeeded packages and add jupyter dash
|
Emmanuel M. Smith
|
|
2 years ago |
|
Checkpoint updates to error surface plots
|
Emmanuel M. Smith
|
|
2 years ago |
|
Add functions for manipulating dataframe features
|
Emmanuel M. Smith
|
|
2 years ago |
|
Add script to verify that parquet files remain the same
|
Emmanuel M. Smith
|
|
2 years ago |
|
Add pre-commit verification
|
Emmanuel M. Smith
|
|
2 years ago |
|
Update dependencies
|
Emmanuel M. Smith
|
|
2 years ago |
|
Update dependencies
|
Emmanuel M. Smith
|
|
2 years ago |
|
Refactor project
|
Emmanuel M. Smith
|
|
2 years ago |
|
Fix output file naming
|
Emmanuel M. Smith
|
|
2 years ago |
|
Update black and run on notebooks
|
Emmanuel M. Smith
|
|
2 years ago |
|
Update/remove dependencies
|
Emmanuel M. Smith
|
|
2 years ago |
|
Update scripts to be in module form
|
Emmanuel M. Smith
|
|
2 years ago |
|
Update air data generation scripts
|
Emmanuel M. Smith
|
|
2 years ago |
|
Update water data generation scripts
|
Emmanuel M. Smith
|
|
2 years ago |
|
Start experimenting with ipywidgets
|
Emmanuel M. Smith
|
|
2 years ago |
|
Update data cache generation helper to deal with multiple source files
|
Emmanuel M. Smith
|
|
2 years ago |