|
feat: refactor entire pipeline to remove data redundency across cores
|
Emmanuel M. Smith
|
|
2 years ago |
|
revert: remove numexpr as it doesnt work well with new nullable dtypes
|
Emmanuel M. Smith
|
|
2 years ago |
|
feat: use numexpr for error calucations for performance improvements
|
Emmanuel M. Smith
|
|
2 years ago |
|
feat: start investigating data issues
|
Emmanuel M. Smith
|
|
2 years ago |
|
feat: refactor dvc pipeline significantly
|
Emmanuel M. Smith
|
|
2 years ago |
|
Add ability to reduce worker count dependent on task memory usage
|
Emmanuel M. Smith
|
|
2 years ago |
|
Update pipeline to inlude different error metrics
|
Emmanuel M. Smith
|
|
2 years ago |
|
Refactor parameters to be managed by DVC pipeline
|
Emmanuel M. Smith
|
|
2 years ago |
|
Update dependencies for extra pre-commit options
|
Emmanuel M. Smith
|
|
2 years ago |
|
Add dvc as dependency and fix path import in pipeline
|
Emmanuel M. Smith
|
|
2 years ago |
|
Update clean data generation scripts.
|
Emmanuel M. Smith
|
|
2 years ago |
|
Run code formatters
|
Emmanuel M. Smith
|
|
2 years ago |
|
Update dependencies and prepare files for LFS removal
|
Emmanuel M. Smith
|
|
2 years ago |
|
Remove undeeded packages and add jupyter dash
|
Emmanuel M. Smith
|
|
2 years ago |
|
Add functions for manipulating dataframe features
|
Emmanuel M. Smith
|
|
2 years ago |
|
Add pre-commit verification
|
Emmanuel M. Smith
|
|
2 years ago |
|
Refactor project
|
Emmanuel M. Smith
|
|
2 years ago |
|
Update black and run on notebooks
|
Emmanuel M. Smith
|
|
2 years ago |
|
Update/remove dependencies
|
Emmanuel M. Smith
|
|
2 years ago |
|
Update air data generation scripts
|
Emmanuel M. Smith
|
|
2 years ago |
|
Cleanup packages
|
Emmanuel M. Smith
|
|
2 years ago |
|
Reorganize data-model generation code
|
Emmanuel M. Smith
|
|
2 years ago |
|
Add scripts for generating complete datasets with data parameters.
|
Emmanuel M. Smith
|
|
2 years ago |
|
Update packages
|
Emmanuel M. Smith
|
|
2 years ago |
|
Add updated air data with figures
|
Emmanuel M. Smith
|
|
3 years ago |
|
Create cleaned versions of air quality dataset
|
Emmanuel M. Smith
|
|
3 years ago |
|
Pull out old articles in preperation for new format
|
Emmanuel M. Smith
|
|
3 years ago |