Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

deprecation of groupby.apply #48

Open
pbeaucage opened this issue Sep 15, 2022 · 1 comment
Open

deprecation of groupby.apply #48

pbeaucage opened this issue Sep 15, 2022 · 1 comment
Assignees
@pbeaucage

Comments

@pbeaucage
Copy link
Collaborator

Warning: src\PyHyperScattering\Fitting.py:18: PendingDeprecationWarning: GroupBy.apply may be deprecated in the future. Using GroupBy.map is encouraged

Must look into this...
@pbeaucage pbeaucage self-assigned this Sep 15, 2022
@pbeaucage
Copy link
Collaborator Author

pbeaucage commented Sep 15, 2022 •
edited
Loading

Ok, not a crisis. This was mainly just renamed, BUT

recent xarray also adds map_blocks which can be parallelized in a streaming way like apply_ufunc.

https://docs.xarray.dev/en/stable/generated/xarray.map_blocks.html#xarray.map_blocks

This would let us finally use dask- or hdf5-backed arrays that don't need to hold all data in memory at once! Huzzah!

  • Switch dataarray.apply calls to dataarray.map
  • Explore map_blocks (which is an unstable/prerelease API and we can't use anyway due to incompatibility with xarray 2022.06.0)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@pbeaucage pbeaucage

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@pbeaucage