Skip to content

Rework data handling#15

Merged
torogi94 merged 5 commits into
data-model-refactorfrom
update-data-handling
May 5, 2025
Merged

Rework data handling#15
torogi94 merged 5 commits into
data-model-refactorfrom
update-data-handling

Conversation

@torogi94

@torogi94 torogi94 commented May 5, 2025

Copy link
Copy Markdown
Collaborator
  • When assigning species from EnzymeML to peaks using PeakAssigner or PeakRangeAssigner, proteins are now excluded from the list of selectable species. Added proteins=True, complexes=True, and small_molecules=True flags to the get_species_from_enzymeml() function to allow for more granular control over which species are pulled from EnzymeML.
  • Added keep_data_model=False and keep_enzymeml=True flags to save_to_file() method to allow for removal of possibly storage-intensive data models.
  • Changed behaviour of NMRpy data model. The rather large numpy arrays of NMR data are now converted to lists and saved to the data model only ad hoc upon calling the save_data_model() method to save on memory size and computation time.

torogi94 added 5 commits May 5, 2025 15:01
- Add species type flags to get_species_from_enzymeml() util function to allow filtering for specific types of species.
- Remove unnecessary display of proteins in PeakAssigner and PeakRangeAssigner using the new species type flags.
- Add save_data_model() method to serialise the NMRpy data model.
- Change handling of data arrays: They are now saved as numpy.ndarrays in each Fid object and only copied as lists into the data model upon serialisation.
- Resolve Pydantic serialisation issues (complex → string conversion).
- Optimise processing loops for faster execution and lower memory usage.
@torogi94 torogi94 merged commit 24cafc7 into data-model-refactor May 5, 2025
@torogi94 torogi94 deleted the update-data-handling branch May 5, 2025 15:17
torogi94 added a commit that referenced this pull request Nov 11, 2025
* Update EnzymeML species handling

- Add species type flags to get_species_from_enzymeml() util function to allow filtering for specific types of species.
- Remove unnecessary display of proteins in PeakAssigner and PeakRangeAssigner using the new species type flags.

* Add flags for keeping data models upon saving

* Change data array handling of NMRpy data model

- Add save_data_model() method to serialise the NMRpy data model.
- Change handling of data arrays: They are now saved as numpy.ndarrays in each Fid object and only copied as lists into the data model upon serialisation.

* Update data_objects.py

- Resolve Pydantic serialisation issues (complex → string conversion).
- Optimise processing loops for faster execution and lower memory usage.

* Change keep_data_model flag to False
torogi94 added a commit that referenced this pull request Nov 13, 2025
* Update EnzymeML species handling

- Add species type flags to get_species_from_enzymeml() util function to allow filtering for specific types of species.
- Remove unnecessary display of proteins in PeakAssigner and PeakRangeAssigner using the new species type flags.

* Add flags for keeping data models upon saving

* Change data array handling of NMRpy data model

- Add save_data_model() method to serialise the NMRpy data model.
- Change handling of data arrays: They are now saved as numpy.ndarrays in each Fid object and only copied as lists into the data model upon serialisation.

* Update data_objects.py

- Resolve Pydantic serialisation issues (complex → string conversion).
- Optimise processing loops for faster execution and lower memory usage.

* Change keep_data_model flag to False
torogi94 added a commit that referenced this pull request Mar 14, 2026
* Update EnzymeML species handling

- Add species type flags to get_species_from_enzymeml() util function to allow filtering for specific types of species.
- Remove unnecessary display of proteins in PeakAssigner and PeakRangeAssigner using the new species type flags.

* Add flags for keeping data models upon saving

* Change data array handling of NMRpy data model

- Add save_data_model() method to serialise the NMRpy data model.
- Change handling of data arrays: They are now saved as numpy.ndarrays in each Fid object and only copied as lists into the data model upon serialisation.

* Update data_objects.py

- Resolve Pydantic serialisation issues (complex → string conversion).
- Optimise processing loops for faster execution and lower memory usage.

* Change keep_data_model flag to False
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant