juaml/junifer
Watch
3
0
Fork
You've already forked junifer
 0
Code Issues 14 Pull requests 2 Packages Activity Actions

[BUG]: Validation failure of multiple pre-processing steps with different input data types requirement #339

Merged
synchon merged 4 commits from fix/multi-preprocessor-validation into main 2024-05-14 11:04:51 +00:00
Conversation 10 Commits 4 Files changed 2 +8 -2
2 changed files with 8 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

1
docs/changes/newsfragments/339.bugfix Normal file
View file

@ -0,0 +1 @@
Fix validation failure of multiple Preprocessors with different input data types requirement by `Synchon Mandal`_

9
junifer/markers/collection.py
View file

@ -136,9 +136,14 @@ class MarkerCollection:
"Validating Preprocessor: " "Validating Preprocessor: "
f"{preprocessor.__class__.__name__}" f"{preprocessor.__class__.__name__}"
) )
# Copy existing data types
old_t_data = t_data.copy()
logger.info(f"Preprocessor input type: {t_data}")
# Validate preprocessor # Validate preprocessor
t_data = preprocessor.validate(t_data) new_t_data = preprocessor.validate(old_t_data)
logger.info(f"Preprocess output type: {t_data}") # Set new data types
t_data = list(set(old_t_data) | set(new_t_data))
logger.info(f"Preprocessor output type: {t_data}")
for marker in self._markers: for marker in self._markers:
logger.info(f"Validating Marker: {marker.name}") logger.info(f"Validating Marker: {marker.name}")