Task stop prematurely if transformer return None
When transformer returned null no more records is processed, this means a transformer cannot filter out data. It also mean the task silently skip process rest of the records.
@@ -60,6 +60,7 @@ class DefaultTask(Task):
while record:
record = self.transformer.transform(record)
if not record:
+ record = self.extractor.extract()
continue
self.loader.load(record)
record = self.extractor.extract()
