Details
-
Sub-task
-
Resolution: Clarified
-
Medium
-
None
-
None
-
None
-
None
Description
It would be nice to allow users to have more influence on the sizes of the chunks of events the TDF has to deal with.
For example, now, with a TDF from scratch, we create 2*Nworkers tasks to process the entire set of entries. This is a good heuristics but on the other hand it may lead to imbalance, let's say, in combination of filters.
This item proposes to upgrade the TDF from scratch, TCsvDS and whatever interfaces in order to be able to give to the user the possibility to influence the work chunk sizes.