How to improve the efficiency of data import when labeling a large amount of data?

When I check and modify the labeled data, I found that it took more time to import the data. Raw data and labeled data are imported in groups. I found:

  1. If I import a large amount of data at once, the slicer will take a long time and take up too much memory.
  2. If I import only part of the data groups at a time, I need to import it multiple times.
    In addition, when I check and modify the labeled data, I often need to switch to display different data pairs, especially when there are many members in the data group, it is very time consuming.

How should I do to improve the efficiency of data import?
I think of a way is to write the correspondence of each group of data to csv, and then import the csv file, select each piece of data of csv to switch the data group. Is there an extension can achieve this? Can anyone give me some advice?

The more data you load, the more memory will be used. If memory usage gets close the amount of physical RAM installed in your computer, operations will start to slow down by a factor of 10x-100x. If you need to visualize a lot of data sets at once then you can either install more RAM or downscale your data (e.g., using Crop Volume module).

To review items one by one in a large data set collection, you can use Case Iterator extension.

Thank you, Andras.
The Case Iterator extension is helpful.

1 Like