asked on June 14, 2019
I plan to load 1M rows and 350 columns.What is the best way to handle this?
⋅ June 14, 2019
Hello,
Thank you for writing to us.
Please note that Flexmonster Pivot does not have any limitations on the size of the data and is designed to perform data analysis as quickly as possible.
Being a client-side component, Flexmonster relies on resources available to the browser, and this affects the maximum size of the data that can be handled on every particular computer.
We would like to point out that one million rows and 350 columns may be too much if loaded into the browser at once. For this reason, we kindly suggest using Elasticsearch for your case.
We would like to provide some explanations regarding the difference between Elasticsearch and other data sources (for example, CSV ).
The key point is when the browser loads data:
In the case of CSV, you have to load all data before component starts displaying any report.
In the case of Elasticsearch, Flexmonster can handle much larger data because not all data is loaded into the browser at once. You have the ability to load just part of the data necessary for the specified report.
An important remark is that only the part of the data needed for the current representation in Flexmonster is sent to the client side when using Elasticsearch.
Every time more data needs to be shown, a query is formed and a different set of data is sent to Flexmonster.
This way memory is used in moderation.
Please let us know if this was helpful and if you have further questions.
Best Regards,
Vera
