asked on March 31, 2025
I have a CSV hosted on S3 bucket which contains around 500k of data, it takes around 20 sec to 1 min to first download the data and then to render, is there any way this can be optimized to improve user experience?
⋅ April 1, 2025
Hello,
Thank you for reaching out to us.
Could you please provide us with details on which approach you use to connect the data to Flexmonster?
Flexmonster provides data sources that do not require getting the whole dataset on the initial page load.
If you want to work with a large data set, we recommend using Flexmonster Data Server - a special server-side tool implementing the custom data source API. It is responsible for fetching data from a data source, processing, and aggregating it. Then, the data is passed to Flexmonster Pivot in a ready-to-show format. For instance, the Data Server will only pass the data that is needed for the specific expanded column. It significantly reduces data loading time.
The detailed guide you can find in our documentation: https://www.flexmonster.com/doc/getting-started-with-data-server/
Alternatively, you can implement the Flexmonster custom data source API – our custom communication protocol that allows you to transfer already aggregated data from a server to Flexmonster Pivot. Like Flexmonster Data Server, data is passed to Pivot in a ready-to-show format.
We recommend checking our guide on choosing the best data source for your use case: https://www.flexmonster.com/blog/how-to-choose-the-best-data-source-to-use-with-flexmonster/
Please let us know if further questions arise.
Kind regards,
Nadia
⋅ April 2, 2025
Hi Nadia,
I am using "dataSource" object for the data connection. I am passing url of file hosted on S3 in the "fileName". I tried with both CSV and JSON using the same approach and the time is almost same for downloading and rendering, while using JSON file I also added "useStreamLoader" property but this didn't help much.
Due to security reasons I don't want to put data on "Flexmonster Data Server". Is there any other way to tackle this issue?
Thanks
⋅ April 3, 2025
Hello, Vaibhav!
Thank you for getting back to us.
Please note that when working with JSON/CSV files, Flexmonster loads the whole file into the browser's memory. From our experience, files bigger than 100Mb can take some time to load and slow down the browser.
The alternatives that we can suggest to reduce the data loading time:
We think that our Flexmonster Data Server approach suits your use case well.
Regarding the security aspect you've mentioned, please note that we provide the Data Server as an executable application, which is installed on your machine, and it processes all the data on your end, so the data is not sent to any external servers.
You can find more information about the security aspect of Flexmonster on the following page: https://www.flexmonster.com/faq/#security.
Alternatively, you can write your own server and use our communication protocol to send the data to Flexmonster.
We understand that the server-side approach may look like an overkill a first glance, but if your data size tends to increase over time, we recommend giving it a second thought.
Hope you will find our answer helpful.
Kind regards,
Solomiia
⋅ April 15, 2025
Hello,
Hope you are having a great week.
We were wondering if you had a chance to check our response. Could you please confirm if the suggested approach works for you?
Looking forward to hearing from you.
Kind regards,
Nadia
