asked on August 26, 2020
we are getting Dataset is too large popup and browser getting stuck for few seconds.
Q1 : is anyway to remove/ disable / hide the warning popup?
Q2 : how can we resolve the browser stuck issue ?
⋅ August 28, 2020
Hello!
Thank you for your questions.
display: none for the pop-up and the element before it in the CSS file. Please note that this approach will hide all Flexmonster pop-ups.
expandAll, which is a heavy operation. Its speed depends on the number of members and hierarchies in the slice. Therefore, if you have slice.expands.expandAll in the Report Object set to true, we kindly recommend defining it as false. This will help the component to process your data.
Please let us know if it helps and in case additional questions arise.
Best regards,
Milena
⋅ September 7, 2020
Hello, Ravi!
We are just checking in to ask if you’ve found our response helpful.
Have you tried hiding the pop-up or resolving the browser stuck issue using the suggested approaches?
Looking forward to your response.
Kind regards,
Milena
⋅ September 7, 2020
Hello Milena,
Thanks for Checking our status,
Actually still we are struggling with handling large data sets.
anyway, bellow is the Questions relevant to these Topics.
1. What is the Data Limit to Load the Pivot for a smooth process?
a. how are you measuring the pivot is having large data sets
b. we are using custom expand/collapse over the expand all. do we have any row/column-wise config to do the expand or collapse instead of saving tuples into the Database?
2. While processing Large Data sets - we can't do any pivot operations.do we have any solutions?
3. How many instances can we process in time?
4. If suppose - we are choosing the Custome Data Source API for Such Large Data sets then what is the alternate solution to use getData with the slice?
Thanks Again!
⋅ September 9, 2020
Hello,
Thank you for giving an update on the issue and for your questions.
1. What is the Data Limit to Load the Pivot for a smooth process?
Being a client-side component, Flexmonster relies on resources available to the browser, which affects the loading time and the maximum size of the data that can be handled on every particular machine. This means that the client machine’s RAM determines how much data can be loaded at once, and CPU capabilities affect how much time is spent on data processing. Therefore, we kindly suggest testing the data limit on your side.
a) how are you measuring the pivot is having large data sets
We would like to mention that Flexmonster is not measuring the dataset. The component will be loading the data as long as there are enough resources of the browser and RAM.
At the same time, some heavy operations such as expandAll can lead to exceptions and page crashes. If the expand operation takes too much time to complete, Flexmonster aborts it and shows "dataset is too large" alert. It allows avoiding page crashes and errors.
Also, we have received your question regarding the browser stuck problem in another thread, so we will provide more details on this in that thread.
b) we are using custom expand/collapse over the expand all. do we have any row/column-wise config to do the expand or collapse instead of saving tuples into the Database?
It seems like we have answered a similar question on the forum. Please have a look at this thread.
2. While processing Large Data sets – we can’t do any pivot operations.do we have any solutions?
The pivot operations should be available as soon as data is loaded and processed. If this does not answer your question, please provide more details.
3. How many instances can we process in time?
We would like to explain that the maximum number of instances depends on the browser and RAM capabilities, so there is no specific number. Our team recommends trying to add several instances and test the page behavior.
4. If suppose – we are choosing the Custome Data Source API for Such Large Data sets then what is the alternate solution to use getData with the slice?
The alternative solution to using getData with a slice is creating multiple Flexmonster instances with different slices specified. You could hide them on the screen, so only charts that are connected to them will be displayed.
Taking into account your case, we would like to recommend using Flexmonster Data Server to fix the issue. The Data Server is a special server-side tool responsible for fetching data from a data source, processing, and aggregating it. For every expand there will be a request performed, and Flexmonster will not need to load all data initially. Please see further details about the Data Server here.
Hope it helps. Do not hesitate to contact us in case any other questions arise.
Kind regards,
Milena
⋅ September 17, 2020
Hello, Ravi,
We were wondering if our response helped you with your question.
Have you tried connecting to a data source using Flexmonster Data Server?
Please let us know what you think about our suggestion.
Kind regards,
Milena
⋅ September 18, 2020
Hello Milena,
We are happy to implement Flexmonster Data Server, but there are some roadblocks to implementing this.
1. We had Customized Expand / Collapse Functions for individual rows and columns. since you are not supporting to have a config to handle individual row/ columns functions. so for avoiding to save tuples into our Database we added custom functions to achieve individual expand/collapse with help of "expand all" functions.
for the reasons, we are using "expand all" in all the pivot tables.
so is there any way to fulfill our needs in Flexmonster Data Server concepts?
2. We are getting pivot data by using GetData() function to plot some chart types of highcharts.so for that we are changing the slice and again calling GetData() to plot charts without changing the Pivot View. by the way we are presenting both Table and Chart in a single view. so we can't have one more pivot instance for charts in hidden view, it will cause the browser performance since already we are facing some performance issue for a single instance.
Is there any way to get the Data from GetData() with slice?
⋅ September 22, 2020
Hello, Ravi,
Thank you for giving an update on your progress.
Flexmonster’s API calls are fully compatible with the Data Server technology. Therefore, your custom functions based on our API will work. Please kindly note that for every expand and collapse Flexmonster will perform a request to the Data Server.
Please let us know if any additional questions arise.
Best regards,
Milena
⋅ September 22, 2020
2. The Data Server approach does not allow using getData with a slice different from the current slice. So we suggest either creating one more instance or using a CSV/JSON data source.
this is not possible in our end. it will cause the browser performance while have large datasets. for the reason only we are looking "Flexmonster Data Server" concepts
⋅ September 23, 2020
Hello, Ravi,
Thank you for your response.
Please note that Flexmonster Data Server processes the data on its side allowing Flexmonster to handle larger datasets. Therefore, the approach with the Data Server and two Flexmonster instances may be more efficient for the browser than with CSV/JSON data source and one instance.
Accordingly, we would like to suggest testing this approach on your dataset.
Please let us know what you think on this matter.
Best regards,
Milena
⋅ September 30, 2020
Hey Milena Pechura,
Thanks for your answer, let us try that
⋅ October 15, 2020
Hi, Ravi,
Hope you are doing well!
Have you tried the approach with the Data Server and two Flexmonster instances?
Please let us know if it improved browser performance.
Kind regards,
Milena
⋅ November 3, 2020
Hello, Ravi,
How are you?
We are just checking in to ask if you had a chance to test the suggested approach.
Our team would be happy to hear your feedback.
Best regards,
Milena
⋅ February 24, 2021
Hello,
We not yet choose to use the Data server approach. it seems costly work needs to do in our product. Thanks for your response.
⋅ February 25, 2021
Hello, Ravi,
Thank you for informing us about your decision.
In case you reconsider using Flexmonster Data Server, do not hesitate to contact us and ask any questions.
Our team will be glad to assist you.
Regards,
Milena