Facing issue : System.MemoryOutOfException error
I have created a SSRS report in report builder with a Table consisting of 350 columns and 1.4+ million records, data is coming from a parallel processing SQL server database.
Data from all 350 columns needs to be displayed in table in report and it is getting filtered through 8 query parameters.this comes becomes business wants to export the data and compare within different matrices.
Please suggest any performance improvement tips or tools which can be used to achieve above results. The only condition the data cannot be reduced we need to all the records in tables.
Related
I am looking for a way to store auto-generated reports. There are about 10-15 columns and 100-3000 rows depending on the report but each report is consistent in column count.
I am looking for a way to organise and store these reports into a large group without creating an entire new database and 1000s of tables to store each indervidual report.
The reports need to be queryable so they can be subdivided by team/area/person etc as each report can be a combination of 3-4 different sub-reports depending on how you split/sort the data.
I am using Python to collect and sort the data from the database so using MariaDB/MySQL would be preferred but im happy to use something else if there is a pre-exising connection libary for it.
To sum up i need something similar to a excel spreadsheet with each table being a sheet and sheet name being the date it was generated so i can select by the date generated.
Think through the goals.
Is this a legal issue -- you need to produce an unalterable report as something "official". A la a non-editable .pdf?
(at the opposite extreme) Be able to generate (or regenerate) any report for any timeframe.
Is performance an issue? (Either perceived or real)
I like to build and maintain Summary Table(s) for any "Data Warehouse" application. And build "reports" that take as a parameter a date range and a small number of other things. And have the report generation so fast that it does not matter if multiple people are pulling reports at random times.
15 columns and 3000 rows is usually excessive. If pulling a report is trivial enough, it can be less 'massive'; just get the parts you want, without such bulk.
http://mysql.rjweb.org/doc.php/summarytables
I have 3 different datasets and each having a different table and a parameter which is having 3 values, for each value it has to call one dataset and as well as the related table to that dataset what can be done to make it possible.
I have a bear of a problem here. The user wants a report that shows the earnings, deductions and liabilities (EDL) code of each employee or null/blank if an EDL code doesn't apply to that employee. I needed one row for each employee name and columns for each possible EDL code combination. I got that answer fixed from my previous question here:
Struggling with a dynamic pivot on multiple columns with one being concatenated
I ran into a problem where there are a potential 270 column headings (EDL code combination with "subj", "elig" or "amt" appended) but not every employee will have a value for every column and security settings lock me out of seeing 1 of the 3 payroll groups. This made my report very limited in that when I ran it I could only show on the Crystal Report the data for what columns I had at the time I created the Crystal Report. Well, the user who requested this report has access to payroll group 1 and if even one of those employees had an EDL code that I didn't have in my data when I created the Crystal Reports file then the report wasn't useful to the user. We figured a way for her to get the info she needed by her logging into SQL Server and executing the stored procedure and she did what she needed to do with the data.
Fast forwarding to today I have to create this as a report in SSRS or give detailed instructions on how she can do this in the future if need be since my contract is coming to an end. I'm not familiar with SSRS but I thought maybe that would meet her needs over Crystal Reports. However, I'm running into the same problem. When I add the stored procedure as a dataset (adding it in as text to execute, not clicking the stored procedure radio button) I only see the EDL codes from that particular query not all potential combinations. I need a way to maybe dynamically add columns to the SSRS report, does such a thing exist?
I have a dataset which has the data to be used in by several tables in my 2012 SSRS report.
Each table uses a different set of rows in the dataset, i.e. where a particular column in the dataset has a particular value.
I would like to grab all the data to be used by all the tables in one go, and then have the tables use the dataset's data, filtering by this particular column.
Unfortunately, it looks like the report fetches data into the dataset every time each table needs to be populated.
Is there a way I can get the table to use the data that has already been fetched into the dataset without it making the report refetch data into the dataset?
I am developing an web app that is reliant on reports being dynamically generated. The client has specified they would like to save reports searches to the database for future use, specifically generating reports from the last 6 month.
I can add the query to the database no bother, the problem is trying to get the date to be dynamic depending on the date the report is ran. The 3 types are bi-monthly, monthly and 6 monthly reports.
My question is:
How would I go about saving the query and getting it to calculate the current date and search based on the report type (2, 3 or 6 month). Is it a simple case of editing the sql query when I pull the query from the database, or would it be easier to split up the query into different parts to make it easier to manipulate/edit later.
Create a second column in your table where you store the query with the dynamic column. Use that column in your dynamic query