Report Testing

Report testing basic scenarios:

1.Verify data shown on the dashboard/reports are as expected.

2.users can see reports according to their user profile(check authentication and authorization)

3.verification of appropriate report layout to ensure it's in synch with the original document

4.verification on the accuracy and completeness of the reports

5.verify drill through reports,cross tab reports,parent/child reports etc to see if they are all working as expected

6.'Analysis functions' and 'Data Analysis' should be working

7.Previewing and/or exporting of reports to different formats such as spreadsheet,PDF,html,e-mail etc to ensure two things:

a.report layout in the new format is not distorted

b.data shown are accurate and consistent

8.if a report shows graph as well as related data in tabular format,then both should reflect consistent data.

9.Create SQL?MDX queries to fetch the data in tabular format,then both should reflect consistent data

10.verify the reports to ensure the data shown on the reports are consistent with what are beeing  supplied by upstream systems(could be oltp database, datamart, dwh,cube,etc..) data from the upstream could be extracted using the sql/mdx as specified in point 9.

11.verify calculations or business rules(if any) that applies to the underlying data(eg. check business formula that applies to a metric/KPI etc)

12.verify report level rules/validations/errors/warnings. for example-error message for wrong input, optional/mandatory prompts, 'No Data' warnings, field/prompts validation etc.

13.verify usability of reports(e.g. general appearance(color,look and feel), navigation etc)

14.verify performances of report.

In General Test scenarios for reports
Headers and Footers:

1)Is there a report title?
2)Is the report title centered? Is it underlined?
3)Was the correct font used for the Report Title?
4)Is the last report refresh datetime displayed in the right corner of page header?
5)Is the report data refresh date displayed in the right corner of the page header?
6)Was the correct  font (for ex:Arial Narrow 9) used in the page header?
7)Was the correct(for ex:Arial Narrow 7) font used in the page footer?
8)Does the footer include the page number and # of pages?
9)Does the footer contain text (for ex:" Confidential")?
10)Does the footer contain "XYZ Company”?

11)Does the “XYZ Company” text appear in blue color?

Report Body/Formatting:

1)Was Arial Narrow 9 font used for column/data headers?
2)Was Arial Narrow 9 font used for data fields?
3)Were commas used for numbers (ex 2,000)?
4)For percentages, was the % sign included in either the table header or in each corresponding data cell, as well as any subtotals and grand totals?
5)For percentages and currency, was the decimal limit set to two?
6)For currency, was the correct currency sign included in each cell, subtotal, and grand total?
7)For percentages and currency, were parenthesis used for negatives?
8)Was the format "dd mon yyyy" (ex 29 Jul 2009) used for dates?
9)Was 24 hour military time used?
10)Were column headers centered?
11)Were row labels left justified?
12)Was text data left justified?
13)Was numeric data right justified?
14)Was calculated data right justified?
15)Were domestic phone numbers formatted like 999-999-9999?


Readability & Accuracy:

1)Are prompt names meaningful?
2)Is the overall report readable (e.g. does shading print appropriately)?
3)Does the report print out in the required format(s)?
4)Has the report been checked for spelling and grammatical errors?

5)Does the report name conform to Centre Of Excellence(COE) report naming standards?

Query Design:

1)Is the data drawn from the appropriate source (e.g., does the data come from the folders that provide accurate results and optimum performance)?

2)Are all of the queries named?

3)Are the query results correct? Have they been checked against an appropriate source?

4)Is the performance acceptable?

Dashboard Testing scenarios:

1)Verify data shown on the  dashboard/reports  are as expected

2)Users can see reports according to their user profile (check authentication and authorization)

3)Verification of appropriate report layout to ensure it’s in synch with the original requirement. 

4)Verification on the accuracy and completeness of the reports 

5)Verify drill through reports, cross tab reports, parent / child reports etc to see if they are all working as expected 

6)'Analysis Functions' and 'Data Analysis' should be  working

7)Previewing and/or exporting of reports to different formats such as spreadsheet, PDF, html, e-mail etc to ensure two things: 

8)report layout in the new format is not distorted 

9)data shown are accurate and consistent 

10)If a report shows graph as well as related data in tabular format, then both should reflect consistent data 

11)Create SQL/MDX queries to fetch the data from the source to compare and validate with the target (in our case ‘reports’).

12)Verify reports to ensure data shown on the reports are consistent with what are being supplied by upstream systems (could be OLTP database, datamart, datawarehouse, cube etc.). Data from the upstream systems could be extracted using the SQL/MDX as specified in point 9.

13)Verify calculations or business rules (if any) that applies to the underlying data (e.g. check business formula that applies to a metric/KPI etc)

14)Verify report level rules/validations/errors/warnings. For example - error message for wrong input, Optional/Mandatory prompts, ‘No data’ warnings, Field/Prompts validation etc. 

15)Verify usability of reports (e.g. General appearance(Color, look and feel), Navigation etc)

16)Verify performances of report 

17)Reference data check, validate the report data as per records in reference table.