#Observatory Overview - Test Analytics Dashboard

Observatory is an advanced analytics and data visualization platform that helps you create custom dashboards with interactive charts and insights. It enables you to visualize test case data, execution results, requirements, and defects through various chart types, helping you understand trends, patterns, and metrics at a glance.

#Core Concepts

#What is Observatory?

Observatory is a data visualization and analytics tool that allows you to:

• Create Custom Dashboards: Build personalized dashboards with multiple charts
• Visualize Data: Transform raw data into meaningful visualizations
• Track Metrics: Monitor key performance indicators and trends
• Gain Insights: Discover patterns and insights from your test data
• Share Analytics: Share dashboards with team members

#Panels

Panels are containers for organizing multiple charts into cohesive dashboards. Each panel:

• Has a title and description
• Contains one or more charts
• Can be organized by theme or purpose
• Provides a focused view of specific metrics

Use Cases:

• Release metrics dashboard
• Test execution analytics
• Defect tracking dashboard
• Requirements coverage analysis

#Charts

Charts are individual visualizations that display data in various formats:

• Bar Charts: Compare values across categories
• Line Charts: Show trends over time
• Pie Charts: Display proportions and distributions
• Doughnut Charts: Similar to pie charts with center space
• Stacked Bar Charts: Show multiple series stacked together
• Radar Charts: Compare multiple variables

Each chart:

• Connects to a data source (Repository, Executions, Requirements)
• Has configurable X and Y axes
• Can be customized with titles and settings
• Updates automatically as data changes

#Data Sources

Observatory supports three main data sources:

Repository:

• Test case data from your repository
• Metrics: Priority, Severity, Test Type, Automation Status
• Use for: Test case distribution, automation coverage, priority analysis

Executions:

• Test run and release execution data
• Metrics: Test case counts, status, defects, requirements
• Use for: Execution trends, test results analysis, defect tracking

Requirements:

• Requirements data
• Metrics: Count, status, coverage
• Use for: Requirements coverage, status distribution

#Accessing Observatory

#To access Observatory:

1. Navigate to your workspace
2. Select a project from the project list
3. Click on Observatory in the project sidebar navigation

The Observatory page displays all panels in a grid layout, showing panel cards with titles, descriptions, and chart counts.

#Viewing Panels

#Panels Grid

The panels grid displays:

• Panel Cards: Each card shows:
  • Panel title
  • Description (truncated if long)
  • Number of charts in the panel
  • Actions menu (Edit, Delete)

#Panel Card Actions

Each panel card has an actions menu:

• View Panel: Click the card to open the panel dashboard
• Edit Panel: Edit title and description
• Delete Panel: Remove panel and all its charts

#Search and Filter

Use the search box to find panels by:

• Title
• Description

The search is case-insensitive and matches partial text.

#Panel Dashboard

#Opening a Panel

Click on any panel card to open its dashboard. The dashboard shows:

Header:

• Panel title
• Back button to return to panels list
• “Add Chart” button

Charts Grid:

• All charts in the panel
• Arranged in a responsive grid (2 columns on desktop)
• Each chart is interactive and can be:
  • Viewed in fullscreen
  • Edited (title and type)
  • Deleted

Empty State:

• If no charts exist, shows a message
• Provides “Create Your First Chart” button

#Creating Charts

#Chart Creation Methods

Observatory offers two ways to create charts:

Smart Insights:

• Pre-configured chart templates
• Quick setup with recommended visualizations
• Ideal for common analytics needs
• One-click creation

Custom Builder:

• Full control over chart configuration
• Choose data source, axes, and chart type
• Customize title and settings
• Ideal for specific requirements

#Chart Configuration

When creating a chart, you configure:

Title: Descriptive name for the chart

Data Source: Repository, Executions, or Requirements

X-Axis: Primary dimension (e.g., Priority, Status, Test Type)

Y-Axis: Metric to measure (e.g., Count, Severity, Automation Status)

Chart Type: Bar, Line, Pie, Doughnut, Stacked Bar, Radar

Note: Available chart types depend on the selected data source and axes combination.

#Chart Types

#Bar Chart

• Use For: Comparing values across categories
• Best For: Single series data, discrete categories
• Example: Test cases by priority, defects by status

#Line Chart

• Use For: Showing trends over time
• Best For: Time series data, continuous trends
• Example: Test execution trends, defect resolution over time

#Pie Chart

• Use For: Showing proportions and distributions
• Best For: Single series, percentage breakdowns
• Example: Test case distribution by type, defect status breakdown

#Doughnut Chart

• Use For: Similar to pie chart with center space
• Best For: Summary views, single series
• Example: Requirements coverage, automation status

#Stacked Bar Chart

• Use For: Comparing multiple series across categories
• Best For: Multi-series data, category comparisons
• Example: Test cases by priority and severity, execution status by release

#Radar Chart

• Use For: Comparing multiple variables
• Best For: Multi-dimensional comparisons
• Example: Test coverage across multiple dimensions

#Data Source Details

#Repository Data Source

Available X-Axis Options:

• Priority
• Severity
• Test Type
• Automation Status

Available Y-Axis Options:

• Count
• Severity
• Priority
• Test Type
• Automation Status

Supported Chart Types:

• Bar, Line, Pie, Doughnut, Stacked Bar

Use Cases:

• Test case distribution by priority
• Automation coverage analysis
• Test type breakdown
• Severity distribution

#Executions Data Source

Available X-Axis Options:

• Testcases
• Defects
• Requirements

Available Y-Axis Options:

• Count
• Status
• Priority
• Severity
• Test Type
• Automation Status

Supported Chart Types:

• Bar, Line, Stacked Bar, Pie, Doughnut

Use Cases:

• Test execution trends
• Defect tracking in executions
• Requirements coverage in test runs
• Execution status distribution

#Requirements Data Source

Available X-Axis Options:

• Requirements

Available Y-Axis Options:

• Count

Supported Chart Types:

• Bar, Line, Pie, Doughnut

Use Cases:

• Requirements count over time
• Requirements distribution
• Requirements coverage

#Best Practices

#Panel Organization

1. Thematic Grouping: Group related charts in the same panel
2. Clear Titles: Use descriptive panel titles
3. Descriptions: Add descriptions to explain panel purpose
4. Logical Flow: Organize panels by workflow or team needs

#Chart Design

1. Appropriate Chart Type: Choose chart type that best represents your data
2. Clear Titles: Use descriptive chart titles
3. Meaningful Axes: Select axes that provide insights
4. Data Source Selection: Choose data source relevant to your analysis

#Dashboard Usage

1. Regular Updates: Charts update automatically as data changes
2. Share Insights: Share panel links with team members
3. Monitor Trends: Use charts to track trends over time
4. Identify Patterns: Look for patterns and anomalies

#Use Cases

#Release Analytics

Panel: “Release Metrics Dashboard”

Charts:

• Test cases executed by release (Bar Chart)
• Execution status trends (Line Chart)
• Defect status distribution (Pie Chart)
• Requirements coverage (Doughnut Chart)

Purpose: Track release progress and quality metrics

#Test Execution Monitoring

Panel: “Execution Analytics”

Charts:

• Test runs over time (Line Chart)
• Execution status breakdown (Stacked Bar Chart)
• Test case distribution by priority (Bar Chart)
• Defect trends in executions (Line Chart)

Purpose: Monitor test execution progress and results

#Test Case Analysis

Panel: “Repository Insights”

Charts:

• Test cases by priority (Bar Chart)
• Automation coverage (Pie Chart)
• Test type distribution (Doughnut Chart)
• Severity breakdown (Bar Chart)

Purpose: Understand test case composition and coverage

#Requirements Tracking

Panel: “Requirements Coverage”

Charts:

• Requirements count over time (Line Chart)
• Requirements distribution (Pie Chart)
• Requirements in executions (Bar Chart)

Purpose: Track requirements coverage and status

#Permissions

Observatory is subject to project-level permissions:

• View Observatory: View panels and charts
• Create Panels: Create new panels
• Edit Panels: Modify panel details
• Delete Panels: Remove panels
• Create Charts: Add charts to panels
• Edit Charts: Modify chart configuration
• Delete Charts: Remove charts

Permissions are managed at the project level through roles. Contact your project administrator if you need additional permissions.

#Next Steps

• Learn about Panels to create and manage dashboards
• Explore Charts to create visualizations
• Check out Test Runs to understand execution data
• Review Repository to understand test case data