Data Reliability

Data Quality & Trust Score

Framework de calidad de datos con Trust Score automático de 0-100. Integración con Great Expectations y detección de anomalías.

Trust Score

Every dataset gets an automatic Trust Score from 0 to 100. Based on Monte Carlo's 5 Pillars of Data Observability, combining 4 key dimensions:

Freshness (25%)How recent is the data?
Quality (25%)Are checks passing?
Volume (25%)Expected row counts?
Schema (25%)Is structure stable?
90-100
70-89
50-69
30-49
0-29
87Trust Score
Enterprise Architecture

Two Approaches, One Goal

Nexion provides complementary quality validation approaches for maximum coverage. Block bad data during ingestion AND monitor what's already stored.

Standalone Rules

Monitoring & Compliance

Independent quality rules that run on-demand, scheduled, or via API. Perfect for compliance reporting and continuous monitoring.

Target: Select Data Pod → Schema → Table
Execution: Scheduled, On-demand, API
Results: Historical tracking & trends
Use Case: HIPAA/GDPR auditing

Best For

Compliance ReportsAuditingMonitoring

Pipeline Quality Gates

Real-time Validation

Inline quality checks in your data pipelines. Block bad data before it reaches your lakehouse. Automatic context from upstream nodes.

Target: Automatic from pipeline edge
Execution: During pipeline run
Results: Pipeline stops on failure
Use Case: ETL data gates

Best For

Data GatesETL ValidationReal-time

Defense in Depth

Enterprise data quality requires both approaches. Pipeline Gates block bad data at ingestion. Standalone Rules monitor what's already stored. Together, they provide complete coverage for compliance and operational excellence.

6 Quality Dimensions

Comprehensive data quality measurement across all dimensions that matter.

Completeness

Measures missing or null values across your datasets

Not null
Required fields
Minimum fill rate

Accuracy

Validates data values against expected patterns and ranges

Value ranges
Pattern matching
Reference data

Consistency

Ensures data matches across related tables and systems

Cross-table validation
Referential integrity
Format consistency

Timeliness

Tracks data freshness and update frequency

Last updated
SLA compliance
Staleness alerts

Uniqueness

Identifies and prevents duplicate records

Primary key validation
Duplicate detection
Unique constraints

Validity

Confirms data conforms to defined business rules

Data type validation
Business rules
Domain constraints
Powered By

Great Expectations Integration

Built on the industry-standard Great Expectations framework. Define expectations through the UI with 100+ rule types across 16 categories. No YAML required.

  • 100+ expectations across 16 categories
  • Custom expectations with SQL
  • Automatic profiling suggestions
  • Data docs generation

Available Check Types

Null & Uniqueness

expect_column_values_to_not_be_nullexpect_column_values_to_be_uniqueexpect_compound_columns_to_be_unique

Set Membership

expect_column_values_to_be_in_setexpect_column_distinct_values_to_equal_setexpect_column_distinct_values_to_contain_set

Numeric & Statistical

expect_column_values_to_be_betweenexpect_column_mean_to_be_betweenexpect_column_stdev_to_be_between

String & Pattern

expect_column_values_to_match_regexexpect_column_value_lengths_to_be_betweenexpect_column_values_to_match_like_pattern

Table Level

expect_table_row_count_to_be_betweenexpect_table_columns_to_match_setexpect_table_column_count_to_equal

Multi-Column

expect_column_pair_values_to_be_equalexpect_column_pair_values_A_to_be_greater_than_Bexpect_multicolumn_sum_to_equal
Enterprise-Grade

Beyond Basic Quality Checks

Nexion goes beyond traditional quality frameworks with AI-powered rules, data contracts, ML anomaly detection, and integrated observability.

AI-Powered Rules

Create quality rules in plain English. AI translates your intent into executable checks automatically.

Example:

"Check that email is never null and matches email format"

expect_column_values_to_match_regex

ML Anomaly Detection

Automatic baseline learning without manual thresholds. Detects anomalies using statistical and machine learning methods.

Z-Score detection
IQR (Interquartile Range)
Isolation Forest

Data Contracts

Define producer/consumer contracts in YAML. Automatic validation and enforcement in your pipelines.

Schema specifications
Quality SLAs
Automatic enforcement

Integrated Modules

Quality, Profiling, Lineage, and Schema work together. When quality fails, see downstream impact instantly.

Quality ↔ Lineage impact
Profiling → Check suggestions
Schema change invalidation

AI Troubleshooting

Observability agents automatically investigate quality failures and identify root causes.

Automatic root cause analysis
Suggested remediation
Historical pattern matching

Smart Notifications

Get alerted on quality issues through your preferred channels. Configurable thresholds and routing.

Slack, Email, Teams
Custom webhooks
Severity-based routing

Trust Score Components

The only composite data health score in the market. Four pillars combined into one actionable number.

Freshness

How recent is the data?

25%

Quality

Pass rate of checks

25%

Volume

Expected row counts

25%

Schema

Structure stability

25%

Unique in the market: No other platform combines these four dimensions into a single, actionable Trust Score. Know your data health at a glance.

Automatic Data Profiling

Every column is automatically profiled with statistics, patterns, and anomaly detection.

Column Profile: customer_email

PII Detected

Row Count

1,245,678

Distinct

1,198,432

96.2% unique

Null %

0.3%

Excellent

Pattern

EMAIL

99.7% match

Top Domains

gmail.com
34%
yahoo.com
18%
outlook.com
12%
company.com
8%

Anomalies Detected

3,721 invalid format emails
47,246 duplicate emails

Quality Metrics Per Run

Every pipeline run captures detailed quality metrics. Track quality over time.

Run #12847 - customer_etl

PASSED2 min ago

Quality Score

92

Checks Passed

47/50

Rows Validated

1.2M

Rows Rejected

3,721

Failed Checks (3)

expect_column_values_to_match_regex(email)3,721 failures
expect_column_values_to_be_unique(customer_id)12 duplicates
expect_column_values_to_not_be_null(phone)156 nulls

Trust your data

Start measuring and improving data quality with Nexion Trust Score.