Intelligent LogStream

Intelligent LogStream

Eliminate the observability tax, make inflight decisions to slash ingest costs

Decisive Log Governance

Control Log Noise and Costs On the Wire with SmartHub

Conceptual overview of Intelligent LogStream
For years, enterprise logs have been a double-edged sword: vital for incident response, yet costing millions annually due to massive, unmanaged volumes.
MyDecisive's SmartHub solves this issue by providing a fully programmable, preconfigured solution to manage the log signal-to-noise ratio and powered by the streaming core of our SmartHub for Telemetry.
Get started with docs

Separate Action from Analysis:

The MyDecisive Log Paradigm

Extracting maximum value from your logging platform today requires the ability to act on data without incurring high costs associated with indexing and retention. MyDecisive’s SmartHub stands out by fundamentally separating Action/Alerting from Storage/Analysis.

Traditional logging platforms necessitate ingestion, indexing, and payment for all log data before any basic actions, such as alerting or filtering, can be executed. This method is not only costly but often depends on static filters that are incomplete and discard data indiscriminately at the source.

In contrast, SmartHub employs in-stream, full-scale processing to facilitate immediate, programmable actions like real-time alerting, automation triggers, or PII redaction on log lines. Once actions are taken, these log lines can be directed to the most cost-effective storage for long-term analysis or discarded entirely. This approach ensures you do not pay to index and store irrelevant data just to alert on a small fraction of signals, offering unparalleled control and real-time response at the lowest total cost of ownership in the market.

Key Capabilities of the SMARTHUB

Cost Savings & In-Stream Log Governance

MyDecisive ensures you store only the logs you need - and decide to - from every service, precisely where you want them, effectively separating storage decisions from operational actions.

Determining which logs to retain and which to discard before they leave your network is critical. SmartHub inspects each log line at full scale, in-stream, before transmission, helping you avoid unnecessary and costly ingestion charges.

Separate storage from actions by keeping critical logs in your SaaS vendor for real-time indexing while routing compliance-required logs to a cost-effective platform like S3 or object storage. This approach helps you bypass vendor ingestion fees and manage long retention challenges.

Enable alerts directly on log data in-stream without the need for prior ingestion and indexing. You can replay those logs to your SaaS vendor as part of the action if desired.

Establish distinct, service-specific policies to categorize log lines as critical, nice-to-have, or pure noise.

Compliance and Cost Savings Through Log Routing

Meeting compliance regulations like HIPAA, PCI-DSS, or SOX necessitates retaining log data for extended periods, often up to 7 years. This often leads to significant costs due to per-GB ingestion and storage fees charged by SaaS observability vendors.

The SmartHub's log routing capability addresses this challenge by enabling organizations to enforce retention and access policies tailored to the type and sensitivity of the log data. This ensures compliance while managing costs effectively.

How MyDecisive SmartHub Routing Solves the Compliance-Cost Conflict

Log CategorySaaS Vendor DestinationLow-Cost Destination

Operational/Debugging Logs

YES. Required for real-time indexing, alerting, and rapid troubleshooting like HTTP errors, application traces.

NO. High volume, low long-term retention value.

Security/Audit Logs

YES (Short Term). Needed for immediate security incident detection and correlation like failed logins.

YES (Long Term). Required for 7-year compliance archives. Log is routed to both destinations.

PII/PHI Logs

NO. Logs containing sensitive data (unless fully redacted) don’t enter third-party platforms.

YES (Securely). Routed only to an internal, encrypted, cost-effective storage for compliance and audit-only access.

Pure Noise Logs

NO. High volume, low signal-to-noise.

NO. Discarded entirely in-stream to save all costs.

SmartHub Compliance Benefits

Cost Separation

Pay your SaaS vendor only for the high-value logs necessary for active indexing and action (alerting, dashboards). For long-term compliance archives stored internally on S3, you only incur costs of cents per GB.

PII Control

Log filtering and redaction modules ensure that logs containing sensitive information are excluded from the third-party vendor, significantly reducing risk exposure.

Retention Management

Now you can avoid a vendor's arbitrary retention window, which often lasts from 90 days to 1 year. Instead, you can easily manage compliance archives within your own S3/storage bucket for the full required duration.

Zero Ingestion Cost

Route logs directly to cold storage, effectively bypassing the costly cycle of Ingest → Index → Store that is common in legacy solutions, ultimately reducing compliance costs.

Stop Paying the 'Tax' on Unmanaged Logs

See the solution now
For Media Inquiriespr@mydecisive.ai
Support via Slack

We will respond within 48 business hours

Core Business Hours

Monday - Friday

9am - 5pm PDT

LinkedIn logoGithub logoYouTube logoSlack logo