DOM: DATA_INFRASTRUCTURE
TECHNICAL_SYSTEM_MODEL

Proposed distributed coordination architecture for the etiS platform ecosystem.

This model represents the ideal long-term execution architecture originally proposed for the etiS product suite: a federated operational system separating governance, execution, tenancy, and event orchestration into independently scalable layers.

This architecture represents the proposed target system model — not the currently deployed production implementation.

CLIENT_EDGE_LAYER

Ingress, frontend delivery, and unified API entry

Operational Clients

Enterprise users

CloudFront CDN

Global edge distribution

S3 Frontend

Static application hosting

API Gateway

Unified ingress boundary

EXTERNAL_EVENT_INGESTION

Push-based operational integrations

Autodesk Webhooks

Broadcast operational events

WhatsApp Events

Directed communication events

External Integrations

Third-party platform ingress

ASYNCHRONOUS_EVENT_SPINE

Distributed Event Ingestion & Routing

Incoming webhook traffic was normalized, enriched with metadata, and distributed through broadcast or directed delivery channels depending on routing semantics.

Autodesk Webhooks
WhatsApp Events
External Integrations

Lambda Processing

Metadata enrichment, routing logic, event normalization, orchestration.

SNS Fanout

Broadcast delivery to multiple clusters

SQS Queues

Directed tenant-specific routing

CENTRAL_TRANSFORMATION_PLANE

Shared Data Processing & Semantic Normalization

Instead of duplicating transformation logic across product deployments, operational data pipelines were centralized into containerized scheduled processing infrastructure.

Transformation Ownership

Canonical processing logic shared across enterprise environments.

Centralized Compute

Heavy transformation workloads isolated from product runtimes.

Semantic Consistency

Normalized operational outputs distributed downstream.

Raw Operational Data
Cross-Product Inputs

ECS / Fargate Processing Cluster

Cron-triggered distributed transformation runtime

Scheduled ETL / ELT

Centralized cron-triggered processing

Transformation Pipelines

Shared enterprise processing logic

Semantic Normalization

Cross-product operational consistency

Selective Distribution

Only relevant outputs sent downstream

Product environments no longer owned raw transformation workloads independently. Instead, they consumed processed, operationally-scoped outputs from a centralized processing substrate.

Product-Specific Outputs

Scoped operational datasets

Normalized Serving Data

Semantically transformed outputs

Enterprise Delivery

Targeted downstream distribution

DISTRIBUTED_WORKER_EXECUTION

Stateless Event-Driven Worker Infrastructure

Worker execution was intentionally separated from product servers, allowing asynchronous operational tasks to scale independently from runtime application clusters.

Workflow Triggers
Notification Requests
Processing Outputs

Queue-Driven Worker Activation

SQS-triggered serverless execution orchestration

Email Delivery Pipelines
WhatsApp Messaging Workers
Document Processing Jobs
Notification Orchestration
Background Operational Tasks

Product clusters delegated asynchronous workloads into queue-driven execution infrastructure, reducing server coupling and allowing independent operational scalability.

Lambda Workers

Elastic serverless execution

Independent Scaling

Execution detached from product runtimes

Operational Outputs

Messaging, delivery, orchestration

TELEMETRY_AND_COMMAND_CONTROL

Unified Governance & Remote Control Loop

A bi-directional control plane ensuring that while product clusters execute independently, they remain strictly governed by platform-wide security and operational policies.

Real-time Telemetry

Resource Monitoring

Cross-tenant CPU/Mem saturation & billing quotas

Operational Logs

Centralized audit trails for all tenant activities

Policy Injection

Remote Config

Feature toggles & environment overrides

Governance Enforcement

Immediate kill-switch & RBAC policy sync

PLATFORM_CONTROL_PLANE

Centralized governance and coordination authority

Authentication
RBAC & Permissions
Tenant Governance
Licensing Services
Platform APIs

Platform Database

Shared governance state, licensing, tenancy metadata, platform coordination records.

TENANT_EXECUTION_CLUSTERS

Multi-tier product runtimes categorized by GTM strategy and SLAs

Pulse (Analytics) Cluster
Standard

Multi-tenant

Shared compute for core features

Advanced

Optimized

Dedicated resources & premium hooks

Enterprise

Isolated

Physical isolation & custom VPC

Nudge (Notifications) Cluster
Standard

Multi-tenant

Shared compute for core features

Advanced

Optimized

Dedicated resources & premium hooks

Enterprise

Isolated

Physical isolation & custom VPC

Code (Workflow Automation) Cluster
Standard

Multi-tenant

Shared compute for core features

Advanced

Optimized

Dedicated resources & premium hooks

Enterprise

Isolated

Physical isolation & custom VPC

FEDERATED_COORDINATION

Cross-cluster operational communication

Shared Governance

Platform-level control with enterprise execution autonomy

Cross-Tenant Coordination

Centralized orchestration with isolated operational runtimes

Distributed Scalability

Independent scaling boundaries for product deployments

The architecture was designed around a fundamental systems assumption:

enterprise operational environments should remain executionally isolated while still participating in a centralized coordination and governance model.

The objective was not merely cloud scalability. It was preserving coherent operational flow across independently evolving systems.

OPERATIONALLY_REALIZED_RUNTIME

Unified Operational Runtime Surface

The current runtime consolidates ingress, routing, and execution into a tightly integrated model. By utilizing colocated persistence and in-process queuing, the system minimizes infrastructure coordination costs while maintaining full enterprise VPC isolation.

Architectural Evolution

This runtime represents the currently realized operational architecture, while the previously shown federated coordination model represents the intended long-term platform direction.

Custom Ingress Surface

EC2 Routing Engine

Acting as unified API Gateway, Load Balancer, and reverse proxy for all system traffic.

API Gateway
Load Balancer
Enterprise_VPC_Boundary

Platform Operational Node

Centralized Coordination & Auth

BullMQ Central
Coordination Logic
Auth Services
Local Postgres

Colocated Persistence

Shared process resources

Enterprise Product Runtimes

Product Execution Server

Multi-tenant Enterprise Runtime

Transformation Pipelines
Notification Workers
Workflow Runtime
Local Postgres

Colocated Persistence

Shared process resources

Operational Velocity

Reducing external cloud service dependencies (SQS, Lambda, RDS) allows for immediate deployment and simpler debugging cycles during early maturation.

Infrastructure Consolidation

Custom EC2 routing provides fine-grained control over traffic steering and load balancing without the overhead of managed gateway services.

SYSTEM_EVOLUTION_MATRIX

Comparison of Architectural States

Capability
Proposed Coordination
Realized Runtime
Ingress Surface
API Gateway / CloudFront
Custom EC2 Routing Engine
Event Routing
SNS / SQS / Lambda
BullMQ / Internal Redis Bus
Worker Execution
Decoupled Serverless
Colocated Worker Threads
Transformation Pipelines
Centralized ECS Cluster
In-Process Transformation
Database Strategy
Domain-Isolated RDS
Colocated PostgreSQL
Runtime Isolation
Physical VPC Isolation
VPC-contained EC2 Nodes
Operational Complexity
High (Optimized for Scale)
Low (Optimized for Velocity)

Pragmatism in architecture is knowing when to optimize for scale and when to optimize for iteration. The realized runtime surface is an intentional choice to minimize operational surface area while the platform's semantic logic matures.