During my consulting work with a large UK enterprise, I was involved in performance evaluation and tuning of a mission-critical, monolithic JEE application operational for over 10 years. This article shares key observations, root causes, and modern architectural solutions for request throttling and system scalability.
Application Architecture Baseline
- One of the largest enterprise systems of its kind globally (exceeding half a Terabyte in Relational Database storage).
- Built with EJBs, JPA 2.0, Struts, GlassFish Cluster Server, Linux CentOS, and Oracle JDK 8.
Key Bottlenecks Observed
Even with an aggressively sized thread pool and vertically scaled high-memory hardware, incoming requests queued up at the processing layer, triggering cascading timeouts due to stateful clustering limitations on GlassFish application servers.
Relational database queries took unusually long due to multiple complex joins spanning millions of records, generating heavy lock contention, transaction bottlenecks, and eventual thread exhaustion.
Build Scalable Web Applications with Modern Tech Stacks
Master full stack architecture, Next.js, React, Node.js, and GenAI integration for enterprise-grade scalability.
Investigation & Modern Scalability Solutions
- Search Engine Indexing: Isolated heavy full-text database queries and migrated search workloads to a dedicated search indexing cluster (Elasticsearch/Solr).
- Query Optimization & Read Replicas: Refactored frequently executed queries, introduced query caching, and redirected read traffic away from the primary transactional database.
- Event-Driven Big Data Streaming: Implemented an asynchronous streaming pipeline using Apache Kafka + Apache Flink for real-time telemetry and asynchronous updates.
- Frontend Decoupling: Migrated from monolithic server-rendered Struts views to modern single-page frontend architecture (Angular / Node.js) with containerized deployment via Docker and Kubernetes.
- Microservices Decomposition: Split monolithic domains into independently deployable microservices backed by high-performance caching (Redis) and NoSQL stores (MongoDB).
Gireesh Babu
25+ years experienced Senior Technical Architect, TOGAF Enterprise Architecture certified, Oracle Java certified, AI & Big Data mentor and founder at Expertzlab.Read more