COOK CHILDREN’S
HEALTH CARE SYSTEM TIME TO DIAGNOSIS PERFORMANCE ISSUES CUT FROM DAYS TO HOURS WITH JOINT RIVERBED AND IXIA ANUE NTO SOLUTION
PIONEER IN PEDIATRIC CARE
Cook Children’s Health Care System is a not-for-profit, nationally recognized pediatric health care organization that operates a medical center, physician network, hospital, pediatric surgery center and health plan. Founded in 1918 and based in Fort Worth, Texas, the integrated system has more than 60 primary and specialty care offices throughout North Texas.
APPLICATION PERFORMANCE CHALLENGES
Networked applications, such as electronic medical records, are vital for Cook Children’s to provide outstanding service to their patients and physicians. As their network grew in complexity and some applications were remotely hosted, Ross Jones, network manager, identified a range of issues:
• End users’ perception of “slowness”.
• Lack of application performance trending: resulted in problems not being identified until customers called in with complaints.
• Root cause analysis could often go on for days.
• Challenges to monitor their network due to: need for visibili ty into multiple 10G links, high quantities of duplicate packet data, and need to share SPAN traffic with multiple tools.
JOINT RIVERBED AND IXIA/ANUE SOLUTION
After a careful search of alternatives, Ixia’s Anue Net Tool Optimizer (NTO) was implemented between network access points to enhance network traffic visibility for the Application Performance Management (APM) platform. Riverbed AppResponse Xpert was selected to meet the APM requirements.
• APM– The Riverbed Performance Management suite enabled 24x7 application transaction monitoring, packet storage, and network analysis, while providing integrated software add-ons for dependency mapping, SNMP reporting, database monitoring, and pre-deployment application testing.
• Aggregation & Filtering– The Ixia’s Anue NTO was implemented to aggregate traffic from the multiple 10G SPANs and direct it to the Riverbed AppResponse Xpert appliance after filtering out duplicate packets.
IMMEDIATE RESULTS
The joint Riverbed and Ixia solution had an immediate impact on improving networked applications performance and reducing troubleshooting time as illustrated by these two examples.
• Proactively monitor EMR application
Before the Riverbed deployment, the networking team would often not be aware of slow response time on the remotely hosted Electronic Medical Records (EMR) application until a physician would call in to complain. Once the problem was identified, it took time to sort out if the root cause of the issue was the application or the network.
This issue was resolved by baselining and continuously monitoring WAN network latency. Thresholds were set using Riverbed’s alert functionality so that the networking team can be aware of and correct potential issues before users complain. When problems do occur, MTTR is reduced by focused root cause analysis.
• Identifying source of Outlook/Exchange Problem
During a conversion from Outlook 2007 to 2010, users from different venues and desktops OS machines could not make Outlook client connections to Exchange. Utilizing Riverbed’s AppTransaction Xpert trace data to contrast good connections with failed ones, the networking team was able to see that the client was connecting to the load bala ncer, but going no further.
This information from the joint Riverbed/Anue solution was vital to discovering an exhausted connection table in the load balancer which would not allow any new backend connections. Without the solution, a difficult to find problem like this would have taken much longer to diagnose and resolve.
KEEPING UP WITH MONITORING TRAFFIC OVERLOAD
“The Anue NTO makes it extremely easy and efficient to provide our Riverbed AppResponse Xpert all the traffic it needs from anywhere in our data center,” said Ross Jones, Network Manager at Cook Children’s Health. “Removing unneeded duplicate packets was a huge benefit.”
The Riverbed AppResponse Xpert analysis is only as good as the data it receives. The appliance required input from four 10G SPAN ports from Cook Children’s Cisco 6509 and Nexus 7000 routers. 50% of the traffic from these SPAN ports consisted of unneeded duplicate packets. Duplicate packets can decrease the processing efficiency of AppResponse Xpert, or, lead to less storage capacity available for useful packets (essential for “back in time” analysis).
The Anue NTO was used to aggregate the four 10G links and remove all duplicate packets, providing the Riverbed solution complete, efficient visibility. The Anue NTO also allowed sharing of traffic from the Cisco SPAN ports with Cook Children’s other packet-based tools, which also required network access.
BENEFITS
• Faster troubleshooting by reducing problem isolation reduced from days to hours.
• Proactively seeing and resolving issues before they become problems.
• Complete network traffic visibility for application performance analysis.
• Improving efficiency of APM system by removing duplicate packets.
• No interference with other department’s network probes thanks to SPAN/Tap sharing.
“ The Anue NTO makes it extremely easy and efficient to provide our Riverbed AppResponse Xpert all the traffic it needs from anywhere in our data center. Removing unneeded duplicate packets was a huge benefit.”
“ The joint Riverbed/Anue solution has cut the time it takes to diagnose performance problems from days to hours.”