Wednesday, May 11, 2016

Blueprint: The Rise of the Network Monitoring Engineer

by Patrick Hubbard, Head Geek, SolarWinds

Today’s network engineers experience tremendous complexity, in part due to increasing demand, but also given the diversity of protocols and the high number of multi-tier applications that are often outside of their control. Combined with improved automated failover it’s become impossible (except in the largest of organizations) for network administrators to be highly specialized, meaning the days of being a router jockey are gone.

Network administrators today are stuck between everyday tasks of change management, hardware refreshes and strategic changes required to support new business initiatives, and the on-demand troubleshooting work they are asked to do. On top of this, automation encourages IT managers to streamline their teams, so as network complexity increases, paradoxically the number of people available to help address these tasks is actually decreasing.

But this doesn’t mean the future of network administration is bleak. There are a number of ways network engineers can improve their skills and remain relevant to their organizations, especially at a time when hybrid IT is taking center stage. According to the most recent SolarWinds IT Trends Report, just nine percent of North American organizations have not migrated at least some infrastructure to the cloud and nearly all IT professionals say adopting cloud technologies is important to their organizations’ long-term business success.

Networking in a Hybrid Environment

In such complex environments, network administrators need the ability to view performance, traffic and configuration details of devices both within and outside their traditional networks. However, hybrid IT means network administrators have much more opacity or outright lack of control over the resources in the cloud that they need to manage and monitor.

Because the end user expectation that IT be able to assure delivery of services is the same for on-premises and cloud, this can be frustrating. It’s exacerbated by cloud service providers who include proprietary monitoring and management tools, but are not vendor-agnostic.  They actually create extra work for administrators who must flip between multiple dashboards without the benefit of holistic views that would allow them to troubleshoot quickly.

Often, such tools also spew alerts without indicating what might be causing the issue. For example, for an application running in the data center, network administrators have visibility into every network layer required to host the hypervisor. However, when that application is moved into the cloud, network administrators lose the administrative authority to be able to easily monitor.  They require a new way to monitor in order to keep the same rich visibility if it were on-premises.

Administrators still need to monitor interface performance, as well as identify service delivery issues as part of the path connecting the service to the end user. New technologies have become available that reveal the physical connectivity of the service components and end uses who might be experiencing poor performance.

So while using disparate vendor-provided tools may be cost-effective in the short term, having a large number of disparate solutions is its own kind of trouble—it doesn’t lend itself to a coherent, integrated alerting and notification strategy that allows administrators to stay on top of performance, ultimately costing time and money in the long term.

The Rise of the Dedicated Monitoring Engineer

Hybrid IT is drawing attention to the need for a new approach to monitoring and management essentials. Enter monitoring as a discipline, which varies from simple monitoring in that it is the defined role of one or more individuals within an organization. A designated monitoring engineer is able to work across systems and environments, thereby removing network and data center silos and gaining the able to turn data points generated by monitoring tools into actionable insights for the business.

Hiring a monitoring engineer or better yet, a team of monitoring engineers, should be considered a critical investment in services and business success. It’s one thing to say that companies need a certain headcount in order to maintain a business and keep the lights on, but another thing entirely when it comes to IT, which is largely viewed as a cost center, and every year most departments are exceeding budgets. However, enlightened companies are beginning to view monitoring as a cost-effective way to achieve greater IT ROI. Instead of purchasing ad hoc tools to keep an eye on their technology, progressive companies have figured out a way to bring discipline and structure to their monitoring practices via staffing and resources. For the right organization, this would be a team of monitoring engineers each with their own specialization—network monitoring, systems monitoring, etc.—but who work in lockstep from a “single point of truth” when it comes to overall infrastructure performance.

How to Make the Business Case for a Monitoring Engineer

With accelerating IT complexity in mind, it’s important that IT management begin to instill monitoring as a discipline principles within the business. IT professionals are already strapped for time and resources, and management needs to step in to help evangelize internally, offer examples and best practices and put budget for new tools and technologies behind these efforts in order to achieve the full benefit of monitoring as a discipline. Management must make a strong business case that the monitoring engineer or engineers will achieve ROI for not only the IT department, but the organization as a whole.

Critical Monitoring Engineer Skills

Although monitoring engineers must possess basic network engineering skills, there are a few particular skillsets in addition that are necessary to be truly successful in the role. These include:
  • A programmer’s eye towards customization and a willingness to improve – Often, we buy technology that’s custom-made and use it right out of the box. But the most successful monitoring engineer will turn their eye towards improving it all the time.
  • An analyst’s eye for data – Instead of simply poring over endless numbers in a spreadsheet, a monitoring engineer should be able to take a step back, look at the bigger picture and ask themselves what their “customers” will be using their monitoring reports for and how they should be visualized. And they must remember, less is more. 
  • On top of cultivating their skills with experience, studying is key – The best way to hone skills is to learn on the fly, as well as spend more than a few lunch breaks and evenings testing new technologies and processes in a lab environment. 
Our networks are growing in complexity as they become further tied to all elements of the IT environment, extending all the way to cloud. IT management should seize this opportunity to return as much value as possible out of existing technology by hiring a monitoring engineer or a monitoring team with at least one individual focused on the network that works in tandem with existing teams to holistically monitor the performance of the entire IT infrastructure.  Whether on-premises or in the cloud, these resources maintain an eye towards improving existing systems, delivering promised ROI and driving repeatable progress for the business.

About the Author

Patrick Hubbard is a head geek and senior technical product marketing manager at SolarWinds. With 20 years of technical expertise and IT customer perspective, his networking management experience includes work with campus, data center, storage networks, VoIP and virtualization, with a focus on application and service delivery in both Fortune 500 companies and startups in high tech, transportation, financial services and telecom industries.

About SolarWinds

SolarWinds (NYSE: SWI) provides powerful and affordable hybrid IT infrastructure management software to customers worldwide from Fortune 500® enterprises to small businesses, government agencies and educational institutions. We are committed to focusing exclusively on IT Pros, and strive to eliminate the complexity that they have been forced to accept from traditional enterprise software vendors. Regardless of where the IT asset or user sits, SolarWinds delivers products that are easy to find, buy, use, maintain and scale while providing the power to address all key areas of the infrastructure from on premises to the cloud. Our solutions are rooted in our deep connection to our user base, which interacts in our thwack online community to solve problems, share technology and best practices, and directly participate in our product development process. Learn more today at

Got an idea for a Blueprint column?  We welcome your ideas on next gen network architecture.
See our guidelines.

Telia Carrier Brings its 100G Backbone to CyrusOne Data Centers

Telia Carrier is bringing its global IP network to CyrusOne, one of the largest carrier-neutral data center providers in the United States.

Telia Carrier's global IP network, AS1299, offers CyrusOne customers immediate 100G availability scalable to multi-terabit capacity, and includes the benefits of the wholesale carrier's Wavelength, IP, and Ethernet services. Telia Carrier owns and operates its global network.

"As one of the leading providers of colocation services for large enterprise customers, CyrusOne provides a unique opportunity for Telia Carrier to expand into previously untouched verticals," said Ivo Pascucci, regional director, Americas at Telia Carrier. "This is a mutually beneficial partnership and we look forward to continuing to grow our regional and global offerings together."

ONUG Launches Open IT Framework Initiatives

The Open Networking User Group (ONUG) is kicking off a set of industry initiatives focused on open IT frameworks and software-defined infrastructure:

  • Open SD-WAN Exchange (OSE)
  • Open Interoperable Control Plane (OICP)
  • Open Traffic Management Format (OTMF)
  • Open Network State Format (ONSF)

“The new open industry initiatives will promote collaboration amongst vendors, academics, standards and open source organizations, and enterprise IT business leaders that is vital in bringing the ONUG Community closer to the open software-defined infrastructure they require,” said Nick Lippis, Co-Chairman and Co-Founder of ONUG. “I would like to commend these trailblazing participants for the role they are playing in steering this movement, which will ultimately work to benefit both IT buyers and sellers.”

Supporting companies include Apstra, Cisco, Citrix, CloudGenix, FatPipe, Glue Networks, NetScout, NTT Innovation Institute, Inc., Nuage Networks, Silver Peak, VeloCloud, Veriflow, Verizon, Versa Networks, and Viptela.

Weaveworks Raises $15 Million for Container Monitoring

Weaveworks, a start-up offering networking and monitoring for containers and microservices, secured $15 million in Series B funding led by new investor GV (formerly Google Ventures).

Weaveworks’ Weave provides a simple and consistent way to connect and manage containers and microservices. It provides simple and reliable networking across development, test and production environments and any mix of data centers and public c111louds. Weave also provides a unique console to visualize and interact with container and microservice deployments in development and production.

The new funding round also included participation from existing investor Accel.

“We’re delighted to welcome GV as a new investor, and Accel as a repeat investor in Weaveworks,” said Alexis Richardson, co-founder and CEO of Weaveworks and chair of the Cloud Native Computing Foundation’s (CNCF) Technical Oversight Committee. “Both share our vision of simplifying microservice-based application development by minimizing the connectivity and deployment complexities, and providing unique visual ways to understand and manage cloud-native applications.”

Weave Enhances its Networking + Monitoring for Docker

Weaveworks, a start-up with offices in San Francisco and London, announced the 1.4 release of its networking and monitoring software for Docker deployments.

Weave Net 1.4 is a Docker networking plug-in that eliminates the requirement to run and manage an external cluster store (database). The plug-in simplifies and accelerates the deployment of Docker containers by removing the requirement to deploy, manage and maintain a centralized database in development and production. It builds on Docker’s core networking capabilities. It runs a “micro router” on each Docker host that works just like an Internet router, providing IP addresses to local containers and sharing peer-to-peer updates with other micro-routers, and learning from their updates. It also responds to DNS requests by containers looking to find other containers by name, also known as Service Discovery. Features include:

  • A simple overlay networking approach for connecting containers across Docker hosts
  • Fast, standards-based VXLAN encapsulation for the network traffic
  • An application-centric micro-network
  • Built-in service discovery
Weaveworks developed “micro router” technology to make Docker container networking fast, easy and “invisible”.

“Removing the dependency on a cluster store makes it faster, easier and simpler to build, ship and run Docker containers,” said Mathew Lodge, COO of Weaveworks. “Weave Net 1.4 embodies Weaveworks’ commitment to making simple, easy to use products that accelerate the deployment of microservices and cloud native applications on containerized infrastructure.”

Videotron to Deploy Ciena's Packet/Optical in Quebec

Videotron is deploying Ciena’s converged packet optical solution to upgrade its regional and backbone network in Quebec.

Ciena said the deployment will allow Videotron to accommodate several terabits of traffic, meeting the surge of bandwidth for Internet and 4K video.

Videotron was the first Canadian telecommunications provider to offer its customers Ultra HD set-top boxes in 2015, and in February 2016, began carrying live sports programs in 4K definition, complementing its library of UHD offerings in movies, television, and more. As of December 31, 2015, Videotron was serving 1,736,900 cable television customers, including 1,570,600 Digital TV subscribers, along with 1,568,200 Interner subscribers over its cable network.

In addition, Videotron recently announced the construction of a new Montreal data center, complementing an existing facility in Quebec City.

Royal Bank of Scotland Picks Red Hat's Mobile, Container and Cloud

Royal Bank of Scotland is powering its new Open Experience center with Red Hat technologies, including the Red Hat Mobile Application Platform and OpenShift Enterprise, Red Hat's web-scale container application platform.

Open Experience is a technology solutions center launched by Royal Bank of Scotland in February 2016 at its headquarters in Edinburgh, U.K., to pursue innovative new technologies for the bank and its customers. Not only a physical space, Open Experience represents a new way of thinking to help Royal Bank of Scotland develop innovative products and services within a framework that promotes closer, more collaborative work between colleagues, businesses, and customers.

IPG Photonics Acquires Menara Networks for Pluggable Optical Modules

IPG Photonics agreed to acquire Menara Networks, a supplier of enhanced optical transmission modules and systems for cable multi-system operators (MSOs), carriers and data centers, for $46.8 million in cash.

The companies recently announced a partnership to provide an integrated solution for simplified repeater-less 100G DWDM transmission for metro and data center interconnection. Menara’s cost and foot-print-saving product suite of 10G and 100G WDM modules eliminate the need for high-priced transponder systems.

IPG said the acquisition provides it with an entry into the growing optical pluggable systems market and leverages IPG’s international market access outside North America.

“The acquisition of Menara Networks is in line with our strategy to make bolt-on acquisitions that provide us with the talent, technology and products to enter large complementary markets,” said Dr. Valentin Gapontsev, IPG Photonics’ Chairman and CEO. “Since IPG was founded in the 1990’s, telecom products have been a staple offering for IPG, part of our DNA. This acquisition broadens and complements our telecommunications offerings and provides significant sales synergies. Together, we can offer our customers an expanded telecom technology platform with more integrated products with superior performance and economics. The acquisition also affords IPG a better position to capitalize on the robust growth of optical networking driven by video and broadband access.”

"The on-going shift to cloud based services and infrastructure has placed unprecedented strain on data centers and telecom/cable operators’ optical networks and presents a significant opportunity for Menara’s differentiated products,” comments Siraj Nour El-Ahmadi, Menara CEO, Chairman and Co-Founder. “We view the combination with IPG as a force multiplier to not only expand our market share vertically and geographically but just as importantly to bring about innovative and differentiated turn-key solutions that will effectively address the large and growing global DWDM market.”

Menara Ships 120 km 10 Gbps Transceivers with OTN & FEC

Menara Networks introduced an optical transceiver based on its OTN “System-in-module” DWDM XFP platform and featuring up to 120 km reach with integrated Forward Error Correction and advanced monitoring capabilities.

Menara said it achieves 120 km reach on standard single mode fiber without the need for optical amplification and/or dispersion compensation. The unamplified 120 km reach is achieved as a result of Menara’s superior performance of its optical transmitter and receiver designs, and the integrated Forward Error Correction coding gain afforded by Menara’s proprietary integrated circuit. Menara 10 Gbps XFP 120 km reach transceivers are MSA compliant and Telcordia qualified, compatible with both 10G Ethernet and 9.96 Gbps SONET/SDH line rates, consume under 3.5 Watts, and are compatible with all major routers and MPLS switches in the industry.

GTT Teans with GBI for Middle East Coverage

GTT Communications and GBI, a global service provider that owns and operates a multilayer, carrier-neutral network connecting the world to the Middle East, announced a strategic relationship to provide enhanced services and connectivity in the Middle East.

As part of the agreement, GTT will be adding new points of presence (PoPs) in the Middle East, starting with the United Arab Emirates (UAE) and Qatar. The agreement will also provide GBI with connectivity to the United States and Europe.