Notice: Function _load_textdomain_just_in_time was called incorrectly. Translation loading for the easy-accordion-free domain was triggered too early. This is usually an indicator for some code in the plugin or theme running too early. Translations should be loaded at the init action or later. Please see Debugging in WordPress for more information. (This message was added in version 6.7.0.) in /home/mother99/jacksonholdingcompany.com/wp-includes/functions.php on line 6114

Notice: Function _load_textdomain_just_in_time was called incorrectly. Translation loading for the zoho-flow domain was triggered too early. This is usually an indicator for some code in the plugin or theme running too early. Translations should be loaded at the init action or later. Please see Debugging in WordPress for more information. (This message was added in version 6.7.0.) in /home/mother99/jacksonholdingcompany.com/wp-includes/functions.php on line 6114

Notice: Function _load_textdomain_just_in_time was called incorrectly. Translation loading for the wordpress-seo domain was triggered too early. This is usually an indicator for some code in the plugin or theme running too early. Translations should be loaded at the init action or later. Please see Debugging in WordPress for more information. (This message was added in version 6.7.0.) in /home/mother99/jacksonholdingcompany.com/wp-includes/functions.php on line 6114

Warning: Cannot modify header information - headers already sent by (output started at /home/mother99/jacksonholdingcompany.com/wp-includes/functions.php:6114) in /home/mother99/jacksonholdingcompany.com/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home/mother99/jacksonholdingcompany.com/wp-includes/functions.php:6114) in /home/mother99/jacksonholdingcompany.com/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home/mother99/jacksonholdingcompany.com/wp-includes/functions.php:6114) in /home/mother99/jacksonholdingcompany.com/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home/mother99/jacksonholdingcompany.com/wp-includes/functions.php:6114) in /home/mother99/jacksonholdingcompany.com/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home/mother99/jacksonholdingcompany.com/wp-includes/functions.php:6114) in /home/mother99/jacksonholdingcompany.com/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home/mother99/jacksonholdingcompany.com/wp-includes/functions.php:6114) in /home/mother99/jacksonholdingcompany.com/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home/mother99/jacksonholdingcompany.com/wp-includes/functions.php:6114) in /home/mother99/jacksonholdingcompany.com/wp-includes/rest-api/class-wp-rest-server.php on line 1893

Warning: Cannot modify header information - headers already sent by (output started at /home/mother99/jacksonholdingcompany.com/wp-includes/functions.php:6114) in /home/mother99/jacksonholdingcompany.com/wp-includes/rest-api/class-wp-rest-server.php on line 1893
{"id":1514,"date":"2023-10-27T08:55:19","date_gmt":"2023-10-27T08:55:19","guid":{"rendered":"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/"},"modified":"2023-10-27T08:55:19","modified_gmt":"2023-10-27T08:55:19","slug":"how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm","status":"publish","type":"post","link":"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/","title":{"rendered":"How to Begin Observability at the Data Source Mel Delgado on October 26, 2023 at 6:13 pm"},"content":{"rendered":"

More data does not mean better observability<\/h2>\n

If you\u2019re familiar with observability, you know most teams have a \u201cdata problem.\u201d That is, observability data has exploded as teams have modernized their a\u2026 Read more on Cisco Blogs<\/a><\/p>\n

\u200b<\/p>\n

More data does not mean better observability<\/h2>\n

If you\u2019re familiar with observability, you know most teams have a \u201cdata problem.\u201d That is, observability data has exploded as teams have modernized their application stacks and embraced microservices architectures.<\/p>\n

If you had unlimited storage, it\u2019d be feasible to ingest all your metrics, events, logs, and traces (MELT data) in a centralized observability platform\u00a0. However, that is simply not the case. Instead, teams index large volumes of data \u2013 some portions being regularly used and others not. Then, teams have to decide whether datasets are worth keeping or should be discarded altogether.<\/p>\n

For the past few months I\u2019ve been playing with a tool called Edge Delta<\/a> to see how it might help IT and DevOps teams to solve this problem by providing a new way to collect, transform, and route your data before<\/em> it is indexed in a downstream platform, like AppDynamics<\/a> or Cisco Full-Stack Observability<\/a>.<\/p>\n

What is Edge Delta?<\/h2>\n

You can use Edge Delta to create observability pipelines or analyze your data from their backend. Typically, observability starts by shipping all your raw data to central service before you begin analysis. In essence, Edge Delta helps you flip this model on its head. Said another way, Edge Delta analyzes your data as it\u2019s created at the source. From there, you can create observability pipelines that route processed data and lightweight analytics to your observability platform.<\/p>\n

Why might this approach be advantageous? Today, teams don\u2019t have a ton of clarity into their data before it\u2019s ingested in an observability platform. Nor do they have control over how that data is treated or flexibility over where the data lives.<\/p>\n

By pushing data processing upstream, Edge Delta enables a new kind of architecture where teams can have\u2026<\/p>\n

Transparency into their data: \u201cHow valuable is this dataset, and how do we use it?\u201d
\nControls to drive usability: \u201cWhat is the ideal shape of that data?\u201d
\nFlexibility to route processed data anywhere: \u201cDo we need this data in our observability platform for real-time analysis, or archive storage for compliance?\u201d<\/p>\n

The net benefit here is that you\u2019re allocating your resources towards the right data in its optimal shape and location based on your use case.<\/p>\n

How I used Edge Delta<\/h2>\n

Over the past few weeks, I\u2019ve explored a couple different use cases with Edge Delta.<\/p>\n

Analyzing NGINX log data from the Edge Delta interface<\/strong><\/p>\n

First, I wanted to use the Edge Delta console to analyze my log data. To do so, deployed the Edge Delta agent on a Kubernetes cluster running NGINX. From here, I sent both valid and invalid http requests to generate log data and observed the output via Edge Delta\u2019s pre-built dashboards.<\/p>\n

Among the most useful screens was \u201cPatterns.\u201d This feature clusters together repetitive loglines, so I can easily interpret each unique log message, understand how frequently it occurs, and whether I should investigate it further.<\/p>\n

Edge Delta\u2019s Patterns feature makes it easy to interpret data by clustering
\ntogether repetitive log messages and provides analytics around each event.<\/em><\/p>\n

Creating pipelines with Syslog data<\/strong><\/h3>\n

Second, I wanted to manipulate data in flight using Edge Delta observability pipelines. Here, I installed the Edge Delta agent on my Mac OS. Then I exported Syslog data from my Cisco ISR1100 to my Mac.<\/p>\n

From within the Edge Delta interface, I configured the agent to listen on the appropriate TCP and UDP ports. Now, I can apply processor nodes to transform (and otherwise manipulate) my data before it hits my downstream analytics platform.<\/p>\n

Specifically, I applied the following processors:<\/p>\n

Mask node<\/strong> to obfuscate sensitive data. Here, I replaced social security numbers in my log data with the string \u2018REDACTED\u2019.
\nRegex filter node<\/strong> which passes along or discards data based on the regex pattern. For this example, I wanted to exclude DEBUG level logs from downstream storage.
\nLog to metric node<\/strong> for extracting metrics from my log data. The metrics can be ingested downstream in lieu of raw data to support real-time monitoring use cases. I captured metrics to track the rate of errors, exceptions, and negative sentiment logs.
\nLog to pattern node<\/strong> which I alluded to in the section above. This creates \u201cpatterns\u201d from my data by grouping together similar loglines for easier interpretation and less noise.<\/p>\n

Through Edge Delta\u2019s Pipelines interface, you can apply processors
\nto your data and route it to different destinations.<\/em><\/p>\n

For now all of this is being routed to the Edge Delta backend. However, Edge Delta is vendor-agnostic and I can route processed data to different destinations \u2013 like AppDynamics<\/a> or Cisco Full-Stack Observability<\/a> \u2013 in a matter of clicks.<\/p>\n

Conclusion<\/h2>\n

If you\u2019re interested in learning more about Edge Delta, you can visit their website (edgedelta.com). From here, you can deploy your own agent and ingest up to 10GB per day for free. Also, check out our video on the YouTube DevNet channel to see the steps above in action. Feel free to post your questions about my configuration below.<\/p>\n

Related resources<\/h2>\n

Learn more about Cisco Full-Stack Observability<\/a>
\nLearn more about
AppDynamics<\/a><\/p>\n

\n\t\tShare\n
\n
<\/div>\n<\/div>\n
\n
\n\t\t<\/a>\n\t<\/div>\n<\/div>\n
\n
\n\t\t<\/a>\n\t<\/div>\n<\/div>\n
\n
\n\t <\/a>\n\t<\/div>\n<\/div>\n<\/div>\n
Share:<\/div>\n
\n
\n
<\/div>\n<\/div>\n
\n
\n\t\t<\/a>\n\t<\/div>\n<\/div>\n
\n
\n\t\t<\/a>\n\t<\/div>\n<\/div>\n
\n
\n\t <\/a>\n\t<\/div>\n<\/div>\n<\/div>\n

\u00a0\u00a0Observable data has exploded as teams modernize their application stacks and embraced microservices architectures. Learn how Edge Delta helps IT and DevOps teams with a new way to collect, transform, and route your data before it is indexed in a downstream platform.\u00a0\u00a0Read More<\/a>\u00a0Cisco Blogs\u00a0<\/p>","protected":false},"excerpt":{"rendered":"

<\/p>\n

More data does not mean better observability<\/h2>\n

If you\u2019re familiar with observability, you know most teams have a \u201cdata problem.\u201d That is, observability data has exploded as teams have modernized their a\u2026 Read more on Cisco Blogs<\/a><\/p>\n

\u200b<\/p>\n

More data does not mean better observability<\/h2>\n

If you\u2019re familiar with observability, you know most teams have a \u201cdata problem.\u201d That is, observability data has exploded as teams have modernized their application stacks and embraced microservices architectures.<\/p>\n

If you had unlimited storage, it\u2019d be feasible to ingest all your metrics, events, logs, and traces (MELT data) in a centralized observability platform\u00a0. However, that is simply not the case. Instead, teams index large volumes of data \u2013 some portions being regularly used and others not. Then, teams have to decide whether datasets are worth keeping or should be discarded altogether.<\/p>\n

For the past few months I\u2019ve been playing with a tool called Edge Delta<\/a> to see how it might help IT and DevOps teams to solve this problem by providing a new way to collect, transform, and route your data before<\/em> it is indexed in a downstream platform, like AppDynamics<\/a> or Cisco Full-Stack Observability<\/a>.<\/p>\n

What is Edge Delta?<\/h2>\n

You can use Edge Delta to create observability pipelines or analyze your data from their backend. Typically, observability starts by shipping all your raw data to central service before you begin analysis. In essence, Edge Delta helps you flip this model on its head. Said another way, Edge Delta analyzes your data as it\u2019s created at the source. From there, you can create observability pipelines that route processed data and lightweight analytics to your observability platform.<\/p>\n

Why might this approach be advantageous? Today, teams don\u2019t have a ton of clarity into their data before it\u2019s ingested in an observability platform. Nor do they have control over how that data is treated or flexibility over where the data lives.<\/p>\n

By pushing data processing upstream, Edge Delta enables a new kind of architecture where teams can have\u2026<\/p>\n

Transparency into their data: \u201cHow valuable is this dataset, and how do we use it?\u201d
\nControls to drive usability: \u201cWhat is the ideal shape of that data?\u201d
\nFlexibility to route processed data anywhere: \u201cDo we need this data in our observability platform for real-time analysis, or archive storage for compliance?\u201d<\/p>\n

The net benefit here is that you\u2019re allocating your resources towards the right data in its optimal shape and location based on your use case.<\/p>\n

How I used Edge Delta<\/h2>\n

Over the past few weeks, I\u2019ve explored a couple different use cases with Edge Delta.<\/p>\n

Analyzing NGINX log data from the Edge Delta interface<\/strong><\/p>\n

First, I wanted to use the Edge Delta console to analyze my log data. To do so, deployed the Edge Delta agent on a Kubernetes cluster running NGINX. From here, I sent both valid and invalid http requests to generate log data and observed the output via Edge Delta\u2019s pre-built dashboards.<\/p>\n

Among the most useful screens was \u201cPatterns.\u201d This feature clusters together repetitive loglines, so I can easily interpret each unique log message, understand how frequently it occurs, and whether I should investigate it further.<\/p>\n

Edge Delta\u2019s Patterns feature makes it easy to interpret data by clustering
\ntogether repetitive log messages and provides analytics around each event.<\/em><\/p>\n

Creating pipelines with Syslog data<\/strong><\/h3>\n

Second, I wanted to manipulate data in flight using Edge Delta observability pipelines. Here, I installed the Edge Delta agent on my Mac OS. Then I exported Syslog data from my Cisco ISR1100 to my Mac.<\/p>\n

From within the Edge Delta interface, I configured the agent to listen on the appropriate TCP and UDP ports. Now, I can apply processor nodes to transform (and otherwise manipulate) my data before it hits my downstream analytics platform.<\/p>\n

Specifically, I applied the following processors:<\/p>\n

Mask node<\/strong> to obfuscate sensitive data. Here, I replaced social security numbers in my log data with the string \u2018REDACTED\u2019.
\nRegex filter node<\/strong> which passes along or discards data based on the regex pattern. For this example, I wanted to exclude DEBUG level logs from downstream storage.
\nLog to metric node<\/strong> for extracting metrics from my log data. The metrics can be ingested downstream in lieu of raw data to support real-time monitoring use cases. I captured metrics to track the rate of errors, exceptions, and negative sentiment logs.
\nLog to pattern node<\/strong> which I alluded to in the section above. This creates \u201cpatterns\u201d from my data by grouping together similar loglines for easier interpretation and less noise.<\/p>\n

Through Edge Delta\u2019s Pipelines interface, you can apply processors
\nto your data and route it to different destinations.<\/em><\/p>\n

For now all of this is being routed to the Edge Delta backend. However, Edge Delta is vendor-agnostic and I can route processed data to different destinations \u2013 like AppDynamics<\/a> or Cisco Full-Stack Observability<\/a> \u2013 in a matter of clicks.<\/p>\n

Conclusion<\/h2>\n

If you\u2019re interested in learning more about Edge Delta, you can visit their website (edgedelta.com). From here, you can deploy your own agent and ingest up to 10GB per day for free. Also, check out our video on the YouTube DevNet channel to see the steps above in action. Feel free to post your questions about my configuration below.<\/p>\n

Related resources<\/h2>\n

Learn more about Cisco Full-Stack Observability<\/a>
\nLearn more about
AppDynamics<\/a><\/p>\n

\n\t\tShare<\/p>\n
\n
<\/div>\n<\/div>\n
\n
\n\t\t<\/a>\n\t<\/div>\n<\/div>\n
\n
\n\t\t<\/a>\n\t<\/div>\n<\/div>\n
\n
\n\t <\/a>\n\t<\/div>\n<\/div>\n<\/div>\n
Share:<\/div>\n
\n
\n
<\/div>\n<\/div>\n
\n
\n\t\t<\/a>\n\t<\/div>\n<\/div>\n
\n
\n\t\t<\/a>\n\t<\/div>\n<\/div>\n
\n
\n\t <\/a>\n\t<\/div>\n<\/div>\n<\/div>\n

\u00a0\u00a0Observable data has exploded as teams modernize their application stacks and embraced microservices architectures. Learn how Edge Delta helps IT and DevOps teams with a new way to collect, transform, and route your data before it is indexed in a downstream platform.\u00a0\u00a0Read More<\/a>\u00a0Cisco Blogs\u00a0<\/p>\n

<\/p>\n","protected":false},"author":0,"featured_media":1515,"comment_status":"","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[12],"tags":[],"class_list":["post-1514","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-cisco-learning"],"yoast_head":"\nHow to Begin Observability at the Data Source Mel Delgado on October 26, 2023 at 6:13 pm - JHC<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How to Begin Observability at the Data Source Mel Delgado on October 26, 2023 at 6:13 pm\" \/>\n<meta property=\"og:description\" content=\"More data does not mean better observability If you\u2019re familiar with observability, you know most teams have a \u201cdata problem.\u201d That is, observability data has exploded as teams have modernized their a\u2026 Read more on Cisco Blogs \u200b More data does not mean better observability If you\u2019re familiar with observability, you know most teams have a \u201cdata problem.\u201d That is, observability data has exploded as teams have modernized their application stacks and embraced microservices architectures. If you had unlimited storage, it\u2019d be feasible to ingest all your metrics, events, logs, and traces (MELT data) in a centralized observability platform\u00a0. However, that is simply not the case. Instead, teams index large volumes of data \u2013 some portions being regularly used and others not. Then, teams have to decide whether datasets are worth keeping or should be discarded altogether. For the past few months I\u2019ve been playing with a tool called Edge Delta to see how it might help IT and DevOps teams to solve this problem by providing a new way to collect, transform, and route your data before it is indexed in a downstream platform, like AppDynamics or Cisco Full-Stack Observability. What is Edge Delta? You can use Edge Delta to create observability pipelines or analyze your data from their backend. Typically, observability starts by shipping all your raw data to central service before you begin analysis. In essence, Edge Delta helps you flip this model on its head. Said another way, Edge Delta analyzes your data as it\u2019s created at the source. From there, you can create observability pipelines that route processed data and lightweight analytics to your observability platform. Why might this approach be advantageous? Today, teams don\u2019t have a ton of clarity into their data before it\u2019s ingested in an observability platform. Nor do they have control over how that data is treated or flexibility over where the data lives. By pushing data processing upstream, Edge Delta enables a new kind of architecture where teams can have\u2026 Transparency into their data: \u201cHow valuable is this dataset, and how do we use it?\u201d Controls to drive usability: \u201cWhat is the ideal shape of that data?\u201d Flexibility to route processed data anywhere: \u201cDo we need this data in our observability platform for real-time analysis, or archive storage for compliance?\u201d The net benefit here is that you\u2019re allocating your resources towards the right data in its optimal shape and location based on your use case. How I used Edge Delta Over the past few weeks, I\u2019ve explored a couple different use cases with Edge Delta. Analyzing NGINX log data from the Edge Delta interface First, I wanted to use the Edge Delta console to analyze my log data. To do so, deployed the Edge Delta agent on a Kubernetes cluster running NGINX. From here, I sent both valid and invalid http requests to generate log data and observed the output via Edge Delta\u2019s pre-built dashboards. Among the most useful screens was \u201cPatterns.\u201d This feature clusters together repetitive loglines, so I can easily interpret each unique log message, understand how frequently it occurs, and whether I should investigate it further. Edge Delta\u2019s Patterns feature makes it easy to interpret data by clustering together repetitive log messages and provides analytics around each event. Creating pipelines with Syslog data Second, I wanted to manipulate data in flight using Edge Delta observability pipelines. Here, I installed the Edge Delta agent on my Mac OS. Then I exported Syslog data from my Cisco ISR1100 to my Mac. From within the Edge Delta interface, I configured the agent to listen on the appropriate TCP and UDP ports. Now, I can apply processor nodes to transform (and otherwise manipulate) my data before it hits my downstream analytics platform. Specifically, I applied the following processors: Mask node to obfuscate sensitive data. Here, I replaced social security numbers in my log data with the string \u2018REDACTED\u2019. Regex filter node which passes along or discards data based on the regex pattern. For this example, I wanted to exclude DEBUG level logs from downstream storage. Log to metric node for extracting metrics from my log data. The metrics can be ingested downstream in lieu of raw data to support real-time monitoring use cases. I captured metrics to track the rate of errors, exceptions, and negative sentiment logs. Log to pattern node which I alluded to in the section above. This creates \u201cpatterns\u201d from my data by grouping together similar loglines for easier interpretation and less noise. Through Edge Delta\u2019s Pipelines interface, you can apply processors to your data and route it to different destinations. For now all of this is being routed to the Edge Delta backend. However, Edge Delta is vendor-agnostic and I can route processed data to different destinations \u2013 like AppDynamics or Cisco Full-Stack Observability \u2013 in a matter of clicks. Conclusion If you\u2019re interested in learning more about Edge Delta, you can visit their website (edgedelta.com). From here, you can deploy your own agent and ingest up to 10GB per day for free. Also, check out our video on the YouTube DevNet channel to see the steps above in action. Feel free to post your questions about my configuration below. Related resources Learn more about Cisco Full-Stack Observability Learn more about AppDynamics Share Share: \u00a0\u00a0Observable data has exploded as teams modernize their application stacks and embraced microservices architectures. Learn how Edge Delta helps IT and DevOps teams with a new way to collect, transform, and route your data before it is indexed in a downstream platform.\u00a0\u00a0Read More\u00a0Cisco Blogs\u00a0\" \/>\n<meta property=\"og:url\" content=\"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/\" \/>\n<meta property=\"og:site_name\" content=\"JHC\" \/>\n<meta property=\"article:published_time\" content=\"2023-10-27T08:55:19+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/jacksonholdingcompany.com\/wp-content\/uploads\/2023\/10\/16412340-4jFBHD.gif\" \/>\n\t<meta property=\"og:image:width\" content=\"1\" \/>\n\t<meta property=\"og:image:height\" content=\"1\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/gif\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/\"},\"author\":{\"name\":\"\",\"@id\":\"\"},\"headline\":\"How to Begin Observability at the Data Source Mel Delgado on October 26, 2023 at 6:13 pm\",\"datePublished\":\"2023-10-27T08:55:19+00:00\",\"dateModified\":\"2023-10-27T08:55:19+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/\"},\"wordCount\":947,\"publisher\":{\"@id\":\"https:\/\/jacksonholdingcompany.com\/#organization\"},\"image\":{\"@id\":\"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/jacksonholdingcompany.com\/wp-content\/uploads\/2023\/10\/16412340-4jFBHD.gif\",\"articleSection\":[\"Cisco: Learning\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/\",\"url\":\"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/\",\"name\":\"How to Begin Observability at the Data Source Mel Delgado on October 26, 2023 at 6:13 pm - JHC\",\"isPartOf\":{\"@id\":\"https:\/\/jacksonholdingcompany.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/jacksonholdingcompany.com\/wp-content\/uploads\/2023\/10\/16412340-4jFBHD.gif\",\"datePublished\":\"2023-10-27T08:55:19+00:00\",\"dateModified\":\"2023-10-27T08:55:19+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/#primaryimage\",\"url\":\"https:\/\/jacksonholdingcompany.com\/wp-content\/uploads\/2023\/10\/16412340-4jFBHD.gif\",\"contentUrl\":\"https:\/\/jacksonholdingcompany.com\/wp-content\/uploads\/2023\/10\/16412340-4jFBHD.gif\",\"width\":1,\"height\":1},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/jacksonholdingcompany.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How to Begin Observability at the Data Source Mel Delgado on October 26, 2023 at 6:13 pm\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/jacksonholdingcompany.com\/#website\",\"url\":\"https:\/\/jacksonholdingcompany.com\/\",\"name\":\"JHC\",\"description\":\"Your Business Is Our Business\",\"publisher\":{\"@id\":\"https:\/\/jacksonholdingcompany.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/jacksonholdingcompany.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/jacksonholdingcompany.com\/#organization\",\"name\":\"JHC\",\"url\":\"https:\/\/jacksonholdingcompany.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/jacksonholdingcompany.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/jacksonholdingcompany.com\/wp-content\/uploads\/2023\/07\/cropped-cropped-jHC-white-500-\u00d7-200-px-1-1.png\",\"contentUrl\":\"https:\/\/jacksonholdingcompany.com\/wp-content\/uploads\/2023\/07\/cropped-cropped-jHC-white-500-\u00d7-200-px-1-1.png\",\"width\":452,\"height\":149,\"caption\":\"JHC\"},\"image\":{\"@id\":\"https:\/\/jacksonholdingcompany.com\/#\/schema\/logo\/image\/\"}}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"How to Begin Observability at the Data Source Mel Delgado on October 26, 2023 at 6:13 pm - JHC","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/","og_locale":"en_US","og_type":"article","og_title":"How to Begin Observability at the Data Source Mel Delgado on October 26, 2023 at 6:13 pm","og_description":"More data does not mean better observability If you\u2019re familiar with observability, you know most teams have a \u201cdata problem.\u201d That is, observability data has exploded as teams have modernized their a\u2026 Read more on Cisco Blogs \u200b More data does not mean better observability If you\u2019re familiar with observability, you know most teams have a \u201cdata problem.\u201d That is, observability data has exploded as teams have modernized their application stacks and embraced microservices architectures. If you had unlimited storage, it\u2019d be feasible to ingest all your metrics, events, logs, and traces (MELT data) in a centralized observability platform\u00a0. However, that is simply not the case. Instead, teams index large volumes of data \u2013 some portions being regularly used and others not. Then, teams have to decide whether datasets are worth keeping or should be discarded altogether. For the past few months I\u2019ve been playing with a tool called Edge Delta to see how it might help IT and DevOps teams to solve this problem by providing a new way to collect, transform, and route your data before it is indexed in a downstream platform, like AppDynamics or Cisco Full-Stack Observability. What is Edge Delta? You can use Edge Delta to create observability pipelines or analyze your data from their backend. Typically, observability starts by shipping all your raw data to central service before you begin analysis. In essence, Edge Delta helps you flip this model on its head. Said another way, Edge Delta analyzes your data as it\u2019s created at the source. From there, you can create observability pipelines that route processed data and lightweight analytics to your observability platform. Why might this approach be advantageous? Today, teams don\u2019t have a ton of clarity into their data before it\u2019s ingested in an observability platform. Nor do they have control over how that data is treated or flexibility over where the data lives. By pushing data processing upstream, Edge Delta enables a new kind of architecture where teams can have\u2026 Transparency into their data: \u201cHow valuable is this dataset, and how do we use it?\u201d Controls to drive usability: \u201cWhat is the ideal shape of that data?\u201d Flexibility to route processed data anywhere: \u201cDo we need this data in our observability platform for real-time analysis, or archive storage for compliance?\u201d The net benefit here is that you\u2019re allocating your resources towards the right data in its optimal shape and location based on your use case. How I used Edge Delta Over the past few weeks, I\u2019ve explored a couple different use cases with Edge Delta. Analyzing NGINX log data from the Edge Delta interface First, I wanted to use the Edge Delta console to analyze my log data. To do so, deployed the Edge Delta agent on a Kubernetes cluster running NGINX. From here, I sent both valid and invalid http requests to generate log data and observed the output via Edge Delta\u2019s pre-built dashboards. Among the most useful screens was \u201cPatterns.\u201d This feature clusters together repetitive loglines, so I can easily interpret each unique log message, understand how frequently it occurs, and whether I should investigate it further. Edge Delta\u2019s Patterns feature makes it easy to interpret data by clustering together repetitive log messages and provides analytics around each event. Creating pipelines with Syslog data Second, I wanted to manipulate data in flight using Edge Delta observability pipelines. Here, I installed the Edge Delta agent on my Mac OS. Then I exported Syslog data from my Cisco ISR1100 to my Mac. From within the Edge Delta interface, I configured the agent to listen on the appropriate TCP and UDP ports. Now, I can apply processor nodes to transform (and otherwise manipulate) my data before it hits my downstream analytics platform. Specifically, I applied the following processors: Mask node to obfuscate sensitive data. Here, I replaced social security numbers in my log data with the string \u2018REDACTED\u2019. Regex filter node which passes along or discards data based on the regex pattern. For this example, I wanted to exclude DEBUG level logs from downstream storage. Log to metric node for extracting metrics from my log data. The metrics can be ingested downstream in lieu of raw data to support real-time monitoring use cases. I captured metrics to track the rate of errors, exceptions, and negative sentiment logs. Log to pattern node which I alluded to in the section above. This creates \u201cpatterns\u201d from my data by grouping together similar loglines for easier interpretation and less noise. Through Edge Delta\u2019s Pipelines interface, you can apply processors to your data and route it to different destinations. For now all of this is being routed to the Edge Delta backend. However, Edge Delta is vendor-agnostic and I can route processed data to different destinations \u2013 like AppDynamics or Cisco Full-Stack Observability \u2013 in a matter of clicks. Conclusion If you\u2019re interested in learning more about Edge Delta, you can visit their website (edgedelta.com). From here, you can deploy your own agent and ingest up to 10GB per day for free. Also, check out our video on the YouTube DevNet channel to see the steps above in action. Feel free to post your questions about my configuration below. Related resources Learn more about Cisco Full-Stack Observability Learn more about AppDynamics Share Share: \u00a0\u00a0Observable data has exploded as teams modernize their application stacks and embraced microservices architectures. Learn how Edge Delta helps IT and DevOps teams with a new way to collect, transform, and route your data before it is indexed in a downstream platform.\u00a0\u00a0Read More\u00a0Cisco Blogs\u00a0","og_url":"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/","og_site_name":"JHC","article_published_time":"2023-10-27T08:55:19+00:00","og_image":[{"width":1,"height":1,"url":"https:\/\/jacksonholdingcompany.com\/wp-content\/uploads\/2023\/10\/16412340-4jFBHD.gif","type":"image\/gif"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/#article","isPartOf":{"@id":"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/"},"author":{"name":"","@id":""},"headline":"How to Begin Observability at the Data Source Mel Delgado on October 26, 2023 at 6:13 pm","datePublished":"2023-10-27T08:55:19+00:00","dateModified":"2023-10-27T08:55:19+00:00","mainEntityOfPage":{"@id":"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/"},"wordCount":947,"publisher":{"@id":"https:\/\/jacksonholdingcompany.com\/#organization"},"image":{"@id":"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/#primaryimage"},"thumbnailUrl":"https:\/\/jacksonholdingcompany.com\/wp-content\/uploads\/2023\/10\/16412340-4jFBHD.gif","articleSection":["Cisco: Learning"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/","url":"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/","name":"How to Begin Observability at the Data Source Mel Delgado on October 26, 2023 at 6:13 pm - JHC","isPartOf":{"@id":"https:\/\/jacksonholdingcompany.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/#primaryimage"},"image":{"@id":"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/#primaryimage"},"thumbnailUrl":"https:\/\/jacksonholdingcompany.com\/wp-content\/uploads\/2023\/10\/16412340-4jFBHD.gif","datePublished":"2023-10-27T08:55:19+00:00","dateModified":"2023-10-27T08:55:19+00:00","breadcrumb":{"@id":"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/#primaryimage","url":"https:\/\/jacksonholdingcompany.com\/wp-content\/uploads\/2023\/10\/16412340-4jFBHD.gif","contentUrl":"https:\/\/jacksonholdingcompany.com\/wp-content\/uploads\/2023\/10\/16412340-4jFBHD.gif","width":1,"height":1},{"@type":"BreadcrumbList","@id":"https:\/\/jacksonholdingcompany.com\/how-to-begin-observability-at-the-data-source-mel-delgado-on-october-26-2023-at-613-pm\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/jacksonholdingcompany.com\/"},{"@type":"ListItem","position":2,"name":"How to Begin Observability at the Data Source Mel Delgado on October 26, 2023 at 6:13 pm"}]},{"@type":"WebSite","@id":"https:\/\/jacksonholdingcompany.com\/#website","url":"https:\/\/jacksonholdingcompany.com\/","name":"JHC","description":"Your Business Is Our Business","publisher":{"@id":"https:\/\/jacksonholdingcompany.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/jacksonholdingcompany.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/jacksonholdingcompany.com\/#organization","name":"JHC","url":"https:\/\/jacksonholdingcompany.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/jacksonholdingcompany.com\/#\/schema\/logo\/image\/","url":"https:\/\/jacksonholdingcompany.com\/wp-content\/uploads\/2023\/07\/cropped-cropped-jHC-white-500-\u00d7-200-px-1-1.png","contentUrl":"https:\/\/jacksonholdingcompany.com\/wp-content\/uploads\/2023\/07\/cropped-cropped-jHC-white-500-\u00d7-200-px-1-1.png","width":452,"height":149,"caption":"JHC"},"image":{"@id":"https:\/\/jacksonholdingcompany.com\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/jacksonholdingcompany.com\/wp-json\/wp\/v2\/posts\/1514","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/jacksonholdingcompany.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/jacksonholdingcompany.com\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/jacksonholdingcompany.com\/wp-json\/wp\/v2\/comments?post=1514"}],"version-history":[{"count":0,"href":"https:\/\/jacksonholdingcompany.com\/wp-json\/wp\/v2\/posts\/1514\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/jacksonholdingcompany.com\/wp-json\/wp\/v2\/media\/1515"}],"wp:attachment":[{"href":"https:\/\/jacksonholdingcompany.com\/wp-json\/wp\/v2\/media?parent=1514"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/jacksonholdingcompany.com\/wp-json\/wp\/v2\/categories?post=1514"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/jacksonholdingcompany.com\/wp-json\/wp\/v2\/tags?post=1514"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}