Recipe: Apache Logs + rsyslog (parsing) + Elasticsearch
More than two years ago we posted a recipe on how to centralize syslog in Elasticsearch in order to search and analyze them with Kibana, all by using only rsyslog. This works well, because rsyslog is...
View ArticleRecipe: rsyslog + Kafka + Logstash
This recipe is similar to the previous rsyslog + Redis + Logstash one, except that we’ll use Kafka as a central buffer and connecting point instead of Redis. You’ll have more of the same advantages:...
View ArticlePresentation: Log Analysis with Elasticsearch
Fresh from the Velocity NYC conference is the latest presentation from Sematext engineers Rafal Kuć and Radu Gheorghe — “From zero to production hero: Log Analysis with Elasticsearch.” The talk goes...
View ArticleElasticsearch “Big Picture”– A Creative Flow Chart and Poster
There are many ways to look at Elasticsearch, but here at Sematext we’re pretty confident that you haven’t seen anything like this flowchart to demonstrate how it works: Download a copy and print your...
View ArticleDocker + Elasticsearch: How to Monitor the Official Elasticsearch Image on...
The official Elasticsearch Image on Docker Hub has already generated more than 1.6 million pulls. It is probably the easiest way to get a development setup — which includes Elasticsearch — to the...
View ArticleIntroducing Top Database Operations
If you run Elasticsearch, Solr, or any datastore you connect to via JDBC, you’ll like what we’ve just added to SPM. We call it Database Operations and in SPM you can find it in the new Database...
View ArticlePresentation: Running High Performance and Fault Tolerant Elasticsearch...
Running Elasticsearch clusters on Docker? Thinking about it? If “yes” then we’ve got a presentation for you that digs deep into the details. (Note: we’ve also got a related blog post about monitoring...
View ArticleUsing Grafana with Elasticsearch for Log Analytics
Grafana is an open-source alternative to Kibana. Grafana is best known as a visualization / dashboarding tool focused on graphing metrics from various data sources, such as InfluxDB. Even though...
View ArticleUsing Filebeat to Send Elasticsearch Logs to Logsene
One of the nice things about our log management and analytics solution Logsene is that you can talk to it using various log shippers. You can use Logstash, or you can use syslog protocol capable tools...
View ArticleVideo and Slides: Running High Performance and Fault Tolerant Elasticsearch...
Running Elasticsearch clusters on Docker? Thinking about it? If “yes” then we’ve got a presentation for you that digs deep into the details. (Note: we’ve also got a related blog post about monitoring...
View ArticleElasticsearch Training in London
3 Elasticsearch Classes in London Elasticsearch for Developers ……. April 4-5 Elasticsearch for Logging ……… April 6 Elasticsearch Operations ……. April 6 All classes cover Elasticsearch 2.x Hands-on —...
View ArticleSlack Analytics & Search with Elasticsearch, Node.js and React
Sematext team is highly distributed. We are ex-Skype users who recently switched to Slack for team collaboration. We’ve been happy with Slack features and especially integrations for watching our...
View ArticleLogagent-js – alternative to logstash, filebeat, fluentd, rsyslog?
What is the easiest way to parse, ship and analyze my web server logs? You should know that I’m a Node.js fan boy and not very thrilled with the idea of running a heavy process like Logstash on my low...
View ArticleReindexing Data with Elasticsearch
SIDE NOTE: We run Elasticsearch and ELK trainings, which may be of interest to you and your teammates. Sooner or later, you’ll run into a problem of reindexing the data of your Elasticsearch instances....
View ArticleDocuments Update By Query with Elasticsearch
SIDE NOTE: We run Elasticsearch and ELK trainings, which may be of interest to you and your teammates. Just recently, we’ve described how to re-index your Elasticsearch data using the built-in re-index...
View ArticleMonitoring rsyslog with Kibana and SPM
A while ago we published this post where we explained how you can get stats about rsyslog, such as the number of messages enqueued, the number of output errors and so on. The point was to send them to...
View ArticleElasticsearch Ingest Node vs Logstash Performance
Starting from Elasticsearch 5.0, you’ll be able to define pipelines within it that process your data, in the same way you’d normally do it with something like Logstash. We decided to take it for a spin...
View ArticleScalable and Flexible Elasticsearch Reindexing via rsyslog
Earlier on, we posted a recipe on reindexing data from within an Elasticsearch 2.3+ cluster. But this doesn’t work if you want to reindex in a different cluster or if your Elasticsearch is older than...
View ArticleElasticsearch / Elastic Stack Training – NYC June 13-16
Next month, June 13-16, 2016, we will be running three Elastic Stack (aka ELK Stack) classes in New York City: June 13 & 14: Elasticsearch for Developers Training Workshop June 15: Elasticsearch...
View ArticleRunning High Performance Fault-tolerant Elasticsearch Clusters on Docker
If you are running Elasticsearch in Docker, here are some slides on that topic to make that smoother. See also Monitoring Official Elasticsearch Image on Docker
View Article