Tag Archives: Configuration

Log4j2 Java Logging Example Tutorial – XML Configuration, Severity Levels, Formatting and Appenders


Log4j2 Java Logging Example Tutorial – XML Configuration, Severity Levels, Formatting and Appenders, Logging Performance idea Continue reading

Advertisements
Posted in Java, Java Logging, LOG4J2 | Tagged , , , , , , , , , , , , , , | 3 Comments

How to Configure Filebeat, Kafka, Logstash Input , Elasticsearch Output and Kibana Dashboard


How to Configure and integrate Filebeat, Kafka, Logstash Input , Elasticsearch Output and Kibana Dashboard Continue reading

Posted in Elasticsearch, ELK, Example, Filebeat, JSON, Kafka, Kibana, Logstash, Zookeeper | Tagged , , , , , , , , | Leave a comment

How to Configure Maven in Window and Linux?


Maven Configuration in Window and Linux Continue reading

Posted in Java, Maven | Tagged , , , | 3 Comments

Integrate Filebeat, Kafka, Logstash, Elasticsearch and Kibana


Integrate Filebeat, Kafka,Logstash,Elasticsearch and Kibana for Organizantion level for log analysis. Continue reading

Posted in Elasticsearch, Filebeat, JSON, Kafka, Kibana, Logstash, Zookeeper | Tagged , , , , , , , , | 30 Comments

Elasticsearch REST JAVA API


Elasticsearch 5 provides low level client api’s to communicate with Elasticsearch Cluster over HTTP by JAVA. Because of REST services and JSON able to communicate with all version of Elasticseach and across firewall also. Elasticsearch REST Client sent http requests internally by … Continue reading

Posted in Elasticsearch, REST | Tagged , , | 5 Comments

Kafka Server Properties Configuration


Kafka provide server level properties for configuration of  Broker, Socket, Zookeeper, Buffering, Retention etc. broker.id :  This broker id which is unique integer value in Kafka cluster. Socket Server Settings : listeners: default value is PLAINTEXT://:9092  where socket servers listens and if … Continue reading

Posted in Kafka, Logstash | Tagged , , , , , , | 6 Comments

Logstash Input and Output to/from Kafka Example


Logstash Input and Output to/from Kafka Example Continue reading

Posted in Kafka, Logstash | Tagged , , , , , | 6 Comments

Integrate Filebeat with Kafka


Kafka can consume messages published by Filebeat based on configuration  filebeat.yml file for Kafka Output. Filebeat Kafka Output Configuration Filebeat.yml  required below fields to connect and publish message to Kafka for configured topic. Kafka will create Topics dynamically based on filebeat requirement. … Continue reading

Posted in Filebeat, Kafka | Tagged , , , , , , | 6 Comments

Setup Kafka Cluster for Multi/Distributed Servers/Brokers


For setting up Kafka Cluster for Multi Broker/ Server on single Machine follow below steps: In below example we will create Kafka cluster with three brokers on single machine. All steps are same as configured for Kafka Cluster with Single Server … Continue reading

Posted in Kafka | Tagged , , , , , , | 6 Comments

Integrate Java with Kafka


Below examples are for Kafka Logs Producer and Consumer by Kafka Java API. Where Producer is sending logs from file to Topic1 on Kafka server and same logs Consumer is subscribing from Topic1. While Kafka Consumer can subscribe logs from … Continue reading

Posted in Kafka | Tagged , , , , , | 6 Comments