Central Logging, Monitoring and Detection Platform
Project Description:
Logging, Monitoring and Detection platform responsible for collecting logs from various applications,
databases, fir...
Project Description:
Logging, Monitoring and Detection platform responsible for collecting logs from various applications,
databases, firewalls, proxy servers, etc to maintain it in a single logging platform for various monitoring and
detection purposes, easy identification of application and other services issues, proactive monitoring by
sending various alert to respective stakeholders
Roles and Responsibilities:
● Planning, architecting and installation of elasticsearch nodes to form a high availability cluster by
forecasting the storage and search requirements
● Estimation and expansion of cluster with respect to the requirements periodically
● Automating the installation of elasticsearch components, logstash,kibana and beats by writing ansible roles
and playbooks for easier installation and expansion
● Setting up of kafka topics and brokers to stream logs from various sources and monitoring its health using
beats
● Installation of Prometheus and grafana components for monitoring kubernetes components
● Planning for movement of data from one cluster to another cluster to archive it for a longer period
● Preparing for periodic upgrades of elastic cluster whenever required
● Monitoring of Kubernetes cluster using prometheus and Grafana
● Implementation of elastic SIEM to enable threat alerts and analysis
● Implementation of APM module to continuously monitor various application performance
● Setting up of live application endpoint monitoring using heartbeat and sending alert for faulty applications
● Setting up of RBAC for various users across various application
● Creation and enhancement of kibana dashboard and visuals for various applications
● Implementation of kibana watcher to alert faulty systems
● Generation of monthly kibana reports for various streams for data analytics
Jenkins
Elasticsearch
Ansible
View more
Jenkins
Elasticsearch
Ansible
Kubernetes
Grafana
Prometheus
Elastic Stack
View more
ELK Development
Project Description:
ELK development team responsible for setting up ELK cluster to serve as an secondary datastore for JBHunt
applicatio...
Project Description:
ELK development team responsible for setting up ELK cluster to serve as an secondary datastore for JBHunt
applications to improve the search responses, by identifying the requirements, creating indices and delivering
elastic queries to application teams for integration
Roles and Responsibilities:
● Implemented elasticsearch cluster as a secondary data store for storing customer records and as a search
engine to improve faster search responses from UI
● Capacity planning of cluster, shard allocation and upgrading cluster whenever required
● Coordination with stakeholders and business analysts for requirement gatherings
● Creating elastic indices and mappings by understanding the search requirements and aligning with the
primary database (SQL)
● Writing elastic query DSL to retrieve data from elastic store and delivering to application development
team for integration
● Responsible for maintaining indices and data throughout the development lifecycle
2
● Updating indices and its settings whenever change in requirement and re-index it for data retrieval
● Promoting the indices from lower environment till production after each sprint
● Creating backups of indices and data by snapshot at periodic intervals
● Leading the team consisting of 6 members
Git
Elasticsearch
View more
Git
Elasticsearch
View more