DEV Community

Ajit Kumar
Ajit Kumar

Posted on

Visualize Your System Logs: Web-based dashboard

#webserver #dashboard #logs #linux

There are several tools that provide web-based dashboards showing disk usage, memory (RAM) usage, CPU, logs, and detailed analysis. Some are lightweight for single hosts, others are enterprise-grade for clusters.

Below is a structured list of options, what they visualize, and how difficult they are to set up.

A. Simple Self-Hosted Dashboards (Easy, Quick Setup)

These are ideal for a single EC2 instance or a few servers.

1. Netdata

What it shows

  • Real-time CPU, memory, disk I/O
  • Disk usage by mountpoint
  • Process list and usage breakdown
  • Network, Docker metrics

Web UI

  • Live graphs per metric
  • Zoomable time ranges

Why use it

  • Extremely low overhead
  • No configuration required to start
  • Visualizes most “health” metrics

Install

bash <(curl -Ss https://my-netdata.io/kickstart.sh)
Enter fullscreen mode Exit fullscreen mode

Access

http://<your-instance-ip>:19999
Enter fullscreen mode Exit fullscreen mode

2. Glances + Web UI

What it shows

  • Top CPU/RAM/disk usage
  • Per-process statistics
  • Can show Docker metrics

Web UI

  • Clean text-based dashboard in browser

Install

sudo apt install glances
Enter fullscreen mode Exit fullscreen mode

Run with web server

glances -w
Enter fullscreen mode Exit fullscreen mode

Access

http://<instance-ip>:61208
Enter fullscreen mode Exit fullscreen mode

3. Cockpit

What it shows

  • System overview (CPU, memory, disk)
  • Log browsing
  • Journal viewer
  • Storage and networking

Why use it

  • Designed specifically for servers
  • Good admin UI

Install

sudo apt install cockpit
sudo systemctl enable --now cockpit
Enter fullscreen mode Exit fullscreen mode

Access

https://<instance-ip>:9090
Enter fullscreen mode Exit fullscreen mode

B. Log-Focused Dashboards (Aggregate Across Time)

If you want deeper historical analysis of logs and patterns:

4. Grafana + Prometheus (or Node Exporter)

What it shows

  • Time series charts for memory, disk, CPU
  • Custom dashboards
  • Alerts

Good for

  • Long-term monitoring
  • Multi-server environments
  • Alerts on thresholds

Setup flow

  1. Install Prometheus
  2. Install Node Exporter on host
  3. Connect Prometheus → Grafana
  4. Visualize metrics

Web UI

http(s)://<grafana-host>:3000
Enter fullscreen mode Exit fullscreen mode

5. ELK Stack (Elasticsearch + Logstash + Kibana)

Purpose

  • Stores logs (journal, syslog)
  • Powerful search & analytics

Web UI

  • Kibana dashboard

Good for

  • Log exploration
  • Centralizing logs from all servers

Cons

  • Heavy (RAM, disk)

C. Hybrid Observability Platforms

If you want system + logs + alerts all in one, with minimal setup:

6. CloudWatch (AWS Native Option)

What it shows

  • CPU, memory (with agent), disk
  • Log insights
  • Alarms & dashboards

Why use it

  • No web server to maintain
  • Integration with AWS IAM, Lambda

Setup

  • Install and configure CloudWatch agent
  • Create dashboards in AWS Console

7. Datadog / New Relic / Dynatrace (Commercial)

What they offer

  • Full observability (metrics, logs, traces)
  • AI-assisted analysis
  • Alerts

Pros

  • Enterprise grade
  • Insightful correlations (e.g., memory spikes vs logs)

Cons

  • Paid service

D. Recommendation for Your Use Case

You have been manually analyzing:

  • Disk usage (du, df)
  • Journald and syslog
  • Docker metadata

To cover all of that in a single Web UI, pick one of these based on how much you want to invest:

Tool Best for Complexity
Netdata Live system metrics Very Easy
Cockpit Logs + metrics Easy
Glances (Web) Quick overview Very Easy
Grafana + Prometheus Historical metrics Moderate
CloudWatch Integrated AWS monitoring Moderate
ELK / Kibana Log analytics High

E. Quick Start Example (Netdata)

1. Install 

bash <(curl -Ss https://my-netdata.io/kickstart.sh)
Enter fullscreen mode Exit fullscreen mode

2. Open Port (if needed) 

sudo ufw allow 19999/tcp
Enter fullscreen mode Exit fullscreen mode

3. View 

http://<your-ec2-public-ip>:19999
Enter fullscreen mode Exit fullscreen mode

Netdata will show:

  • RAM usage
  • Disk space usage
  • Disk I/O
  • Docker resource breakdown
  • Per-process CPU/RAM charts

F. Quick Start Example (Cockpit)

1. Install 

sudo apt install cockpit
sudo systemctl enable --now cockpit
Enter fullscreen mode Exit fullscreen mode

2. View 

https://<instance-ip>:9090
Enter fullscreen mode Exit fullscreen mode

Cockpit gives:

  • Free/used memory
  • Disk usage per mount
  • Journal logs
  • Services status
  • Docker containers (with plugin)

G. If You Want Logs in Web Format

Install Filebeat → Elasticsearch → Kibana or just push logs to CloudWatch Logs and use AWS Console.

Summary (Best First)

Start with Netdata or Cockpit. They both provide:

  • Memory (RAM) usage graphs
  • Disk space usage
  • CPU usage
  • Temporal history
  • No heavy setup required

You can later expand to Grafana + Prometheus for long-term trend analysis and alerting.

Top comments (0)