netdata (1.6.0) - 2017-03-20

* birthday release: 1 year netdata

netdata was first published on March 30th, 2016.

It has been a crazy year since then:

225.000 unique netdata users

currently, at 1.000 new unique users per day

80.000 unique netdata installations

currently, at 500 new installation per day

610.000 docker pulls on docker hub

4.000.000 netdata sessions served

currently, at 15.000 sessions served per day

20.000 github stars

Thank you!

You are awesome!

* central netdata is here

This is the first release that supports real-time streaming of

metrics between netdata servers.

netdata can now be:

- autonomous host monitoring

(like it always has been)

- headless data collector

(collect and stream metrics in real-time to another netdata)

- headless proxy

(collect metrics from multiple netdata and stream them to another netdata)

- store and forward proxy

(like headless proxy, but with a local database)

- central database

(metrics from multiple hosts are aggregated)

metrics databases can be configured on all nodes and each node maintaining

a database may have a different retention policy and possibly run

(even different) alarms on them.

* monitoring ephemeral nodes

netdata now supports monitoring autoscaled ephemeral nodes,

that are started and stopped on demand (their IP is not known).

When the ephemeral nodes start streaming metrics to the central

netdata, the central netdata will show register them at "my-netdata"

menu on the dashboard.

For more information check:

https://github.com/firehol/netdata/wiki/monitoring-ephemeral-nodes

* monitoring ephemeral containers and VM guests

netdata now cleans up container, guest VM, network interfaces and mounted

disk metrics, disabling automatically their alarms too.

For more information check:

https://github.com/firehol/netdata/wiki/monitoring-ephemeral-containers

* apps.plugin ported for FreeBSD

@vlvkobal has ported "apps.plugin" to FreeBSD. netdata can now provide

"Applications", "Users" and "User Groups" on FreeBSD.

* web_log plugin

@l2isbad has done a wonderful job creating a unified web log parsing plugin

for all kinds of web server logs. With it, netdata provides real-time

performance information and health monitoring alarms for web applications

and web sites!

For more information check:

https://github.com/firehol/netdata/wiki/The-spectacles-of-a-web-server-log-file

* backends

netdata can now archive metrics to `JSON` backends

(both push, by @lfdominguez, and pull modes).

* IPMI monitoring

netdata now has an IPMI plugin (based on freeipmi)

for monitoring server hardware.

The plugin creates (up to) 8 charts:

1. number of sensors by state

2. number of events in SEL

3. Temperatures CELCIUS

4. Temperatures FAHRENHEIT

5. Voltages

6. Currents

7. Power

8. Fans

It also supports alarms (including the number of sensors in critical state).

For more information, check:

https://github.com/firehol/netdata/wiki/monitoring-IPMI

* new plugins

@l2isbad builds python data collection plugins for netdata at an wonderfull

rate! He rocks!

- **web_log** for monitoring in real-time all kinds of web server log files @l2isbad

- **freeipmi** for monitoring IPMI (server hardware)

- **nsd** (the [name server daemon](https://www.nlnetlabs.nl/projects/nsd/)) @383c57

- **mongodb** @l2isbad

- **smartd_log** (monitoring disk S.M.A.R.T. values) @l2isbad

* improved plugins

- **nfacct** reworked and now collects connection tracker information using netlink.

- **ElasticSearch** re-worked @l2isbad

- **mysql** re-worked to allow faster development of custom mysql based plugins (MySQLService) @l2isbad

- **SNMP**

- **tomcat** @NMcCloud

- **ap** (monitoring hostapd access points)

- **php_fpm** @l2isbad

- **postgres** @l2isbad

- **isc_dhcpd** @l2isbad

- **bind_rndc** @l2isbad

- **numa**

- **apps.plugin** improvements and freebsd support @vlvkobal

- **fail2ban** @l2isbad

- **freeradius** @l2isbad

- **nut** (monitoring UPSes)

- **tc** (Linux QoS) now works on qdiscs instead of classes for the same result (a lot faster) @t-h-e

- **varnish** @l2isbad

* new and improved alarms

- **web_log**, many alarms to detect common web site/API issues

- **fping**, alarms to detect packet loss, disconnects and unusually high latency

- **cpu**, cpu utilization alarm now ignores `nice`

* new and improved alarm notification methods

- **HipChat** to allow hosted HipChat @frei-style

- **discordapp** @lowfive

* dashboard improvements

- dashboard now works on HiDPi screens

- dashboard now shows version of netdata

- dashboard now resets charts properly

- dashboard updated to use latest gauge.js release

* other improvements

- thanks to @rlefevre netdata now uses a lot of different high resolution system clocks.

netdata has received a lot more improvements from many more contributors!

Thank you all!

netdata (1.5.0) - 2017-01-22

* yet another release that makes netdata the fastest

netdata ever!

* netdata runs on FreeBSD, FreeNAS and MacOS !

Vladimir Kobal (@vlvkobal) has done a magnificent work

porting netdata to FreeBSD and MacOS.

Everyhing works: cpu, memory, disks performance, disks space,

network interfaces, interrupts, IPv4 metrics, IPv6 metrics

processes, context switches, softnet, IPC queues,

IPC semaphores, IPC shared memory, uptime, etc. Wow!

* netdata supports data archiving to backend databases:

- Graphite

- OpenTSDB

- Prometheus

and of course all the compatible ones

(KairosDB, InfluxDB, Blueflood, etc)

* new plugins:

Ilya Mashchenko (@l2isbad) has created most of the python

data collection plugins in this release !

- systemd Services (using cgroups!)

- FPing (yes, network latency in netdata!)

- postgres databases @facetoe, @moumoul

- Vanish disk cache (v3 and v4) @l2isbad

- ElasticSearch @l2isbad

- HAproxy @l2isbad

- FreeRadius @l2isbad, @lgz

- mdstat (RAID) @l2isbad

- ISC bind (via rndc) @l2isbad

- ISC dhcpd @l2isbad, @lgz

- Fail2Ban @l2isbad

- OpenVPN status log @l2isbad, @lgz

- NUMA memory @tycho

- CPU Idle @tycho

- gunicorn log @deltaskelta

- ECC memory hardware errors

- IPC semaphores

- uptime plugin (with a nice badge too)

* improved plugins:

- netfilter conntrack

- mysql (replication) @l2isbad

- ipfs @pjz

- cpufreq @tycho

- hddtemp @l2isbad

- sensors @l2isbad

- nginx @leolovenet

- nginx_log @paulfantom

- phpfpm @leolovenet

- redis @leolovenet

- dovecot @justohall

- cgroups

- disk space

- apps.plugin

- /proc/interrupts @rlefevre

- /proc/softirqs @rlefevre

- /proc/vmstat (system memory charts)

- /proc/net/snmp6 (IPv6 charts)

- /proc/self/meminfo (system memory charts)

- /proc/net/dev (network interfaces)

- tc (linux QoS)

* new/improved alarms:

- MySQL / MariaDB alarms (incl. replication)

- IPFS alarms

- HAproxy alarms

- UDP buffer alarms

- TCP AttemptFails

- ECC memory alarms

- netfilter connections alarms

- SNMP

* new alarm notifications:

- messagebird.com @tech-no-logical

- pagerduty.com @jimcooley

- pushbullet.com @tperalta82

- twilio.com @shadycuz

- HipChat

- kafka

* shell integration

- shell scripts can now query netdata easily!

* dashboard improvements:

- dashboard is now faster on firefox, safari, opera, edge

(edge is still the slowest)

- dashboard now has a little bigger fonts

- SHIFT + mouse wheel to zoom charts, works on all browsers

- perfect-scrollbar on the dashboard

- dashboard 4K resolution fixes

- dashboard compatibility fixes for embedding charts in

third party web sites

- charts on custom dashboards can have common min/max

even if they come from different netdata servers

- alarm log is now saved and loaded back so that

the alarm history is available at the dashboard

* other improvements:

- python.d.plugin has received way to many improvements

from many contributors!

- charts.d.plugin can now be forked to support

multiple independent instances

- registry has been re-factored to lower its memory

requirements (required for the public registry)

- simple patterns in cgroups, disks and alarms

- netdata-installer.sh can now correctly install

netdata in containers

- supplied logrotate script compatibility fixes

- spec cleanup @breed808

- clocks and timers reworked @rlefevre

netdata has received a lot more improvements from many more

contributors!

Thank you all guys!

netdata (1.4.0) - 2016-10-04

At a glance:

- the fastest netdata ever (with a better look too)!

- improved IoT and containers support!

- alarms improved in almost every way!

- new plugins:

softnet netdev,

extended TCP metrics,

UDPLite

NFS v2, v3 client (server was there already),

NFS v4 server & client,

APCUPSd,

RetroShare

- improved plugins:

mysql,

cgroups,

hddtemp,

sensors,

phpfm,

tc (QoS)

In detail:

* improved alarms

Many new alarms have been added to detect common kernel

configuration errors and old alarms have been re-worked

to avoid notification floods.

Alarms now support notification hysteresis (both static

and dynamic), notification self-cancellation, dynamic

thresholds based on current alarm status

* improved alarm notifications

netdata now supports:

- email notifications

- slack.com notifications on slack channels

- pushover.net notifications (mobile push notifications)

- telegram.org notifications

For all the above methods, netdata supports role-based

notifications, with multiple recipients for each role

and severity filtering per recipient!

Also, netdata support HTML5 notifications, while the

dashboard is open in a browser window (no need to be

the active one).

All notifications are now clickable to get to the chart

that raised the alarm.

* improved IoT support!

netdata builds and runs with musl libc and runs on systems

based on busybox.

* improved containers support!

netdata runs on alpine linux (a low profile linux distribution

used in containers).

* Dozens of other improvements and bugfixes

netdata (1.3.0) - 2016-08-28

At a glance:

- netdata has health monitoring / alarms!

- netdata has badges that can be embeded anywhere!

- netdata plugins are now written in Python!

- new plugins: redis, memcached, nginx_log, ipfs, apache_cache

IMPORTANT:

Since netdata now uses Python plugins, new packages are

required to be installed on a system to allow it work.

For more information, please check the installation page:

https://github.com/firehol/netdata/wiki/Installation

In detail:

* netdata has alarms!

Based on the POLL we made on github

(https://github.com/firehol/netdata/issues/436),

health monitoring was the winner. So here it is!

netdata now has a poweful health monitoring system embedded.

Please check the wiki page:

https://github.com/firehol/netdata/wiki/health-monitoring

* netdata has badges!

netdata can generate badges with live information from the

collected metrics.

Please check the wiki page:

https://github.com/firehol/netdata/wiki/Generating-Badges

* netdata plugins are now written in Python!

Thanks to the great work of Paweł Krupa (@paulfantom), most BASH

plugins have been ported to Python.

The new python.d.plugin supports both python2 and python3 and

data collection from multiple sources for all modules.

The following pre-existing modules have been ported to Python:

- apache

- cpufreq

- example

- exim

- hddtemp

- mysql

- nginx

- phpfm

- postfix

- sensors

- squid

- tomcat

The following new modules have been added:

- apache_cache

- dovecot

- ipfs

- memcached

- nginx_log

- redis

* other data collectors:

- Thanks to @simonnagl netdata now reports disk space usage.

* dashboards now transfer a certain settings from server to server

when changing servers via the my-netdata menu.

The settings transferred are the dashboard theme, the online

help status and current pan and zoom timeframe of the dashboard.

* API improvements:

- reduction functions now support 'min', 'sum' and 'incremental-sum'.

- netdata now offers a multi-threaded and a single threaded

web server (single threaded is better for IoT).

* apps.plugin improvements:

- can now run with command line argument 'without-files'

to prevent it from enumating all the open files/sockets/pipes

of all running processes.

- apps.plugin now scales the collected values to match the

the total system usage.

- apps.plugin can now report guest CPU usage per process.

- repeating errors are now logged once per process.

* netdata now runs with IDLE process priority (lower than nice 19)

* netdata now instructs the kernel to kill it first when it starves

for memory.

* netdata listens for signals:

- SIGHUP to netdata instructs it to re-open its log files

(new logrotate files added too).

- SIGUSR1 to netdata saves the database

- SIGUSR2 to netdata reloads health / alarms configuration

* netdata can now bind to multiple IPs and ports.

* netdata now has new systemd service file (it starts as user

netdata and does not fork).

* Dozens of other improvements and bugfixes

netdata (1.2.0) - 2016-05-16

At a glance:

- netdata is now 30% faster

- netdata now has a registry (my-netdata dashboard menu)

- netdata now monitors Linux Containers (docker, lxc, etc)

IMPORTANT:

This version requires libuuid. The package you need is:

- uuid-dev (debian/ubuntu), or

- libuuid-devel (centos/fedora/redhat)

In detail:

* netdata is now 30% faster !

- Patches submitted by @fredericopissarra improved overall

netdata performance by 10%.

- A new improved search function in the internal indexes

made all searches faster by 50%, resulting in about

20% better performance for the core of netdata.

- More efficient threads locking in key components

contributed to the overal efficiency.

* netdata now has a CENTRAL REGISTRY !

The central registry tracks all your netdata servers

and bookmarks them for you at the 'my-netdata' menu

on all dashboards.

Every netdata can act as a registry, but there is also

a global registry provided for free for all netdata users!

* netdata now monitors CONTAINERS !

docker, lxc, or anything else. For each container it monitors

CPU, RAM, DISK I/O (network interfaces were already monitored)

* apps.plugin: now uses linux capabilities by default

without setuid to root

* netdata has now an improved signal handler

thanks to @simonnagl

* API: new improved CORS support

* SNMP: counter64 support fixed

* MYSQL: more charts, about QCache, MyISAM key cache,

InnoDB buffer pools, open files

* DISK charts now show mount point when available

* Dashboard: improved support for older web browsers

and mobile web browsers (thanks to @simonnagl)

* Multi-server dashboards now allow de-coupled refreshes for

each chart, so that if one netdata has a network latency

the other charts are not affected

* Several other minor improvements and bugfixes

netdata (1.1.0) - 2016-04-20

Dozens of commits that improve netdata in several ways:

- Data collection: added IPv6 monitoring

- Data collection: added SYNPROXY DDoS protection monitoring

- Data collection: apps.plugin: added charts for users and user groups

- Data collection: apps.plugin: grouping of processes now support patterns

- Data collection: apps.plugin: now it is faster, after the new features added

- Data collection: better auto-detection of partitions for disk monitoring

- Data collection: better fireqos intergation for QoS monitoring

- Data collection: squid monitoring now uses squidclient

- Data collection: SNMP monitoring now supports 64bit counters

- API: fixed issues in CSV output generation

- API: netdata can now be restricted to listen on a specific IP

- Core and apps.plugin: error log flood protection

- Dashboard: better error handling when the netdata server is unreachable

- Dashboard: each chart now has a toolbox

- Dashboard: on-line help support

- Dashboard: check for netdata updates button

- Dashboard: added example /tv.html dashboard

- Packaging: now compiles with musl libc (alpine linux)

- Packaging: added debian packaging

- Packaging: support non-root installations

- Packaging: the installer generates uninstall script

netdata (1.0.0) - 2016-03-22

- first public release

netdata (1.0.0-rc.1) - 2015-11-28

- initial packaging