Trend Predictions Using RRDtool and Cacti

Post general support questions here that do not specifically fall into the Linux or Windows categories.

Moderators: Developers, Moderators

Post Reply
User avatar
TheWitness
Developer
Posts: 16897
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Trend Predictions Using RRDtool and Cacti

Post by TheWitness »

All,

I wanted to upload this in case people have questions relative to using RRDtool for performing trend analysis. It's a great write-up of where you can take a modern Cacti, and I would like to thank the author.
Attachments
Example Graph with Prediction.png
Example Graph with Prediction.png (796 KiB) Viewed 1782 times
Trend-predictions-with-RRDtool.pdf
(456.51 KiB) Downloaded 53 times
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
User avatar
TheWitness
Developer
Posts: 16897
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Re: Trend Predictions Using RRDtool and Cacti

Post by TheWitness »

Here is also a good article on HoltWinters.

https://www.usenix.org/legacy/events/li ... index.html

and for Prediction:

https://hints.jeb.be/2009/12/04/trend-p ... h-rrdtool/

I'll post additional resources here separate from several others discussions that have taken place on the forums over the years, for example:

viewtopic.php?t=25930

and

viewtopic.php?t=29963

and a plugin, that I have not evaluated.

viewtopic.php?t=48807

and Least Squares

viewtopic.php?f=5&t=23758
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
User avatar
TheWitness
Developer
Posts: 16897
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Re: Trend Predictions Using RRDtool and Cacti

Post by TheWitness »

Okay, after some discussion. Here is a draft plan with assignments.
  1. First merge the special data source types from the Least Squares post into mainline (TheWitness - Complete)
  2. Second add the HoltWinters Consolidation Functions to the core (TheWitness)
  3. Provide Mock-Up for a dynamic interface where you can turn on/off Predictions in any Graph (Petr Macan)
  4. Discuss Mock-Up and arrive at a plan that does not radically alter templates, but provides a way to scale up prediction using the Cacti Templating engine if possible. (TBD)
  5. Perform raw development of agreed to interface (Petr Macan)
The first release of Forecasting add-on may just be the UI to do live predictions, and second pass to scale out that model. Of course, this post here is to foster the debate.
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
User avatar
TheWitness
Developer
Posts: 16897
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Re: Trend Predictions Using RRDtool and Cacti

Post by TheWitness »

Looking at RAW HoltWinters, it looks like we would require a schema change. We have the following RRA's per the RRDtool documentation:
  • RRA:HWPREDICT:rows:alpha:beta:seasonal period[:rra-num]
  • RRA:MHWPREDICT:rows:alpha:beta:seasonal period[:rra-num]
  • RRA:SEASONAL:seasonal period:gamma:rra-num[:smoothing-window=fraction]
  • RRA:DEVSEASONAL:seasonal period:gamma:rra-num[:smoothing-window=fraction]
  • RRA:DEVPREDICT:rows:rra-num
  • RRA:FAILURES:rows:threshold:window length:rra-num
If we use the Structured SQL, we would need additional columns
  • alpha - mandatory for HWPREDICT, MHWPREDICT
  • beta - mandatory for HWPREDICT, MHWPREDICT
  • seasonal period - mandatory for HWPREDICT, MHWPREDICT, SEASONAL, DEVSEASONAL
  • gamma - mandatory for DEVSEASONAL
  • smoothing_window - optional for SEASONAL, DEVSEASONAL
  • threshold - mandatory for FAILURES
  • window_length - mandatory for FAILURES
The RRA number looks like it's mandatory for all but HWPREDICT and MHWPREDICT.
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Post Reply

Who is online

Users browsing this forum: No registered users and 0 guests