Recently implementing some solution using IBM TCR I have noticed that one of the default reports in TCR/BIRT is a Control Chart in the classical (SPC) version. Looks like that was one of the requirements for ability to build a consistent reports using TCR/BIRT as it's written here: Tivoli Common Reporting Enablement Guide
So I have built a few TCR reports with control chart against Tivoli performance data and that was somewhat useful.
I believe the IT-Control Chart (see my post about that type of control chart here) would give much more value for analyzing time stamped historical data. Is that possible to build using BIRT?
The BIRT is open source free BI tool (can be downloaded from here). I have downloaded and installed that on my laptop and have built a few reports for one of my customers. One of them was to filter out the exceptionally "bad" objects (servers) using EV criteria (see the linked post here).
Then I have built the IT-Control chart using BIRT. Below is the result:
Yes, it is possible with some limitation I have noticed in the current version of BIRT report designer. You could see it if you compare that with oher IT-Control Charts I have build using R (See example here), SAS (Example here) or EXCEL (here).
Anyway, could you see how that chart reports pro-actively on an issue?
So it is another way (not to program like in R or SAS and not to make manually like in EXCEL) to build IT-Control charts. After it is built that could be submitted to TCR (or other reporting portals) to be seen/run on a web.
This blog relates to experiences in the Systems Capacity and Availability areas, focusing on statistical filtering and pattern recognition and BI analysis and reporting techniques (SPC, APC, MASF, 6-SIGMA, SEDS/SETDS and other)
Popular Post
-
I have got the comment on my previous post “ BIRT based Control Chart “ with questions about how actually in BIRT the data are prepared for ...
-
Your are welcome to post to this blog any message related to the Capacity, Performance and/or Availability of computer systems. Just put you...
_
Saturday, September 17, 2011
BIRT based Control Chart
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.com). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
Subscribe to:
Post Comments (Atom)
Hi Igor,
ReplyDeleteInteresting results. Does BIRT allow you to use multiple time classifiers (e.g. time of day, day of week, time of month) to compute mean, UCL, LCL? Can you compute a reference set?
I have used reference sets as a stationary short term forecast. If I am looking at the past 4 hours, the present, and the forecast next 4 hours, I can compare the current event - if it shows novelty - to the max/min of the previous hours and forecast hours, to determine if the current novelty event is 'advisory' (for example, it is statistically unusual but lower than the recent maximum or forecast maximum (UCL)) or a 'threat' (higher than nearby LCL/UCLs. This works well for monitoring applications where you want to do some threat assessment of novelty events. I have found that sometimes workloads are shifted in time due to scheduling changes, and thus create novelty that are 'advisory' events rather than 'threats'.
~ Tim Browning
Some Tim's questions in the 1st comment are answered in my next post in this blog - http://itrubin.blogspot.com/2011/09/one-example-of-birt-data-cubes-usage.html
ReplyDeleteBut I like idea to separate 'advisory' events and 'threats'... and will be keeping that in mind. I used to use a non-statistical empirical rules to filter out possible false positives, but that could be also used for having several exception categories to recognize. Thanks Tim!