The presentation itself was recorded and published here:
Popular Post
-
I have got the comment on my previous post “ BIRT based Control Chart “ with questions about how actually in BIRT the data are prepared for ... -
Your are welcome to post to this blog any message related to the Capacity, Performance and/or Availability of computer systems. Just put you...
Saturday, April 27, 2013
Modeling the Online Application Migration from Sparc to AIX Platform
The presentation itself was recorded and published here:
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.com). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
Thursday, April 25, 2013
I. Trubin: AIX frame and LPAR level Capacity Planning. User Case for Online Banking Application
[1] Bob Chan: “Unix
Server Sizing – Or What to do When There are No MIPS”, Proceedings of the
Computer Measurement Group, 2000
§[2] Ray White and Igor Trubin: “System Management by Exception, the Final Part”, Proceedings of the
Computer Measurement Group, 2007.
§[3] Linwood Merritt and Igor Trubin: “Disk Subsystem Capacity Management, Based on Business
Drivers, I/O Performance Metrics and MASF ”, Proceedings of the Computer Measurement Group, 2004
§[4] Igor Trubin: “Exception
Based Modeling and Forecasting”, Proceedings of the Computer Measurement Group, 2008
§[6] Jeffrey Buzen
and Annie Shum: "MASF - Multivariate
Adaptive Statistical Filtering", Proceedings of the Computer Measurement Group, 1995,
pp. 1-10.
§[7] Igor Trubin: “How
To Build IT-Control Chart - Use the Excel Pivot Table! “, “System
Management by Exception” tech. blog www.itrubin.blogspot.com
§[8] Linwood Merritt: “A Capacity Planning
Partnership with the Business”,
Proceedings of the Computer Measurement Group, 2004.
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.com). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
Thursday, April 18, 2013
Identify trends and anomalies by using wavelets - CMG'12 paper
Twelve years ago being hired as a Capacity Planner first time and not knowing anything about the specialty, I was asked to look at computer measurements to do any analysis. Applying my academic researcher skills I noticed that server's capacity usage usually shows different seasonality patterns (shifts, weekends, lunch times and so on); so my first impulse was to decompose that to several signals using Fourier Transform. I formulate the task to my manager, but for some reason (to much math and computing power requirements?) he suggested to use just standard statistical approaches instead, and I did…
I did develop and implement SEDS methodology (statistical exception detection) that naturally covers daily and weekly cycles and potentially can uncover monthly and yearly ones if there is enough data history to build baseline.
But Fourier analysis was still in my mind, and I have just been waiting for the time when our computational capacity would be enough to apply the method against system performance data….
That’s why I was positively surprised when I noticed the following paper in CMG’12 agenda:
Introduction to Wavelets and their Application for Computer Performance Trend and Anomaly Detection Dima Seliverstov, BMC Software
ABSTRACT: This paper presents a technique to identify trends and anomalies in Performance data using wavelets.
And of course, I planed (see my past post here), attended and enjoyed that, I know Dima via other CMG events, spoke with him a few times and have already analyzed some other his papers in this blog (The Exception Value Concept to Measure Magnitude of Systems Behavior Anomalies).
His "wavelet" paper is about implementation of my old dream to use something like Fourier analysis and his idea of decomposing the performance data to combination of typical wavelets is a good attempt to do that. Especially impressive was to see the "Scalogram that is a type of a heat-map to show the location of the energy as a function of frequency and time”: “Scalogram is a heat map for wavelets transformation”. Some interesting examples (including against VMware VCenter data) were presented and was calculated by MATLAB tool:
BTW stock market is already adopting this idea, the paper references that: Wavelets for Stock Market Analysis
Why not us?
… Ironically the same manager asks me now to analyze how business cycles drive capacity usage….
I did develop and implement SEDS methodology (statistical exception detection) that naturally covers daily and weekly cycles and potentially can uncover monthly and yearly ones if there is enough data history to build baseline.
But Fourier analysis was still in my mind, and I have just been waiting for the time when our computational capacity would be enough to apply the method against system performance data….
That’s why I was positively surprised when I noticed the following paper in CMG’12 agenda:
Introduction to Wavelets and their Application for Computer Performance Trend and Anomaly Detection Dima Seliverstov, BMC Software
ABSTRACT: This paper presents a technique to identify trends and anomalies in Performance data using wavelets.
And of course, I planed (see my past post here), attended and enjoyed that, I know Dima via other CMG events, spoke with him a few times and have already analyzed some other his papers in this blog (The Exception Value Concept to Measure Magnitude of Systems Behavior Anomalies).
His "wavelet" paper is about implementation of my old dream to use something like Fourier analysis and his idea of decomposing the performance data to combination of typical wavelets is a good attempt to do that. Especially impressive was to see the "Scalogram that is a type of a heat-map to show the location of the energy as a function of frequency and time”: “Scalogram is a heat map for wavelets transformation”. Some interesting examples (including against VMware VCenter data) were presented and was calculated by MATLAB tool:
BTW stock market is already adopting this idea, the paper references that: Wavelets for Stock Market Analysis
Why not us?
… Ironically the same manager asks me now to analyze how business cycles drive capacity usage….
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.com). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
Tuesday, April 9, 2013
SCMG meeting in Richmond: AIX frame and LPAR level Capacity Planning
The CMG - Southern Region meeting is scheduled April 25, 2013. I will be presenting again my CMG'12 paper:
AIX frame and LPAR level Capacity Planning. User Case for Online Banking Application
Here is agenda: LINK:
Registration:
http://regions.cmg.org/regions/scmg/spring_13/richmond/reg.htm
Location: Northrop Grumman IT, VITA Project
11751 Meadowville Lane, 2S-J3
Chester, VA 23836
AIX frame and LPAR level Capacity Planning. User Case for Online Banking Application
Here is agenda: LINK:
http://regions.cmg.org/regions/scmg/spring_13/richmond/reg.htm
Location: Northrop Grumman IT, VITA Project
11751 Meadowville Lane, 2S-J3
Chester, VA 23836
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.com). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
Subscribe to:
Posts (Atom)