Visualization and Analysis of Performance Data using R
I did not attend this, but that is about free statistical and graphical tool (“R” tool and “S” language http://www.r-project.org/ ). Note: there is interface to SAS dataset function in open lib: http://lib.stat.cmu.edu/S/dataset
Functions that define and manipulate S "dataset" objects. A dataset is a matrix whose columns (variables) may be of different data types. Though motivated by a need to interface to SAS, they are useful in any data analysis. There is some function that relates to SPC: JohnsonSystem (http://lib.stat.cmu.edu/S/JohnsonSystem.q)
In 2004 he published CMG paper about R usage: The Use of R for System Performance Analysis . See also Lecture: Graphing in R (http://www.ats.ucla.edu/stat/r/library/lecture_graphing_r.htm) or http://ieee.cincinnati.fuse.net/R_IEEE_V2.pdf
Major takeaways: That might be a good SAS/Graph replacement. I also think about writing some "S" program to build SEDS type of Control charts to illustrate how that works, for instance THAT COULD BE USED for a workshop similar Mr. Holtman had done.
Automating Process Pathology Detection – Rule Engine Design Hints
This is about analytical approach to capture pathologies like run-away and memory leaks. BTW Ron referenced my papers as an example of different (statistical) approach to do the same. This is continuation of his previous work in this field: http://www.cmg.org/proceedings/2003/3027.pdf
In private conversation he actually expressed some interest to put together both approaches to see how that works from different angles... I am opened.
CMG-T: Modeling and Forecasting
Speaker: Dr. Michael A. Salsburg
Just a good an overview and tutorial for queuing theory and simulation based modeling and forecasting vs. statistical modeling-forecasting way I presented in my paper.
eBay - the Shape of Infrastructure to Come
Speaker: Paul Strong
Cloud computing is a “Outsourcing 2.0”, sooner or later even banks will use that approach to use capacity on-demand from cloud instead of having own computer farm….
Exception Based Modeling and Forecasting
Speaker: Dr. Igor A. Trubin
This is my presentation which was successful and attracted more than 60 attendees. There were a lot of questions and comments during and before this session, positive comments were received from Mark Friedman (After I had to clarify for him 3-D concept of weekly control charts... - my bad ,I was probably not very clear presenting that...) and Ron Kaminski who expressed some interest in my EV algorithm to capture recent bad trends as that solves some problems of workload pathology recognition on which he has been working recently.
So You Want to Manage Your z-Series MIPS? Then Detect & Control Application Workload Variance!
Speaker: John S. Van Wagenen, Caterpillar
Unfortunately I could not attend this session as I presented mine in the same time. But this paper is about SEDS-like approach to manage Mainframe capacity! And that presentation got prestigious Mullen award!
There is a similar paper written by the same author last year: Performance Monitoring Process for Out of Standard Applications
SEDS approach is valid and our implementation on mainframe might be adjusted using this paper methodology.
Predicting the Relative Performance of CPU
Speaker: Debbie Sheetz
I used similar approach (see my 1st CMG paper and 1st figure in my last paper) in the past and know how challenging is to apply SPEC or other benchmarks to real servers with different configurations.
This paper could be helpful in соме consolidation projects.
Panel: Michelson Panel - Visualization
Speaker: Jeff Buzen
That was interesting to see deferent ways to present data visually. During this panel discussions I realized that my weekly control charts and especially 3-D version of that are kind of unique. I have even approached Dr. Buzen, with my comments about that…
Mainstream NUMA and the TCP/IP stack
Speaker: Mark B. Friedman
This is brilliant but very scary paper. Two scary points:
A. For multicore servers the speed of memory access could be unpredictable and sometimes deadly slow because of NUMA – non universal memory access. And there are no any metrics or tools to measure that!
B. High performance network (1-10 and higher Gb) cannot be fully utilized, because it might consume all CPU cycles only to process network related interrupts.
It’s OK if network interface bandwidth utilization is low. And we should be careful with using modern multicore processors (8 and more cores).
Performance and Capacity Management in an Outsourced Environment
Speaker: Jeff Hammond
This is very useful information about what we could expect working with outsourced service (people) or if we got outsourced ourselves. It confirms my own experience.
Action Items: Be prepared just in case!
I have got the comment on my previous post “ BIRT based Control Chart “ with questions about how actually in BIRT the data are prepared for ...
Your are welcome to post to this blog any message related to the Capacity, Performance and/or Availability of computer systems. Just put you...
Saturday, January 24, 2009
CMG'08 Trip Report
He started in 1979 as an IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for about 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US and worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG 2002 and was presented at UKCMG 2003 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (www.Performalist.com). Author of “Performance Anomaly Detection” class (https://cmg1.teachable.com). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 2+ years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering department and since 2015 he is a member of CMG.org Board of Directors