Popular Post

Friday, May 3, 2019

CMG #THEXCHANGE #VirtualConference is all about #scalability and #reliability

The next CMG #VirtualConference has just been announced. This next event is all about
#scalability and #reliability. No need to step out of the office, CMG is bringing the conference to
you. Don't miss out on the #THEXCHANGE virtual conference coming to an iPad or computer
near you on June 18, 2019. Reserve your “virtual seat” here: http://bit.ly/2UDj4IR #cmgnews

Wednesday, May 1, 2019

I will moderate #CMGExpert Roundtable on #AI - please join!

Please join us for our Roundtable on . Participants will engage in a small group discussion on the topic lead by moderator of . After the session, CMG will publish a piece recapping the session for the rest of the . Participants have the potential to connect with some of our influential , , and readers. Interested in attending CMG’s New Event Series? For more information and to register, click here: http://bit.ly/2DIZuBk

Friday, April 26, 2019

Under #cloud -y skies - #capacityPlanning in changing times ‐ Brian L Wong

Brian Wong is a Technology Fellow at Capital One and his talk was very much about the company’s transition to the cloud. Brian talked about how capacity planning is far from obsolete, but practicing it in a rapidly changing environment is entirely different from how it was practiced in the past. In his talk, Brian addressed containers, microservices, function-as-a-service, and fully managed services. He outlined the next-generation computing environment from an observability, capacity, and analytical perspective, and speculated on the form and value of capacity planning in these environments.

NB: I proud to work with him now!

Wednesday, January 16, 2019

My CMG IMPACT conference presentation is scheduled 2/20/19 Wednesday at 1:30pm - "Catching Anomaly and Normality in Cloud by Neural Net and Entropy Calculation"

See details here: https://cmgimpact.com/timetable/event/catching-anomalies-in-the-cloud/ 

UPDATE: That was a successful presentation, slides and video will available later for download.
By Igor Trubin, Capital One Bank
Part 1.  The Neural Network (NN) is not a new machine learning method. About 12 years ago I was involved as a Capacity Planning resource for the project of building an infrastructure (servers) to run NN for the fraud detection application. Now NN got much more attention and popularity as a part of AI, mostly because the computing power is increased dramatically and respectively more tasks can be done by using NN.
The goal of the presentation is  to demystify the technique in some simple terms and examples to show what it actually is and how that could be used for Capacity and Demand management. That is done by developing R code to recognize typical workload pasterns, like OLTP, or others in the time series performance data daily profiles.
Part 2. It is the typical concern to detect anomalies for short living objects or for the object with very small amount of measurements. Why? Number of those objects could be thousands and thousands so it is important to separate exceptional ones with anomalies for further investigation.  That could be servers or customers that have just started being monitored or public cloud objects (EC2s, ASGs) that usually have very short lifespan. Suggested approach to detect anomalous behavior of this type of objects is  to estimate the Entropy of the each object. If the entropy is low, everything should be in order and most likely OK. If not – there is a possible disorder there or mess and someone needs to check what is going on with the object. The method is implemented in the cloud based application written on R that scans every  hour all cloud Auto Scaling Groups (ASG) to detect imbalanced ones in term of number of EC2 instances in the group. That allows to separate a couple hundreds ASGs out of hundreds thousands of them.
This entropy based method is well known and it described in details in the following www.Trub.in  blog post:
“Quantifying Imbalance in Computer Systems” which is written based on CMG’12 paper.

Tuesday, December 11, 2018

CMG IMPACT conference discount #cmgnews

All -

I have promotional code for you in case you want to attend. Just respond and I'll give you a good discount!

Thank you!

Igor Trubin 


Wednesday, November 21, 2018

Great Customer Feedback about the #CapacityManagement Service I Provide

I have just got an internal feedback which has impressed me so I have decided to share that here as a good indication of making difference by Capacity Management service I provide to my customers:

..."Igor has helped us on a couple of instances, prevent potential disasters within our platform by the historical trends he’s tracking.  We know this since there was one occasion where our server crashed when we didn't react fast enough to Igor’s email warnings..."

Wednesday, November 14, 2018

AIXCHANGE (Virtual #CMGnews Event about #AI) November 27 @ 10:00 am - 3:00 pm EST

Attend this virtual conference all about artificial intelligence!
Conference rooms and office stand-ups are all buzzing. Artificial intelligence (AI) is emerging to represent one of the largest technological shifts across countless industries in recent history.
From driving manufacturing to supporting marketing to improving customer retention to improving ITops, AI is become the most in-demand technology of IT execs and quickly rising to the top of the list for IT investment in 2019.
According to recent reports, the machine learning market alone is anticipated to grow from $1.4B in 2017 to $8.8B by 2022.
CMG wants to help you to navigate this technological shift and keep you the smartest team member at the table. On November 27th, join CMG and its partners for AIXCHANGE. The latest of CMG’s virtual conference program will feature live presentations from companies and individuals leading in the AI space.
Scheduled Sessions
  • 10:00 AM - The History and Future of AI with Bryan Krouse
  • 11:00 AM - The Machines are Talking - The Future of AI and Chat for the Enterprise with Stephen Mallik
  • 12:00 PM - A Practical Guide for Information Discovery Using Machine Learning and Visualization
  • 1:00 PM - To Be Announced!
  • 2:00 PM - Soon AI will Test Everything with Jason Arbon

Tuesday, November 13, 2018

"Implementation and Interpretation of Control Charts in R" - qcc package

I was pointed to the nice resent on-line publication: https://datascienceplus.com/implementation-and-interpretation-of-control-charts-in-r/ 

"...Control charts are used during the Control phase of DMAIC methodology. Control charts, also known as Shewhart charts or process-behavior charts, are a statistical process control tool used to determine if a manufacturing or business process is in a state of control. If analysis of the control chart indicates that the process is currently under control, then no corrections or changes to process control parameters are needed. Moreover, data from the method can be used to predict the future performance of the process. If the control chart indicates that the process is not in control, analysis of the chart can help determine the sources of variation, as this will result in degradation of process performance..."

My comment:
When I had been developing SEDS (Performance Anomaly Detection System) long ago (years ago) I looked at that package (and referenced the link to my early CMG papers, BTW) even not knowing how to write R programs (now I can!)... They might improved that, but I did not find that time the way to do MASF type of control charts. I have even dreamed to build SETDS charts (IT-Control Charts)  package on a open source way. So my approach is the same but different, please read details in my paper:

Friday, October 19, 2018

#CMGnews: The training course Performance Anomaly Detection is now free for CMG Members. Visit the Membership Benefits Page for Access.

Be a CMG member and get the following benefits:
  • Access to a repository of more than over 1,000 research papers, presentations, and white papers from industry experts for the information you need for delivering improved results.
  • Free 1 hour webinars featuring industry experts and technology demos and recorded webinar access.
  • Free newsletters that feature the latest informative CMG news.
  • Quarterly issues of the CMG Journal
  • Discounted registration for CMG International-hosted events.
  • Access to CMG imPACt conference presentations and papers.
  • Access to our members-only videos channel with event videos, interviews and more.
  • Discounted registration for CMG’s international annual imPACt conference bringing together the best in the industry for four days of research, training, workshops, networking and practice sharing.
  • Access to our international Member Directory.
  • Access to CMG's Slack channel and LinkedIn to take part in performance and capacity discussions, hot topics, evaluations, information, networking, stay up to date with company news, and more!