Popular Post


Monday, December 28, 2020

My Article: "IT-Control Chart" reached 800 reads (#qualitycontrol #capacitymanagement #performanceengineering)

 ABSTRACT: The Control Chart is one of the main Six Sigma tools to optimize business processes. After some adjustments it is used now as visualization tool in IT Capacity Management especially in “behavior learning” products to underline performance and capacity usage anomalies. This review answers the following questions. What is the Control Chart and how to read it and where to use? Review of some performance tools that use it. Control chart types: MASF charts vs. classical SPC; introduction to IT-Control Chart for IT application performance control. How to build a Control Chart using Excel for interactive analysis and R scripting to do it automatically?

The full paper is HERE

Wednesday, December 9, 2020

#AWS #Re:invent - Capacity Planning Use Case

 From the following session:

How Capital One manages the health of its applications on AWS

As your applications grow, your resources can scale across multiple accounts and AWS Regions. In this session, learn how you can intelligently automate your applications on AWS using DevOps, machine learning, and support tools from AWS such as AWS Health, AWS Trusted Advisor, Service Quotas, AWS Config, and the AWS Well-Architected Tool. Additionally, hear how Capital One uses AWS Health across accounts to monitor the health of their applications on AWS at scale.

Tipu Qureshi, AWS Speaker :

Friday, December 4, 2020

This year at #CMGIMPACT2021, I’ll be a speaker on "Cloud Resources Workload Profiling". Anyone looking to attend please contact me for a discount code, saving 40% off the registration price. #CMGnews

This year at #CMGIMPACT2021, I’ll be a speaker on Cloud Resources Workload Profiling. Anyone looking to attend please contact me for a discount code, saving 40% off the registration price. Find more information on IMPACT 2021 Virtual Conference here: cmgimpact.com/home2021/

#CMGnews: "Detection of Performance #Anomaly using DESOM" - #cmgimpact2021 session


Deep Embedded Self Organizing Map (DESOM), a hybrid Deep Neural Network based Autoencoder-Decoder (AE-DE) with an embedded Self Organizing Map (SOM), is applied successfully for the first time to detect anomaly in the performance metrics of mobile network entities with over 94% accuracy. SOM has been widely used in many areas for anomaly detection such as fraud detection, intrusion detection, etc. DESOM is a recent enhancement of SOM but not evaluated as practical solution for real problems prior to this work. Several novel methods to detect concept drift using the intrinsic features of DESOM have been incorporated in the complete solution pipeline.

Jayanta Choudhury
Senior Data Scientist
Ericsson Inc.
Santa Clara, California United States

Anila Joshi
Sr. Data Science Manager
Ericsson Inc.
Santa Clara, California United States

Performance Engineering and DevOps


Tuesday, December 1, 2020

#AWS #Re:invent virtual conference activities log

I will be putting there Re:invent sessions that could relate to this blog topics... 

Machine Learning Keynote (https://virtual.awsevents.com/media/1_07cg4srl)

Join Swami Sivasubramanian for the first-ever Machine Learning Keynote, live at re:Invent. Hear how AWS is freeing builders to innovate on machine learning with the latest developments in AWS machine learning, demos of new technology, and insights from customers.

4:15 PM TO 4:45 PM EST

Productionizing R workloads using Amazon SageMaker, featuring Siemens

R language and its 16,000+ packages dedicated to statistics and ML are used by statisticians and data scientists in industries such as energy, healthcare, life science, and financial services. Using R, you can run simulations and ML securely and at scale with Amazon SageMaker, while reducing the cost of development by using the fully elastic resources in the cloud. Learn how Siemens Energy, a technology provider for more than one-sixth of the global electricity generation, with more than 91,000 employees and presence in more than 90 countries, is enabling new digital products with Amazon SageMaker to build, train, and deploy statistical and ML models in R at scale.

 DEC 1, 2020 | 4:45 PM - 5:15 PM EST (now...) DEC 2, 2020 | 12:45 AM - 1:15 AM EST DEC 2, 2020 | 8:45 AM - 9:15 AM EST [NEW LAUNCH!] Detect abnormal equipment behavior by analyzing sensor data Industrial companies are constantly working to avoid unplanned downtime due to equipment failure and to improve operational efficiency. Over the years, they have invested in physical sensors, data connectivity, data storage, and dashboarding to monitor equipment and get real-time alerts.... 


 DEC 2, 2020 | 2:15 PM - 2:45 PM EST DEC 2, 2020 | 10:15 PM - 10:45 PM EST DEC 3, 2020 | 6:15 AM - 6:45 AM EST [NEW LAUNCH!] Amazon Lookout for Vision Figuring out if a part has been manufactured correctly, or if machine part is damaged, is vitally important. Making this determination usually requires people to inspect objects, which can be slow and error-prone. 
Dec 2 8pm The most interesting session for me as a cloud capacity manager so far is: 

"Optimize compute for performance and cost"

"It’s easier than ever to grow your compute capacity and enable new types of cloud computing applications while maintaining the lowest total cost of ownership (TCO) by blending EC2 Spot Instances, On-Demand Instances, and Savings Plans purchase models. In this session, learn how to use the power of EC2 Fleet with AWS services such as Amazon EC2 Auto Scaling, Amazon ECS, Amazon EKS, Amazon EMR, and AWS Batch to programmatically optimize costs while maintaining high performance and availability. Dive deep into cost-optimization patterns for workloads such as containers, web services, CI/CD, batch, big data, and more."

 Most interesting slides from that session:

 I plan to look at suggested workshops to learn in details how AWS suggests to do capacity usage/rightsizing and cost optimization for ASG, EMR, ECS, EKS and batch services.

#AWS #Re:invent virtual conference activities (I support Capital One's sponsor booth there! )

I hope you enjoy the conference. My presence at Capital One's (platinum sponsor) is to answer questions from the virtual chat at the following time spots: Wednesday, December 2⋅2:30 – 5:00pm Thursday, December 3⋅12:00 – 2:30pm Tuesday, December 8⋅12:00 – 2:30pm Wednesday, December 9⋅2:30 – 5:00pm Wednesday, December 16⋅2:30 – 5:00pm Thursday, December 17⋅2:30 – 5:00pm Thursday, December 17⋅2:30 – 5:00pm ______________________________________ Please come over to our page there and chat! Also please check the list of session related to this blog topic - http://www.trub.in/2020/12/aws-reinvent-virtual-conference_1.html