See details (Syllabus and how to enroll) HERE:
http://www.trub.in/2018/04/performance-anomalydetection-online.html
Popular Post
-
I have got the comment on my previous post “ BIRT based Control Chart “ with questions about how actually in BIRT the data are prepared for ... -
Re-posting interesting article from R-vs.-Python-for-Data-Science R vs. Python for Data Science Norm Matloff, Prof. of Computer ...
Thursday, June 21, 2018
Performance #AnomalyDetection on-line class - my presentation at #cloudXchange virtual conference
See details (Syllabus and how to enroll) HERE:
http://www.trub.in/2018/04/performance-anomalydetection-online.html
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.org). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
Tuesday, June 19, 2018
"The Ride of #AnomalyDetection" -#cloudXchange2018 video is here going now
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.org). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
Self-Driven IT Ops. starts with Anomaly Detection! Check the #cloudXchange presentation about that made by CA SME
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.org). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
Monday, June 18, 2018
#CMGnews: #CLOUDXCHANGE virtual conference is tomorrow! Check the agenda here
CMG will be streaming live sessions from 7:00
AM to 7:00 PM EDT at www.cmg.org/cloudxchange. Check out our confirmed speakers below and
share your participation with #cloudXchange2018.
|
|
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.org). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
Friday, June 15, 2018
#CMGnews: The #Compuware expert speaks about #MachineLearning, #DevOps and products (#zAdviser)
That was one of the session during the National Capital Area Computer Management Group (www.CMG.org) meetup meeting "Performance Engineering for/on Mainframe and Cloud" See agenda is here: https://www.meetup.com/NCACMG/events/251111371/
This session was for members and NOVA college students.
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.org). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
Tuesday, June 12, 2018
#CMGnews - I am presenting at #CLOUDXCHANGE #VirtualConference the CMG Professional Development Offerings
That will be an announcement with some explanations of the on-line classes that are honored by CMG experts.
Among others that includes my class:
The short presentation is scheduled on the next Tuesday 6/19 at about 5:30. Please preregister to the virtual conference HERE and connect to my presentation!
To enroll go HERE or find CMG school at https://cmg1.teachable.com/
Among others that includes my class:
The short presentation is scheduled on the next Tuesday 6/19 at about 5:30. Please preregister to the virtual conference HERE and connect to my presentation!
To enroll go HERE or find CMG school at https://cmg1.teachable.com/
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.org). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
Sunday, June 10, 2018
#CMGnews in #DC- #CloudCapacity Management - fragment of the presentation
Full version is available for www.CMG.org members
NEXT MEETING ON 6/14/18 RSVP - https://www.meetup.com/NCACMG/
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.org). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
Thursday, May 31, 2018
Hey! If you live close to DC - We meet again to discuss Mainframe and Cloud related stuff in our NCA CMG meetup. Check the agenda!
Hey! If you live close to DC - We meet again to discuss Mainframe related stuff in our meetup:
LINK - https://www.meetup.com/NCACMG/events/251111371/
LINK - https://www.meetup.com/NCACMG/events/251111371/
When: Thursday, June 14, 2018
10:00 AM to 3:00 PM
10:00 AM to 3:00 PM
Add to calendar
Where:
AGENDA:
1. "Preparing Today’s Infrastructure for Tomorrow’s
Workloads", Kofi Hayford, DataCore
2. "Flash, Flash and more Flash: What’s in it for me?", John Baker from Data Kinetics
ABSTRACT: Flash. Is this the light on my camera, a plugin for my browser, or a superhero that runs really fast? If you’re in IT, flash likely refers to something else: flash memory of some sort. But even then, the term is both ubiquitous and vague. The solid-state drive in your laptop; the new memory in your z14; your new “all flash” storage array. These all boast “flash” technology that promises to make everything faster.
Flash technology is not new but reductions in price and advancements in capacity are exploding adoption. There are many compelling arguments for flash – but is it the solution to all storage bottlenecks? Take a stroll with John as we slow down the hype to explore the various implementations of flash technology and which, if any, can best speed up your datacenter. And don’t worry; I won’t be wearing a red, spandex suit.
3. "Dave’s not here: R4HA, AWLC, SCRT and other 4-letter software pricing words", John Baker from Data Kinetics
ABSTRACT: David Chase has left the building. Which leaves many of us scratching our heads about the whirlwind of available pricing options. IBM Z continues to improve efficiency and options like Country-Wide Multiplex (CMP), Mobile and Container pricing, and soft capping options, improve ROI but how does all this stuff work? The R4HA remains key but even that requires context. Its measured on each LPAR but often combined depending on what, and where, various subsystems are running. Which value, average, or total determines your software bill? And what if some LPARs are capped? This session is for everyone. Performance, Capacity, or Finance. Costs are driving more and more of our decisions. Lets start by understanding how these costs are determined.
PRESENTER: John Baker has over 25 years in the IT industry as both a customer and consultant. For the last 20 years, John has focused on mainframe performance and cost optimization. As a customer, John designed, implemented and maintained many critical projects such as WLM Goal Mode, GDPS/Data Mirroring, and merging datacenters.
Light LUNCH is provided by Compuware
4. Compuware presentations by Kelly Vogt:
- "The Practical and Wholesale Application of Strobe to Reduce Cost, Improve Scalability and Performance",
ABSTRACT: Tuning is often a reactive activity. A crisis presents and we turn out in force to stamp out the fire; then return to the myriad other things we have to do… But what if we flip that around and make it a proactive activity for fun and profit? See how a common sense approach to proactive treasure hunting in your system can save large amounts of money in your installation and improve service for your customers.
- "The Necessity of, and the Value Proposition for, Total Batch Automation with ThruPut Manager"
ABSTRACT: What is the future of your batch strategy? Is it nimble? Fluid? For all the automation brought to the mainframe, why is it that batch is still manually operated? All that tracking jobs and endless commands fiddling about with initiators and job classes. Learn why we cannot continue on like we are… and what we can do about it.
PRESENTER: Kelly Vogt joined Compuware in February as an Field Tech in support of ThruPut Manager. He has 38 years in the mainframe arena, with 24 years in systems programming and performance management. His last 14 years were spent in management leading Large Systems Engineering for Humana. He has extensive experience buying and renewing IBM and ISV hardware/software; knowledge of software license models and contracts; performance and capacity planning experience; and the day in, day out of data center operation.
5. "Performance Anomaly Detection and more at CMG Training Program" - https://www.cmg.org/professional-development/ Igor Trubin, IT Manager at Capital One, CMG director.
2. "Flash, Flash and more Flash: What’s in it for me?", John Baker from Data Kinetics
ABSTRACT: Flash. Is this the light on my camera, a plugin for my browser, or a superhero that runs really fast? If you’re in IT, flash likely refers to something else: flash memory of some sort. But even then, the term is both ubiquitous and vague. The solid-state drive in your laptop; the new memory in your z14; your new “all flash” storage array. These all boast “flash” technology that promises to make everything faster.
Flash technology is not new but reductions in price and advancements in capacity are exploding adoption. There are many compelling arguments for flash – but is it the solution to all storage bottlenecks? Take a stroll with John as we slow down the hype to explore the various implementations of flash technology and which, if any, can best speed up your datacenter. And don’t worry; I won’t be wearing a red, spandex suit.
3. "Dave’s not here: R4HA, AWLC, SCRT and other 4-letter software pricing words", John Baker from Data Kinetics
ABSTRACT: David Chase has left the building. Which leaves many of us scratching our heads about the whirlwind of available pricing options. IBM Z continues to improve efficiency and options like Country-Wide Multiplex (CMP), Mobile and Container pricing, and soft capping options, improve ROI but how does all this stuff work? The R4HA remains key but even that requires context. Its measured on each LPAR but often combined depending on what, and where, various subsystems are running. Which value, average, or total determines your software bill? And what if some LPARs are capped? This session is for everyone. Performance, Capacity, or Finance. Costs are driving more and more of our decisions. Lets start by understanding how these costs are determined.
PRESENTER: John Baker has over 25 years in the IT industry as both a customer and consultant. For the last 20 years, John has focused on mainframe performance and cost optimization. As a customer, John designed, implemented and maintained many critical projects such as WLM Goal Mode, GDPS/Data Mirroring, and merging datacenters.
Light LUNCH is provided by Compuware
4. Compuware presentations by Kelly Vogt:
- "The Practical and Wholesale Application of Strobe to Reduce Cost, Improve Scalability and Performance",
ABSTRACT: Tuning is often a reactive activity. A crisis presents and we turn out in force to stamp out the fire; then return to the myriad other things we have to do… But what if we flip that around and make it a proactive activity for fun and profit? See how a common sense approach to proactive treasure hunting in your system can save large amounts of money in your installation and improve service for your customers.
- "The Necessity of, and the Value Proposition for, Total Batch Automation with ThruPut Manager"
ABSTRACT: What is the future of your batch strategy? Is it nimble? Fluid? For all the automation brought to the mainframe, why is it that batch is still manually operated? All that tracking jobs and endless commands fiddling about with initiators and job classes. Learn why we cannot continue on like we are… and what we can do about it.
PRESENTER: Kelly Vogt joined Compuware in February as an Field Tech in support of ThruPut Manager. He has 38 years in the mainframe arena, with 24 years in systems programming and performance management. His last 14 years were spent in management leading Large Systems Engineering for Humana. He has extensive experience buying and renewing IBM and ISV hardware/software; knowledge of software license models and contracts; performance and capacity planning experience; and the day in, day out of data center operation.
5. "Performance Anomaly Detection and more at CMG Training Program" - https://www.cmg.org/professional-development/ Igor Trubin, IT Manager at Capital One, CMG director.
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.org). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
Wednesday, May 16, 2018
NCA CMG meetup meeting 12/6/2017 -roll call of participants
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.org). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
Tuesday, May 15, 2018
Got caught on the www.CMG.org official video: "41st International Performance & Capacity Conference"
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.org). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
Wednesday, April 18, 2018
Performance #AnomalyDetection Online Course Info and #Perfomalist Tool DEMO
- Perfomalist.com (Anomaly visualization) tool demo:
- See Course Here: Performance Anomaly Detection - Power of Control Chart: How to Read, How to Build, How to Use for Performance Anomaly Detection
- Free for CMG Members; $149 for Non-Members.
What is covered:
- Machine learning based Anomaly Detection technique
- Classical (SPC) and MASF (For system performance data) Control Chartirting
- Where is the Control Chart Used?
- What are the types of Control Charts?
- Reading, building, and interpreting Control Charts
- Typical cases of real world issues captured by anomaly detection system (VMs, Mainframes, Middleware, E2E response and more)
- How to build free AWS cloud server with R and build there control charts
- Performance anomaly (Perfomaly) detection system R implementation example (SEDS-lite - open source based tool)
"Perfomaly"=Performance Anomaly:
Control Chart as a Machine Learning Tool to Detect Anomalies
See mode details in another post of this blog:
Performance Anomaly ("Perfomaly") Detection. Parts 1-4: Power of Control Charts
Feedback is welcome.
Информация на русском здесь
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.org). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
Tuesday, April 17, 2018
Perfomalist is a #ChangeDetection system based on Exception Value (EV) data analysis
2022 update:
Now the same method is used for free online tool - Perfomalist https://www.perfomalist.com/
More detailed has been added to the method and published here "
CPD - Change Point Detection is planed to be implemented in the free web tool Perfomalist
___________________
The right term for SETDS methodology is Anomaly and Change (point) detection.
The second part of SETDS - trend detection recently implemented on R and got the "TrendieR" name - is actually a Change Point Detection tool.
See more details how it works in the previous post:
The second part of SETDS - trend detection recently implemented on R and got the "TrendieR" name - is actually a Change Point Detection tool.
See more details how it works in the previous post:
AnomalyDetection vs. NoveltyDetection. SETDS Method Detects and Separates both
But in short the change points are the the following equation roots (solutions)
EV(t)=0
Where t is time and EV is Exception Value (magnitude of exception calculated as the difference between actual data and baseline statistical limits UCL and LCL).
CMG.org paper there was the attempt to describe that calculation more formally by the following formulas:
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.org). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
Friday, March 2, 2018
#NemtsovPlaza opening culmination and me arguing with famous Russian journalists...
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.org). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
Wednesday, February 7, 2018
More about #CloudCapacityPlanning from #CMGnews
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.org). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
Visiting #CapitalOneCafe
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.org). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
What is Capacity Management?
What is Capacity Management? [Webinar Recap]: Capacity management is the practice of making sure IT resources meet business demands today and down the road—without over-provisioning. But the role of capacity management has changed as IT environments have evolved.
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.org). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
Tuesday, February 6, 2018
"Machine Learning for Predictive Performance Monitoring" - interesting #CMGJournal article (#CMGnews)
Tim Browning has a lot of good publications about Capacity Management in www.CMG.org and also in this blog:
"Entropy-Based Anomaly Detection for SAP z/OS Systems"
#CMGamplify - "#DataScience Tools for Infrastructure
Operational Intelligence"
"the
review of cloud computing article "Optimal Density of Workload Placement"
"Entropy-Based Anomaly Detection for SAP z/OS Systems"
#CMGamplify - "#DataScience Tools for Infrastructure
Operational Intelligence"
"the
review of cloud computing article "Optimal Density of Workload Placement"
He has just published his new paper in the CMG Journal:
"Machine Learning for Predictive Performance Monitoring",
which is available for CMG members
I have enjoyed reading the paper, below is the abstract:
I like especially his following very true saying:
"...Machines don’t actually “learn” nor do statistical algorithms represent some mechanistic disembodied intelligence. However, human learning and intelligence is greatly assisted by statistical modeling in much the same way that optics technology assists vision..."
I appreciate he referenced two my CMG papers under his "Useful Related Materials" section:
- Trubin, Igor, “Exception Based Modeling and Forecasting”, CMG2008 Proceedings
- Trubin, Igor, “Capturing Workload Pathology by Statistical Exception Detection System”,
CMG2005 Proceedings.
I appreciate he referenced two my CMG papers under his "Useful Related Materials" section:
- Trubin, Igor, “Exception Based Modeling and Forecasting”, CMG2008 Proceedings
- Trubin, Igor, “Capturing Workload Pathology by Statistical Exception Detection System”,
CMG2005 Proceedings.
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.org). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
Friday, February 2, 2018
YouTube playlist "My Work"
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.org). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
#ROBOTS IN MY LIFE - YT playlist
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.org). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
Thursday, February 1, 2018
#AnomalyDetection vs. #NoveltyDetection. SETDS Method Detects and Separates both
Reading "Anomaly detection with Apache MXNet":
"An important distinction has to be made between anomaly detection and “novelty detection.” The latter turns up new, previously unobserved, events that still are acceptable and expected. For example, at some point in time, your credit card statements might start showing baby products, which you’ve never before purchased. Those are new observations not found in the training data, but given the normal changes in consumers’ lives, may be acceptable purchases that should not be marked as anomalies."
I figured out that my SETDS method has this Novelty Detection included as my
"An important distinction has to be made between anomaly detection and “novelty detection.” The latter turns up new, previously unobserved, events that still are acceptable and expected. For example, at some point in time, your credit card statements might start showing baby products, which you’ve never before purchased. Those are new observations not found in the training data, but given the normal changes in consumers’ lives, may be acceptable purchases that should not be marked as anomalies."
I figured out that my SETDS method has this Novelty Detection included as my
EV based trends detection method (e.g. implemented in R as "TrendieR") finds recent change points in the time-serious data and then by building trend-forecast checks if the change is permanent or not. So if it is permanent the possible "novelty" is detected.
So the 1st part of SETDS (e.g. implemented as "SonR" on R) captures just anomalies and/or outliers, then Trend detection separates cases that indicate the possible "novelty". (something changed and stays changed and growing). Still false positive could be there though....
BTW there is a 3rd level of SETDS which is actually the way to correlate performance data with demand (drivers) data to build meaningful forecasts (e.g. implemented as "Model Factory")
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.org). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
Thursday, December 28, 2017
My comments on "The End of #CloudComputing"
Source: https://a16z.com/2016/12/16/the-end-of-cloud-computing/
Here is my comments:
- IoT replaces the Cloud with Fog computing. It is wise to process data just where it is captured like the human nervous system does a lot of processing before sending information to the brain.
- So centralized cloud would still be needed as a background ML engine to process big data, maybe....
- Data should be decentralized too and blockchain technology is the way to do that.
- Buttomeline is the optimal structure should be combination of centralized and decentralized computing/data processing. Again like human synergistic loop concept: smart sensors - spine brain - brain - back to muscles,
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.org). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
R or Python? Six Reasons To Learn R For Business
About Python
Python is a general service programming language developed by software engineers that has solid programming libraries for math, statistics and machine learning. Python has best-in-class tools for pure machine learning and deep learning, but lacks much of the infrastructure for subjects like econometrics and communication tools such as reporting. Because of this, Python is well-suited for computer scientists and software engineers.About R
R is a statistical programming language developed by scientists that has open source libraries for statistics, machine learning, and data science. R lends itself well to business because of its depth of topic-specific packages and its communciation infrastructure. R has packages covering a wide range of topics such as econometrics, finance, and time series. R has best-in-class tools for visualization, reporting, and interactivity, which are as important to business as they are to science. Because of this, R is well-suited for scientists, engineers and business professionals.What Should You Do?
Don’t make the decision tougher than what it is. Think about where you are coming from:- Are you a computer scientist or software engineer? If yes, choose Python.
- Are you an analytics professional or mechanical/industrial/chemical engineer looking to get into data science? If yes, choose R.
- Are you trying to build a self-driving car? If yes, choose Python.
- Are you trying to communicate business analytics throughout your organization? If yes, choose R.
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.org). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
Tuesday, December 26, 2017
#CMGnews 2017 #Hackathon Winner - "Laissez Passer", #Blockchain Based #Identity System (#MobileApp)
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.org). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
Saturday, December 16, 2017
How to do Capacity Management in the Cloud
Speaking about System (on Cloud) Management by Exception - the main topic of this blog - the anomaly (exception) detection become extremely important technique as based on that video there is apparent shift from protectiveness (classical capacity management) to reactivates. So the SETDS method works well applying now to cloud capacity/performance data.
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.org). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin
Thursday, December 7, 2017
NCA CMG meetup meeting 12/6/2017 (Capacity Management on Cloud vs. on-Prem and z/OS Performance HOT Topics)
- (0:02:17) Capacity Planning for Pervasive Encryption with zBNA - Kathy Walsh, IBM Distinguished Engineer - Abstract: This session will discuss the capacity planning methods and tools available to gain a better understanding of the impact of a pervasive encryption implementation strategy. The session will discuss the system requirements necessary to build a capacity plan and will review the steps necessary to complete the planning. Information on both DFSMS data set encryption and CF structure encryption will be shared. The capability to estimate the capacity impact on current and future technology such as a z14 processor will be covered.
- (01:08:00) Sponsor presentation: Talend | Open Source Cloud Integration Abstract: Talend is a next-generation leader in cloud and big data integration software. With Talend, you can spin up and spin down EMR clusters so you never waste resources and add unneeded expenses to your AWS account. At scale, this can save organizations millions.
Presenters: Karim Sharara (Account Executive) and Vincent Wilmot (Senior Solutions Engineer) - (02:09:00 - Partial Capture) Is Capacity Management Needed in the Cloud? - Kevin McLaughlin (https://cmgimpact.com/speakers/kevin-mclaughlin/) Capital One director (he will repeat his Velocity and CMG imPACT’17 conferences presentation) - Abstract: The cloud holds the promise of bottomless capacity, available instantly. Recently, Capital One has been shifting a significant portion of its workload to the public cloud. Kevin McLaughlin explores what capacity management looks like in the cloud, which old concepts still apply, which should be retired, and what new metrics become important in the process. Kevin also covers the importance of performance management and outlines what needs to be monitored as workloads transition to the cloud and what to monitor once a workload is fully in the cloud, as well as considerations for ensuring the legacy environment maintains sufficient capacity during the transition. (see more details HERE (http://www.trub.in/2016/08/cmg-impact-and-velocity-conferences.html)
He started in 1979 as IBM/370 system engineer. In 1986 he got his PhD. in Robotics at St. Petersburg Technical University (Russia) and then worked as a professor teaching CAD/CAM, Robotics for 12 years. He published 30+ papers and made several presentations for conferences related to the Robotics and Artificial Intelligent fields. In 1999 he moved to the US, worked at Capital One bank as a Capacity Planner. His first CMG.org paper was written and presented in 2001. The next one, "Exception Detection System Based on MASF Technique," won a Best Paper award at CMG'02 and was presented at UKCMG'03 in Oxford, England. He made other tech. presentations at IBM z/Series Expo, SPEC.org, Southern and Central Europe CMG and ran several workshops covering his original method of Anomaly and Change Point Detection (Perfomalist.com). Author of “Performance Anomaly Detection” class (at CMG.org). Worked 2 years as the Capacity team lead for IBM, worked for SunTrust Bank for 3 years and then at IBM for 3 years as Sr. IT Architect. Now he works for Capital One bank as IT Manager at the Cloud Engineering and since 2015 he is a member of CMG.org Board of Directors. Runs UT channel iTrubin