2015 UPDATE: Now having access to HADOOP I am thinking of how to use Map-Reduce to speed up SETDSing against the big performance data. The flowing thesis could very helpful for that:
Distributed Anomaly Detection andPrevention for Virtual Platforms by Ali Imran Jehangiri
Last week we ran our Richmond SCMG meeting following the agenda published HERE (links to presentations are there too including mine). The 1st presentation was titled: "Some Workload Scheduling Alternatives for High Performance Computing Systems" and presented by Jim McGalliard, the frequent CMG presenter and our friend. He mentioned some old topic he already presented in the past – Supercomputer batch jobs optimization by categorizing and scheduling them. Then after a brief description of MapReduce
( “method for simple implementation of parallelism in a program..”)
he explained how HADOOP
(“Designed for very large (thousands of processors) systems using commodity processors, including grid systems, Hadoop is a specific open source implementation of the MapReduce framework written in Java and licensed by Apache” )
does job scheduling using MapReduce and some other means.
That presentation leads me to another task to consider – job scheduling in the cloud. Ironically just before the meeting I had red interesting article about it (BTW it was recommended reading from my current manager as we are also going to clouds… What about you?). Here is the link to that article from one of the author’s webpage (Asit K Mishra ) and title:
”Towards Characterizing Cloud Backend Workloads: Insights from Google Compute Clusters”
I firmly believed that the workload characterization is going away due to virtualization - each workload/apps can have separate virtual server now. Right? But based on the article looks like the jobs categorization could be useful for optimizing their schedule to run in the cloud and maybe in HADOOP…
Distributed Anomaly Detection andPrevention for Virtual Platforms by Ali Imran Jehangiri
Last week we ran our Richmond SCMG meeting following the agenda published HERE (links to presentations are there too including mine). The 1st presentation was titled: "Some Workload Scheduling Alternatives for High Performance Computing Systems" and presented by Jim McGalliard, the frequent CMG presenter and our friend. He mentioned some old topic he already presented in the past – Supercomputer batch jobs optimization by categorizing and scheduling them. Then after a brief description of MapReduce
( “method for simple implementation of parallelism in a program..”)
he explained how HADOOP
does job scheduling using MapReduce and some other means.
That presentation leads me to another task to consider – job scheduling in the cloud. Ironically just before the meeting I had red interesting article about it (BTW it was recommended reading from my current manager as we are also going to clouds… What about you?). Here is the link to that article from one of the author’s webpage (Asit K Mishra ) and title:
”Towards Characterizing Cloud Backend Workloads: Insights from Google Compute Clusters”
I firmly believed that the workload characterization is going away due to virtualization - each workload/apps can have separate virtual server now. Right? But based on the article looks like the jobs categorization could be useful for optimizing their schedule to run in the cloud and maybe in HADOOP…
2 comments:
Bilgisayar oyunlarına olan ilgim her zaman yüksektir ve yeni oyunlar keşfetmek benim için büyük bir tutku haline geldi. Bu nedenle, güvenilir kaynaklardan oyun indirirken dikkatli oluyorum ve oyun indir sitesi gibi siteleri tercih ediyorum. Böylece hem zaman kazanıyor hem de güvenli bir şekilde istediğim oyunlara ulaşabiliyorum. Son zamanlarda en çok ilgimi çeken oyunları oradan edindim ve gerçekten memnunum.
35F4D9BD5D
For high-quality custom printing solutions, many businesses and individuals turn to specialized services like DTF Printing & DTF Transfers in Bergen County, New Jersey | DTFhub. They offer a wide range of transfer options that ensure vibrant, durable results for apparel and promotional items. Whether you're looking to create unique designs or mass produce branded merchandise, their expertise can help bring your vision to life. Trusting local providers like DTFhub guarantees quick turnaround times and exceptional customer support.
Post a Comment