amazon web services - It is possible use AutoScaling with Elastic Mapreduce? -


i know if can use autoscaling automatically scaling or down amazon ec2 capacity according cpu utilization elastic map reduce.

for example, start mapreduce job 1 instance, if instance arrive 50% utilization example want use created autoscaling group start new instance. possible?

do know if possible? or elastic mapreduce because "elastic", if needs starts automatically more instances without configuration?

no, auto scaling cannot used amazon elastic mapreduce (emr).

it possible scale emr via api or command-line calls, adding , removing task nodes (which not host hdfs storage). note not possible remove core nodes (because host hdfs storage, , removing nodes lead lost data). in fact, difference between core , task nodes.

it possible change number of nodes within emr "step". steps executed sequentially, cluster made larger prior step requiring heavy processing, , reduced in size in subsequent step.

from emr developer guide:

you can have different number of slave nodes each cluster step. can add step running cluster modify number of slave nodes. because steps guaranteed run sequentially default, can specify number of running slave nodes step.

cpu not metric on base scaling of emr cluster, since hadoop keep nodes busy possible when job running. better metric number of jobs waiting, can finish quicker.

see also:


Comments

Post a Comment

Popular posts from this blog

jquery - How do you format the date used in the popover widget title of FullCalendar? -

Image
in fullcalendar, how format date used in popover widget title when clicking '+n more'? code: <div class="fc-popover fc-more-popover"> <div class="fc-header fc-widget-header"> <span class="fc-close fc-icon fc-icon-x"></span> <span class="fc-title">tuesday, april 7</span> ... </div> ... </div> you use daypopoverformat that. determines date format of title of popover created eventlimitclick option. must date formatting string. default value "dddd, mmmm d" english , "ll" other languages.
Read more

asp.net mvc - SSO between MVCForum and Umbraco7 -

i need integrate sso between mvcforum (forum of company) , umbraco7 (manages cms company). however struggling shared authentication work. tried several ways suggested on other threads still not running expected. here did: 1. in mvcforum (forum.mywebsite.com) 1.1. machine key in web.xml: <machinekey validationkey="the same key umbraco7" decryptionkey="the same key umbraco7" validation="sha1" decryption="aes" /> 1.2. authenticate forms in web.xml <forms name="my-sso-auth" protection="all" path="/" timeout="43200" domain="forum.mywebsite.com" loginurl="/members/logon" enablecrossappredirects="true" /> 2. in umbraco7 (news.mywebsite.com) 2.1. machine key in web.xml: <machinekey validationkey="the same key mvcforum" decryptionkey="the same key mvcforum" validation="sha1" decryption="aes" /> 2.2. a...
Read more

Python Tkinter keyboard using bind -

i have problem using bind option can click button in keyboard, , call function once key pressed. tried taking other codes have similar purpose , saw i'm doing pretty same, though still have problem must've missed. thankful if me this. here's code: # -*- coding: utf-8 -*- #imports tkinter import * pil import imagetk, image import time import tkmessagebox #===========================================================================================================================================# #tkinter class class app(frame): def __init__(self, master=none): frame.__init__(self, master) self.pack() #===========================================================================================================================================# #game pieces classes class board: def __init__(self, rows = 7, columns = 6, picture_height = none, picture_width = none): self.rows = rows self.columns = columns self.picture ...
Read more