apache spark - Are cached RDDs resilient to graceful worker shutdown? -

-

i have (very) small spark cluster used 'sandpit' environment several people. occasionally, need restart worker nodes in course of maintaining cluster.

if running job working off rdd has been .cache()'d, , worker stopped gracefully (by running ./stop-slave.sh on node), happens portion of cached rdd?

the 2 scenarios can think of (assuming storage level rdd memory_only, no replication) that:

  1. the worker distributes portion of rdd across other workers;
  2. the portion of rdd held worker lost, , must recomputed.

the documentation suggests partition recomputed, it's unclear whether covers 'graceful' worker shutdown.


Comments

Post a Comment

Popular posts from this blog

java - HTTP Status 500 - An exception occurred processing JSP page /second.jsp at line 15 -

-
this question has answer here: what nullpointerexception, , how fix it? 12 answers i have 4 pages on jsp web project student showing details db.. have used tomcat web server. index.html <body> <h1> student search page</h1> <form action="second.jsp"> <h2> enter id search details</h2> <input type=text name=id1 /> <br/> <input type=submit value=search /> </form> </body> second.jsp <body> <% string id =(request.getparameter("id1")); studentdao std=new studentdao(); student s=std.searchinfo("id"); %> <h1> <%=s.showstudent()%></h1> </body> student.java import java.io.*; public class student implements serializable { string name; string id1,phone,clas; ...
Read more

php - Using str_replace to translate a MySQL Table in html -

-
i have website contains pricelist of cs:go items. now, how did this: mysql db w/ prices --> select db x ( item name ) --> echo table ( works fine ) now want translation of item names. how planned it: mysql db --> $result= ( signature character ) --> $translate = str_replace (signature character $result) however, there's issue code or str_replace think. $translate returns $result no filtering. <?php require 'lang.php'; $servername = "localhost"; $username = ""; $dbname = ""; $password = ""; // create connection $conn = new mysqli($servername, $username, $password, $dbname); // check connection if ($conn->connect_error) { die("connection failed: " . $conn->connect_error); } // filter name $sql = "select name, price utf name 'k%'"; $result = $conn->query($sql); // translate $tr = str_replace('k','karambit','$result'); // ech...
Read more

asp.net mvc - Cannot display error message on Editor or EditorFor -

-
in mvc application, can display error messages inputs i.e. textboxfor , dropdownlist , etc. however, using same approach, cannot show validation error kendo().editor() or kendo().editorfor() . tried validationmessage beside validationmessagefor , not make sense. might problem be? view: <script type="text/javascript"> $(function () { //for using kendo validation: $("form").kendovalidator(); }); </script> //validation works textboxfor, dropdownlist, etc.: @html.labelfor(m => m.summary) @html.textboxfor(m => m.summary, new { maxlength = 50, @class = "k-textbox"}) @html.validationmessagefor(m => m.summary) //validation not work editor or editorfor: @html.labelfor(m => m.description, new { maxlength = 1000, @class = "editor-label" }) @(html.kendo().editor() //@(html.kendo().editorfor(m=>m.description) //also tried .name("description") .htmlattributes(new { @class...
Read more