R foreach loop - package load fails -

-

i'm unable load packages parallel processes in foreach %dopar% loop.

i create 4 sock clusters using foreach , dosnow packages, try run trivial parallel process. works %dopar% without using packages, loading arbitrary package throws error.

sample code below, followed session info showing packages in use.

i have used type of code before without issues. recent network changes @ company meant had change settings (default library path, etc), may related change. not sure start in troubleshooting issue - appreciated!

#load foreach , dosnow packages, setup 4 clusters#  > require(foreach)  > require(dosnow)  > registerdosnow(makecluster(4, type = "sock"))  > getdoparworkers() [1] 4  > getdoparname() [1] "dosnow"  # %dopar% loop without loading packages -- works ok #  > foreach(i=1:2) %dopar%  {     i+1 }  [[1]] [1] 2  [[2]] [1] 3  # %dopar% loop loading package -- not work #  > foreach(i=1:2,.packages="forecast") %dopar%    {        i+1    }  error in e$fun(obj, substitute(ex), parent.frame(), e$data) :    worker initialization failed: package or namespace load failed        'forecast'

session info: r version 3.2.1 (2015-06-18) platform: x86_64-w64-mingw32/x64 (64-bit) running under: windows 7 x64 (build 7601) service pack 1

locale: [1] lc_collate=english_united states.1252 lc_ctype=english_united states.1252 lc_monetary=english_united states.1252 lc_numeric=c
[5] lc_time=english_united states.1252

attached base packages: [1] stats graphics grdevices utils datasets methods base

other attached packages: [1] writexls_3.6.1 rlist_0.4 timeseries_3012.99 reshape2_1.4.1 plyr_1.8.3 lubridate_1.3.3 lmtest_0.9-34 lattice_0.20-31 knitr_1.10.5
[10] hts_4.5 matrix_1.2-1 sparsem_1.6 ggplot2_1.0.1 data.table_1.9.4 car_2.0-25 forecast_6.1 timedate_3012.100 zoo_1.7-12
[19] dosnow_1.0.12 snow_0.3-13 iterators_1.0.7 foreach_1.4.2

loaded via namespace (and not attached): [1] rcpp_0.11.6 compiler_3.2.1 nloptr_1.0.4 tseries_0.10-34 tools_3.2.1 lme4_1.1-8 digest_0.6.8 memoise_0.2.1 gtable_0.1.2 nlme_3.1-120
[11] mgcv_1.8-6 parallel_3.2.1 proto_0.3-10 stringr_1.0.0 grid_3.2.1 nnet_7.3-9 minqa_1.2.4 magrittr_1.5 scales_0.2.5 codetools_0.2-11 [21] mass_7.3-40 splines_3.2.1 pbkrtest_0.4-2 colorspace_1.2-6 fracdiff_1.4-2 quantreg_5.11 quadprog_1.5-5 stringi_0.5-5 munsell_0.4.2 chron_2.3-47

other info may useful- .libpaths() location , details makecluster function.

> .libpaths()  [1] "c:/users/g082580/documents/my documents/r/r-3.2.1" "c:/r-3.2.1/library"                                 > makecluster(4,type="sock",manual=true)

manually start worker on localhost c:/r-32~1.1/bin/rscript.exe "c:/users/g082580/documents/my documents/r/r-3.2.1/snow/rsocknode.r" master=localhost port=11535 out=/dev/null snowlib=c:/users/g082580/documents/my documents/r/r-3.2.1

if need use .libpaths function in order load packages on master, you'll need call on workers well. example uses clustercall function initialize workers same master:

library(dosnow) cl <- makesockcluster(4) registerdosnow(cl) clustercall(cl, function(x) .libpaths(x), .libpaths())

Comments

Post a Comment

Popular posts from this blog

python - No exponential form of the z-axis in matplotlib-3D-plots -

-
Image
i have similar problem described in how prevent numbers being changed exponential form in python matplotlib figure : i don't want (in special case) weird scientific formatting of axis. problem different have problem @ z -axis. 2-d plots can use ax.get_yaxis().get_major_formatter().set_useoffset(false) . , there no function ax.get_zaxis() what use format z -axis same way? edit: example: from mpl_toolkits.mplot3d import axes3d import numpy np import sys import matplotlib import matplotlib.pyplot pyplot def func(xi, ti): res = 10e3 + np.cos(ti) * np.sin(xi) return res if __name__ == '__main__': timespacing = 20 timestart = 0 timeend = 1 time = np.linspace(timestart, timeend, timespacing) widthspacing = 50 widthstart = 0 widthend = 3 width = np.linspace(widthstart, widthend, widthspacing) reslist = [] matplotlib.rcparams['legend.fontsize'] = 10 fig = pyplot.figure() ax = fig.gca(projection = '3d...
Read more

php - Best Light server (Linux + Web server + Database) for Raspberry Pi -

-
i install web server database on raspberry pi (little computer). computer has 1gb ram. i want know best combination: linux distribution , web server , dbms run local server multiple users minimal latency, use php on server. , best settings performance , not have bugs (memory usage, disable plugin, disable service, etc)? i thought light debian , lighttpd server , sqlite database. solution? i think lighttpd + sqlite great choice. linux distro, debian @ centos or tiny core linux , although i'm not sure of compatibility pi. obviously, can't go wrong raspbian if want use in production , more stable performance, few more pi's , set them in cluster .
Read more

c# - "Newtonsoft.Json.JsonSerializationException unable to find constructor to use for types" error when deserializing class -

-
i developing app in xamarin android. have splash screen serialize class , pass mainactivity using intent . when try deserialize in mainactivity error message : "serializationexception unable find constructor use types" serialization : void loaddata() { currency currency = new currency(this); intent = new intent(this, typeof(mainactivity)); intent.putextra("currency", newtonsoft.json.jsonconvert.serializeobject(currency)); startactivity(intent); } deserialization : cur = newtonsoft.json.jsonconvert.deserializeobject<currency> (intent.getstringextra("currency")); // error here class constructor : public currency(context context) { thiscontext = context; } i began experiencing problem after added parameter context context constructor. has caused this? how can solve it? possible serialize/deserialize class has parameters? you need have empty constructor in currency class in order deserialize it. ...
Read more