lua - Torch: luajit out of memory on simple task -

-

i trying load mnist dataset in th repl , mean subtraction following:

file = torch.load('data/mnist.t7/train_32x32.t7', 'ascii')  data = file.data:type(torch.getdefaulttensortype())  mean = data:mean()  data:add(-mean)

the last line causes following error:

.../torch/install/bin/luajit: not enough memory

i running on laptop 16gb of ram. mnist has been loaded data not sure why doing data:add(-mean) cause issue. ideas?

thanks

the problem was trying print whole matrix (which large) console.

this can overcome doing either data = data:add(-mean) or data:add(-mean); - notice semicolon

answer provided soumith chintala on torch gitter.


Comments

Post a Comment

Popular posts from this blog

python - No exponential form of the z-axis in matplotlib-3D-plots -

-
Image
i have similar problem described in how prevent numbers being changed exponential form in python matplotlib figure : i don't want (in special case) weird scientific formatting of axis. problem different have problem @ z -axis. 2-d plots can use ax.get_yaxis().get_major_formatter().set_useoffset(false) . , there no function ax.get_zaxis() what use format z -axis same way? edit: example: from mpl_toolkits.mplot3d import axes3d import numpy np import sys import matplotlib import matplotlib.pyplot pyplot def func(xi, ti): res = 10e3 + np.cos(ti) * np.sin(xi) return res if __name__ == '__main__': timespacing = 20 timestart = 0 timeend = 1 time = np.linspace(timestart, timeend, timespacing) widthspacing = 50 widthstart = 0 widthend = 3 width = np.linspace(widthstart, widthend, widthspacing) reslist = [] matplotlib.rcparams['legend.fontsize'] = 10 fig = pyplot.figure() ax = fig.gca(projection = '3d...
Read more

python - PIL cannot identify image file for io.BytesIO object -

-
i using pillow fork of pil , keep receiving error oserror: cannot identify image file <_io.bytesio object @ 0x103a47468> when trying open image. using virtualenv python 3.4 , no installation of pil. i have tried find solution based on others encountering same problem, however, solutions did not work me. here code: from pil import image import io # portion part of test code byteimg = image.open("some/location/to/a/file/in/my/directories.png").tobytes() # non test code databytesio = io.bytesio(byteimg) image.open(databytesio) # <- error here the image exists in initial opening of file , gets converted bytes. appears work else can't figure out why fails me. edit: databytesio.seek(0) does not work solution (tried it) since i'm not saving image via stream, i'm instantiating bytesio data, therefore (if i'm thinking of correctly) seek should @ 0. (this solution author himself. have moved here.) solution: # portion part ...
Read more

python - concatenating scipy matrices -

-
i want concatenate 2 csr_matrix, each shape=(1,n) . i know should use scipy.sparse.vstack : from scipy.sparse import csr_matrix,vstack c1 = csr_matrix([[1, 2]]) c2 = csr_matrix([[3, 4]]) print c1.shape,c2.shape print vstack([c1, c2], format='csr') #prints: (1, 2) (1, 2) (0, 0) 1 (0, 1) 2 (1, 0) 3 (1, 1) 4 however, code fails: from scipy.sparse import csr_matrix,vstack import numpy np y_train = np.array([1, 0, 1, 0, 1, 0]) x_train = csr_matrix([[1, 1], [-1, 1], [1, 0], [-1, 0], [1, -1], [-1, -1]]) c0 = x_train[y_train == 0].mean(axis=0) c1 = x_train[y_train == 1].mean(axis=0) print c0.shape, c1.shape #prints (1l, 2l) (1l, 2l) print c0,c1 #prints [[-1. 0.]] [[ 1. 0.]] print vstack([c0,c1], format='csr') the last line raises exception - file "c:\anaconda\lib\site-packages\scipy\sparse\construct.py", line 484, in vstack return bmat([[b] b in blocks], format=format, dtype=dtype) file "c:\anaconda\li...
Read more