Out of memory (and possibly other errors) when running test_driver on Quadro NVS 140M
by Philipp Lies
Hi,
first of all: nice piece of work Andreas!
Now to my problem: I installed CUDA 2.1 on my T61 laptop computer with a
Nvidia Quadro NVS 140M graphics card w/ 128MB memory.
git version of PyCUDA (0.93 beta I assume) installs fine but I get some
errors when I try to run tests. First test_driver:
/opt/PyCUDA/pycuda-git/test$python test_driver.py
...E....Eterminate called after throwing an instance of 'cuda::error'
what(): cuMemFree failed: invalid context
Aborted
Or runnung gpuarray speed test:
/opt/PyCUDA/pycuda-git/test$python undistributed/test_gpuarray_speed.py
1024
2048
4096
8192
16384
32768
65536
131072
262144
524288
1048576
2097152
Traceback (most recent call last):
File "undistributed/test_gpuarray_speed.py", line 83, in <module>
main()
File "undistributed/test_gpuarray_speed.py", line 27, in main
b = gpuarray.zeros((size,), dtype=numpy.float32)
File
"/usr/lib/python2.5/site-packages/pycuda-0.93beta-py2.5-linux-x86_64.egg/pycuda/gpuarray.py",
line 409, in zeros
result = GPUArray(shape, dtype, stream, allocator)
File
"/usr/lib/python2.5/site-packages/pycuda-0.93beta-py2.5-linux-x86_64.egg/pycuda/gpuarray.py",
line 75, in __init__
self.gpudata = self.allocator(self.size * self.dtype.itemsize)
pycuda._driver.MemoryError: cuMemAlloc failed: out of memory
-----------------------------------------------------------
PyCUDA WARNING: I'm being asked to destroy a
context that's part of the current context stack.
-----------------------------------------------------------
I will pick the next lower active context from the
context stack. Since this choice is happening
at an unspecified point in time, your code
may be making false assumptions about which
context is active at what point.
Call Context.pop() to avoid this warning.
-----------------------------------------------------------
If Python is terminating abnormally (eg. exiting upon an
unhandled exception), you may ignore this.
-----------------------------------------------------------
test_gpuarray only threw some warnings:
python test_gpuarray.py
/usr/lib/python2.5/site-packages/pycuda-0.93beta-py2.5-linux-x86_64.egg/pycuda/gpuarray.py:498:
UserWarning: behavior change: arange guessed dtype other than float32.
suggest specifying explicit dtype.
warn("behavior change: arange guessed dtype other than float32. "
..................
----------------------------------------------------------------------
Ran 18 tests in 14.756s
OK
Here are some debug information you might need:
In [61]: pycuda.autoinit.device.get_attributes()
Out[62]:
{pycuda._driver.device_attribute.MAX_THREADS_PER_BLOCK: 512,
pycuda._driver.device_attribute.MAX_BLOCK_DIM_X: 512,
pycuda._driver.device_attribute.MAX_BLOCK_DIM_Y: 512,
pycuda._driver.device_attribute.MAX_BLOCK_DIM_Z: 64,
pycuda._driver.device_attribute.MAX_GRID_DIM_X: 65535,
pycuda._driver.device_attribute.MAX_GRID_DIM_Y: 65535,
pycuda._driver.device_attribute.MAX_GRID_DIM_Z: 1,
pycuda._driver.device_attribute.MAX_SHARED_MEMORY_PER_BLOCK: 16384,
pycuda._driver.device_attribute.TOTAL_CONSTANT_MEMORY: 65536,
pycuda._driver.device_attribute.WARP_SIZE: 32,
pycuda._driver.device_attribute.MAX_PITCH: 262144,
pycuda._driver.device_attribute.MAX_REGISTERS_PER_BLOCK: 8192,
pycuda._driver.device_attribute.CLOCK_RATE: 800000,
pycuda._driver.device_attribute.TEXTURE_ALIGNMENT: 256,
pycuda._driver.device_attribute.GPU_OVERLAP: 1,
pycuda._driver.device_attribute.MULTIPROCESSOR_COUNT: 2}
In [63]: pycuda.autoinit.device.compute_capability()
Out[63]: (1, 1)
In [65]: pycuda.autoinit.device.total_memory()
Out[65]: 133496832
In [66]: pycuda.autoinit.device.make_context()
terminate called after throwing an instance of 'cuda::error'
what(): cuMemFree failed: invalid context
Aborted
All the other tests were fine, so PyCUDA works nicely.
Could you please check where the "invalid context" error comes from?
And maybe add a memory checker to your tests so we low-mem GPU user are
not discriminated ;-).
Keep up the good work!
Philipp
10 years, 5 months
casting arguments to memset to unsigned int ?
by Michael Rule
I'm sorry to bother the list, but I can't seem to generate
appropriately typed arguments for the memset_d32 function
my current attempt looks like :
array=pycuda.driver.mem_alloc(bytes)
pycuda.driver.memset_d32(numpy.uint32(array),numpy.uint32(0),numpy.uint32(N))
Which generates the following error :
Boost.Python.ArgumentError: Python argument types in
pycuda._driver.memset_d32(numpy.uint32, numpy.uint32, numpy.uint32)
did not match C++ signature:
memset_d32(unsigned int dest, unsigned int data, unsigned int size)
how do I cast to this particular unsigned int type ?
sincerely,
mrule.
10 years, 6 months
Re: [PyCUDA] question SVD
by Derek Anderson
i'm afraid i'm of no use there. been windows-free for going on 10 years
now. :)
ananth ranga wrote:
> Oh thats great, thatnks alot. really appreciate it. I am trying to
> install pycuda on windows and kind of struggling with it. could ou
> please run me through it? I have VS 05 and 08 but not 03 , is that
> fine?
>
> On Tue, Jun 30, 2009 at 11:49 AM, Derek Anderson<public(a)kered.org> wrote:
>> well, both matrices have to be squarish. but even for say 100x120*120x100,
>> i would think not. here were my performance numbers when i wrote it:
>> (includes memory transfer times)
>>
>> (4160×4160)*(4160×4160) = 43.0X faster than numpy
>> (4096×4096)*(4096×4096) = 34.0X
>> (3900×3900)*(3900×3900) = 47.3X
>> (2048×2048)*(2048×2048) = 28.2X
>> (1024×1024)*(1024×1024) = 58.8X
>> (512×512)*(512×512) = 24.1X
>> (256×256)*(256×256) = 6.3X
>> (128×128)*(128×128) = 1.1X
>>
>> CPU: Intel(R) Core(TM)2 Duo CPU E8400 @ 3.00GHz stepping 06
>> GPU: nVidia Corporation GeForce 8800 GT (rev a2)
>>
>> but, you *might* get a modest increase (<5x) if you're keeping the matrices
>> on the card and performing the multiplications many times before you pull it
>> back to main memory. (likely, if you're doing svd :)
>>
>> derek
>>
>>
>> ananth ranga wrote:
>>> Hey mine is also an pretty evenly sized matrix. its (120*100). So you
>>> suggesting that for this evenly sized small matrix i can expect speed
>>> up in SVD calculation? or you mean it should be a larger sized and
>>> even sized matrix to get good speed up?
>>>
>>> On Tue, Jun 30, 2009 at 11:31 AM, Derek Anderson<public(a)kered.org> wrote:
>>>> np. yes, for more evenly sized matrices it's much faster. (for >500^2
>>>> too)
>>>> btw if just matrix multiplication is what you're looking for, i wrote a
>>>> numpy wrapper for it a while back:
>>>>
>>>> http://kered.org/blog/2009-04-13/easy-python-numpy-cuda-cublas/
>>>>
>>>> derek
>>>>
>>>>
>>>> ananth ranga wrote:
>>>>> Thanks derek. I read some paper which suggest a speed up of upto 60
>>>>> when the matrix size is big and almost even for size less than (500 *
>>>>> 500).
>>>>>
>>>>> On Tue, Jun 30, 2009 at 9:53 AM, Derek Anderson<public(a)kered.org> wrote:
>>>>>> my experience with trying to cuda-ize svd/nmf calculations is that
>>>>>> they're
>>>>>> not really a good fit for cuda. specifically, most of your expensive
>>>>>> operations are matrix multiplications over very long and narrow
>>>>>> matrices.
>>>>>> (mxk or kxn), where m~=n (within an order of mag) but k<<(m|n). even
>>>>>> when
>>>>>> m~=2^16 (the max for cublas matrices) and k<2^8, i was barely breaking
>>>>>> even
>>>>>> with normal cpu-based blas libs.
>>>>>>
>>>>>> derek
>>>>>>
>>>>>>
>>>>>> ananth ranga wrote:
>>>>>>> Hello people,
>>>>>>>
>>>>>>> I am Ranga a new member to the group. I have a problem of
>>>>>>> finding svd of a matrix of size 120*100. On a CPU with the VTK
>>>>>>> implemented version its taking about 5 ms for evaluation. So I was
>>>>>>> wondering if a pycuda version of it could give me abetter reult
>>>>>>> regarding the speed.
>>>>>>>
>>>>>>> If any one has a pycuda version of SVD calculation could you please
>>>>>>> help
>>>>>>> me out.
>>>>>>>
>>>>>>> Thanks,
>>>>>>> ranga
>>>>>>>
>>>>>>> _______________________________________________
>>>>>>> PyCUDA mailing list
>>>>>>> PyCUDA(a)tiker.net
>>>>>>> http://tiker.net/mailman/listinfo/pycuda_tiker.net
10 years, 6 months
Re: [PyCUDA] PyCUDA Digest, Vol 12, Issue 28
by Vince Fulco
Dear Andreas-
Thank you for the detailed response.
At the risk of belabouring, a portion of the Marsenne Twister code
contains two kernel/functions for the Box Muller transformation calcs.
One is defined __device__ and the other which draws on calcs of the
first is a __global__. Would it be possible to re-code the first as a
__global__ with appropriate changes internally as well and then wrap
the two with Pycuda or am I missing something more obvious? This may
not be an efficient use of the device but could be faster than
porting. Of course there is a larger portion of C which accesses the
host and would need to be dealt with as well.
TIA, Vince
On Mon, Jun 29, 2009 at 2:00 PM, <pycuda-request(a)tiker.net> wrote:
> Send PyCUDA mailing list submissions to
> pycuda(a)tiker.net
>
> To subscribe or unsubscribe via the World Wide Web, visit
> http://tiker.net/mailman/listinfo/pycuda_tiker.net
> or, via email, send a message with subject or body 'help' to
> pycuda-request(a)tiker.net
>
> You can reach the person managing the list at
> pycuda-owner(a)tiker.net
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of PyCUDA digest..."
>
>
> Today's Topics:
>
> 1. Re: Wrapping SDK code... (Andreas Kl?ckner)
> 2. Re: OpenGL interop woes... help! (Andreas Kl?ckner)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Sun, 28 Jun 2009 15:51:28 -0400
> From: Andreas Kl?ckner <lists(a)informa.tiker.net>
> Subject: Re: [PyCUDA] Wrapping SDK code...
> To: pycuda(a)tiker.net
> Message-ID: <200906281551.29553.lists(a)informa.tiker.net>
> Content-Type: text/plain; charset="windows-1252"
>
> On Freitag 26 Juni 2009, Vince Fulco wrote:
>> Early attempts to port over the Monte Carlo Option Pricing code
>> supplied with the SDK and need to mod it for simple time series
>> bootstrapping. Not being terribly facile in C/C++ (but learning!),
>> could someone provide a short list of the critical components which
>> need to be wrapped by pycuda?
>
> What PyCUDA can do for you is compile and execute functions marked __global__
> in that sample's source code--i.e. code that runs on the GPU. Everything else
> is CPU code, and making that accessible is beyond the scope of PyCUDA. If you
> do want to leave that CPU code in C, there are several other packages that
> might help you, ranging from Swig, Cython, Boost Python (potentially with
> codepy), to ctypes.
>
> I'm guessing that you might have the most fun if you just port the CPU control
> code to Python, though--less hassle.
>
>> I am aware of the various
>> kernels/functions necessary from the main body of code but more
>> interested in a how-to in terms of referencing the ancillary functions
>> properly. I.E. the RNGs "MonteCarlo_SM10" and "MonteCarlo_SM13"
>> routines.
>
> See above--if you want to keep those in C, use one of the packages mentioned
> above (and worry about compiling them separately), or just quickly translate
> them to Python. (you'll find they get a fair bit shorter :P)
>
> Andreas
>
>
10 years, 6 months
question SVD
by ananth ranga
Hello people,
I am Ranga a new member to the group. I have a problem of
finding svd of a matrix of size 120*100. On a CPU with the VTK
implemented version its taking about 5 ms for evaluation. So I was
wondering if a pycuda version of it could give me abetter reult
regarding the speed.
If any one has a pycuda version of SVD calculation could you please help me out.
Thanks,
ranga
10 years, 6 months
OpenGL interop woes... help!
by Peter Berrington
A few months ago I was trying to port over Nvidia's postprocessGL program,
as included with the CUDA SDK.
I am attempting to do this using the PyOpenGL bindings for python and using
pycuda. I'm a beginner to python, I know even less about openGL and less
still about CUDA, so I was mostly undertaking this as a learning excercise;
after getting frustrated about not know at all what to do I gave up for a
few months and I'm only now attempting again to make some sense of this.
I've put up a copy of my attempt so far over here:
http://codepad.org/8c49ByZV
Apologies for the very unpythonic way things are layed out, hopefully once I
have some sense of what I'm doing I'll tidy it up.
Right now I have a few problems that I'm hoping someone can clear up for me.
The first issue is to do with the pycuda.BufferObject class. I assume this
is for representing openGL pixel buffer objects, but I have no idea how to
give this PBO to the cuda kernel! The cuda kernel wants either a
DeviceAllocation, a GPUArray or something that implements the python buffer
interface... It seems like the pycuda.BufferObject class is none of these
things so how do I use it? The original C version of postprocessGL just
passes a pointer to the PBO to its kernel function.
The second problem may be out of the scope of this mailing list since its
more to do with pyopengl than pycuda per se, but if I run my program it
fails during the glReadPixels function call, with this openGL error:
GLError(
err = 1282,
description = 'invalid operation',
baseOperation = glReadPixels,
cArguments = (
0,
0,
640,
640,
GL_BGRA,
GL_UNSIGNED_BYTE,
c_void_p(None),
)
)
I've read the documentation and this error should only come up under a few
circumstances, none of which seems to be true as far as I can see
(invalid_operation is usually caused when glReadPixels would cause more data
to be written than the bound buffer could hold). Is there some other way of
setting up PBO's that I haven't figured out, or is anything in my code
obviously wrong?
If anyone can take a look at my source and offer any advice I'd really
appreciate it.
10 years, 6 months
Wrapping SDK code...
by Vince Fulco
Early attempts to port over the Monte Carlo Option Pricing code
supplied with the SDK and need to mod it for simple time series
bootstrapping. Not being terribly facile in C/C++ (but learning!),
could someone provide a short list of the critical components which
need to be wrapped by pycuda? I am aware of the various
kernels/functions necessary from the main body of code but more
interested in a how-to in terms of referencing the ancillary functions
properly. I.E. the RNGs "MonteCarlo_SM10" and "MonteCarlo_SM13"
routines.
TIA, V.
--
Vince Fulco, CFA, CAIA
612.424.5477 (universal)
vfulco1(a)gmail.com
A posse ad esse non valet consequentia
“the possibility does not necessarily lead to materialization”
10 years, 6 months
Install problem: OS X 10.5, Python 2.6
by Bryan Catanzaro
Hello all -
I'm trying to install PyCuda on OS X 10.5, using Python 2.6
(unfortunately, I can't use 2.5 in the project I'm working on.)
Has anyone successfully installed it with this configuration? It
seems to build successfully, but when I try to import pycuda.driver,
the python interpreter aborts with an error message:
Fatal Python error: Interpreter not initialized (version mismatch?)
I believe I'm building PyCuda with the Python 2.6 include files, so
I'm not sure where the version mismatch is coming. Perhaps from the
python boost library? Has anyone seen this error before?
Thanks,
bryan
10 years, 6 months
pycuda erosion/dilation slow
by Stanislav Ravas
Good day,
I'm new to both CUDA and PyCUDA. I'm trying to write binary
erosion/dilation accelerator module for my project, but they are slower
then scipy.ndimage's functions.
I don't know if i'm doing something wrong(as I said, I'm new), or nvidia
nvs140m in my notebook is just not fast enough.
It would be great if someone with more powerful card could try it, or
may be some guru :) could have a look into my sources?
Source is attached.
If I get it to work, I'll share it for all :)
Anyway, CUDA and PyCUDA are great work!
Thanks
10 years, 6 months
After kernel call, array.min() returns NaN while array[array.argmin()] returns something else
by Benjamin Horstman
I saw the earlier discussion on the handling of NaN on numpy, and I can see
that currently it is ignored when you use pure numpy min:
In [25]: a
Out[25]: array([ 0., NaN, 0.])
In [26]: a.min()
Out[26]: 0.0
In [27]: a.argmin()
Out[27]: 0
However, somehow the pycuda drv.out() leaves the array in such a state that
a.min() returns NaN while a[a.argmin()] returns something else. Not sure
exactly what causes this, as it only happens sometimes. When I have seen
this bug, it's on a large unwieldy dataset that's hard to debug. The
workaround seems to be to just use a[a.argmin()]...
--
Benjamin P. Horstman
Delta Upsilon International Fraternity
President, Gamers Anonymous
CWRU EECS BS/MS 2009
10 years, 7 months
