pycuda install help
by nhieu duong
hi,
ive been endlessly trying to install pycuda on a red hat dist. machine, but
to no avail. it would be much appreciated if i could get some help.
i am able to get past the configure part of the installation, but the when i
"make" , the problem occurs. here is my siteconf.py file
BOOST_INC_DIR = ['/usr/local/include/boost/']
BOOST_LIB_DIR = ['/usr/lib']
BOOST_COMPILER = 'gcc4.1.2'
BOOST_PYTHON_LIBNAME = ['boost_python']
BOOST_THREAD_LIBNAME = ['boost_thread']
CUDA_TRACE = False
CUDA_ROOT = '/usr/local/cuda/'
CUDA_ENABLE_GL = False
CUDADRV_LIB_DIR = ['/usr/lib']
CUDADRV_LIBNAME = ['cuda']
CXXFLAGS = ['-DBOOST_PYTHON_NO_PY_SIGNATURES']
LDFLAGS = []
i beleive i built boost with gcc version 4.1.2
the error im getting is.....
/usr/local/include/boost/type_traits/remove_const.hpp:61: instantiated
from ‘boost::remove_const<<unnamed>::pooled_host_allocation>’
/usr/local/include/boost/python/object/pointer_holder.hpp:127:
instantiated from ‘void* boost::python::objects::pointer_holder<Pointer,
Value>::holds(boost::python::type_info, bool) [with Pointer =
std::auto_ptr<<unnamed>::pooled_host_allocation>, Value =
<unnamed>::pooled_host_allocation]’
src/wrapper/mempool.cpp:278: instantiated from here
/usr/local/include/boost/type_traits/detail/cv_traits_impl.hpp:38: internal
compiler error: in make_rtl_for_nonlocal_decl, at cp/decl.c:5067
i only included the ends. if you want the entire thing let me know. but the
error seems to point to a gcc problem. ive read thru
your archives but doesnt seem to solve this problem
if someone could shed some light on this issue, i would very appreciate it.
thanks
-nhieu
9 years, 1 month
ImportError: No module named _driver
by Riccardo Taormina
Hi everybody,
I am new on PyCuda. I just installed everything on Windows XP and, from the installation log, I think that I did it properly. However, I tried to run the test files provided with pycuda and I get this error
Traceback (most recent call last):
File "C:\PyCuda\test\test_gpuarray.py", line 2, in <module>
import pycuda.autoinit
File "C:\PyCuda\pycuda\autoinit.py", line 1, in <module>
import pycuda.driver as cuda
File "C:\PyCuda\pycuda\driver.py", line 1, in <module>
from _driver import *
ImportError: No module named _driver
how can I solve it?
thanks and sorry for the newbieness of this post
den3b
_________________________________________________________________
I tuoi amici sempre a portata di clic, sul nuovo Web Messenger
http://www.windowslive.it/foto.aspx
9 years, 7 months
Exception: CUFFT_INVALID_PLAN with parret
by Reckoner
Hi,
I've been working with parret as a means to use FFT's with PyCUDA.
http://www.mathcs.emory.edu/~yfan/PARRET/doc/index.html
but I am having trouble running demo_fft.py (see attached):
% python demo_fft.py
Running FFT for size
2
4
8
Traceback (most recent call last):
File "demo_fft.py", line 45, in <module>
gpu_fft(a, b, plan)
File "/home/reckoner/lib/python2.6/site-packages/parret/cufft.py", line
102, in fft
return _fft(CUFFT_FORWARD, x, y, plan)
File "/home/reckoner/lib/python2.6/site-packages/parret/cufft.py", line
98, in _fft
check_cufft_result(result)
File "/home/reckoner/lib/python2.6/site-packages/parret/cufft.py", line
37, in check_cufft_result
raise Exception(CUFFT_RESULT[result])
Exception: CUFFT_INVALID_PLAN
zsh: abort python demo_fft.py
The mysterious part is why FFT sizes 2 and 4 seem to run successfully.
Here's the output of dump_properties.py:
% python dump_properties.py
GeForce 9800M GTS
Compute Capability: 1.1
Total Memory: 524096 KB
CAN_MAP_HOST_MEMORY: 0
CLOCK_RATE: 1500000
COMPUTE_MODE: DEFAULT
CONCURRENT_KERNELS: 0
ECC_ENABLED: 0
GPU_OVERLAP: 1
INTEGRATED: 0
KERNEL_EXEC_TIMEOUT: 0
MAXIMUM_TEXTURE1D_WIDTH: 8192
MAXIMUM_TEXTURE2D_ARRAY_HEIGHT: 8192
MAXIMUM_TEXTURE2D_ARRAY_NUMSLICES: 512
MAXIMUM_TEXTURE2D_ARRAY_WIDTH: 8192
MAXIMUM_TEXTURE2D_HEIGHT: 32768
MAXIMUM_TEXTURE2D_WIDTH: 65536
MAXIMUM_TEXTURE3D_DEPTH: 2048
MAXIMUM_TEXTURE3D_HEIGHT: 2048
MAXIMUM_TEXTURE3D_WIDTH: 2048
MAX_BLOCK_DIM_X: 512
MAX_BLOCK_DIM_Y: 512
MAX_BLOCK_DIM_Z: 64
MAX_GRID_DIM_X: 65535
MAX_GRID_DIM_Y: 65535
MAX_GRID_DIM_Z: 1
MAX_PITCH: 2147483647
MAX_REGISTERS_PER_BLOCK: 8192
MAX_SHARED_MEMORY_PER_BLOCK: 16384
MAX_THREADS_PER_BLOCK: 512
MULTIPROCESSOR_COUNT: 8
SURFACE_ALIGNMENT: 256
TEXTURE_ALIGNMENT: 256
TOTAL_CONSTANT_MEMORY: 65536
WARP_SIZE: 32
Also, I'm using Python 2.6, Cuda compilation tools, release 3.1, V0.2.1221,
and Pycuda 0.94c
Any help appreciated.
9 years, 8 months
installing PyCUDA locally
by Lev Givon
Given that the latest revision of PyCUDA apparently needs to remove
setuptools before downloading and installing distribute, is it
effectively no longer possible to build/install PyCUDA locally (i.e.,
within a user directory) on a Linux system? If I run configure.py as a
non-root user, setuptools obviously can't be removed if it is
installed globally.
L.G.
9 years, 8 months
Fwd: installing/upgrading issue with siteconf.py, setup.py and 0.94rc
by Vince Fulco
Following up on install issues of two weeks ago. Sorry for the delay
as on the road. I can send the make install output next if necessary.
It would appear make & make install completes without error except
for the same 'dist.py' warning (found below) and the make tests raise
a multitude of errors. I think I may have the setup tools vs.
distribute problem mentioned previously although only running python
2.6.2 and python-setuptools 0.6c9 on FC12. However, if I attempt a
'yum remove python-setuptools', it will remove numpy and rpy I use
elsewhere. Will I need to re-install separately? Would prefer to
hear others experiences before removing working packages.
Best, V.
##
'rm -Rf build' (done)
make output:
[root@skynet-linux1 pycuda]# make
ctags -R src || true
/usr/bin/python setup.py build
Scanning installed packages
Setuptools installation detected at /home/vfulco/Downloads/pycuda
Non-egg installation
Removing elements out of the way...
Already patched.
/home/vfulco/Downloads/pycuda/setuptools-0.6c9-py2.6.egg-info already patched.
Extracting in /tmp/tmpL4muIo
Now working in /tmp/tmpL4muIo/distribute-0.6.4
Building a Distribute egg in /home/vfulco/Downloads/pycuda
/home/vfulco/Downloads/pycuda/setuptools-0.6c9-py2.6.egg-info already exists
/usr/include/ /boost/ python .hpp
/usr/lib64 / lib boost_python-mt .so
/usr/lib64 / lib boost_thread-mt .so
/usr/local/cuda/ /bin/ nvcc
/usr/local/cuda/include / cuda .h
/usr/lib64 / lib cuda .so
/usr/lib64/python2.6/distutils/dist.py:266: UserWarning: Unknown
distribution option: 'install_requires'
warnings.warn(msg)
running build
running build_py
creating build
creating build/lib.linux-x86_64-2.6
creating build/lib.linux-x86_64-2.6/pycuda
copying pycuda/autoinit.py -> build/lib.linux-x86_64-2.6/pycuda
copying pycuda/curandom.py -> build/lib.linux-x86_64-2.6/pycuda
copying pycuda/tools.py -> build/lib.linux-x86_64-2.6/pycuda
copying pycuda/cumath.py -> build/lib.linux-x86_64-2.6/pycuda
copying pycuda/gpuarray.py -> build/lib.linux-x86_64-2.6/pycuda
copying pycuda/reduction.py -> build/lib.linux-x86_64-2.6/pycuda
copying pycuda/driver.py -> build/lib.linux-x86_64-2.6/pycuda
copying pycuda/compiler.py -> build/lib.linux-x86_64-2.6/pycuda
copying pycuda/__init__.py -> build/lib.linux-x86_64-2.6/pycuda
copying pycuda/elementwise.py -> build/lib.linux-x86_64-2.6/pycuda
creating build/lib.linux-x86_64-2.6/pycuda/gl
copying pycuda/gl/autoinit.py -> build/lib.linux-x86_64-2.6/pycuda/gl
copying pycuda/gl/__init__.py -> build/lib.linux-x86_64-2.6/pycuda/gl
running build_ext
building '_driver' extension
creating build/temp.linux-x86_64-2.6
creating build/temp.linux-x86_64-2.6/src
creating build/temp.linux-x86_64-2.6/src/cpp
creating build/temp.linux-x86_64-2.6/src/wrapper
gcc -pthread -fno-strict-aliasing -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2
-fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64
-mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -O3 -DNDEBUG -fPIC
-DHAVE_GL=1 -Isrc/cpp -I/usr/include/ -I/usr/local/cuda/include
-I/usr/lib64/python2.6/site-packages/numpy/core/include
-I/usr/include/python2.6 -c src/cpp/cuda.cpp -o
build/temp.linux-x86_64-2.6/src/cpp/cuda.o
gcc -pthread -fno-strict-aliasing -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2
-fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64
-mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -O3 -DNDEBUG -fPIC
-DHAVE_GL=1 -Isrc/cpp -I/usr/include/ -I/usr/local/cuda/include
-I/usr/lib64/python2.6/site-packages/numpy/core/include
-I/usr/include/python2.6 -c src/cpp/bitlog.cpp -o
build/temp.linux-x86_64-2.6/src/cpp/bitlog.o
gcc -pthread -fno-strict-aliasing -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2
-fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64
-mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -O3 -DNDEBUG -fPIC
-DHAVE_GL=1 -Isrc/cpp -I/usr/include/ -I/usr/local/cuda/include
-I/usr/lib64/python2.6/site-packages/numpy/core/include
-I/usr/include/python2.6 -c src/wrapper/wrap_cudadrv.cpp -o
build/temp.linux-x86_64-2.6/src/wrapper/wrap_cudadrv.o
src/wrapper/wrap_cudadrv.cpp: In function ‘void init_module__driver()’:
src/wrapper/wrap_cudadrv.cpp:443: warning: deprecated conversion from
string constant to ‘char*’
src/wrapper/wrap_cudadrv.cpp:447: warning: deprecated conversion from
string constant to ‘char*’
src/wrapper/wrap_cudadrv.cpp:448: warning: deprecated conversion from
string constant to ‘char*’
src/wrapper/wrap_cudadrv.cpp:449: warning: deprecated conversion from
string constant to ‘char*’
src/wrapper/wrap_cudadrv.cpp:450: warning: deprecated conversion from
string constant to ‘char*’
gcc -pthread -fno-strict-aliasing -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2
-fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64
-mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -O3 -DNDEBUG -fPIC
-DHAVE_GL=1 -Isrc/cpp -I/usr/include/ -I/usr/local/cuda/include
-I/usr/lib64/python2.6/site-packages/numpy/core/include
-I/usr/include/python2.6 -c src/wrapper/mempool.cpp -o
build/temp.linux-x86_64-2.6/src/wrapper/mempool.o
gcc -pthread -fno-strict-aliasing -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2
-fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64
-mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -O3 -DNDEBUG -fPIC
-DHAVE_GL=1 -Isrc/cpp -I/usr/include/ -I/usr/local/cuda/include
-I/usr/lib64/python2.6/site-packages/numpy/core/include
-I/usr/include/python2.6 -c src/wrapper/wrap_cudagl.cpp -o
build/temp.linux-x86_64-2.6/src/wrapper/wrap_cudagl.o
g++ -pthread -shared build/temp.linux-x86_64-2.6/src/cpp/cuda.o
build/temp.linux-x86_64-2.6/src/cpp/bitlog.o
build/temp.linux-x86_64-2.6/src/wrapper/wrap_cudadrv.o
build/temp.linux-x86_64-2.6/src/wrapper/mempool.o
build/temp.linux-x86_64-2.6/src/wrapper/wrap_cudagl.o -L/usr/lib64
-L/usr/lib64 -L/usr/lib64 -lboost_python-mt -lboost_thread-mt -lcuda
-lpython2.6 -o build/lib.linux-x86_64-2.6/pycuda/_driver.so
building '_pvt_struct' extension
gcc -pthread -fno-strict-aliasing -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2
-fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64
-mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -O3 -DNDEBUG -fPIC
-I/usr/include/python2.6 -c src/wrapper/_pycuda_struct.c -o
build/temp.linux-x86_64-2.6/src/wrapper/_pycuda_struct.o
src/wrapper/_pycuda_struct.c:240: warning: ‘unpack_float’ defined but not used
src/wrapper/_pycuda_struct.c:252: warning: ‘unpack_double’ defined but not used
gcc -pthread -shared
build/temp.linux-x86_64-2.6/src/wrapper/_pycuda_struct.o -L/usr/lib64
-lpython2.6 -o build/lib.linux-x86_64-2.6/pycuda/_pvt_struct.so
[root@skynet-linux1 pycuda]#
9 years, 8 months
SparseSolve.py example
by Brian Menounos
Hello - I'm running pycuda (linux), and I can run many of the examples and those from the wiki-examples without a problem. However, I can't seem to get 'SparseSolve.py' to run with a mtm matrix file as arg[0].
- python SparseSolve.py example_5pt_10x10.mtx
starting...
building...
Traceback (most recent call last):
File "SparseSolve.py", line 85, in <module>
main_cg()
File "SparseSolve.py", line 31, in main_cg
from pycuda.sparse.packeted import PacketedSpMV
ImportError: No module named sparse.packeted
Does this require installation of the 'iterative-cuda' package? Thanks for any suggestions. Cheers,
#########################################
Brian Menounos, associate professor
Geography Program and Natural Resources and Environmental Studies Institute
University of Northern British Columbia
3333 University Way
Prince George, BC, V2N 4Z9
tel: 250-960-6266
fax: 250-960-6533
email: menounos(a)unbc.ca
web: http://web.unbc.ca/~menounos/
#########################################
9 years, 9 months
64-bit Snow Leopard
by Daniel Lepage
Hi everyone,
I recently got a new MacBook Pro running Snow Leopard, and I'm
trying to install PyCuda 0.94 on a 64-bit install of python 2.6. The
installation seems to have worked, but I'm getting weird results and
crashes on simple programs.
For example, consider the trivial program below:
import pycuda.autoinit
import pycuda.driver as drv
import numpy
from pycuda.compiler import SourceModule
mod = SourceModule("""
__global__ void setit(int *dest, int *a)
{
const int i = threadIdx.x;
dest[i] = a[i];
}
""")
setit = mod.get_function("setit")
a = numpy.zeros(10).astype(numpy.int32)
dest = numpy.zeros(10).astype(numpy.int32)
print dest # Should be all zeros
setit(drv.Out(dest), drv.In(a), block=(10,1,1))
print dest # Should still be all zeros
This ought to print only zeros, because all it does is copy one array
of all zeros into another array of all zeros. Instead it prints:
[0 0 0 0 0 0 0 0 0 0]
[-16576992 -16445665 -16641753 -16575962 -16445152 -16575708 -16575451
-16641242 -16640984 -16640983]
Oddly, if I replace "a[i]" with "i" in the kernel source, it works
fine (producing [0 1 2...9]), so the problem seems to be that it can't
read from a.
Moreover, I added the following:
from pycuda import gpuarray
a = gpuarray.zeros(10, numpy.int32)
dest = gpuarray.zeros(10, numpy.int32)
setit(dest, a, block=(10,1,1))
print dest # Should STILL be all zeros
and running it froze my graphics card.
I've tested this code on a different machine and had no problem. Has
anyone run into this before?
Thanks,
Dan Lepage
9 years, 9 months
Ubuntu 9.10 installation issue
by Simone Mannori
Bonjour,
I'm using UBUNTU 9.10 64bit distro on a NVDIA based laptop (Sony F11).
CUDA 3.0 has been installed and woks perfectly.
I have tried to install "stable" pycuda-0.93.tar.gz using the instructions
available on your web site (including gcc downgrade) without success.
I have tried also to install "git" version
In both cases the error looks the same (see below for the details). I have
tried all the hints available on-line without success.
Where is the mistake ?
Do you suggest to concentrate on 0.93, git or whatever?
Do I need to use another distro? 10.04 is incompatible with NVDIA-CUDA
driver, so I have stepped back to 9.10 (suggested by NVIDIA).
I'm a really green on Python, so I'm feeling lost. Pycuda looks great. I'm
working on thermonuclear fusion simulation (www.iter.org) using custom MHD
code: Pycuda could simplify A LOT the development.
Thanks in advance for your help
Simone Mannori - ENEA Brasimone - INRIA Rocquencourt
www.scicos.org - www.scicoslab.org
//++++++++++++++++++++++++++++++++++++++++++++++
simone@vaio:~/svn/pycuda/pycuda$ ./configure.py
Scanning installed packages
Setuptools installation detected at /home/simone/svn/pycuda/pycuda
Non-egg installation
Removing elements out of the way...
Already patched.
/home/simone/svn/pycuda/pycuda/setuptools-0.6c9-py2.6.egg-info already
patched.
Extracting in /tmp/tmpF6gEju
Now working in /tmp/tmpF6gEju/distribute-0.6.4
Building a Distribute egg in /home/simone/svn/pycuda/pycuda
Traceback (most recent call last):
File "setup.py", line 142, in <module>
scripts = scripts,
File "/usr/lib/python2.6/distutils/core.py", line 113, in setup
_setup_distribution = dist = klass(attrs)
File "/tmp/tmpF6gEju/distribute-0.6.4/setuptools/dist.py", line 224, in
__init__
_Distribution.__init__(self,attrs)
File "/usr/lib/python2.6/distutils/dist.py", line 270, in __init__
self.finalize_options()
File "/tmp/tmpF6gEju/distribute-0.6.4/setuptools/dist.py", line 257, in
finalize_options
ep.load()(self, ep.name, value)
File "/tmp/tmpF6gEju/distribute-0.6.4/pkg_resources.py", line 1922, in
load
raise ImportError("%r has no %r attribute" % (entry,attr))
ImportError: <module 'setuptools.dist' from
'/tmp/tmpF6gEju/distribute-0.6.4/setuptools/dist.py'> has no
'check_packages' attribute
/home/simone/svn/pycuda/pycuda/setuptools-0.6c9-py2.6.egg-info already
exists
Traceback (most recent call last):
File "./configure.py", line 3, in <module>
from aksetup_helper import configure_frontend
File "/home/simone/svn/pycuda/pycuda/aksetup_helper.py", line 3, in
<module>
distribute_setup.use_setuptools()
File "/home/simone/svn/pycuda/pycuda/distribute_setup.py", line 139, in
use_setuptools
return _do_download(version, download_base, to_dir, download_delay)
File "/home/simone/svn/pycuda/pycuda/distribute_setup.py", line 120, in
_do_download
egg = _build_egg(tarball, to_dir)
File "/home/simone/svn/pycuda/pycuda/distribute_setup.py", line 112, in
_build_egg
raise IOError('Could not build the egg.')
IOError: Could not build the egg.
simone@vaio:~/svn/pycuda/pycuda$
9 years, 9 months
2D FFT using pyfft, pycuda and multiprocessing
by jackin
Dear All,
I had problems of memory leakage when I used python
multithreading with pycuda. The gpu memory was not totally freed even
after the thread has ended, which caused problems with allocating memory
and starting the next thread. This problem is already mentioned in the
FAQ which I think is mainly due to the memory sharing nature of
multithreads in python. So I planned to try python multiprocessing.
After a lot of hard work, got 2d-fft to work with pyfft,
pycuda and multiprocessing. It is so much encouraging that it solved the
problem of memory leak which I faced when using multi-threading.
I have uploaded the python source code for the same
to /PyCuda/Examples/2DFFT. The code uses transpose-split method for the
FFT, inorder to accomodate larger sizes and multiprocessing.
I believe that the code could still be imporved for better
prefomance. I would be happy and encourage any one willing to develop on
my code.
Since FFT is the most used and also the most time consuming
(when it comes to large sizes), I hope improvement to this code will
help the PYCUDA community a lot.
Eagerly waiting for some comments !!
regards,
Jackin
9 years, 9 months
