bwhite / hadoopy

Python MapReduce library written in Cython. Visit us in #hadoopy on freenode. See the link below for documentation and tutorials.

bwhite/hadoopy Issues

Permission Denied error triggered by Python subprocess
Closed 13 years ago5
Installation fails on windows
Updated 7 years ago1
Image dataset to be used for facefinder-example
Closed 7 years ago
IOError : writetb :Hadoop process returned[255]
Updated 7 years ago
Redundant Tabulation
Updated 8 years ago
Installation fails with python3
Updated 8 years ago
pip install hadoopy raised "Failed building wheel for hadoopy"
Updated 9 years ago
import sklearn in job crashes task
Closed 10 years ago7
Instantiate IOError objects with meaningful values for errno / strerror.
Updated 10 years ago
Cannot install hadoopy on Mac Os X mavericks
Closed 10 years ago1
Issue with TypedBytesWritable class of Hadoop
Closed 10 years ago7
pyinstaller 2.0 mac os
Updated 11 years ago
Run examples with errors.
Updated 11 years ago1
Cannot run tests in repo.
Updated 11 years ago
Different arguments are sent to mapper if the script is executed on hadoop cluster
Updated 11 years ago
Make separate project for HDFS Random Access
Updated 12 years ago
Check that files exist before calling hadoop to provide better warnings
Updated 12 years ago
Import errors in client code can break pipe
Updated 12 years ago
Pyinstaller used with -O disables assert
Updated 12 years ago
Add ability to include additional python modules
Updated 12 years ago
"pipe" intermediary only works on files that are executable (+x)
Updated 12 years ago2
Relative imports don't work when using launch_local
Closed 12 years ago1
Run "python" on the script to verify that it doesn't throw syntax errors
Updated 12 years ago
Make hadoopy.run entry point allow for jobconfs and command line execution
Closed 12 years ago1
Add flag to skip launch commands where inputs already exist
Closed 12 years ago1
Add PyInstaller background freezing and easier reuse
Updated 12 years ago1
Add profiling support for jobs and framework overhead
Updated 12 years ago
Before calling pyinstaller, verify that the script exists so that errors can be neatly reported
Closed 12 years ago
Add support for using dicts for cmdenvs and jobconfs
Updated 12 years ago
Add support for cmdenv verification before launching job
Updated 12 years ago
hadoopy.readtb fails silently when client machine doesn't have necessary compression codecs
Updated 12 years ago
Find a cleaner way of finding the user's hadoop home dir
Updated 12 years ago
Make example using Pagerank and PI calculation
Updated 12 years ago
Incorrectly setting HADOOP_HOME can cause unclear errors
Updated 12 years ago
Frozen files of the same thing are having different hashes
Updated 12 years ago1
Unrecognized option: -io
Closed 13 years ago2
OOM killer on the Java process can cause the job may complete silently
Closed 12 years ago6
using hadoopy.launch() with wc.py example causes error in StreamJob
Updated 12 years ago3
Use hadoop streaming return code to produce more informative messages
Updated 12 years ago
launch_local environment is shared between mapper/reducer
Updated 12 years ago
Detect if Hadoop is in Local mode and produce a message that it is unsupported
Updated 12 years ago
If setting jobconf mapred.child.java.opts too high, hard to diagnose failure occurs
Updated 12 years ago
Launch local pipe blocks on individual writes greater than 64K
Closed 12 years ago1
Unicode encoding to ASCII error
Closed 12 years ago3
If the current user isn't in the appropriate groups, confusing errors come from streaming
Updated 12 years ago
Elaborate on the role of PyInstaller
Updated 13 years ago1
Modify tracebacks from user code to not include Hadoopy details
Updated 13 years ago
Extremely large KV pairs (> 1GB) fail silently in writetb depending on java stack size
Closed 13 years ago1
Pyinstaller gives a cryptic error when freezing a zipped egg
Updated 13 years ago
Improve error message when Hadoop can't connect to HDFS
Updated 13 years ago