titer1 / winutils

Windows binaries for Hadoop versions (built from the git commit ID used for the ASF relase)

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

winutils

Windows binaries for Hadoop versions

These are built directly from the same git commit used to create the official ASF releases; they are checked out and built on a windows VM which is dedicated purely to testing Hadoop/YARN apps on Windows. It is not a day-to-day used system so is isolated from driveby/email security attacks.

Note that I am a Hadoop committer: I have nothing to gain by creating malicious versions of these binaries. If I wanted to run anything on your systems, I'd be able to add the code into Hadoop itself, or its build process.

I'm moving to gpg -armor signing of binaries; the GPG key used is on the MIT key server

release process

in hadoop-trunk

Check out the git commit ID voted on as the final release of the ASF artifacts.

mvn clean
mvn package -Pdist -Dmaven.javadoc.skip=true -DskipTests

This creates a distribution, with the native binaries under hadoop-dist\target

  1. create dir winutils/$VERSION
  2. copy bin* to winutils/$VERSION
  3. rm stuff you don't want
  4. add the rest
  5. GPG sign, add .ASC files.
  6. commit
  7. push

About

Windows binaries for Hadoop versions (built from the git commit ID used for the ASF relase)

License:Apache License 2.0


Languages

Language:Shell 51.9%Language:Batchfile 47.2%Language:PowerShell 0.9%