Gitinfo fails on unicode filename

[Michel Racic]

Just for fun I added a movie reference, while it works for hugo server run, it fails when I build the output be it locally or on wercker.
I have a File named π.md under content (see http://rac.su and look closer at the footer bar on the right)

Adding it to git works but I noticed git status did list it as "content/\317\200.md"
Hugo fails when building it at
ERROR: 2017/02/21 04:38:02 gitinfo.go:63: Failed to find GitInfo for "content/π.md"

Another example of weird file names is 💩.md which git translates to "content/\360\237\222\251.md" which you can find at http://rac.su/💩 if EnableGitInfo is set to false.

While my case is more fun than anything else, this may also have an effect to other unicode characters like chinese filenames, cyrillic filenames, ... that use unicode.

Searching for unicode in filenames issues, seems like many projects fail on that but there should be some way to enhance hugolib/gitinfo.go to actually handle them correctly.

[Bjørn Erik Pedersen]

Are you running macOS?

[Michel Racic]

Yes I'm on OSX 10.10.5 and on wercker it runs on a Debian box.
Hugo itself can handle those files and render them to HTML pages just fine.
I think it's just the way how gitinfo.go normalizes filenames and hands it over to git binary

// Git normalizes file paths on this form:
filename := path.Join(filepath.ToSlash(contentRoot), contentDir, filepath.ToSlash(p.Path()))

[Bjørn Erik Pedersen]

The reason I ask about the macOS is the NFD way they store filenames.

So, given a Git repo:

▶ echo "test" >> π.txt                                                                       ◒
▶ git  add -A && git commit
[master (root-commit) a5dd87f] Test
 1 file changed, 1 insertion(+)
 create mode 100644 "\317\200.txt"

So, this is an issue that lives outside of Hugo.

Try:

git config --global core.quotePath false

Alternatively:

git config --global core.precomposeunicode true

[Michel Racic]

Thanks @bep that was the issue, I searched for a solution on the wrong side.
Setting core.quotePath to false resolves the issue on OSX and on debian as well.
So just for those reading this issue text later, here is my wercker.yml that allows it to build:

box: debian
build:
  steps:
    - install-packages:
        packages: git
    - script:
        name: Set git config core.quotePath to false for emoji filenames
        code: git config --global core.quotePath false
# Build the HUGO page in public folder
    - arjen/hugo-build@1.14.1:
        version: "0.18.1"
        theme: mainroad
        flags: --buildDrafts=false

[github-actions]

This issue has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.