0.11 cannot build with package manager, 0.10 can

Question

0.11 cannot build with package manager, 0.10 can

rezahussain opened this issue 4 years ago · comments

Hello,

It looks like s4tf projects cannot build from the command line if they use the package manager in 0.11, but they do work in 0.10.

This issue is only affecting ubuntu 18.04 LTS, I tried this same project on my mac with 0.11 and it worked ok
test_s4tf.zip

I deleted Package.resolved but it still happens on my ubuntu box. Please let me know if I am missing something obvious or if there is any more info I can provide that will help to isolate this problem.

Thanks

Saleem Abdulrasool · Answer 1 · Thu Sep 17 2020 01:14:02 GMT+0800 (China Standard Time)

Thanks for the report, we will look into it soon. It isn't immediately clear why swift-package-manager is unable to resolve the dependency set.

brett koonce · Answer 2 · Thu Sep 17 2020 02:59:58 GMT+0800 (China Standard Time)

@rezahussain i ran into this when mixing/matching 0.11 and master. clear out your build cache (eg delete .build/* in the folder you are running spm in) and things will hopefully start working correctly. I would suggest just using nightlies until 0.12 is released.

Reza Hussain · Answer 3 · Thu Sep 17 2020 07:58:28 GMT+0800 (China Standard Time)

Hello @brettkoonce

I just downloaded v11 and nightly again to make sure and did the test again

v0.11 test UBUNTU 18.04 CPU ONLY

(base) admin2@msimegx570:~/dev_projects/test_s4tf/Sources$ rm ../Package.resolved
(base) admin2@msimegx570:~/dev_projects/test_s4tf/Sources$ rm -rf .build
(base) admin2@msimegx570:~/dev_projects/test_s4tf/Sources$ /home/admin2/dev_projects/s4tf_v11/usr/bin/swift run test_s4tf
Updating https://github.com/httpswift/swifter.git
Updating https://github.com/IBM-Swift/BlueSSLService
Updating https://github.com/IBM-Swift/BlueSocket.git
Updating https://github.com/codewinsdotcom/PostgresClientKit
Cloning https://github.com/IBM-Swift/BlueSocket.git
Resolving https://github.com/IBM-Swift/BlueSocket.git at 1.0.52
Cloning https://github.com/IBM-Swift/BlueSSLService
Resolving https://github.com/IBM-Swift/BlueSSLService at 1.0.52
Updating https://github.com/httpswift/swifter.git
Updating https://github.com/codewinsdotcom/PostgresClientKit
Updating https://github.com/IBM-Swift/BlueSocket.git
Updating https://github.com/IBM-Swift/BlueSSLService
Everything is already up-to-date
error: the Package.resolved file is most likely severely out-of-date and is preventing correct resolution; delete the resolved file and try again
(base) admin2@msimegx570:~/dev_projects/test_s4tf/Sources$

test UBUNTU 18.04 CPU ONLY Nightly development

(base) admin2@msimegx570:~/dev_projects/test_s4tf/Sources$ rm ../Package.resolved
(base) admin2@msimegx570:~/dev_projects/test_s4tf/Sources$ rm -rf .build
(base) admin2@msimegx570:~/dev_projects/test_s4tf/Sources$ /home/admin2/dev_projects/s4tf_nightly/usr/bin/swift run test_s4tf
Updating https://github.com/httpswift/swifter.git
Updating https://github.com/IBM-Swift/BlueSocket.git
Updating https://github.com/codewinsdotcom/PostgresClientKit
Updating https://github.com/IBM-Swift/BlueSSLService
Everything is already up-to-date
Updating https://github.com/httpswift/swifter.git
Updating https://github.com/codewinsdotcom/PostgresClientKit
Updating https://github.com/IBM-Swift/BlueSSLService
Updating https://github.com/IBM-Swift/BlueSocket.git
Removing https://github.com/IBM-Swift/BlueSocket.git
Removing https://github.com/IBM-Swift/BlueSSLService
error: the Package.resolved file is most likely severely out-of-date and is preventing correct resolution; delete the resolved file and try again
(base) admin2@msimegx570:~/dev_projects/test_s4tf/Sources$

This happens on both 0.11 and the nightly at the time of this writing. Let me know if I should do more tests, I also attached the helloworld project(s4tf_test.zip) above.

@compnerd good to hear please let me know what you find.

Brad Larson · Answer 4 · Thu Sep 17 2020 22:26:16 GMT+0800 (China Standard Time)

This appears to be only impacting swift run and not swift build.

I encountered this with even a simple project with the following package description:

// swift-tools-version:5.3
// The swift-tools-version declares the minimum version of Swift required to build this package.

import PackageDescription

let package = Package(
    name: "testproject",
    products: [
    ],
    dependencies: [
        .package(url: "https://github.com/tensorflow/swift-models.git", .branch("master")),
    ],
    targets: [
        .target(
            name: "testproject",
            dependencies: [.product(name: "Datasets", package: "swift-models")]),
    ]
)

A reproducer project is attached that exhibits this error when you run swift run testproject. swift build will build this project correctly, just not swift run:
testproject.zip

brett koonce · Answer 5 · Fri Sep 18 2020 01:10:33 GMT+0800 (China Standard Time)

@BradLarson that works here locally with a nightly for me, fwiw
can reproduce the error with reza's original project
i ran into this the first time ~a month ago, it came back again later, it went away by navigating to the swift-models checkout (eg .build/checkouts/swift-models) and doing a git pull origin master which reset something internally iirc
the only difference in my manifest is i have the

  platforms: [
    .macOS(.v10_13),
  ],

Brad Larson · Answer 6 · Fri Sep 18 2020 01:29:26 GMT+0800 (China Standard Time)

@brettkoonce - The nightly that this is working with on your end, is that a macOS nightly? I still get the same error with swift run on our latest Ubuntu nightlies, but haven't tested with a macOS nightly. If it works there, that could be another clue.

brett koonce · Answer 7 · Sat Sep 19 2020 00:23:02 GMT+0800 (China Standard Time)

@BradLarson ubuntu 18.04 over here, using cuda 10.2 nightlies

Saleem Abdulrasool · Answer 8 · Tue Sep 22 2020 05:09:33 GMT+0800 (China Standard Time)

This seems like an issue with swift-package-manager. I see the same behaviour with the latest snapshot of the toolchain (https://swift.org/builds/development/ubuntu1804/swift-DEVELOPMENT-SNAPSHOT-2020-09-17-a/swift-DEVELOPMENT-SNAPSHOT-2020-09-17-a-ubuntu18.04.tar.gz). I think that this is probably best reported to bugs.swift.org.

Saleem Abdulrasool · Answer 9 · Tue Sep 22 2020 05:24:52 GMT+0800 (China Standard Time)

Some more details: it is not present in the 5.3 release, but it is present in the oldest snapshot that I see on the website (7/21/20).

brett koonce · Answer 10 · Tue Sep 22 2020 06:55:02 GMT+0800 (China Standard Time)

if there's reproducer, then yeah go upstream. my notes say i last saw this 8/16, but i remember hitting it randomly ~a month prior to that.
rebuilt from scratch locally + works with with nightly (wget https://storage.googleapis.com/swift-tensorflow-artifacts/nightlies/latest/swift-tensorflow-DEVELOPMENT-cuda10.2-cudnn7-ubuntu18.04.tar.gz):

brett koonce · Answer 11 · Tue Sep 22 2020 06:56:23 GMT+0800 (China Standard Time)

and yes spm would be my suspicion

Saleem Abdulrasool · Answer 12 · Thu Sep 24 2020 01:17:27 GMT+0800 (China Standard Time)

Filed on JIRA as https://bugs.swift.org/browse/SR-13590

marcrasi · Answer 13 · Thu Sep 24 2020 06:31:10 GMT+0800 (China Standard Time)

A workaround that works for me is to run swift build first, and then run the swift run command that I want.

Reza Hussain · Answer 14 · Fri Sep 25 2020 00:01:04 GMT+0800 (China Standard Time)

Thanks to everyone!