breakage running pip install

[jimc]

prelude

[jimc@frodo virtme-ng.git]$ git checkout main 
Switched to branch 'main'
Your branch is up to date with 'origin/main'.
[jimc@frodo virtme-ng.git]$ make
cd virtme_ng_init && cargo install --path . --root ../virtme/guest
  Installing virtme-ng-init v0.1.0 (/home/jimc/projects/virtme-ng.git/virtme_ng_init)
    Updating crates.io index
     Locking 11 packages to latest compatible versions
      Adding base64 v0.21.7 (latest: v0.22.1)
      Adding bitflags v1.3.2 (latest: v2.6.0)
      Adding memoffset v0.7.1 (latest: v0.9.1)
      Adding nix v0.26.4 (latest: v0.29.0)
    Finished `release` profile [optimized] target(s) in 0.29s
   Replacing ../virtme/guest/bin/virtme-ng-init
    Replaced package `virtme-ng-init v0.1.0 (/home/jimc/projects/virtme-ng.git/virtme_ng_init)` with `virtme-ng-init v0.1.0 (/home/jimc/projects/virtme-ng.git/virtme_ng_init)` (executable `virtme-ng-init`)
warning: be sure to add `../virtme/guest/bin` to your PATH to be able to run the installed binaries
[jimc@frodo virtme-ng.git]$ make install
make: *** No rule to make target 'install'.  Stop.

the erroneous run:

[jimc@frodo virtme-ng.git]$ BUILD_VIRTME_NG_INIT=1 pip3 install --verbose -r requirements.txt .
Using pip 24.1.2 from /home/jimc/.local/lib/python3.12/site-packages/pip (python 3.12)
Defaulting to user installation because normal site-packages is not writeable
Processing /home/jimc/projects/virtme-ng.git
  Running command python setup.py egg_info
  running egg_info
  creating /tmp/pip-pip-egg-info-_5nrb75k/virtme_ng.egg-info
  writing /tmp/pip-pip-egg-info-_5nrb75k/virtme_ng.egg-info/PKG-INFO
  writing dependency_links to /tmp/pip-pip-egg-info-_5nrb75k/virtme_ng.egg-info/dependency_links.txt
  writing entry points to /tmp/pip-pip-egg-info-_5nrb75k/virtme_ng.egg-info/entry_points.txt
  writing requirements to /tmp/pip-pip-egg-info-_5nrb75k/virtme_ng.egg-info/requires.txt
  writing top-level names to /tmp/pip-pip-egg-info-_5nrb75k/virtme_ng.egg-info/top_level.txt
  writing manifest file '/tmp/pip-pip-egg-info-_5nrb75k/virtme_ng.egg-info/SOURCES.txt'
  reading manifest file '/tmp/pip-pip-egg-info-_5nrb75k/virtme_ng.egg-info/SOURCES.txt'
  adding license file 'LICENSE'
  writing manifest file '/tmp/pip-pip-egg-info-_5nrb75k/virtme_ng.egg-info/SOURCES.txt'
  Preparing metadata (setup.py) ... done
Requirement already satisfied: argcomplete in /usr/lib/python3.12/site-packages (from -r requirements.txt (line 1)) (3.3.0)
Requirement already satisfied: argparse-manpage in /home/jimc/.local/lib/python3.12/site-packages (from -r requirements.txt (line 2)) (4.6)
Requirement already satisfied: requests in /usr/lib/python3.12/site-packages (from -r requirements.txt (line 3)) (2.31.0)
Requirement already satisfied: charset-normalizer<4,>=2 in /usr/lib/python3.12/site-packages (from requests->-r requirements.txt (line 3)) (3.3.2)
Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3.12/site-packages (from requests->-r requirements.txt (line 3)) (3.7)
Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/lib/python3.12/site-packages (from requests->-r requirements.txt (line 3)) (1.26.19)
Building wheels for collected packages: virtme-ng
  Running command python setup.py bdist_wheel
  running bdist_wheel
  running build
  running build_py
  BUILD_VIRTME_NG_INIT: 1
  cd virtme_ng_init && cargo install --path . --root ../virtme/guest
    Installing virtme-ng-init v0.1.0 (/home/jimc/projects/virtme-ng.git/virtme_ng_init)
      Updating crates.io index
       Locking 11 packages to latest compatible versions
        Adding base64 v0.21.7 (latest: v0.22.1)
        Adding bitflags v1.3.2 (latest: v2.6.0)
        Adding memoffset v0.7.1 (latest: v0.9.1)
        Adding nix v0.26.4 (latest: v0.29.0)
      Finished `release` profile [optimized] target(s) in 0.22s
     Replacing ../virtme/guest/bin/virtme-ng-init
      Replaced package `virtme-ng-init v0.1.0 (/home/jimc/projects/virtme-ng.git/virtme_ng_init)` with `virtme-ng-init v0.1.0 (/home/jimc/projects/virtme-ng.git/virtme_ng_init)` (executable `virtme-ng-init`)
  warning: be sure to add `../virtme/guest/bin` to your PATH to be able to run the installed binaries
  creating build
  creating build/lib
  creating build/lib/virtme_ng
  copying virtme_ng/__init__.py -> build/lib/virtme_ng
  copying virtme_ng/spinner.py -> build/lib/virtme_ng
  copying virtme_ng/mainline.py -> build/lib/virtme_ng
  copying virtme_ng/utils.py -> build/lib/virtme_ng
  copying virtme_ng/run.py -> build/lib/virtme_ng
  copying virtme_ng/version.py -> build/lib/virtme_ng
  creating build/lib/virtme
  copying virtme/__init__.py -> build/lib/virtme
  copying virtme/cpiowriter.py -> build/lib/virtme
  copying virtme/mkinitramfs.py -> build/lib/virtme
  copying virtme/modfinder.py -> build/lib/virtme
  copying virtme/qemu_helpers.py -> build/lib/virtme
  copying virtme/resources.py -> build/lib/virtme
  copying virtme/util.py -> build/lib/virtme
  copying virtme/virtmods.py -> build/lib/virtme
  copying virtme/architectures.py -> build/lib/virtme
  creating build/lib/virtme/commands
  copying virtme/commands/__init__.py -> build/lib/virtme/commands
  copying virtme/commands/mkinitramfs.py -> build/lib/virtme/commands
  copying virtme/commands/run.py -> build/lib/virtme/commands
  copying virtme/commands/configkernel.py -> build/lib/virtme/commands
  creating build/lib/virtme/guest
  copying virtme/guest/__init__.py -> build/lib/virtme/guest
  running egg_info
  writing virtme_ng.egg-info/PKG-INFO
  writing dependency_links to virtme_ng.egg-info/dependency_links.txt
  writing entry points to virtme_ng.egg-info/entry_points.txt
  writing requirements to virtme_ng.egg-info/requires.txt
  writing top-level names to virtme_ng.egg-info/top_level.txt
  reading manifest file 'virtme_ng.egg-info/SOURCES.txt'
  adding license file 'LICENSE'
  writing manifest file 'virtme_ng.egg-info/SOURCES.txt'
  error: can't copy 'virtme/scripts': doesn't exist or not a regular file
  error: subprocess-exited-with-error
  
  × python setup.py bdist_wheel did not run successfully.
  │ exit code: 1
  ╰─> See above for output.
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
  full command: /usr/bin/python3 -u -c '
  exec(compile('"'"''"'"''"'"'
  # This is <pip-setuptools-caller> -- a caller that pip uses to run setup.py
  #
  # - It imports setuptools before invoking setup.py, to enable projects that directly
  #   import from `distutils.core` to work with newer packaging standards.
  # - It provides a clear error message when setuptools is not installed.
  # - It sets `sys.argv[0]` to the underlying `setup.py`, when invoking `setup.py` so
  #   setuptools doesn'"'"'t think the script is `-c`. This avoids the following warning:
  #     manifest_maker: standard file '"'"'-c'"'"' not found".
  # - It generates a shim setup.py, for handling setup.cfg-only projects.
  import os, sys, tokenize
  
  try:
      import setuptools
  except ImportError as error:
      print(
          "ERROR: Can not execute `setup.py` since setuptools is not available in "
          "the build environment.",
          file=sys.stderr,
      )
      sys.exit(1)
  
  __file__ = %r
  sys.argv[0] = __file__
  
  if os.path.exists(__file__):
      filename = __file__
      with tokenize.open(__file__) as f:
          setup_py_code = f.read()
  else:
      filename = "<auto-generated setuptools caller>"
      setup_py_code = "from setuptools import setup; setup()"
  
  exec(compile(setup_py_code, filename, "exec"))
  '"'"''"'"''"'"' % ('"'"'/home/jimc/projects/virtme-ng.git/setup.py'"'"',), "<pip-setuptools-caller>", "exec"))' bdist_wheel -d /tmp/pip-wheel-ql779g1g
  cwd: /home/jimc/projects/virtme-ng.git/
  Building wheel for virtme-ng (setup.py) ... error
  ERROR: Failed building wheel for virtme-ng
  Running setup.py clean for virtme-ng
  Running command python setup.py clean
  running clean
  removing 'build/lib' (and everything under it)
  'build/bdist.linux-x86_64' does not exist -- can't clean it
  'build/scripts-3.12' does not exist -- can't clean it
  removing 'build'
Failed to build virtme-ng
ERROR: ERROR: Failed to build installable wheels for some pyproject.toml based projects (virtme-ng)
[jimc@frodo virtme-ng.git]$ ls
bin  DCO-1.1.txt  Makefile   requirements.txt  setup.py  virtme-configkernel  virtme_ng           virtme_ng_init    virtme-run  vng.1
cfg  LICENSE      README.md  setup.cfg         virtme    virtme-mkinitramfs   virtme_ng.egg-info  virtme-ng-prompt  vng         vng-prompt
[jimc@frodo virtme-ng.git]$ cd virtme
[jimc@frodo virtme]$ ls
architectures.py  cpiowriter.py  __init__.py     modfinder.py  qemu_helpers.py  scripts  virtmods.py
commands          guest          mkinitramfs.py  __pycache__   resources.py     util.py
[jimc@frodo virtme]$ ll scripts/
total 4
-rwxr-xr-x. 1 jimc jimc 2508 Jun 12 16:04 virtme-prep-kdir-mods
[jimc@frodo virtme]$ ll 
total 48
-rw-r--r--. 1 jimc jimc 11114 Jul 10 16:01 architectures.py
drwxr-xr-x. 1 jimc jimc    92 Jul 14 21:59 commands
-rwxr-xr-x. 1 jimc jimc  2939 Nov 18  2023 cpiowriter.py
drwxr-xr-x. 1 jimc jimc   216 Jul 14 19:43 guest
-rw-r--r--. 1 jimc jimc     0 Nov 18  2023 __init__.py
-rw-r--r--. 1 jimc jimc  5052 Nov 18  2023 mkinitramfs.py
-rw-r--r--. 1 jimc jimc  2161 Nov 18  2023 modfinder.py
drwxr-xr-x. 1 jimc jimc    88 Jul 14 19:43 __pycache__
-rw-r--r--. 1 jimc jimc  1921 Nov 18  2023 qemu_helpers.py
-rw-r--r--. 1 jimc jimc  1350 Nov 18  2023 resources.py
lrwxrwxrwx. 1 jimc jimc     6 Nov 18  2023 scripts -> ../bin
-rw-r--r--. 1 jimc jimc  1726 Nov 18  2023 util.py
-rw-r--r--. 1 jimc jimc  1174 Jun 12 18:12 virtmods.py
[jimc@frodo virtme]$ 

its failing on a virtme/scripts subdir, which is a symlink to ../bin

I dont know what to make of this.

Could it be a side effect of pip installing setuptools & setuptools-scm ?
which I fiddled a bit with.

[jimc]

FWIW, this doesnt affect my other box,
so I can ignore this for a while and hack there.

[jimc]

Whatever it was, its not a problem now.

I think it was the removing a symlink
599d8ba Merge pull request #143 from arighi/vng-remove-scripts-symlink
that fixed it.