• poudriere-devel has dotnet-9.0.6 stuck at 'build_port_done"; dotnet8-8.0.6_4 at "build"

    From Mark Millard@marklmi@yahoo.com to muc.lists.freebsd.ports on Sat Jul 26 11:46:55 2025
    From Newsgroup: muc.lists.freebsd.ports

    The other builders in the "bulk -Ca" run till are operating.
    # poudriere version
    poudriere-git-3.4.99.20250601
    Extractions of appearently related information follow . . .
    # poudriere status -b
    [main-ZNV4-bulk_a-alt] [2025-07-24_17h17m32s] [parallel_build] Time: 1D:14:22:35
    Queued: 36640 Inspected: 0 Ignored: 361 Built: 31142 Failed: 141 Skipped: 619 Fetched: 0 Remaining: 4377
    . . .
    [03] 05:47:01 lang/dotnet8 | dotnet8-8.0.6_4 build 05:45:28 4.81 GiB 0% 0.5%
    [04] 06:39:07 lang/dotnet | dotnet-9.0.6 build_port_done 05:59:17 4.75 GiB
    . . .
    The poudriere-devel output shows:
    . . .
    [1D:07:43:30] [04] [00:00:00] Building lang/dotnet | dotnet-9.0.6
    . . .
    [1D:08:23:20] [04] [00:39:50] Finished lang/dotnet | dotnet-9.0.6: Success
    . . .
    [1D:08:35:36] [03] [00:00:00] Building lang/dotnet8 | dotnet8-8.0.6_4
    . . .
    # ls -lodT /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/packages/All/dotnet-9.0.6.pkg
    -rw-r--r-- 1 root wheel uarch 758491155 Jul 26 01:40:52 2025 /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/packages/All/dotnet-9.0.6.pkg
    # find /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/ -print
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/ /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6/All
    # find /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/ -name '*dotnet-9*' -print
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/All/dotnet-9.0.6.pkg
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6
    # ls -loaT /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/wrkdirs/
    total 2
    drwx------ 2 root wheel uarch 2 Jul 26 01:40:59 2025 .
    drwxr-xr-x 26 root wheel - 1984 Jul 26 01:33:37 2025 ..
    # ls -loaT /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/
    total 5082
    drwxr-xr-x 26 root wheel - 1984 Jul 26 01:33:37 2025 .
    drwx--x--x 15 root wheel - 832 Jul 24 17:19:30 2025 ..
    -rw-r--r-- 1 root wheel - 3 Jul 24 17:17:32 2025 .cpignore -rw-r--r-- 1 root wheel - 0 Jul 26 01:01:03 2025 .need_rollback drwxr-xr-x 3 root wheel uarch 3 Jul 26 01:33:37 2025 .npkg
    -rw-r--r-- 1 root wheel - 0 Jul 26 01:33:37 2025 .npkg_mounted drwxr-xr-x 4 root wheel - 192 Jul 24 17:19:31 2025 .p
    -rw-r--r-- 2 root wheel uarch 495 Aug 20 10:45:06 2023 .profile
    -rw-r--r-- 1 root wheel - 68 Jul 26 01:01:03 2025 .tmpfs_blacklist_dir
    -r--r--r-- 1 root wheel uarch 6070 Jun 28 23:04:06 2025 COPYRIGHT drwxr-xr-x 2 root wheel - 3008 Jun 28 23:03:57 2025 bin
    drwxr-xr-x 14 root wheel - 4672 Jun 28 23:04:06 2025 boot
    drwxr-xr-x 3 root wheel - 64 Jul 24 17:17:32 2025 compat
    dr-xr-xr-x 11 root wheel - 512 Jul 26 01:01:03 2025 dev
    drwxr-xr-x 485 root wheel uarch 32439 Jul 25 14:15:42 2025 distfiles drwxr-xr-x 31 root wheel - 6784 Jul 26 01:01:57 2025 etc
    lrwxr-xr-x 1 root wheel - 8 Jul 24 17:17:32 2025 home -> usr/home drwxr-xr-x 4 root wheel - 4992 Jun 28 23:03:56 2025 lib
    drwxr-xr-x 3 root wheel - 512 Jun 26 22:28:15 2025 libexec
    drwxr-xr-x 2 root wheel - 0 Dec 4 14:52:10 2021 media
    drwxr-xr-x 2 root wheel - 0 Dec 4 14:52:10 2021 mnt
    drwxr-xr-x 2 root wheel - 0 Dec 4 14:52:10 2021 net
    drwxr-xr-x 2 root wheel - 0 Jul 24 17:17:32 2025 overlays
    drwxr-xr-x 5 root wheel uarch 8 Jul 24 17:19:23 2025 packages
    drwxr-xr-x 3 root wheel - 64 Jul 26 01:01:03 2025 portdistfiles dr-xr-xr-x 1 root wheel - 0 Jul 26 08:55:43 2025 proc
    drwxr-xr-x 2 root wheel uarch 152 Jun 28 23:03:56 2025 rescue
    drwxr-x--- 3 root wheel - 384 Jul 24 17:17:32 2025 root
    drwxr-xr-x 2 root wheel - 9536 Jun 28 23:03:58 2025 sbin
    drwxrwxrwt 71 root wheel - 4480 Jul 26 01:48:28 2025 tmp
    drwxr-xr-x 16 root wheel - 896 Jul 24 17:17:32 2025 usr
    drwxr-xr-x 84 root wheel - 1408 Dec 4 14:52:10 2021 var
    drwx------ 2 root wheel uarch 2 Jul 26 01:40:59 2025 wrkdirs
    # find /tmp/ -name '*lock-*' -exec ls -lodT {} \;
    -rw-r--r-- 1 root wheel uarch 4 Jul 26 11:34:26 2025 /tmp/poudriere.LZmiUvjmEy/lock-main-ZNV4-bulk_a-alt-update_stats.pid
    -rw-r--r-- 1 root wheel uarch 0 Jul 24 17:17:34 2025 /tmp/poudriere.LZmiUvjmEy/lock-main-ZNV4-bulk_a-alt-update_stats.flock
    # more /tmp/poudriere.LZmiUvjmEy/lock-main-ZNV4-bulk_a-alt-update_stats.pid 3615
    From "ps -alxd":
    . . .
    0 3615 3158 15 59 0 16868 4152 wait S 1 22:19.56 | | | |-- sh: poudriere[main-ZNV4-bulk_a-alt]: html_json_main (sh)
    0 56410 3615 5 89 0 14532 3728 - R 1 0:00.75 | | | | |-- /usr/bin/awk -v mini=yes -f /usr/bin/awk main-ZNV4-bulk_a-alt/2025-07-24_17h17m32s/.poudriere.builders main-
    0 56411 3615 29 59 0 14532 2752 piperd S 1 0:00.00 | | | | |-- /usr/bin/awk ORS=""; {print} END {print "\\n"}
    0 56412 3615 10 59 0 14108 2236 piperd S 1 0:00.00 | | | | |-- /usr/bin/sed -e s/,\\([]}]\\)/\\1/g
    0 56413 3615 19 59 0 16868 4144 piperd S 1 0:00.00 | | | | `-- sh: poudriere[main-ZNV4-bulk_a-alt]: html_json_main (sh)
    . . .
    Doing "ps -alxd" does not show a process tree for dotnet-9.0.6 but does for dotnet8-8.0.6_4 :
    UID PID PPID C PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND
    . . .
    0 28395 3158 18 59 0 23524 11608 select I 1 0:00.04 | | | |-- sh: poudriere[main-ZNV4-bulk_a-alt][03]: build_pkg (dotnet8-8.0.6_4) (sh)
    0 55498 28395 25 59 0 23524 11604 wait I 1 0:00.00 | | | | `-- sh: poudriere[main-ZNV4-bulk_a-alt][03]: build_pkg (dotnet8-8.0.6_4) (sh)
    0 55499 55498 21 59 0 14216 3784 wait IsJ - 0:00.02 | | | | `-- /usr/bin/make -C /usr/ports/lang/dotnet8 build
    0 55524 55499 29 59 0 14668 3304 wait IJ - 0:00.00 | | | | `-- /bin/sh -e /tmp/makedskEnT
    0 55525 55524 7 59 0 16204 4920 wait IJ - 0:00.01 | | | | `-- bash ./build.sh --release-manifest release.json --clean-while-building --with-sdk /wrkdirs/usr/ports
    0 56836 55525 4 59 0 406855036 195184 uwait IJ - 0:30.89 | | | | `-- /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet msbuild /wrkdirs/usr/ports/lang/dotnet8/
    0 5126 56836 5 3 0 14748 3512 wait IJ - 0:00.00 | | | | `-- /bin/sh -c export LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; . /tmp/MSBuildTemproot/tmpc8ecf97
    0 5127 5126 4 11 0 16284 5032 wait IJ - 0:00.00 | | | | `-- bash /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/build.sh --ci --configuration R
    0 5130 5127 1 59 0 16284 5376 wait IJ - 0:00.02 | | | | `-- bash /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/eng/common/build.sh --pack --
    0 5330 5130 0 59 0 406784004 105688 uwait IJ - 0:00.55 | | | | `-- /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m /nologo /clp:Summary
    0 5473 5330 22 59 0 14748 3528 wait IJ - 0:00.00 | | | | `-- /bin/sh -c export LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; . /tmp/MSBuildTemproot/tm
    0 5474 5473 28 59 0 406867320 195692 uwait IJ - 0:06.62 | | | | `-- /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m /nologo /clp:Sum
    0 5684 5474 2 9 0 406769428 112740 uwait IJ - 0:02.97 | | | | |-- /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet /wrkdirs/usr/ports/lang/do
    0 5757 5474 9 59 0 406801372 139216 uwait IJ - 0:01.45 | | | | `-- /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet /wrkdirs/usr/ports/lang/do
    A "ww"-added ps command output has:
    UID PID PPID C PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND
    . . .
    0 28395 3158 18 59 0 23524 11608 select I 1 0:00.04 | | | |-- sh: poudriere[main-ZNV4-bulk_a-alt][03]: build_pkg (dotnet8-8.0.6_4) (sh)
    0 55498 28395 25 59 0 23524 11604 wait I 1 0:00.00 | | | | `-- sh: poudriere[main-ZNV4-bulk_a-alt][03]: build_pkg (dotnet8-8.0.6_4) (sh)
    0 55499 55498 21 59 0 14216 3784 wait IsJ - 0:00.02 | | | | `-- /usr/bin/make -C /usr/ports/lang/dotnet8 build
    0 55524 55499 29 59 0 14668 3304 wait IJ - 0:00.00 | | | | `-- /bin/sh -e /tmp/makedskEnT
    0 55525 55524 7 59 0 16204 4920 wait IJ - 0:00.01 | | | | `-- bash ./build.sh --release-manifest release.json --clean-while-building --with-sdk /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk --with-packages /wrkdirs/usr/ports/lang/dotnet8/work/packages -- -maxcpucount:3
    0 56836 55525 4 59 0 406855036 195184 uwait IJ - 0:30.89 | | | | `-- /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet msbuild /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/build.proj -bl:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/log/Debug/Build_0726085441.binlog -flp:LogFile=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/logs/Build_0726085441.log -flp:v=detailed -p:CleanWhileBuilding=true -p:CustomPrebuiltSourceBuiltPackagesPath=/wrkdirs/usr/ports/lang/dotnet8/work/packages -maxcpucount:3
    0 5126 56836 5 3 0 14748 3512 wait IJ - 0:00.00 | | | | `-- /bin/sh -c export LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; . /tmp/MSBuildTemproot/tmpc8ecf970b04a4faea5680a0118915aaa.exec.cmd
    0 5127 5126 4 11 0 16284 5032 wait IJ - 0:00.00 | | | | `-- bash /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/build.sh --ci --configuration Release --restore --build --pack --publish -bl /p:ArcadeBuildFromSource=true /p:CopyWipIntoInnerSourceBuildRepo=true /p:DotNetBuildOffline=true /p:CopySrcInsteadOfClone=true /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/ /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/ /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/ /p:SourceBuildUseMonoRuntime= --nodereuse false
    0 5130 5127 1 59 0 16284 5376 wait IJ - 0:00.02 | | | | `-- bash /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/eng/common/build.sh --pack --build --restore --test --ci --configuration Release --restore --build --pack --publish -bl /p:ArcadeBuildFromSource=true /p:CopyWipIntoInnerSourceBuildRepo=true /p:DotNetBuildOffline=true /p:CopySrcInsteadOfClone=true /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/ /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/ /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/ /p:SourceBuildUseMonoRuntime= --nodereuse false
    0 5330 5130 0 59 0 406784004 105688 uwait IJ - 0:00.55 | | | | `-- /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m /nologo /clp:Summary /v:minimal /nr:false /warnaserror /p:TreatWarningsAsErrors=true /p:ContinuousIntegrationBuild=true /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/Build.proj /bl:"/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/log/Release/Build.binlog" /p:Configuration=Release /p:RepoRoot=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/ /p:Restore=true /p:Build=true /p:Rebuild=false /p:Test=true /p:Pack=true /p:IntegrationTest=false /p:PerformanceTest=false /p:Sign=false /p:Publish=true /p:ArcadeBuildFromSource=true /p:CopyWipIntoInnerSourceBuildRepo=true /p:DotNetBuildOffline=true /p:CopySrcInsteadOfClone=true /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/ /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/ /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/ /p:SourceBuildUseMonoRuntime= -logger:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/net8.0/Microsoft.DotNet.ArcadeLogging.dll
    0 5473 5330 22 59 0 14748 3528 wait IJ - 0:00.00 | | | | `-- /bin/sh -c export LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; . /tmp/MSBuildTemproot/tmp5c13d207e7a4487188f01bcfbfeb74bc.exec.cmd
    0 5474 5473 28 59 0 406867320 195692 uwait IJ - 0:06.62 | | | | `-- /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m /nologo /clp:Summary /v:minimal /nr:false /warnaserror /p:TreatWarningsAsErrors=true /p:ContinuousIntegrationBuild=true /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/Build.proj /bl:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/log/Release/Build.binlog /p:Configuration=Release /p:RepoRoot=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/ /p:Restore=true /p:Build=true /p:Rebuild=false /p:Test=true /p:Pack=true /p:IntegrationTest=false /p:PerformanceTest=false /p:Sign=false /p:Publish=true /p:ArcadeBuildFromSource=true /p:CopyWipIntoInnerSourceBuildRepo=true /p:DotNetBuildOffline=true /p:CopySrcInsteadOfClone=true /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/ /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/ /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/ /p:SourceBuildUseMonoRuntime= -logger:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/net8.0/Microsoft.DotNet.ArcadeLogging.dll /p:ArcadeInnerBuildFromSource=true /p:DotNetBuildFromSource=true /p:RepoRoot=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/self/src/ /p:ArtifactsDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/self/src/artifacts/ /bl:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/self/src/artifacts/sourcebuild.binlog /p:ContinuousIntegrationBuild=true /p:SourceBuildOutputDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/ /p:SourceBuiltBlob
    0 5684 5474 2 9 0 406769428 112740 uwait IJ - 0:02.97 | | | | |-- /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/sdk/8.0.100/MSBuild.dll /nologo /nodemode:1 /nodeReuse:false /low:false
    0 5757 5474 9 59 0 406801372 139216 uwait IJ - 0:01.45 | | | | `-- /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/sdk/8.0.100/MSBuild.dll /nologo /nodemode:1 /nodeReuse:false /low:false
    . . .
    Notes:
    I eventually killed process 5757 to let [03] progress to the next package.
    Such classfies dotnet8 as failed.
    I still have [04] stuck at build_port_done for dotnet-9.0.6 .
    ===
    Mark Millard
    marklmi at yahoo.com
    --
    Posted automagically by a mail2news gateway at muc.de e.V.
    Please direct questions, flames, donations, etc. to news-admin@muc.de
    --- Synchronet 3.21a-Linux NewsLink 1.2
  • From Mark Millard@marklmi@yahoo.com to muc.lists.freebsd.ports on Tue Jul 29 06:34:10 2025
    From Newsgroup: muc.lists.freebsd.ports

    On Jul 26, 2025, at 11:46, Mark Millard <marklmi@yahoo.com> wrote:
    The other builders in the "bulk -Ca" run till are operating.

    # poudriere version
    poudriere-git-3.4.99.20250601

    Extractions of appearently related information follow . . .

    # poudriere status -b
    [main-ZNV4-bulk_a-alt] [2025-07-24_17h17m32s] [parallel_build] Time: 1D:14:22:35
    Queued: 36640 Inspected: 0 Ignored: 361 Built: 31142 Failed: 141 Skipped: 619 Fetched: 0 Remaining: 4377
    . . .
    [03] 05:47:01 lang/dotnet8 | dotnet8-8.0.6_4 build 05:45:28 4.81 GiB 0% 0.5%
    [04] 06:39:07 lang/dotnet | dotnet-9.0.6 build_port_done 05:59:17 4.75 GiB
    . . .

    The poudriere-devel output shows:

    . . .
    [1D:07:43:30] [04] [00:00:00] Building lang/dotnet | dotnet-9.0.6
    . . .
    [1D:08:23:20] [04] [00:39:50] Finished lang/dotnet | dotnet-9.0.6: Success . . .
    [1D:08:35:36] [03] [00:00:00] Building lang/dotnet8 | dotnet8-8.0.6_4
    . . .

    # ls -lodT /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/packages/All/dotnet-9.0.6.pkg
    -rw-r--r-- 1 root wheel uarch 758491155 Jul 26 01:40:52 2025 /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/packages/All/dotnet-9.0.6.pkg

    # find /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/ -print
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/ /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6/All

    # find /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/ -name '*dotnet-9*' -print
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/All/dotnet-9.0.6.pkg
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6

    # ls -loaT /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/wrkdirs/ total 2
    drwx------ 2 root wheel uarch 2 Jul 26 01:40:59 2025 .
    drwxr-xr-x 26 root wheel - 1984 Jul 26 01:33:37 2025 ..

    # ls -loaT /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/
    total 5082
    drwxr-xr-x 26 root wheel - 1984 Jul 26 01:33:37 2025 .
    drwx--x--x 15 root wheel - 832 Jul 24 17:19:30 2025 ..
    -rw-r--r-- 1 root wheel - 3 Jul 24 17:17:32 2025 .cpignore -rw-r--r-- 1 root wheel - 0 Jul 26 01:01:03 2025 .need_rollback drwxr-xr-x 3 root wheel uarch 3 Jul 26 01:33:37 2025 .npkg
    -rw-r--r-- 1 root wheel - 0 Jul 26 01:33:37 2025 .npkg_mounted drwxr-xr-x 4 root wheel - 192 Jul 24 17:19:31 2025 .p
    -rw-r--r-- 2 root wheel uarch 495 Aug 20 10:45:06 2023 .profile -rw-r--r-- 1 root wheel - 68 Jul 26 01:01:03 2025 .tmpfs_blacklist_dir
    -r--r--r-- 1 root wheel uarch 6070 Jun 28 23:04:06 2025 COPYRIGHT drwxr-xr-x 2 root wheel - 3008 Jun 28 23:03:57 2025 bin
    drwxr-xr-x 14 root wheel - 4672 Jun 28 23:04:06 2025 boot
    drwxr-xr-x 3 root wheel - 64 Jul 24 17:17:32 2025 compat
    dr-xr-xr-x 11 root wheel - 512 Jul 26 01:01:03 2025 dev
    drwxr-xr-x 485 root wheel uarch 32439 Jul 25 14:15:42 2025 distfiles drwxr-xr-x 31 root wheel - 6784 Jul 26 01:01:57 2025 etc
    lrwxr-xr-x 1 root wheel - 8 Jul 24 17:17:32 2025 home -> usr/home drwxr-xr-x 4 root wheel - 4992 Jun 28 23:03:56 2025 lib
    drwxr-xr-x 3 root wheel - 512 Jun 26 22:28:15 2025 libexec drwxr-xr-x 2 root wheel - 0 Dec 4 14:52:10 2021 media
    drwxr-xr-x 2 root wheel - 0 Dec 4 14:52:10 2021 mnt
    drwxr-xr-x 2 root wheel - 0 Dec 4 14:52:10 2021 net
    drwxr-xr-x 2 root wheel - 0 Jul 24 17:17:32 2025 overlays drwxr-xr-x 5 root wheel uarch 8 Jul 24 17:19:23 2025 packages drwxr-xr-x 3 root wheel - 64 Jul 26 01:01:03 2025 portdistfiles dr-xr-xr-x 1 root wheel - 0 Jul 26 08:55:43 2025 proc
    drwxr-xr-x 2 root wheel uarch 152 Jun 28 23:03:56 2025 rescue
    drwxr-x--- 3 root wheel - 384 Jul 24 17:17:32 2025 root
    drwxr-xr-x 2 root wheel - 9536 Jun 28 23:03:58 2025 sbin
    drwxrwxrwt 71 root wheel - 4480 Jul 26 01:48:28 2025 tmp
    drwxr-xr-x 16 root wheel - 896 Jul 24 17:17:32 2025 usr
    drwxr-xr-x 84 root wheel - 1408 Dec 4 14:52:10 2021 var
    drwx------ 2 root wheel uarch 2 Jul 26 01:40:59 2025 wrkdirs

    # find /tmp/ -name '*lock-*' -exec ls -lodT {} \;
    -rw-r--r-- 1 root wheel uarch 4 Jul 26 11:34:26 2025 /tmp/poudriere.LZmiUvjmEy/lock-main-ZNV4-bulk_a-alt-update_stats.pid
    -rw-r--r-- 1 root wheel uarch 0 Jul 24 17:17:34 2025 /tmp/poudriere.LZmiUvjmEy/lock-main-ZNV4-bulk_a-alt-update_stats.flock

    # more /tmp/poudriere.LZmiUvjmEy/lock-main-ZNV4-bulk_a-alt-update_stats.pid 3615

    From "ps -alxd":

    . . .
    0 3615 3158 15 59 0 16868 4152 wait S 1 22:19.56 | | | |-- sh: poudriere[main-ZNV4-bulk_a-alt]: html_json_main (sh)
    0 56410 3615 5 89 0 14532 3728 - R 1 0:00.75 | | | | |-- /usr/bin/awk -v mini=yes -f /usr/bin/awk main-ZNV4-bulk_a-alt/2025-07-24_17h17m32s/.poudriere.builders main-
    0 56411 3615 29 59 0 14532 2752 piperd S 1 0:00.00 | | | | |-- /usr/bin/awk ORS=""; {print} END {print "\\n"}
    0 56412 3615 10 59 0 14108 2236 piperd S 1 0:00.00 | | | | |-- /usr/bin/sed -e s/,\\([]}]\\)/\\1/g
    0 56413 3615 19 59 0 16868 4144 piperd S 1 0:00.00 | | | | `-- sh: poudriere[main-ZNV4-bulk_a-alt]: html_json_main (sh)
    . . .

    Doing "ps -alxd" does not show a process tree for dotnet-9.0.6 but does for dotnet8-8.0.6_4 :

    UID PID PPID C PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND
    . . .
    0 28395 3158 18 59 0 23524 11608 select I 1 0:00.04 | | | |-- sh: poudriere[main-ZNV4-bulk_a-alt][03]: build_pkg (dotnet8-8.0.6_4) (sh)
    0 55498 28395 25 59 0 23524 11604 wait I 1 0:00.00 | | | | `-- sh: poudriere[main-ZNV4-bulk_a-alt][03]: build_pkg (dotnet8-8.0.6_4) (sh)
    0 55499 55498 21 59 0 14216 3784 wait IsJ - 0:00.02 | | | | `-- /usr/bin/make -C /usr/ports/lang/dotnet8 build
    0 55524 55499 29 59 0 14668 3304 wait IJ - 0:00.00 | | | | `-- /bin/sh -e /tmp/makedskEnT
    0 55525 55524 7 59 0 16204 4920 wait IJ - 0:00.01 | | | | `-- bash ./build.sh --release-manifest release.json --clean-while-building --with-sdk /wrkdirs/usr/ports
    0 56836 55525 4 59 0 406855036 195184 uwait IJ - 0:30.89 | | | | `-- /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet msbuild /wrkdirs/usr/ports/lang/dotnet8/
    0 5126 56836 5 3 0 14748 3512 wait IJ - 0:00.00 | | | | `-- /bin/sh -c export LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; . /tmp/MSBuildTemproot/tmpc8ecf97
    0 5127 5126 4 11 0 16284 5032 wait IJ - 0:00.00 | | | | `-- bash /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/build.sh --ci --configuration R
    0 5130 5127 1 59 0 16284 5376 wait IJ - 0:00.02 | | | | `-- bash /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/eng/common/build.sh --pack --
    0 5330 5130 0 59 0 406784004 105688 uwait IJ - 0:00.55 | | | | `-- /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m /nologo /clp:Summary
    0 5473 5330 22 59 0 14748 3528 wait IJ - 0:00.00 | | | | `-- /bin/sh -c export LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; . /tmp/MSBuildTemproot/tm
    0 5474 5473 28 59 0 406867320 195692 uwait IJ - 0:06.62 | | | | `-- /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m /nologo /clp:Sum
    0 5684 5474 2 9 0 406769428 112740 uwait IJ - 0:02.97 | | | | |-- /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet /wrkdirs/usr/ports/lang/do
    0 5757 5474 9 59 0 406801372 139216 uwait IJ - 0:01.45 | | | | `-- /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet /wrkdirs/usr/ports/lang/do

    A "ww"-added ps command output has:

    UID PID PPID C PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND
    . . .
    0 28395 3158 18 59 0 23524 11608 select I 1 0:00.04 | | | |-- sh: poudriere[main-ZNV4-bulk_a-alt][03]: build_pkg (dotnet8-8.0.6_4) (sh)
    0 55498 28395 25 59 0 23524 11604 wait I 1 0:00.00 | | | | `-- sh: poudriere[main-ZNV4-bulk_a-alt][03]: build_pkg (dotnet8-8.0.6_4) (sh)
    0 55499 55498 21 59 0 14216 3784 wait IsJ - 0:00.02 | | | | `-- /usr/bin/make -C /usr/ports/lang/dotnet8 build
    0 55524 55499 29 59 0 14668 3304 wait IJ - 0:00.00 | | | | `-- /bin/sh -e /tmp/makedskEnT
    0 55525 55524 7 59 0 16204 4920 wait IJ - 0:00.01 | | | | `-- bash ./build.sh --release-manifest release.json --clean-while-building --with-sdk /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk --with-packages /wrkdirs/usr/ports/lang/dotnet8/work/packages -- -maxcpucount:3
    0 56836 55525 4 59 0 406855036 195184 uwait IJ - 0:30.89 | | | | `-- /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet msbuild /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/build.proj -bl:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/log/Debug/Build_0726085441.binlog -flp:LogFile=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/logs/Build_0726085441.log -flp:v=detailed -p:CleanWhileBuilding=true -p:CustomPrebuiltSourceBuiltPackagesPath=/wrkdirs/usr/ports/lang/dotnet8/work/packages -maxcpucount:3
    0 5126 56836 5 3 0 14748 3512 wait IJ - 0:00.00 | | | | `-- /bin/sh -c export LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; . /tmp/MSBuildTemproot/tmpc8ecf970b04a4faea5680a0118915aaa.exec.cmd
    0 5127 5126 4 11 0 16284 5032 wait IJ - 0:00.00 | | | | `-- bash /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/build.sh --ci --configuration Release --restore --build --pack --publish -bl /p:ArcadeBuildFromSource=true /p:CopyWipIntoInnerSourceBuildRepo=true /p:DotNetBuildOffline=true /p:CopySrcInsteadOfClone=true /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/ /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/ /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/ /p:SourceBuildUseMonoRuntime= --nodereuse false
    0 5130 5127 1 59 0 16284 5376 wait IJ - 0:00.02 | | | | `-- bash /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/eng/common/build.sh --pack --build --restore --test --ci --configuration Release --restore --build --pack --publish -bl /p:ArcadeBuildFromSource=true /p:CopyWipIntoInnerSourceBuildRepo=true /p:DotNetBuildOffline=true /p:CopySrcInsteadOfClone=true /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/ /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/ /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/ /p:SourceBuildUseMonoRuntime= --nodereuse false
    0 5330 5130 0 59 0 406784004 105688 uwait IJ - 0:00.55 | | | | `-- /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m /nologo /clp:Summary /v:minimal /nr:false /warnaserror /p:TreatWarningsAsErrors=true /p:ContinuousIntegrationBuild=true /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/Build.proj /bl:"/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/log/Release/Build.binlog" /p:Configuration=Release /p:RepoRoot=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/ /p:Restore=true /p:Build=true /p:Rebuild=false /p:Test=true /p:Pack=true /p:IntegrationTest=false /p:PerformanceTest=false /p:Sign=false /p:Publish=true /p:ArcadeBuildFromSource=true /p:CopyWipIntoInnerSourceBuildRepo=true /p:DotNetBuildOffline=true /p:CopySrcInsteadOfClone=true /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/ /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/ /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/ /p:SourceBuildUseMonoRuntime= -logger:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/net8.0/Microsoft.DotNet.ArcadeLogging.dll
    0 5473 5330 22 59 0 14748 3528 wait IJ - 0:00.00 | | | | `-- /bin/sh -c export LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; . /tmp/MSBuildTemproot/tmp5c13d207e7a4487188f01bcfbfeb74bc.exec.cmd
    0 5474 5473 28 59 0 406867320 195692 uwait IJ - 0:06.62 | | | | `-- /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m /nologo /clp:Summary /v:minimal /nr:false /warnaserror /p:TreatWarningsAsErrors=true /p:ContinuousIntegrationBuild=true /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/Build.proj /bl:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/log/Release/Build.binlog /p:Configuration=Release /p:RepoRoot=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/ /p:Restore=true /p:Build=true /p:Rebuild=false /p:Test=true /p:Pack=true /p:IntegrationTest=false /p:PerformanceTest=false /p:Sign=false /p:Publish=true /p:ArcadeBuildFromSource=true /p:CopyWipIntoInnerSourceBuildRepo=true /p:DotNetBuildOffline=true /p:CopySrcInsteadOfClone=true /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/ /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/ /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/ /p:SourceBuildUseMonoRuntime= -logger:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/net8.0/Microsoft.DotNet.ArcadeLogging.dll /p:ArcadeInnerBuildFromSource=true /p:DotNetBuildFromSource=true /p:RepoRoot=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/self/src/ /p:ArtifactsDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/self/src/artifacts/ /bl:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/self/src/artifacts/sourcebuild.binlog /p:ContinuousIntegrationBuild=true /p:SourceBuildOutputDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/ /p:SourceBuiltBlob
    0 5684 5474 2 9 0 406769428 112740 uwait IJ - 0:02.97 | | | | |-- /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/sdk/8.0.100/MSBuild.dll /nologo /nodemode:1 /nodeReuse:false /low:false
    0 5757 5474 9 59 0 406801372 139216 uwait IJ - 0:01.45 | | | | `-- /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/sdk/8.0.100/MSBuild.dll /nologo /nodemode:1 /nodeReuse:false /low:false
    . . .

    Notes:

    I eventually killed process 5757 to let [03] progress to the next package. Such classfies dotnet8 as failed.

    I still have [04] stuck at build_port_done for dotnet-9.0.6 .

    In another bulk -Ca test, dotnet8 built fine but dotnet-9.0.6 seems
    to be stuck in build_port_done again:
    ID TOTAL ORIGIN PKGNAME PHASE TIME TMPFS CPU% MEM%
    . . .
    [25] 06:10:17 lang/dotnet | dotnet-9.0.6 build_port_done 04:40:03 4.75 GiB
    . . .
    ===
    Mark Millard
    marklmi at yahoo.com
    --
    Posted automagically by a mail2news gateway at muc.de e.V.
    Please direct questions, flames, donations, etc. to news-admin@muc.de
    --- Synchronet 3.21a-Linux NewsLink 1.2
  • From Naram Qashat@cyberbotx@cyberbotx.com to muc.lists.freebsd.ports on Tue Jul 29 10:14:56 2025
    From Newsgroup: muc.lists.freebsd.ports

    On 2025-07-29 09:34, Mark Millard wrote:
    On Jul 26, 2025, at 11:46, Mark Millard <marklmi@yahoo.com> wrote:

    The other builders in the "bulk -Ca" run till are operating.

    # poudriere version
    poudriere-git-3.4.99.20250601

    Extractions of appearently related information follow . . .

    # poudriere status -b
    [main-ZNV4-bulk_a-alt] [2025-07-24_17h17m32s] [parallel_build]
    Time: 1D:14:22:35
    Queued: 36640 Inspected: 0 Ignored: 361 Built: 31142 Failed: 141
    Skipped: 619 Fetched: 0 Remaining: 4377
    . . .
    [03] 05:47:01 lang/dotnet8 | dotnet8-8.0.6_4
    build 05:45:28 4.81 GiB 0% 0.5%
    [04] 06:39:07 lang/dotnet | dotnet-9.0.6
    build_port_done 05:59:17 4.75 GiB
    . . .

    The poudriere-devel output shows:

    . . .
    [1D:07:43:30] [04] [00:00:00] Building lang/dotnet | dotnet-9.0.6
    . . .
    [1D:08:23:20] [04] [00:39:50] Finished lang/dotnet | dotnet-9.0.6:
    Success
    . . .
    [1D:08:35:36] [03] [00:00:00] Building lang/dotnet8 |
    dotnet8-8.0.6_4
    . . .

    # ls -lodT
    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/packages/All/dotnet-9.0.6.pkg
    -rw-r--r-- 1 root wheel uarch 758491155 Jul 26 01:40:52 2025
    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/packages/All/dotnet-9.0.6.pkg

    # find
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/
    -print
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6/All

    # find /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/ -name
    '*dotnet-9*' -print
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/All/dotnet-9.0.6.pkg
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6

    # ls -loaT
    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/wrkdirs/
    total 2
    drwx------ 2 root wheel uarch 2 Jul 26 01:40:59 2025 .
    drwxr-xr-x 26 root wheel - 1984 Jul 26 01:33:37 2025 ..

    # ls -loaT /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/
    total 5082
    drwxr-xr-x 26 root wheel - 1984 Jul 26 01:33:37 2025 .
    drwx--x--x 15 root wheel - 832 Jul 24 17:19:30 2025 ..
    -rw-r--r-- 1 root wheel - 3 Jul 24 17:17:32 2025 .cpignore
    -rw-r--r-- 1 root wheel - 0 Jul 26 01:01:03 2025
    .need_rollback
    drwxr-xr-x 3 root wheel uarch 3 Jul 26 01:33:37 2025 .npkg
    -rw-r--r-- 1 root wheel - 0 Jul 26 01:33:37 2025
    .npkg_mounted
    drwxr-xr-x 4 root wheel - 192 Jul 24 17:19:31 2025 .p
    -rw-r--r-- 2 root wheel uarch 495 Aug 20 10:45:06 2023 .profile
    -rw-r--r-- 1 root wheel - 68 Jul 26 01:01:03 2025
    .tmpfs_blacklist_dir
    -r--r--r-- 1 root wheel uarch 6070 Jun 28 23:04:06 2025 COPYRIGHT
    drwxr-xr-x 2 root wheel - 3008 Jun 28 23:03:57 2025 bin
    drwxr-xr-x 14 root wheel - 4672 Jun 28 23:04:06 2025 boot
    drwxr-xr-x 3 root wheel - 64 Jul 24 17:17:32 2025 compat
    dr-xr-xr-x 11 root wheel - 512 Jul 26 01:01:03 2025 dev
    drwxr-xr-x 485 root wheel uarch 32439 Jul 25 14:15:42 2025 distfiles
    drwxr-xr-x 31 root wheel - 6784 Jul 26 01:01:57 2025 etc
    lrwxr-xr-x 1 root wheel - 8 Jul 24 17:17:32 2025 home ->
    usr/home
    drwxr-xr-x 4 root wheel - 4992 Jun 28 23:03:56 2025 lib
    drwxr-xr-x 3 root wheel - 512 Jun 26 22:28:15 2025 libexec
    drwxr-xr-x 2 root wheel - 0 Dec 4 14:52:10 2021 media
    drwxr-xr-x 2 root wheel - 0 Dec 4 14:52:10 2021 mnt
    drwxr-xr-x 2 root wheel - 0 Dec 4 14:52:10 2021 net
    drwxr-xr-x 2 root wheel - 0 Jul 24 17:17:32 2025 overlays
    drwxr-xr-x 5 root wheel uarch 8 Jul 24 17:19:23 2025 packages
    drwxr-xr-x 3 root wheel - 64 Jul 26 01:01:03 2025
    portdistfiles
    dr-xr-xr-x 1 root wheel - 0 Jul 26 08:55:43 2025 proc
    drwxr-xr-x 2 root wheel uarch 152 Jun 28 23:03:56 2025 rescue
    drwxr-x--- 3 root wheel - 384 Jul 24 17:17:32 2025 root
    drwxr-xr-x 2 root wheel - 9536 Jun 28 23:03:58 2025 sbin
    drwxrwxrwt 71 root wheel - 4480 Jul 26 01:48:28 2025 tmp
    drwxr-xr-x 16 root wheel - 896 Jul 24 17:17:32 2025 usr
    drwxr-xr-x 84 root wheel - 1408 Dec 4 14:52:10 2021 var
    drwx------ 2 root wheel uarch 2 Jul 26 01:40:59 2025 wrkdirs

    # find /tmp/ -name '*lock-*' -exec ls -lodT {} \;
    -rw-r--r-- 1 root wheel uarch 4 Jul 26 11:34:26 2025
    /tmp/poudriere.LZmiUvjmEy/lock-main-ZNV4-bulk_a-alt-update_stats.pid
    -rw-r--r-- 1 root wheel uarch 0 Jul 24 17:17:34 2025
    /tmp/poudriere.LZmiUvjmEy/lock-main-ZNV4-bulk_a-alt-update_stats.flock

    # more
    /tmp/poudriere.LZmiUvjmEy/lock-main-ZNV4-bulk_a-alt-update_stats.pid
    3615

    From "ps -alxd":

    . . .
    0 3615 3158 15 59 0 16868 4152 wait S 1
    22:19.56 | | | |-- sh: poudriere[main-ZNV4-bulk_a-alt]:
    html_json_main (sh)
    0 56410 3615 5 89 0 14532 3728 - R 1
    0:00.75 | | | | |-- /usr/bin/awk -v mini=yes -f /usr/bin/awk
    main-ZNV4-bulk_a-alt/2025-07-24_17h17m32s/.poudriere.builders main-
    0 56411 3615 29 59 0 14532 2752 piperd S 1
    0:00.00 | | | | |-- /usr/bin/awk ORS=""; {print} END {print
    "\\n"}
    0 56412 3615 10 59 0 14108 2236 piperd S 1
    0:00.00 | | | | |-- /usr/bin/sed -e s/,\\([]}]\\)/\\1/g
    0 56413 3615 19 59 0 16868 4144 piperd S 1
    0:00.00 | | | | `-- sh: poudriere[main-ZNV4-bulk_a-alt]:
    html_json_main (sh)
    . . .

    Doing "ps -alxd" does not show a process tree for dotnet-9.0.6 but
    does for dotnet8-8.0.6_4 :

    UID PID PPID C PRI NI VSZ RSS MWCHAN STAT TT
    TIME COMMAND
    . . .
    0 28395 3158 18 59 0 23524 11608 select I 1
    0:00.04 | | | |-- sh: poudriere[main-ZNV4-bulk_a-alt][03]:
    build_pkg (dotnet8-8.0.6_4) (sh)
    0 55498 28395 25 59 0 23524 11604 wait I 1
    0:00.00 | | | | `-- sh: poudriere[main-ZNV4-bulk_a-alt][03]:
    build_pkg (dotnet8-8.0.6_4) (sh)
    0 55499 55498 21 59 0 14216 3784 wait IsJ -
    0:00.02 | | | | `-- /usr/bin/make -C /usr/ports/lang/dotnet8
    build
    0 55524 55499 29 59 0 14668 3304 wait IJ -
    0:00.00 | | | | `-- /bin/sh -e /tmp/makedskEnT
    0 55525 55524 7 59 0 16204 4920 wait IJ -
    0:00.01 | | | | `-- bash ./build.sh --release-manifest
    release.json --clean-while-building --with-sdk /wrkdirs/usr/ports
    0 56836 55525 4 59 0 406855036 195184 uwait IJ -
    0:30.89 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet msbuild
    /wrkdirs/usr/ports/lang/dotnet8/
    0 5126 56836 5 3 0 14748 3512 wait IJ -
    0:00.00 | | | | `-- /bin/sh -c export
    LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; .
    /tmp/MSBuildTemproot/tmpc8ecf97
    0 5127 5126 4 11 0 16284 5032 wait IJ -
    0:00.00 | | | | `-- bash
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/build.sh
    --ci --configuration R
    0 5130 5127 1 59 0 16284 5376 wait IJ -
    0:00.02 | | | | `-- bash
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/eng/common/build.sh
    --pack --
    0 5330 5130 0 59 0 406784004 105688 uwait IJ -
    0:00.55 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m
    /nologo /clp:Summary
    0 5473 5330 22 59 0 14748 3528 wait IJ -
    0:00.00 | | | | `-- /bin/sh -c export
    LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; . /tmp/MSBuildTemproot/tm
    0 5474 5473 28 59 0 406867320 195692 uwait IJ -
    0:06.62 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m
    /nologo /clp:Sum
    0 5684 5474 2 9 0 406769428 112740 uwait IJ -
    0:02.97 | | | | |--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet
    /wrkdirs/usr/ports/lang/do
    0 5757 5474 9 59 0 406801372 139216 uwait IJ -
    0:01.45 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet
    /wrkdirs/usr/ports/lang/do

    A "ww"-added ps command output has:

    UID PID PPID C PRI NI VSZ RSS MWCHAN STAT TT
    TIME COMMAND
    . . .
    0 28395 3158 18 59 0 23524 11608 select I 1
    0:00.04 | | | |-- sh: poudriere[main-ZNV4-bulk_a-alt][03]:
    build_pkg (dotnet8-8.0.6_4) (sh)
    0 55498 28395 25 59 0 23524 11604 wait I 1
    0:00.00 | | | | `-- sh: poudriere[main-ZNV4-bulk_a-alt][03]:
    build_pkg (dotnet8-8.0.6_4) (sh)
    0 55499 55498 21 59 0 14216 3784 wait IsJ -
    0:00.02 | | | | `-- /usr/bin/make -C /usr/ports/lang/dotnet8
    build
    0 55524 55499 29 59 0 14668 3304 wait IJ -
    0:00.00 | | | | `-- /bin/sh -e /tmp/makedskEnT
    0 55525 55524 7 59 0 16204 4920 wait IJ -
    0:00.01 | | | | `-- bash ./build.sh --release-manifest
    release.json --clean-while-building --with-sdk
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk --with-packages
    /wrkdirs/usr/ports/lang/dotnet8/work/packages -- -maxcpucount:3
    0 56836 55525 4 59 0 406855036 195184 uwait IJ -
    0:30.89 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet msbuild
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/build.proj
    -bl:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/log/Debug/Build_0726085441.binlog
    -flp:LogFile=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/logs/Build_0726085441.log
    -flp:v=detailed -p:CleanWhileBuilding=true
    -p:CustomPrebuiltSourceBuiltPackagesPath=/wrkdirs/usr/ports/lang/dotnet8/work/packages
    -maxcpucount:3
    0 5126 56836 5 3 0 14748 3512 wait IJ -
    0:00.00 | | | | `-- /bin/sh -c export
    LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; .
    /tmp/MSBuildTemproot/tmpc8ecf970b04a4faea5680a0118915aaa.exec.cmd
    0 5127 5126 4 11 0 16284 5032 wait IJ -
    0:00.00 | | | | `-- bash
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/build.sh
    --ci --configuration Release --restore --build --pack --publish -bl
    /p:ArcadeBuildFromSource=true /p:CopyWipIntoInnerSourceBuildRepo=true
    /p:DotNetBuildOffline=true /p:CopySrcInsteadOfClone=true
    /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props
    /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/
    /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/
    /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/
    /p:SourceBuildUseMonoRuntime= --nodereuse false
    0 5130 5127 1 59 0 16284 5376 wait IJ -
    0:00.02 | | | | `-- bash
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/eng/common/build.sh
    --pack --build --restore --test --ci --configuration Release --restore
    --build --pack --publish -bl /p:ArcadeBuildFromSource=true
    /p:CopyWipIntoInnerSourceBuildRepo=true /p:DotNetBuildOffline=true
    /p:CopySrcInsteadOfClone=true
    /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props
    /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/
    /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/
    /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/
    /p:SourceBuildUseMonoRuntime= --nodereuse false
    0 5330 5130 0 59 0 406784004 105688 uwait IJ -
    0:00.55 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m
    /nologo /clp:Summary /v:minimal /nr:false /warnaserror
    /p:TreatWarningsAsErrors=true /p:ContinuousIntegrationBuild=true
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/Build.proj
    /bl:"/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/log/Release/Build.binlog"
    /p:Configuration=Release
    /p:RepoRoot=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/
    /p:Restore=true /p:Build=true /p:Rebuild=false /p:Test=true
    /p:Pack=true /p:IntegrationTest=false /p:PerformanceTest=false
    /p:Sign=false /p:Publish=true /p:ArcadeBuildFromSource=true
    /p:CopyWipIntoInnerSourceBuildRepo=true /p:DotNetBuildOffline=true
    /p:CopySrcInsteadOfClone=true
    /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props
    /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/
    /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/
    /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/
    /p:SourceBuildUseMonoRuntime=
    -logger:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/net8.0/Microsoft.DotNet.ArcadeLogging.dll
    0 5473 5330 22 59 0 14748 3528 wait IJ -
    0:00.00 | | | | `-- /bin/sh -c export
    LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; .
    /tmp/MSBuildTemproot/tmp5c13d207e7a4487188f01bcfbfeb74bc.exec.cmd
    0 5474 5473 28 59 0 406867320 195692 uwait IJ -
    0:06.62 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m
    /nologo /clp:Summary /v:minimal /nr:false /warnaserror
    /p:TreatWarningsAsErrors=true /p:ContinuousIntegrationBuild=true
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/Build.proj
    /bl:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/log/Release/Build.binlog
    /p:Configuration=Release
    /p:RepoRoot=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/
    /p:Restore=true /p:Build=true /p:Rebuild=false /p:Test=true
    /p:Pack=true /p:IntegrationTest=false /p:PerformanceTest=false
    /p:Sign=false /p:Publish=true /p:ArcadeBuildFromSource=true
    /p:CopyWipIntoInnerSourceBuildRepo=true /p:DotNetBuildOffline=true
    /p:CopySrcInsteadOfClone=true
    /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props
    /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/
    /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/
    /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/
    /p:SourceBuildUseMonoRuntime=
    -logger:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/net8.0/Microsoft.DotNet.ArcadeLogging.dll
    /p:ArcadeInnerBuildFromSource=true /p:DotNetBuildFromSource=true
    /p:RepoRoot=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/self/src/
    /p:ArtifactsDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/self/src/artifacts/
    /bl:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/self/src/artifacts/sourcebuild.binlog
    /p:ContinuousIntegrationBuild=true
    /p:SourceBuildOutputDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/
    /p:SourceBuiltBlob
    0 5684 5474 2 9 0 406769428 112740 uwait IJ -
    0:02.97 | | | | |--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/sdk/8.0.100/MSBuild.dll >> /nologo /nodemode:1 /nodeReuse:false /low:false
    0 5757 5474 9 59 0 406801372 139216 uwait IJ -
    0:01.45 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/sdk/8.0.100/MSBuild.dll >> /nologo /nodemode:1 /nodeReuse:false /low:false
    . . .

    Notes:

    I eventually killed process 5757 to let [03] progress to the next
    package.
    Such classfies dotnet8 as failed.

    I still have [04] stuck at build_port_done for dotnet-9.0.6 .


    In another bulk -Ca test, dotnet8 built fine but dotnet-9.0.6 seems
    to be stuck in build_port_done again:

    ID TOTAL ORIGIN PKGNAME
    PHASE TIME TMPFS
    CPU% MEM%
    . . .
    [25] 06:10:17 lang/dotnet | dotnet-9.0.6
    build_port_done 04:40:03 4.75 GiB
    . . .


    ===
    Mark Millard
    marklmi at yahoo.com

    I'd like to point out that I too have been experiencing this, although
    only on my amd64 builders and never on my arm64 builder. One thing Mark
    did not point out, though, is that the log for the build ends with
    saying that the wrkdirs unmount failed, specifically I see this as the
    last line in my own logs:

    umount: unmount of
    /usr/local/poudriere/data/.m/14amd64-default/01/wrkdirs failed: Device
    busy

    And similarly to Mark, because it ends like this with absolutely no
    processes in the jail, there is nothing to kill and thus no way to get poudriere to finish off that job.

    Thanks,
    Naram "CyberBotX" Qashat


    --
    Posted automagically by a mail2news gateway at muc.de e.V.
    Please direct questions, flames, donations, etc. to news-admin@muc.de
    --- Synchronet 3.21a-Linux NewsLink 1.2
  • From Mark Millard@marklmi@yahoo.com to muc.lists.freebsd.ports on Tue Jul 29 10:10:31 2025
    From Newsgroup: muc.lists.freebsd.ports

    Naram Qashat <cyberbotx_at_cyberbotx.com> wrote on
    Date: Tue, 29 Jul 2025 14:14:56 UTC :
    On 2025-07-29 09:34, Mark Millard wrote:
    On Jul 26, 2025, at 11:46, Mark Millard <marklmi@yahoo.com> wrote:

    The other builders in the "bulk -Ca" run till are operating.

    # poudriere version
    poudriere-git-3.4.99.20250601

    Extractions of appearently related information follow . . .

    # poudriere status -b
    [main-ZNV4-bulk_a-alt] [2025-07-24_17h17m32s] [parallel_build]
    Time: 1D:14:22:35
    Queued: 36640 Inspected: 0 Ignored: 361 Built: 31142 Failed: 141
    Skipped: 619 Fetched: 0 Remaining: 4377
    . . .
    [03] 05:47:01 lang/dotnet8 | dotnet8-8.0.6_4
    build 05:45:28 4.81 GiB 0% 0.5%
    [04] 06:39:07 lang/dotnet | dotnet-9.0.6
    build_port_done 05:59:17 4.75 GiB
    . . .

    The poudriere-devel output shows:

    . . .
    [1D:07:43:30] [04] [00:00:00] Building lang/dotnet | dotnet-9.0.6
    . . .
    [1D:08:23:20] [04] [00:39:50] Finished lang/dotnet | dotnet-9.0.6: > >> Success
    . . .
    [1D:08:35:36] [03] [00:00:00] Building lang/dotnet8 |
    dotnet8-8.0.6_4
    . . .

    # ls -lodT
    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/packages/All/dotnet-9.0.6.pkg
    -rw-r--r-- 1 root wheel uarch 758491155 Jul 26 01:40:52 2025
    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/packages/All/dotnet-9.0.6.pkg

    # find
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/ > >> -print
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/ >> /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6/All

    # find /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/ -name
    '*dotnet-9*' -print
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/All/dotnet-9.0.6.pkg
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6

    # ls -loaT
    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/wrkdirs/
    total 2
    drwx------ 2 root wheel uarch 2 Jul 26 01:40:59 2025 .
    drwxr-xr-x 26 root wheel - 1984 Jul 26 01:33:37 2025 ..

    # ls -loaT /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/
    total 5082
    drwxr-xr-x 26 root wheel - 1984 Jul 26 01:33:37 2025 .
    drwx--x--x 15 root wheel - 832 Jul 24 17:19:30 2025 ..
    -rw-r--r-- 1 root wheel - 3 Jul 24 17:17:32 2025 .cpignore
    -rw-r--r-- 1 root wheel - 0 Jul 26 01:01:03 2025
    .need_rollback
    drwxr-xr-x 3 root wheel uarch 3 Jul 26 01:33:37 2025 .npkg
    -rw-r--r-- 1 root wheel - 0 Jul 26 01:33:37 2025
    .npkg_mounted
    drwxr-xr-x 4 root wheel - 192 Jul 24 17:19:31 2025 .p
    -rw-r--r-- 2 root wheel uarch 495 Aug 20 10:45:06 2023 .profile
    -rw-r--r-- 1 root wheel - 68 Jul 26 01:01:03 2025
    .tmpfs_blacklist_dir
    -r--r--r-- 1 root wheel uarch 6070 Jun 28 23:04:06 2025 COPYRIGHT
    drwxr-xr-x 2 root wheel - 3008 Jun 28 23:03:57 2025 bin
    drwxr-xr-x 14 root wheel - 4672 Jun 28 23:04:06 2025 boot
    drwxr-xr-x 3 root wheel - 64 Jul 24 17:17:32 2025 compat
    dr-xr-xr-x 11 root wheel - 512 Jul 26 01:01:03 2025 dev
    drwxr-xr-x 485 root wheel uarch 32439 Jul 25 14:15:42 2025 distfiles
    drwxr-xr-x 31 root wheel - 6784 Jul 26 01:01:57 2025 etc
    lrwxr-xr-x 1 root wheel - 8 Jul 24 17:17:32 2025 home ->
    usr/home
    drwxr-xr-x 4 root wheel - 4992 Jun 28 23:03:56 2025 lib
    drwxr-xr-x 3 root wheel - 512 Jun 26 22:28:15 2025 libexec
    drwxr-xr-x 2 root wheel - 0 Dec 4 14:52:10 2021 media
    drwxr-xr-x 2 root wheel - 0 Dec 4 14:52:10 2021 mnt
    drwxr-xr-x 2 root wheel - 0 Dec 4 14:52:10 2021 net
    drwxr-xr-x 2 root wheel - 0 Jul 24 17:17:32 2025 overlays
    drwxr-xr-x 5 root wheel uarch 8 Jul 24 17:19:23 2025 packages
    drwxr-xr-x 3 root wheel - 64 Jul 26 01:01:03 2025
    portdistfiles
    dr-xr-xr-x 1 root wheel - 0 Jul 26 08:55:43 2025 proc
    drwxr-xr-x 2 root wheel uarch 152 Jun 28 23:03:56 2025 rescue
    drwxr-x--- 3 root wheel - 384 Jul 24 17:17:32 2025 root
    drwxr-xr-x 2 root wheel - 9536 Jun 28 23:03:58 2025 sbin
    drwxrwxrwt 71 root wheel - 4480 Jul 26 01:48:28 2025 tmp
    drwxr-xr-x 16 root wheel - 896 Jul 24 17:17:32 2025 usr
    drwxr-xr-x 84 root wheel - 1408 Dec 4 14:52:10 2021 var
    drwx------ 2 root wheel uarch 2 Jul 26 01:40:59 2025 wrkdirs

    # find /tmp/ -name '*lock-*' -exec ls -lodT {} \;
    -rw-r--r-- 1 root wheel uarch 4 Jul 26 11:34:26 2025
    /tmp/poudriere.LZmiUvjmEy/lock-main-ZNV4-bulk_a-alt-update_stats.pid
    -rw-r--r-- 1 root wheel uarch 0 Jul 24 17:17:34 2025
    /tmp/poudriere.LZmiUvjmEy/lock-main-ZNV4-bulk_a-alt-update_stats.flock

    # more
    /tmp/poudriere.LZmiUvjmEy/lock-main-ZNV4-bulk_a-alt-update_stats.pid
    3615

    From "ps -alxd":

    . . .
    0 3615 3158 15 59 0 16868 4152 wait S 1
    22:19.56 | | | |-- sh: poudriere[main-ZNV4-bulk_a-alt]:
    html_json_main (sh)
    0 56410 3615 5 89 0 14532 3728 - R 1
    0:00.75 | | | | |-- /usr/bin/awk -v mini=yes -f /usr/bin/awk
    main-ZNV4-bulk_a-alt/2025-07-24_17h17m32s/.poudriere.builders main-
    0 56411 3615 29 59 0 14532 2752 piperd S 1
    0:00.00 | | | | |-- /usr/bin/awk ORS=""; {print} END {print
    "\\n"}
    0 56412 3615 10 59 0 14108 2236 piperd S 1
    0:00.00 | | | | |-- /usr/bin/sed -e s/,\\([]}]\\)/\\1/g
    0 56413 3615 19 59 0 16868 4144 piperd S 1
    0:00.00 | | | | `-- sh: poudriere[main-ZNV4-bulk_a-alt]:
    html_json_main (sh)
    . . .

    Doing "ps -alxd" does not show a process tree for dotnet-9.0.6 but > >> does for dotnet8-8.0.6_4 :

    UID PID PPID C PRI NI VSZ RSS MWCHAN STAT TT
    TIME COMMAND
    . . .
    0 28395 3158 18 59 0 23524 11608 select I 1
    0:00.04 | | | |-- sh: poudriere[main-ZNV4-bulk_a-alt][03]:
    build_pkg (dotnet8-8.0.6_4) (sh)
    0 55498 28395 25 59 0 23524 11604 wait I 1
    0:00.00 | | | | `-- sh: poudriere[main-ZNV4-bulk_a-alt][03]:
    build_pkg (dotnet8-8.0.6_4) (sh)
    0 55499 55498 21 59 0 14216 3784 wait IsJ -
    0:00.02 | | | | `-- /usr/bin/make -C /usr/ports/lang/dotnet8
    build
    0 55524 55499 29 59 0 14668 3304 wait IJ -
    0:00.00 | | | | `-- /bin/sh -e /tmp/makedskEnT
    0 55525 55524 7 59 0 16204 4920 wait IJ -
    0:00.01 | | | | `-- bash ./build.sh --release-manifest
    release.json --clean-while-building --with-sdk /wrkdirs/usr/ports
    0 56836 55525 4 59 0 406855036 195184 uwait IJ -
    0:30.89 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet msbuild > >> /wrkdirs/usr/ports/lang/dotnet8/
    0 5126 56836 5 3 0 14748 3512 wait IJ -
    0:00.00 | | | | `-- /bin/sh -c export
    LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; .
    /tmp/MSBuildTemproot/tmpc8ecf97
    0 5127 5126 4 11 0 16284 5032 wait IJ -
    0:00.00 | | | | `-- bash
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/build.sh > >> --ci --configuration R
    0 5130 5127 1 59 0 16284 5376 wait IJ -
    0:00.02 | | | | `-- bash
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/eng/common/build.sh
    --pack --
    0 5330 5130 0 59 0 406784004 105688 uwait IJ -
    0:00.55 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m
    /nologo /clp:Summary
    0 5473 5330 22 59 0 14748 3528 wait IJ -
    0:00.00 | | | | `-- /bin/sh -c export
    LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; . /tmp/MSBuildTemproot/tm
    0 5474 5473 28 59 0 406867320 195692 uwait IJ -
    0:06.62 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m
    /nologo /clp:Sum
    0 5684 5474 2 9 0 406769428 112740 uwait IJ -
    0:02.97 | | | | |--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet
    /wrkdirs/usr/ports/lang/do
    0 5757 5474 9 59 0 406801372 139216 uwait IJ -
    0:01.45 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet
    /wrkdirs/usr/ports/lang/do

    A "ww"-added ps command output has:

    UID PID PPID C PRI NI VSZ RSS MWCHAN STAT TT
    TIME COMMAND
    . . .
    0 28395 3158 18 59 0 23524 11608 select I 1
    0:00.04 | | | |-- sh: poudriere[main-ZNV4-bulk_a-alt][03]:
    build_pkg (dotnet8-8.0.6_4) (sh)
    0 55498 28395 25 59 0 23524 11604 wait I 1
    0:00.00 | | | | `-- sh: poudriere[main-ZNV4-bulk_a-alt][03]:
    build_pkg (dotnet8-8.0.6_4) (sh)
    0 55499 55498 21 59 0 14216 3784 wait IsJ -
    0:00.02 | | | | `-- /usr/bin/make -C /usr/ports/lang/dotnet8
    build
    0 55524 55499 29 59 0 14668 3304 wait IJ -
    0:00.00 | | | | `-- /bin/sh -e /tmp/makedskEnT
    0 55525 55524 7 59 0 16204 4920 wait IJ -
    0:00.01 | | | | `-- bash ./build.sh --release-manifest
    release.json --clean-while-building --with-sdk
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk --with-packages > >> /wrkdirs/usr/ports/lang/dotnet8/work/packages -- -maxcpucount:3
    0 56836 55525 4 59 0 406855036 195184 uwait IJ -
    0:30.89 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet msbuild > >> /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/build.proj
    -bl:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/log/Debug/Build_0726085441.binlog
    -flp:LogFile=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/logs/Build_0726085441.log
    -flp:v=detailed -p:CleanWhileBuilding=true
    -p:CustomPrebuiltSourceBuiltPackagesPath=/wrkdirs/usr/ports/lang/dotnet8/work/packages
    -maxcpucount:3
    0 5126 56836 5 3 0 14748 3512 wait IJ -
    0:00.00 | | | | `-- /bin/sh -c export
    LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; .
    /tmp/MSBuildTemproot/tmpc8ecf970b04a4faea5680a0118915aaa.exec.cmd
    0 5127 5126 4 11 0 16284 5032 wait IJ -
    0:00.00 | | | | `-- bash
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/build.sh > >> --ci --configuration Release --restore --build --pack --publish -bl > >> /p:ArcadeBuildFromSource=true /p:CopyWipIntoInnerSourceBuildRepo=true
    /p:DotNetBuildOffline=true /p:CopySrcInsteadOfClone=true
    /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props
    /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/
    /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/
    /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/
    /p:SourceBuildUseMonoRuntime= --nodereuse false
    0 5130 5127 1 59 0 16284 5376 wait IJ -
    0:00.02 | | | | `-- bash
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/eng/common/build.sh
    --pack --build --restore --test --ci --configuration Release --restore
    --build --pack --publish -bl /p:ArcadeBuildFromSource=true
    /p:CopyWipIntoInnerSourceBuildRepo=true /p:DotNetBuildOffline=true
    /p:CopySrcInsteadOfClone=true
    /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props
    /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/
    /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/
    /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/
    /p:SourceBuildUseMonoRuntime= --nodereuse false
    0 5330 5130 0 59 0 406784004 105688 uwait IJ -
    0:00.55 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m
    /nologo /clp:Summary /v:minimal /nr:false /warnaserror
    /p:TreatWarningsAsErrors=true /p:ContinuousIntegrationBuild=true > >> /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/Build.proj
    /bl:"/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/log/Release/Build.binlog"
    /p:Configuration=Release
    /p:RepoRoot=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/ > >> /p:Restore=true /p:Build=true /p:Rebuild=false /p:Test=true > >> /p:Pack=true /p:IntegrationTest=false /p:PerformanceTest=false > >> /p:Sign=false /p:Publish=true /p:ArcadeBuildFromSource=true > >> /p:CopyWipIntoInnerSourceBuildRepo=true /p:DotNetBuildOffline=true
    /p:CopySrcInsteadOfClone=true
    /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props
    /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/
    /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/
    /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/
    /p:SourceBuildUseMonoRuntime=
    -logger:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/net8.0/Microsoft.DotNet.ArcadeLogging.dll
    0 5473 5330 22 59 0 14748 3528 wait IJ -
    0:00.00 | | | | `-- /bin/sh -c export
    LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; .
    /tmp/MSBuildTemproot/tmp5c13d207e7a4487188f01bcfbfeb74bc.exec.cmd
    0 5474 5473 28 59 0 406867320 195692 uwait IJ -
    0:06.62 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m
    /nologo /clp:Summary /v:minimal /nr:false /warnaserror
    /p:TreatWarningsAsErrors=true /p:ContinuousIntegrationBuild=true > >> /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/Build.proj
    /bl:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/log/Release/Build.binlog
    /p:Configuration=Release
    /p:RepoRoot=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/ > >> /p:Restore=true /p:Build=true /p:Rebuild=false /p:Test=true > >> /p:Pack=true /p:IntegrationTest=false /p:PerformanceTest=false > >> /p:Sign=false /p:Publish=true /p:ArcadeBuildFromSource=true > >> /p:CopyWipIntoInnerSourceBuildRepo=true /p:DotNetBuildOffline=true
    /p:CopySrcInsteadOfClone=true
    /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props
    /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/
    /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/
    /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/
    /p:SourceBuildUseMonoRuntime=
    -logger:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/net8.0/Microsoft.DotNet.ArcadeLogging.dll
    /p:ArcadeInnerBuildFromSource=true /p:DotNetBuildFromSource=true > >> /p:RepoRoot=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/self/src/
    /p:ArtifactsDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/self/src/artifacts/
    /bl:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/self/src/artifacts/sourcebuild.binlog
    /p:ContinuousIntegrationBuild=true
    /p:SourceBuildOutputDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/
    /p:SourceBuiltBlob
    0 5684 5474 2 9 0 406769428 112740 uwait IJ -
    0:02.97 | | | | |--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/sdk/8.0.100/MSBuild.dll
    /nologo /nodemode:1 /nodeReuse:false /low:false
    0 5757 5474 9 59 0 406801372 139216 uwait IJ -
    0:01.45 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/sdk/8.0.100/MSBuild.dll
    /nologo /nodemode:1 /nodeReuse:false /low:false
    . . .

    Notes:

    I eventually killed process 5757 to let [03] progress to the next > >> package.
    Such classfies dotnet8 as failed.

    I still have [04] stuck at build_port_done for dotnet-9.0.6 .


    In another bulk -Ca test, dotnet8 built fine but dotnet-9.0.6 seems
    to be stuck in build_port_done again:

    ID TOTAL ORIGIN PKGNAME
    PHASE TIME TMPFS
    CPU% MEM%
    . . .
    [25] 06:10:17 lang/dotnet | dotnet-9.0.6
    build_port_done 04:40:03 4.75 GiB
    . . .


    ===
    Mark Millard
    marklmi at yahoo.com

    I'd like to point out that I too have been experiencing this, although > only on my amd64 builders and never on my arm64 builder. One thing Mark
    did not point out, though, is that the log for the build ends with
    saying that the wrkdirs unmount failed, specifically I see this as the > last line in my own logs:

    umount: unmount of
    /usr/local/poudriere/data/.m/14amd64-default/01/wrkdirs failed: Device > busy
    Confirmed for my context as well, for example:
    # tail -1 /usr/local/poudriere/data/logs/bulk/main-ZNV4-bulk_a-alt/2025-07-27_20h19m08s/logs/dotnet-9.0.6.log
    umount: unmount of /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/wrkdirs failed: Device busy
    Also:
    # df -m | grep dotnet /usr/local/poudriere/data/cache/tmp/wrkdirs/dotnet-9.0.6.BcQxQlcLsf 368348 137587 230761 37% /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/wrkdirs
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6 363202 132441 230761 36% /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/.npkg
    And:
    # umount /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/wrkdirs
    # umount /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/.npkg
    So: No complaints about the later manual umount's. Whatever blocked
    the original umount appears to have been a temporary condition.
    Also, now:
    # ls -loaT /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/wrkdirs
    total 2
    drwxr-xr-x 2 root wheel - 0 Jul 27 20:19:08 2025 .
    drwxr-xr-x 26 root wheel - 1984 Jul 29 01:24:15 2025 ..
    # ls -loaT /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6
    total 26
    drwxr-xr-x 3 root wheel uarch 3 Jul 29 01:24:15 2025 .
    drwxr-xr-x 4 root wheel uarch 4 Jul 29 10:07:13 2025 ..
    drwxr-xr-x 2 root wheel uarch 2 Jul 29 01:34:54 2025 All
    # ls -loaT /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6/All/
    total 1
    drwxr-xr-x 2 root wheel uarch 2 Jul 29 01:34:54 2025 .
    drwxr-xr-x 3 root wheel uarch 3 Jul 29 01:24:15 2025 ..
    And similarly to Mark, because it ends like this with absolutely no processes in the jail, there is nothing to kill and thus no way to get > poudriere to finish off that job.
    ===
    Mark Millard
    marklmi at yahoo.com
    --
    Posted automagically by a mail2news gateway at muc.de e.V.
    Please direct questions, flames, donations, etc. to news-admin@muc.de
    --- Synchronet 3.21a-Linux NewsLink 1.2
  • From Mark Millard@marklmi@yahoo.com to muc.lists.freebsd.ports on Tue Jul 29 14:58:16 2025
    From Newsgroup: muc.lists.freebsd.ports

    On Jul 29, 2025, at 10:10, Mark Millard <marklmi@yahoo.com> wrote:
    Naram Qashat <cyberbotx_at_cyberbotx.com> wrote on
    Date: Tue, 29 Jul 2025 14:14:56 UTC :

    On 2025-07-29 09:34, Mark Millard wrote:
    On Jul 26, 2025, at 11:46, Mark Millard <marklmi@yahoo.com> wrote:

    The other builders in the "bulk -Ca" run till are operating.

    # poudriere version
    poudriere-git-3.4.99.20250601

    Extractions of appearently related information follow . . .

    # poudriere status -b
    [main-ZNV4-bulk_a-alt] [2025-07-24_17h17m32s] [parallel_build]
    Time: 1D:14:22:35
    Queued: 36640 Inspected: 0 Ignored: 361 Built: 31142 Failed: 141
    Skipped: 619 Fetched: 0 Remaining: 4377
    . . .
    [03] 05:47:01 lang/dotnet8 | dotnet8-8.0.6_4
    build 05:45:28 4.81 GiB 0% 0.5%
    [04] 06:39:07 lang/dotnet | dotnet-9.0.6
    build_port_done 05:59:17 4.75 GiB
    . . .

    The poudriere-devel output shows:

    . . .
    [1D:07:43:30] [04] [00:00:00] Building lang/dotnet | dotnet-9.0.6
    . . .
    [1D:08:23:20] [04] [00:39:50] Finished lang/dotnet | dotnet-9.0.6: >>>> Success
    . . .
    [1D:08:35:36] [03] [00:00:00] Building lang/dotnet8 |
    dotnet8-8.0.6_4
    . . .

    # ls -lodT
    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/packages/All/dotnet-9.0.6.pkg
    -rw-r--r-- 1 root wheel uarch 758491155 Jul 26 01:40:52 2025
    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/packages/All/dotnet-9.0.6.pkg

    # find
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/ >>>> -print
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/ >>>> /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6/All

    # find /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/ -name >>>> '*dotnet-9*' -print
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/All/dotnet-9.0.6.pkg
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6

    # ls -loaT
    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/wrkdirs/
    total 2
    drwx------ 2 root wheel uarch 2 Jul 26 01:40:59 2025 .
    drwxr-xr-x 26 root wheel - 1984 Jul 26 01:33:37 2025 ..

    # ls -loaT /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/
    total 5082
    drwxr-xr-x 26 root wheel - 1984 Jul 26 01:33:37 2025 .
    drwx--x--x 15 root wheel - 832 Jul 24 17:19:30 2025 ..
    -rw-r--r-- 1 root wheel - 3 Jul 24 17:17:32 2025 .cpignore
    -rw-r--r-- 1 root wheel - 0 Jul 26 01:01:03 2025
    .need_rollback
    drwxr-xr-x 3 root wheel uarch 3 Jul 26 01:33:37 2025 .npkg
    -rw-r--r-- 1 root wheel - 0 Jul 26 01:33:37 2025
    .npkg_mounted
    drwxr-xr-x 4 root wheel - 192 Jul 24 17:19:31 2025 .p
    -rw-r--r-- 2 root wheel uarch 495 Aug 20 10:45:06 2023 .profile
    -rw-r--r-- 1 root wheel - 68 Jul 26 01:01:03 2025
    .tmpfs_blacklist_dir
    -r--r--r-- 1 root wheel uarch 6070 Jun 28 23:04:06 2025 COPYRIGHT
    drwxr-xr-x 2 root wheel - 3008 Jun 28 23:03:57 2025 bin
    drwxr-xr-x 14 root wheel - 4672 Jun 28 23:04:06 2025 boot
    drwxr-xr-x 3 root wheel - 64 Jul 24 17:17:32 2025 compat
    dr-xr-xr-x 11 root wheel - 512 Jul 26 01:01:03 2025 dev
    drwxr-xr-x 485 root wheel uarch 32439 Jul 25 14:15:42 2025 distfiles
    drwxr-xr-x 31 root wheel - 6784 Jul 26 01:01:57 2025 etc
    lrwxr-xr-x 1 root wheel - 8 Jul 24 17:17:32 2025 home ->
    usr/home
    drwxr-xr-x 4 root wheel - 4992 Jun 28 23:03:56 2025 lib
    drwxr-xr-x 3 root wheel - 512 Jun 26 22:28:15 2025 libexec
    drwxr-xr-x 2 root wheel - 0 Dec 4 14:52:10 2021 media
    drwxr-xr-x 2 root wheel - 0 Dec 4 14:52:10 2021 mnt
    drwxr-xr-x 2 root wheel - 0 Dec 4 14:52:10 2021 net
    drwxr-xr-x 2 root wheel - 0 Jul 24 17:17:32 2025 overlays
    drwxr-xr-x 5 root wheel uarch 8 Jul 24 17:19:23 2025 packages
    drwxr-xr-x 3 root wheel - 64 Jul 26 01:01:03 2025
    portdistfiles
    dr-xr-xr-x 1 root wheel - 0 Jul 26 08:55:43 2025 proc
    drwxr-xr-x 2 root wheel uarch 152 Jun 28 23:03:56 2025 rescue
    drwxr-x--- 3 root wheel - 384 Jul 24 17:17:32 2025 root
    drwxr-xr-x 2 root wheel - 9536 Jun 28 23:03:58 2025 sbin
    drwxrwxrwt 71 root wheel - 4480 Jul 26 01:48:28 2025 tmp
    drwxr-xr-x 16 root wheel - 896 Jul 24 17:17:32 2025 usr
    drwxr-xr-x 84 root wheel - 1408 Dec 4 14:52:10 2021 var
    drwx------ 2 root wheel uarch 2 Jul 26 01:40:59 2025 wrkdirs

    # find /tmp/ -name '*lock-*' -exec ls -lodT {} \;
    -rw-r--r-- 1 root wheel uarch 4 Jul 26 11:34:26 2025
    /tmp/poudriere.LZmiUvjmEy/lock-main-ZNV4-bulk_a-alt-update_stats.pid
    -rw-r--r-- 1 root wheel uarch 0 Jul 24 17:17:34 2025
    /tmp/poudriere.LZmiUvjmEy/lock-main-ZNV4-bulk_a-alt-update_stats.flock >>>>
    # more
    /tmp/poudriere.LZmiUvjmEy/lock-main-ZNV4-bulk_a-alt-update_stats.pid
    3615

    From "ps -alxd":

    . . .
    0 3615 3158 15 59 0 16868 4152 wait S 1
    22:19.56 | | | |-- sh: poudriere[main-ZNV4-bulk_a-alt]:
    html_json_main (sh)
    0 56410 3615 5 89 0 14532 3728 - R 1
    0:00.75 | | | | |-- /usr/bin/awk -v mini=yes -f /usr/bin/awk
    main-ZNV4-bulk_a-alt/2025-07-24_17h17m32s/.poudriere.builders main-
    0 56411 3615 29 59 0 14532 2752 piperd S 1
    0:00.00 | | | | |-- /usr/bin/awk ORS=""; {print} END {print
    "\\n"}
    0 56412 3615 10 59 0 14108 2236 piperd S 1
    0:00.00 | | | | |-- /usr/bin/sed -e s/,\\([]}]\\)/\\1/g
    0 56413 3615 19 59 0 16868 4144 piperd S 1
    0:00.00 | | | | `-- sh: poudriere[main-ZNV4-bulk_a-alt]:
    html_json_main (sh)
    . . .

    Doing "ps -alxd" does not show a process tree for dotnet-9.0.6 but >>>> does for dotnet8-8.0.6_4 :

    UID PID PPID C PRI NI VSZ RSS MWCHAN STAT TT
    TIME COMMAND
    . . .
    0 28395 3158 18 59 0 23524 11608 select I 1
    0:00.04 | | | |-- sh: poudriere[main-ZNV4-bulk_a-alt][03]:
    build_pkg (dotnet8-8.0.6_4) (sh)
    0 55498 28395 25 59 0 23524 11604 wait I 1
    0:00.00 | | | | `-- sh: poudriere[main-ZNV4-bulk_a-alt][03]:
    build_pkg (dotnet8-8.0.6_4) (sh)
    0 55499 55498 21 59 0 14216 3784 wait IsJ -
    0:00.02 | | | | `-- /usr/bin/make -C /usr/ports/lang/dotnet8
    build
    0 55524 55499 29 59 0 14668 3304 wait IJ -
    0:00.00 | | | | `-- /bin/sh -e /tmp/makedskEnT
    0 55525 55524 7 59 0 16204 4920 wait IJ -
    0:00.01 | | | | `-- bash ./build.sh --release-manifest
    release.json --clean-while-building --with-sdk /wrkdirs/usr/ports
    0 56836 55525 4 59 0 406855036 195184 uwait IJ -
    0:30.89 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet msbuild >>>> /wrkdirs/usr/ports/lang/dotnet8/
    0 5126 56836 5 3 0 14748 3512 wait IJ -
    0:00.00 | | | | `-- /bin/sh -c export
    LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; .
    /tmp/MSBuildTemproot/tmpc8ecf97
    0 5127 5126 4 11 0 16284 5032 wait IJ -
    0:00.00 | | | | `-- bash
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/build.sh >>>> --ci --configuration R
    0 5130 5127 1 59 0 16284 5376 wait IJ -
    0:00.02 | | | | `-- bash
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/eng/common/build.sh
    --pack --
    0 5330 5130 0 59 0 406784004 105688 uwait IJ -
    0:00.55 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m >>>> /nologo /clp:Summary
    0 5473 5330 22 59 0 14748 3528 wait IJ -
    0:00.00 | | | | `-- /bin/sh -c export
    LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; . /tmp/MSBuildTemproot/tm >>>> 0 5474 5473 28 59 0 406867320 195692 uwait IJ -
    0:06.62 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m >>>> /nologo /clp:Sum
    0 5684 5474 2 9 0 406769428 112740 uwait IJ -
    0:02.97 | | | | |--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet
    /wrkdirs/usr/ports/lang/do
    0 5757 5474 9 59 0 406801372 139216 uwait IJ -
    0:01.45 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet
    /wrkdirs/usr/ports/lang/do

    A "ww"-added ps command output has:

    UID PID PPID C PRI NI VSZ RSS MWCHAN STAT TT
    TIME COMMAND
    . . .
    0 28395 3158 18 59 0 23524 11608 select I 1
    0:00.04 | | | |-- sh: poudriere[main-ZNV4-bulk_a-alt][03]:
    build_pkg (dotnet8-8.0.6_4) (sh)
    0 55498 28395 25 59 0 23524 11604 wait I 1
    0:00.00 | | | | `-- sh: poudriere[main-ZNV4-bulk_a-alt][03]:
    build_pkg (dotnet8-8.0.6_4) (sh)
    0 55499 55498 21 59 0 14216 3784 wait IsJ -
    0:00.02 | | | | `-- /usr/bin/make -C /usr/ports/lang/dotnet8
    build
    0 55524 55499 29 59 0 14668 3304 wait IJ -
    0:00.00 | | | | `-- /bin/sh -e /tmp/makedskEnT
    0 55525 55524 7 59 0 16204 4920 wait IJ -
    0:00.01 | | | | `-- bash ./build.sh --release-manifest
    release.json --clean-while-building --with-sdk
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk --with-packages >>>> /wrkdirs/usr/ports/lang/dotnet8/work/packages -- -maxcpucount:3
    0 56836 55525 4 59 0 406855036 195184 uwait IJ -
    0:30.89 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet msbuild >>>> /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/build.proj
    -bl:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/log/Debug/Build_0726085441.binlog
    -flp:LogFile=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/logs/Build_0726085441.log
    -flp:v=detailed -p:CleanWhileBuilding=true
    -p:CustomPrebuiltSourceBuiltPackagesPath=/wrkdirs/usr/ports/lang/dotnet8/work/packages
    -maxcpucount:3
    0 5126 56836 5 3 0 14748 3512 wait IJ -
    0:00.00 | | | | `-- /bin/sh -c export
    LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; .
    /tmp/MSBuildTemproot/tmpc8ecf970b04a4faea5680a0118915aaa.exec.cmd
    0 5127 5126 4 11 0 16284 5032 wait IJ -
    0:00.00 | | | | `-- bash
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/build.sh >>>> --ci --configuration Release --restore --build --pack --publish -bl >>>> /p:ArcadeBuildFromSource=true /p:CopyWipIntoInnerSourceBuildRepo=true
    /p:DotNetBuildOffline=true /p:CopySrcInsteadOfClone=true
    /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props
    /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/
    /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/
    /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/
    /p:SourceBuildUseMonoRuntime= --nodereuse false
    0 5130 5127 1 59 0 16284 5376 wait IJ -
    0:00.02 | | | | `-- bash
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/eng/common/build.sh
    --pack --build --restore --test --ci --configuration Release --restore >>>> --build --pack --publish -bl /p:ArcadeBuildFromSource=true
    /p:CopyWipIntoInnerSourceBuildRepo=true /p:DotNetBuildOffline=true
    /p:CopySrcInsteadOfClone=true
    /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props
    /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/
    /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/
    /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/
    /p:SourceBuildUseMonoRuntime= --nodereuse false
    0 5330 5130 0 59 0 406784004 105688 uwait IJ -
    0:00.55 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m >>>> /nologo /clp:Summary /v:minimal /nr:false /warnaserror
    /p:TreatWarningsAsErrors=true /p:ContinuousIntegrationBuild=true >>>> /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/Build.proj
    /bl:"/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/log/Release/Build.binlog"
    /p:Configuration=Release
    /p:RepoRoot=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/ >>>> /p:Restore=true /p:Build=true /p:Rebuild=false /p:Test=true >>>> /p:Pack=true /p:IntegrationTest=false /p:PerformanceTest=false >>>> /p:Sign=false /p:Publish=true /p:ArcadeBuildFromSource=true >>>> /p:CopyWipIntoInnerSourceBuildRepo=true /p:DotNetBuildOffline=true
    /p:CopySrcInsteadOfClone=true
    /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props
    /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/
    /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/
    /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/
    /p:SourceBuildUseMonoRuntime=
    -logger:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/net8.0/Microsoft.DotNet.ArcadeLogging.dll
    0 5473 5330 22 59 0 14748 3528 wait IJ -
    0:00.00 | | | | `-- /bin/sh -c export
    LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; .
    /tmp/MSBuildTemproot/tmp5c13d207e7a4487188f01bcfbfeb74bc.exec.cmd
    0 5474 5473 28 59 0 406867320 195692 uwait IJ -
    0:06.62 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m >>>> /nologo /clp:Summary /v:minimal /nr:false /warnaserror
    /p:TreatWarningsAsErrors=true /p:ContinuousIntegrationBuild=true >>>> /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/Build.proj
    /bl:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/log/Release/Build.binlog
    /p:Configuration=Release
    /p:RepoRoot=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/ >>>> /p:Restore=true /p:Build=true /p:Rebuild=false /p:Test=true >>>> /p:Pack=true /p:IntegrationTest=false /p:PerformanceTest=false >>>> /p:Sign=false /p:Publish=true /p:ArcadeBuildFromSource=true >>>> /p:CopyWipIntoInnerSourceBuildRepo=true /p:DotNetBuildOffline=true
    /p:CopySrcInsteadOfClone=true
    /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props
    /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/
    /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/
    /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/
    /p:SourceBuildUseMonoRuntime=
    -logger:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/net8.0/Microsoft.DotNet.ArcadeLogging.dll
    /p:ArcadeInnerBuildFromSource=true /p:DotNetBuildFromSource=true >>>> /p:RepoRoot=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/self/src/
    /p:ArtifactsDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/self/src/artifacts/
    /bl:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/self/src/artifacts/sourcebuild.binlog
    /p:ContinuousIntegrationBuild=true
    /p:SourceBuildOutputDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/
    /p:SourceBuiltBlob
    0 5684 5474 2 9 0 406769428 112740 uwait IJ -
    0:02.97 | | | | |--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/sdk/8.0.100/MSBuild.dll
    /nologo /nodemode:1 /nodeReuse:false /low:false
    0 5757 5474 9 59 0 406801372 139216 uwait IJ -
    0:01.45 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/sdk/8.0.100/MSBuild.dll
    /nologo /nodemode:1 /nodeReuse:false /low:false
    . . .

    Notes:

    I eventually killed process 5757 to let [03] progress to the next >>>> package.
    Such classfies dotnet8 as failed.

    I still have [04] stuck at build_port_done for dotnet-9.0.6 .


    In another bulk -Ca test, dotnet8 built fine but dotnet-9.0.6 seems
    to be stuck in build_port_done again:

    ID TOTAL ORIGIN PKGNAME
    PHASE TIME TMPFS
    CPU% MEM%
    . . .
    [25] 06:10:17 lang/dotnet | dotnet-9.0.6
    build_port_done 04:40:03 4.75 GiB
    . . .


    ===
    Mark Millard
    marklmi at yahoo.com

    I'd like to point out that I too have been experiencing this, although
    only on my amd64 builders and never on my arm64 builder. One thing Mark
    did not point out, though, is that the log for the build ends with
    saying that the wrkdirs unmount failed, specifically I see this as the
    last line in my own logs:

    umount: unmount of
    /usr/local/poudriere/data/.m/14amd64-default/01/wrkdirs failed: Device
    busy

    Confirmed for my context as well, for example:

    # tail -1 /usr/local/poudriere/data/logs/bulk/main-ZNV4-bulk_a-alt/2025-07-27_20h19m08s/logs/dotnet-9.0.6.log
    umount: unmount of /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/wrkdirs failed: Device busy

    Also:

    # df -m | grep dotnet /usr/local/poudriere/data/cache/tmp/wrkdirs/dotnet-9.0.6.BcQxQlcLsf 368348 137587 230761 37% /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/wrkdirs
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6 363202 132441 230761 36% /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/.npkg

    And:

    # umount /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/wrkdirs

    # umount /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/.npkg

    So: No complaints about the later manual umount's. Whatever blocked
    the original umount appears to have been a temporary condition.

    Also, now:

    # ls -loaT /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/wrkdirs
    total 2
    drwxr-xr-x 2 root wheel - 0 Jul 27 20:19:08 2025 .
    drwxr-xr-x 26 root wheel - 1984 Jul 29 01:24:15 2025 ..

    # ls -loaT /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6
    total 26
    drwxr-xr-x 3 root wheel uarch 3 Jul 29 01:24:15 2025 .
    drwxr-xr-x 4 root wheel uarch 4 Jul 29 10:07:13 2025 ..
    drwxr-xr-x 2 root wheel uarch 2 Jul 29 01:34:54 2025 All

    # ls -loaT /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6/All/
    total 1
    drwxr-xr-x 2 root wheel uarch 2 Jul 29 01:34:54 2025 .
    drwxr-xr-x 3 root wheel uarch 3 Jul 29 01:24:15 2025 ..


    And similarly to Mark, because it ends like this with absolutely no >> processes in the jail, there is nothing to kill and thus no way to get
    poudriere to finish off that job.
    Another note is that the tmpfs use is stall active for:
    # df -m | grep /25 | grep ^tmpfs
    tmpfs 523619 2370 521248 0% /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25
    tmpfs 2048 32 2015 2% /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/.p
    tmpfs 523712 2463 521248 0% /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/usr/local
    (So: over 4 GiBytes.)
    Of course, there are various other mount points
    matching:
    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/*/
    and:
    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/*/*/
    and:
    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/*/*/*/
    that are still active as well.
    ===
    Mark Millard
    marklmi at yahoo.com
    --
    Posted automagically by a mail2news gateway at muc.de e.V.
    Please direct questions, flames, donations, etc. to news-admin@muc.de
    --- Synchronet 3.21a-Linux NewsLink 1.2
  • From Mark Millard@marklmi@yahoo.com to muc.lists.freebsd.ports on Wed Jul 30 06:31:45 2025
    From Newsgroup: muc.lists.freebsd.ports

    On Jul 29, 2025, at 14:58, Mark Millard <marklmi@yahoo.com> wrote:
    On Jul 29, 2025, at 10:10, Mark Millard <marklmi@yahoo.com> wrote:

    Naram Qashat <cyberbotx_at_cyberbotx.com> wrote on
    Date: Tue, 29 Jul 2025 14:14:56 UTC :

    On 2025-07-29 09:34, Mark Millard wrote:
    On Jul 26, 2025, at 11:46, Mark Millard <marklmi@yahoo.com> wrote:

    The other builders in the "bulk -Ca" run till are operating.

    # poudriere version
    poudriere-git-3.4.99.20250601

    Extractions of appearently related information follow . . .

    # poudriere status -b
    [main-ZNV4-bulk_a-alt] [2025-07-24_17h17m32s] [parallel_build]
    Time: 1D:14:22:35
    Queued: 36640 Inspected: 0 Ignored: 361 Built: 31142 Failed: 141 >>>>> Skipped: 619 Fetched: 0 Remaining: 4377
    . . .
    [03] 05:47:01 lang/dotnet8 | dotnet8-8.0.6_4
    build 05:45:28 4.81 GiB 0% 0.5%
    [04] 06:39:07 lang/dotnet | dotnet-9.0.6
    build_port_done 05:59:17 4.75 GiB
    . . .

    The poudriere-devel output shows:

    . . .
    [1D:07:43:30] [04] [00:00:00] Building lang/dotnet | dotnet-9.0.6
    . . .
    [1D:08:23:20] [04] [00:39:50] Finished lang/dotnet | dotnet-9.0.6: >>>>> Success
    . . .
    [1D:08:35:36] [03] [00:00:00] Building lang/dotnet8 |
    dotnet8-8.0.6_4
    . . .

    # ls -lodT
    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/packages/All/dotnet-9.0.6.pkg
    -rw-r--r-- 1 root wheel uarch 758491155 Jul 26 01:40:52 2025
    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/packages/All/dotnet-9.0.6.pkg

    # find
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/ >>>>> -print
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/ >>>>> /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6/All

    # find /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/ -name >>>>> '*dotnet-9*' -print
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/All/dotnet-9.0.6.pkg
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6

    # ls -loaT
    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/wrkdirs/
    total 2
    drwx------ 2 root wheel uarch 2 Jul 26 01:40:59 2025 .
    drwxr-xr-x 26 root wheel - 1984 Jul 26 01:33:37 2025 ..

    # ls -loaT /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/
    total 5082
    drwxr-xr-x 26 root wheel - 1984 Jul 26 01:33:37 2025 .
    drwx--x--x 15 root wheel - 832 Jul 24 17:19:30 2025 ..
    -rw-r--r-- 1 root wheel - 3 Jul 24 17:17:32 2025 .cpignore
    -rw-r--r-- 1 root wheel - 0 Jul 26 01:01:03 2025
    .need_rollback
    drwxr-xr-x 3 root wheel uarch 3 Jul 26 01:33:37 2025 .npkg
    -rw-r--r-- 1 root wheel - 0 Jul 26 01:33:37 2025
    .npkg_mounted
    drwxr-xr-x 4 root wheel - 192 Jul 24 17:19:31 2025 .p
    -rw-r--r-- 2 root wheel uarch 495 Aug 20 10:45:06 2023 .profile
    -rw-r--r-- 1 root wheel - 68 Jul 26 01:01:03 2025
    .tmpfs_blacklist_dir
    -r--r--r-- 1 root wheel uarch 6070 Jun 28 23:04:06 2025 COPYRIGHT
    drwxr-xr-x 2 root wheel - 3008 Jun 28 23:03:57 2025 bin
    drwxr-xr-x 14 root wheel - 4672 Jun 28 23:04:06 2025 boot
    drwxr-xr-x 3 root wheel - 64 Jul 24 17:17:32 2025 compat
    dr-xr-xr-x 11 root wheel - 512 Jul 26 01:01:03 2025 dev
    drwxr-xr-x 485 root wheel uarch 32439 Jul 25 14:15:42 2025 distfiles >>>>> drwxr-xr-x 31 root wheel - 6784 Jul 26 01:01:57 2025 etc
    lrwxr-xr-x 1 root wheel - 8 Jul 24 17:17:32 2025 home ->
    usr/home
    drwxr-xr-x 4 root wheel - 4992 Jun 28 23:03:56 2025 lib
    drwxr-xr-x 3 root wheel - 512 Jun 26 22:28:15 2025 libexec
    drwxr-xr-x 2 root wheel - 0 Dec 4 14:52:10 2021 media
    drwxr-xr-x 2 root wheel - 0 Dec 4 14:52:10 2021 mnt
    drwxr-xr-x 2 root wheel - 0 Dec 4 14:52:10 2021 net
    drwxr-xr-x 2 root wheel - 0 Jul 24 17:17:32 2025 overlays
    drwxr-xr-x 5 root wheel uarch 8 Jul 24 17:19:23 2025 packages
    drwxr-xr-x 3 root wheel - 64 Jul 26 01:01:03 2025
    portdistfiles
    dr-xr-xr-x 1 root wheel - 0 Jul 26 08:55:43 2025 proc
    drwxr-xr-x 2 root wheel uarch 152 Jun 28 23:03:56 2025 rescue
    drwxr-x--- 3 root wheel - 384 Jul 24 17:17:32 2025 root
    drwxr-xr-x 2 root wheel - 9536 Jun 28 23:03:58 2025 sbin
    drwxrwxrwt 71 root wheel - 4480 Jul 26 01:48:28 2025 tmp
    drwxr-xr-x 16 root wheel - 896 Jul 24 17:17:32 2025 usr
    drwxr-xr-x 84 root wheel - 1408 Dec 4 14:52:10 2021 var
    drwx------ 2 root wheel uarch 2 Jul 26 01:40:59 2025 wrkdirs

    # find /tmp/ -name '*lock-*' -exec ls -lodT {} \;
    -rw-r--r-- 1 root wheel uarch 4 Jul 26 11:34:26 2025
    /tmp/poudriere.LZmiUvjmEy/lock-main-ZNV4-bulk_a-alt-update_stats.pid >>>>> -rw-r--r-- 1 root wheel uarch 0 Jul 24 17:17:34 2025
    /tmp/poudriere.LZmiUvjmEy/lock-main-ZNV4-bulk_a-alt-update_stats.flock >>>>>
    # more
    /tmp/poudriere.LZmiUvjmEy/lock-main-ZNV4-bulk_a-alt-update_stats.pid >>>>> 3615

    From "ps -alxd":

    . . .
    0 3615 3158 15 59 0 16868 4152 wait S 1
    22:19.56 | | | |-- sh: poudriere[main-ZNV4-bulk_a-alt]:
    html_json_main (sh)
    0 56410 3615 5 89 0 14532 3728 - R 1
    0:00.75 | | | | |-- /usr/bin/awk -v mini=yes -f /usr/bin/awk
    main-ZNV4-bulk_a-alt/2025-07-24_17h17m32s/.poudriere.builders main-
    0 56411 3615 29 59 0 14532 2752 piperd S 1
    0:00.00 | | | | |-- /usr/bin/awk ORS=""; {print} END {print
    "\\n"}
    0 56412 3615 10 59 0 14108 2236 piperd S 1
    0:00.00 | | | | |-- /usr/bin/sed -e s/,\\([]}]\\)/\\1/g
    0 56413 3615 19 59 0 16868 4144 piperd S 1
    0:00.00 | | | | `-- sh: poudriere[main-ZNV4-bulk_a-alt]:
    html_json_main (sh)
    . . .

    Doing "ps -alxd" does not show a process tree for dotnet-9.0.6 but >>>>> does for dotnet8-8.0.6_4 :

    UID PID PPID C PRI NI VSZ RSS MWCHAN STAT TT
    TIME COMMAND
    . . .
    0 28395 3158 18 59 0 23524 11608 select I 1
    0:00.04 | | | |-- sh: poudriere[main-ZNV4-bulk_a-alt][03]:
    build_pkg (dotnet8-8.0.6_4) (sh)
    0 55498 28395 25 59 0 23524 11604 wait I 1
    0:00.00 | | | | `-- sh: poudriere[main-ZNV4-bulk_a-alt][03]:
    build_pkg (dotnet8-8.0.6_4) (sh)
    0 55499 55498 21 59 0 14216 3784 wait IsJ -
    0:00.02 | | | | `-- /usr/bin/make -C /usr/ports/lang/dotnet8
    build
    0 55524 55499 29 59 0 14668 3304 wait IJ -
    0:00.00 | | | | `-- /bin/sh -e /tmp/makedskEnT
    0 55525 55524 7 59 0 16204 4920 wait IJ -
    0:00.01 | | | | `-- bash ./build.sh --release-manifest
    release.json --clean-while-building --with-sdk /wrkdirs/usr/ports
    0 56836 55525 4 59 0 406855036 195184 uwait IJ -
    0:30.89 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet msbuild >>>>> /wrkdirs/usr/ports/lang/dotnet8/
    0 5126 56836 5 3 0 14748 3512 wait IJ -
    0:00.00 | | | | `-- /bin/sh -c export
    LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; .
    /tmp/MSBuildTemproot/tmpc8ecf97
    0 5127 5126 4 11 0 16284 5032 wait IJ -
    0:00.00 | | | | `-- bash
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/build.sh >>>>> --ci --configuration R
    0 5130 5127 1 59 0 16284 5376 wait IJ -
    0:00.02 | | | | `-- bash
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/eng/common/build.sh
    --pack --
    0 5330 5130 0 59 0 406784004 105688 uwait IJ -
    0:00.55 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m >>>>> /nologo /clp:Summary
    0 5473 5330 22 59 0 14748 3528 wait IJ -
    0:00.00 | | | | `-- /bin/sh -c export
    LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; . /tmp/MSBuildTemproot/tm >>>>> 0 5474 5473 28 59 0 406867320 195692 uwait IJ -
    0:06.62 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m >>>>> /nologo /clp:Sum
    0 5684 5474 2 9 0 406769428 112740 uwait IJ -
    0:02.97 | | | | |--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet
    /wrkdirs/usr/ports/lang/do
    0 5757 5474 9 59 0 406801372 139216 uwait IJ -
    0:01.45 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet
    /wrkdirs/usr/ports/lang/do

    A "ww"-added ps command output has:

    UID PID PPID C PRI NI VSZ RSS MWCHAN STAT TT
    TIME COMMAND
    . . .
    0 28395 3158 18 59 0 23524 11608 select I 1
    0:00.04 | | | |-- sh: poudriere[main-ZNV4-bulk_a-alt][03]:
    build_pkg (dotnet8-8.0.6_4) (sh)
    0 55498 28395 25 59 0 23524 11604 wait I 1
    0:00.00 | | | | `-- sh: poudriere[main-ZNV4-bulk_a-alt][03]:
    build_pkg (dotnet8-8.0.6_4) (sh)
    0 55499 55498 21 59 0 14216 3784 wait IsJ -
    0:00.02 | | | | `-- /usr/bin/make -C /usr/ports/lang/dotnet8
    build
    0 55524 55499 29 59 0 14668 3304 wait IJ -
    0:00.00 | | | | `-- /bin/sh -e /tmp/makedskEnT
    0 55525 55524 7 59 0 16204 4920 wait IJ -
    0:00.01 | | | | `-- bash ./build.sh --release-manifest
    release.json --clean-while-building --with-sdk
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk --with-packages >>>>> /wrkdirs/usr/ports/lang/dotnet8/work/packages -- -maxcpucount:3
    0 56836 55525 4 59 0 406855036 195184 uwait IJ -
    0:30.89 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet msbuild >>>>> /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/build.proj
    -bl:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/log/Debug/Build_0726085441.binlog
    -flp:LogFile=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/logs/Build_0726085441.log
    -flp:v=detailed -p:CleanWhileBuilding=true
    -p:CustomPrebuiltSourceBuiltPackagesPath=/wrkdirs/usr/ports/lang/dotnet8/work/packages
    -maxcpucount:3
    0 5126 56836 5 3 0 14748 3512 wait IJ -
    0:00.00 | | | | `-- /bin/sh -c export
    LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; .
    /tmp/MSBuildTemproot/tmpc8ecf970b04a4faea5680a0118915aaa.exec.cmd
    0 5127 5126 4 11 0 16284 5032 wait IJ -
    0:00.00 | | | | `-- bash
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/build.sh >>>>> --ci --configuration Release --restore --build --pack --publish -bl
    /p:ArcadeBuildFromSource=true /p:CopyWipIntoInnerSourceBuildRepo=true >>>>> /p:DotNetBuildOffline=true /p:CopySrcInsteadOfClone=true
    /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props
    /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/
    /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/
    /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/
    /p:SourceBuildUseMonoRuntime= --nodereuse false
    0 5130 5127 1 59 0 16284 5376 wait IJ -
    0:00.02 | | | | `-- bash
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/eng/common/build.sh
    --pack --build --restore --test --ci --configuration Release --restore >>>>> --build --pack --publish -bl /p:ArcadeBuildFromSource=true
    /p:CopyWipIntoInnerSourceBuildRepo=true /p:DotNetBuildOffline=true
    /p:CopySrcInsteadOfClone=true
    /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props
    /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/
    /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/
    /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/
    /p:SourceBuildUseMonoRuntime= --nodereuse false
    0 5330 5130 0 59 0 406784004 105688 uwait IJ -
    0:00.55 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m >>>>> /nologo /clp:Summary /v:minimal /nr:false /warnaserror
    /p:TreatWarningsAsErrors=true /p:ContinuousIntegrationBuild=true
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/Build.proj
    /bl:"/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/log/Release/Build.binlog"
    /p:Configuration=Release
    /p:RepoRoot=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/ >>>>> /p:Restore=true /p:Build=true /p:Rebuild=false /p:Test=true >>>>> /p:Pack=true /p:IntegrationTest=false /p:PerformanceTest=false
    /p:Sign=false /p:Publish=true /p:ArcadeBuildFromSource=true >>>>> /p:CopyWipIntoInnerSourceBuildRepo=true /p:DotNetBuildOffline=true
    /p:CopySrcInsteadOfClone=true
    /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props
    /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/
    /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/
    /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/
    /p:SourceBuildUseMonoRuntime=
    -logger:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/net8.0/Microsoft.DotNet.ArcadeLogging.dll
    0 5473 5330 22 59 0 14748 3528 wait IJ -
    0:00.00 | | | | `-- /bin/sh -c export
    LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; .
    /tmp/MSBuildTemproot/tmp5c13d207e7a4487188f01bcfbfeb74bc.exec.cmd
    0 5474 5473 28 59 0 406867320 195692 uwait IJ -
    0:06.62 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m >>>>> /nologo /clp:Summary /v:minimal /nr:false /warnaserror
    /p:TreatWarningsAsErrors=true /p:ContinuousIntegrationBuild=true
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/Build.proj
    /bl:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/log/Release/Build.binlog
    /p:Configuration=Release
    /p:RepoRoot=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/ >>>>> /p:Restore=true /p:Build=true /p:Rebuild=false /p:Test=true >>>>> /p:Pack=true /p:IntegrationTest=false /p:PerformanceTest=false
    /p:Sign=false /p:Publish=true /p:ArcadeBuildFromSource=true >>>>> /p:CopyWipIntoInnerSourceBuildRepo=true /p:DotNetBuildOffline=true
    /p:CopySrcInsteadOfClone=true
    /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props
    /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/
    /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/
    /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/
    /p:SourceBuildUseMonoRuntime=
    -logger:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/net8.0/Microsoft.DotNet.ArcadeLogging.dll
    /p:ArcadeInnerBuildFromSource=true /p:DotNetBuildFromSource=true
    /p:RepoRoot=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/self/src/
    /p:ArtifactsDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/self/src/artifacts/
    /bl:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/self/src/artifacts/sourcebuild.binlog
    /p:ContinuousIntegrationBuild=true
    /p:SourceBuildOutputDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/
    /p:SourceBuiltBlob
    0 5684 5474 2 9 0 406769428 112740 uwait IJ -
    0:02.97 | | | | |--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/sdk/8.0.100/MSBuild.dll
    /nologo /nodemode:1 /nodeReuse:false /low:false
    0 5757 5474 9 59 0 406801372 139216 uwait IJ -
    0:01.45 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/sdk/8.0.100/MSBuild.dll
    /nologo /nodemode:1 /nodeReuse:false /low:false
    . . .

    Notes:

    I eventually killed process 5757 to let [03] progress to the next >>>>> package.
    Such classfies dotnet8 as failed.

    I still have [04] stuck at build_port_done for dotnet-9.0.6 .


    In another bulk -Ca test, dotnet8 built fine but dotnet-9.0.6 seems
    to be stuck in build_port_done again:

    ID TOTAL ORIGIN PKGNAME
    PHASE TIME TMPFS
    CPU% MEM%
    . . .
    [25] 06:10:17 lang/dotnet | dotnet-9.0.6
    build_port_done 04:40:03 4.75 GiB
    . . .


    ===
    Mark Millard
    marklmi at yahoo.com

    I'd like to point out that I too have been experiencing this, although
    only on my amd64 builders and never on my arm64 builder. One thing Mark >>> did not point out, though, is that the log for the build ends with >>> saying that the wrkdirs unmount failed, specifically I see this as the
    last line in my own logs:

    umount: unmount of
    /usr/local/poudriere/data/.m/14amd64-default/01/wrkdirs failed: Device
    busy

    Confirmed for my context as well, for example:

    # tail -1 /usr/local/poudriere/data/logs/bulk/main-ZNV4-bulk_a-alt/2025-07-27_20h19m08s/logs/dotnet-9.0.6.log
    umount: unmount of /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/wrkdirs failed: Device busy

    Also:

    # df -m | grep dotnet
    /usr/local/poudriere/data/cache/tmp/wrkdirs/dotnet-9.0.6.BcQxQlcLsf 368348 137587 230761 37% /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/wrkdirs
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6 363202 132441 230761 36% /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/.npkg

    And:

    # umount /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/wrkdirs

    # umount /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/.npkg

    So: No complaints about the later manual umount's. Whatever blocked
    the original umount appears to have been a temporary condition.

    Also, now:

    # ls -loaT /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/wrkdirs
    total 2
    drwxr-xr-x 2 root wheel - 0 Jul 27 20:19:08 2025 .
    drwxr-xr-x 26 root wheel - 1984 Jul 29 01:24:15 2025 ..

    # ls -loaT /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6
    total 26
    drwxr-xr-x 3 root wheel uarch 3 Jul 29 01:24:15 2025 .
    drwxr-xr-x 4 root wheel uarch 4 Jul 29 10:07:13 2025 ..
    drwxr-xr-x 2 root wheel uarch 2 Jul 29 01:34:54 2025 All

    # ls -loaT /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6/All/
    total 1
    drwxr-xr-x 2 root wheel uarch 2 Jul 29 01:34:54 2025 .
    drwxr-xr-x 3 root wheel uarch 3 Jul 29 01:24:15 2025 ..


    And similarly to Mark, because it ends like this with absolutely no >>> processes in the jail, there is nothing to kill and thus no way to get
    poudriere to finish off that job.

    Another note is that the tmpfs use is stall active for:

    # df -m | grep /25 | grep ^tmpfs
    tmpfs 523619 2370 521248 0% /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25
    tmpfs 2048 32 2015 2% /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/.p
    tmpfs 523712 2463 521248 0% /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/usr/local

    (So: over 4 GiBytes.)

    Of course, there are various other mount points
    matching:

    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/*/
    and:
    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/*/*/
    and:
    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/*/*/*/

    that are still active as well.
    Also another one was stuck at the end. It also got the
    umount "Device busy" failure notice:
    Cleaning for gatk-4.6.1.0_1
    umount: unmount of /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/28/wrkdirs failed: Device busy
    ===
    Mark Millard
    marklmi at yahoo.com
    --
    Posted automagically by a mail2news gateway at muc.de e.V.
    Please direct questions, flames, donations, etc. to news-admin@muc.de
    --- Synchronet 3.21a-Linux NewsLink 1.2
  • From Mark Millard@marklmi@yahoo.com to muc.lists.freebsd.ports on Thu Jul 31 16:52:16 2025
    From Newsgroup: muc.lists.freebsd.ports

    On Jul 30, 2025, at 06:31, Mark Millard <marklmi@yahoo.com> wrote:
    On Jul 29, 2025, at 14:58, Mark Millard <marklmi@yahoo.com> wrote:

    On Jul 29, 2025, at 10:10, Mark Millard <marklmi@yahoo.com> wrote:

    Naram Qashat <cyberbotx_at_cyberbotx.com> wrote on
    Date: Tue, 29 Jul 2025 14:14:56 UTC :

    On 2025-07-29 09:34, Mark Millard wrote:
    On Jul 26, 2025, at 11:46, Mark Millard <marklmi@yahoo.com> wrote:

    The other builders in the "bulk -Ca" run till are operating.

    # poudriere version
    poudriere-git-3.4.99.20250601

    Extractions of appearently related information follow . . .

    # poudriere status -b
    [main-ZNV4-bulk_a-alt] [2025-07-24_17h17m32s] [parallel_build] >>>>>> Time: 1D:14:22:35
    Queued: 36640 Inspected: 0 Ignored: 361 Built: 31142 Failed: 141 >>>>>> Skipped: 619 Fetched: 0 Remaining: 4377
    . . .
    [03] 05:47:01 lang/dotnet8 | dotnet8-8.0.6_4
    build 05:45:28 4.81 GiB 0% 0.5%
    [04] 06:39:07 lang/dotnet | dotnet-9.0.6
    build_port_done 05:59:17 4.75 GiB
    . . .

    The poudriere-devel output shows:

    . . .
    [1D:07:43:30] [04] [00:00:00] Building lang/dotnet | dotnet-9.0.6
    . . .
    [1D:08:23:20] [04] [00:39:50] Finished lang/dotnet | dotnet-9.0.6: >>>>>> Success
    . . .
    [1D:08:35:36] [03] [00:00:00] Building lang/dotnet8 |
    dotnet8-8.0.6_4
    . . .

    # ls -lodT
    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/packages/All/dotnet-9.0.6.pkg
    -rw-r--r-- 1 root wheel uarch 758491155 Jul 26 01:40:52 2025
    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/packages/All/dotnet-9.0.6.pkg

    # find
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/ >>>>>> -print
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/ >>>>>> /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6/All

    # find /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/ -name >>>>>> '*dotnet-9*' -print
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/All/dotnet-9.0.6.pkg
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6

    # ls -loaT
    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/wrkdirs/
    total 2
    drwx------ 2 root wheel uarch 2 Jul 26 01:40:59 2025 .
    drwxr-xr-x 26 root wheel - 1984 Jul 26 01:33:37 2025 ..

    # ls -loaT /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/
    total 5082
    drwxr-xr-x 26 root wheel - 1984 Jul 26 01:33:37 2025 .
    drwx--x--x 15 root wheel - 832 Jul 24 17:19:30 2025 ..
    -rw-r--r-- 1 root wheel - 3 Jul 24 17:17:32 2025 .cpignore
    -rw-r--r-- 1 root wheel - 0 Jul 26 01:01:03 2025
    .need_rollback
    drwxr-xr-x 3 root wheel uarch 3 Jul 26 01:33:37 2025 .npkg
    -rw-r--r-- 1 root wheel - 0 Jul 26 01:33:37 2025
    .npkg_mounted
    drwxr-xr-x 4 root wheel - 192 Jul 24 17:19:31 2025 .p
    -rw-r--r-- 2 root wheel uarch 495 Aug 20 10:45:06 2023 .profile
    -rw-r--r-- 1 root wheel - 68 Jul 26 01:01:03 2025
    .tmpfs_blacklist_dir
    -r--r--r-- 1 root wheel uarch 6070 Jun 28 23:04:06 2025 COPYRIGHT
    drwxr-xr-x 2 root wheel - 3008 Jun 28 23:03:57 2025 bin
    drwxr-xr-x 14 root wheel - 4672 Jun 28 23:04:06 2025 boot
    drwxr-xr-x 3 root wheel - 64 Jul 24 17:17:32 2025 compat
    dr-xr-xr-x 11 root wheel - 512 Jul 26 01:01:03 2025 dev
    drwxr-xr-x 485 root wheel uarch 32439 Jul 25 14:15:42 2025 distfiles >>>>>> drwxr-xr-x 31 root wheel - 6784 Jul 26 01:01:57 2025 etc
    lrwxr-xr-x 1 root wheel - 8 Jul 24 17:17:32 2025 home ->
    usr/home
    drwxr-xr-x 4 root wheel - 4992 Jun 28 23:03:56 2025 lib
    drwxr-xr-x 3 root wheel - 512 Jun 26 22:28:15 2025 libexec
    drwxr-xr-x 2 root wheel - 0 Dec 4 14:52:10 2021 media
    drwxr-xr-x 2 root wheel - 0 Dec 4 14:52:10 2021 mnt
    drwxr-xr-x 2 root wheel - 0 Dec 4 14:52:10 2021 net
    drwxr-xr-x 2 root wheel - 0 Jul 24 17:17:32 2025 overlays
    drwxr-xr-x 5 root wheel uarch 8 Jul 24 17:19:23 2025 packages
    drwxr-xr-x 3 root wheel - 64 Jul 26 01:01:03 2025
    portdistfiles
    dr-xr-xr-x 1 root wheel - 0 Jul 26 08:55:43 2025 proc
    drwxr-xr-x 2 root wheel uarch 152 Jun 28 23:03:56 2025 rescue
    drwxr-x--- 3 root wheel - 384 Jul 24 17:17:32 2025 root
    drwxr-xr-x 2 root wheel - 9536 Jun 28 23:03:58 2025 sbin
    drwxrwxrwt 71 root wheel - 4480 Jul 26 01:48:28 2025 tmp
    drwxr-xr-x 16 root wheel - 896 Jul 24 17:17:32 2025 usr
    drwxr-xr-x 84 root wheel - 1408 Dec 4 14:52:10 2021 var
    drwx------ 2 root wheel uarch 2 Jul 26 01:40:59 2025 wrkdirs

    # find /tmp/ -name '*lock-*' -exec ls -lodT {} \;
    -rw-r--r-- 1 root wheel uarch 4 Jul 26 11:34:26 2025
    /tmp/poudriere.LZmiUvjmEy/lock-main-ZNV4-bulk_a-alt-update_stats.pid >>>>>> -rw-r--r-- 1 root wheel uarch 0 Jul 24 17:17:34 2025
    /tmp/poudriere.LZmiUvjmEy/lock-main-ZNV4-bulk_a-alt-update_stats.flock >>>>>>
    # more
    /tmp/poudriere.LZmiUvjmEy/lock-main-ZNV4-bulk_a-alt-update_stats.pid >>>>>> 3615

    From "ps -alxd":

    . . .
    0 3615 3158 15 59 0 16868 4152 wait S 1
    22:19.56 | | | |-- sh: poudriere[main-ZNV4-bulk_a-alt]:
    html_json_main (sh)
    0 56410 3615 5 89 0 14532 3728 - R 1
    0:00.75 | | | | |-- /usr/bin/awk -v mini=yes -f /usr/bin/awk
    main-ZNV4-bulk_a-alt/2025-07-24_17h17m32s/.poudriere.builders main- >>>>>> 0 56411 3615 29 59 0 14532 2752 piperd S 1
    0:00.00 | | | | |-- /usr/bin/awk ORS=""; {print} END {print
    "\\n"}
    0 56412 3615 10 59 0 14108 2236 piperd S 1
    0:00.00 | | | | |-- /usr/bin/sed -e s/,\\([]}]\\)/\\1/g
    0 56413 3615 19 59 0 16868 4144 piperd S 1
    0:00.00 | | | | `-- sh: poudriere[main-ZNV4-bulk_a-alt]:
    html_json_main (sh)
    . . .

    Doing "ps -alxd" does not show a process tree for dotnet-9.0.6 but >>>>>> does for dotnet8-8.0.6_4 :

    UID PID PPID C PRI NI VSZ RSS MWCHAN STAT TT
    TIME COMMAND
    . . .
    0 28395 3158 18 59 0 23524 11608 select I 1
    0:00.04 | | | |-- sh: poudriere[main-ZNV4-bulk_a-alt][03]:
    build_pkg (dotnet8-8.0.6_4) (sh)
    0 55498 28395 25 59 0 23524 11604 wait I 1
    0:00.00 | | | | `-- sh: poudriere[main-ZNV4-bulk_a-alt][03]:
    build_pkg (dotnet8-8.0.6_4) (sh)
    0 55499 55498 21 59 0 14216 3784 wait IsJ -
    0:00.02 | | | | `-- /usr/bin/make -C /usr/ports/lang/dotnet8
    build
    0 55524 55499 29 59 0 14668 3304 wait IJ -
    0:00.00 | | | | `-- /bin/sh -e /tmp/makedskEnT
    0 55525 55524 7 59 0 16204 4920 wait IJ -
    0:00.01 | | | | `-- bash ./build.sh --release-manifest
    release.json --clean-while-building --with-sdk /wrkdirs/usr/ports
    0 56836 55525 4 59 0 406855036 195184 uwait IJ -
    0:30.89 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet msbuild >>>>>> /wrkdirs/usr/ports/lang/dotnet8/
    0 5126 56836 5 3 0 14748 3512 wait IJ -
    0:00.00 | | | | `-- /bin/sh -c export
    LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; .
    /tmp/MSBuildTemproot/tmpc8ecf97
    0 5127 5126 4 11 0 16284 5032 wait IJ -
    0:00.00 | | | | `-- bash
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/build.sh >>>>>> --ci --configuration R
    0 5130 5127 1 59 0 16284 5376 wait IJ -
    0:00.02 | | | | `-- bash
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/eng/common/build.sh
    --pack --
    0 5330 5130 0 59 0 406784004 105688 uwait IJ -
    0:00.55 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m >>>>>> /nologo /clp:Summary
    0 5473 5330 22 59 0 14748 3528 wait IJ -
    0:00.00 | | | | `-- /bin/sh -c export
    LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; . /tmp/MSBuildTemproot/tm >>>>>> 0 5474 5473 28 59 0 406867320 195692 uwait IJ -
    0:06.62 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m >>>>>> /nologo /clp:Sum
    0 5684 5474 2 9 0 406769428 112740 uwait IJ -
    0:02.97 | | | | |--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet
    /wrkdirs/usr/ports/lang/do
    0 5757 5474 9 59 0 406801372 139216 uwait IJ -
    0:01.45 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet
    /wrkdirs/usr/ports/lang/do

    A "ww"-added ps command output has:

    UID PID PPID C PRI NI VSZ RSS MWCHAN STAT TT
    TIME COMMAND
    . . .
    0 28395 3158 18 59 0 23524 11608 select I 1
    0:00.04 | | | |-- sh: poudriere[main-ZNV4-bulk_a-alt][03]:
    build_pkg (dotnet8-8.0.6_4) (sh)
    0 55498 28395 25 59 0 23524 11604 wait I 1
    0:00.00 | | | | `-- sh: poudriere[main-ZNV4-bulk_a-alt][03]:
    build_pkg (dotnet8-8.0.6_4) (sh)
    0 55499 55498 21 59 0 14216 3784 wait IsJ -
    0:00.02 | | | | `-- /usr/bin/make -C /usr/ports/lang/dotnet8
    build
    0 55524 55499 29 59 0 14668 3304 wait IJ -
    0:00.00 | | | | `-- /bin/sh -e /tmp/makedskEnT
    0 55525 55524 7 59 0 16204 4920 wait IJ -
    0:00.01 | | | | `-- bash ./build.sh --release-manifest
    release.json --clean-while-building --with-sdk
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk --with-packages >>>>>> /wrkdirs/usr/ports/lang/dotnet8/work/packages -- -maxcpucount:3
    0 56836 55525 4 59 0 406855036 195184 uwait IJ -
    0:30.89 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet msbuild >>>>>> /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/build.proj
    -bl:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/log/Debug/Build_0726085441.binlog
    -flp:LogFile=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/logs/Build_0726085441.log
    -flp:v=detailed -p:CleanWhileBuilding=true
    -p:CustomPrebuiltSourceBuiltPackagesPath=/wrkdirs/usr/ports/lang/dotnet8/work/packages
    -maxcpucount:3
    0 5126 56836 5 3 0 14748 3512 wait IJ -
    0:00.00 | | | | `-- /bin/sh -c export
    LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; .
    /tmp/MSBuildTemproot/tmpc8ecf970b04a4faea5680a0118915aaa.exec.cmd
    0 5127 5126 4 11 0 16284 5032 wait IJ -
    0:00.00 | | | | `-- bash
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/build.sh >>>>>> --ci --configuration Release --restore --build --pack --publish -bl >>>>>> /p:ArcadeBuildFromSource=true /p:CopyWipIntoInnerSourceBuildRepo=true >>>>>> /p:DotNetBuildOffline=true /p:CopySrcInsteadOfClone=true
    /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props
    /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/
    /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/
    /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/
    /p:SourceBuildUseMonoRuntime= --nodereuse false
    0 5130 5127 1 59 0 16284 5376 wait IJ -
    0:00.02 | | | | `-- bash
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/eng/common/build.sh
    --pack --build --restore --test --ci --configuration Release --restore >>>>>> --build --pack --publish -bl /p:ArcadeBuildFromSource=true
    /p:CopyWipIntoInnerSourceBuildRepo=true /p:DotNetBuildOffline=true >>>>>> /p:CopySrcInsteadOfClone=true
    /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props
    /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/
    /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/
    /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/
    /p:SourceBuildUseMonoRuntime= --nodereuse false
    0 5330 5130 0 59 0 406784004 105688 uwait IJ -
    0:00.55 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m >>>>>> /nologo /clp:Summary /v:minimal /nr:false /warnaserror
    /p:TreatWarningsAsErrors=true /p:ContinuousIntegrationBuild=true
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/Build.proj
    /bl:"/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/log/Release/Build.binlog"
    /p:Configuration=Release
    /p:RepoRoot=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/ >>>>>> /p:Restore=true /p:Build=true /p:Rebuild=false /p:Test=true
    /p:Pack=true /p:IntegrationTest=false /p:PerformanceTest=false
    /p:Sign=false /p:Publish=true /p:ArcadeBuildFromSource=true >>>>>> /p:CopyWipIntoInnerSourceBuildRepo=true /p:DotNetBuildOffline=true
    /p:CopySrcInsteadOfClone=true
    /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props
    /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/
    /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/
    /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/
    /p:SourceBuildUseMonoRuntime=
    -logger:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/net8.0/Microsoft.DotNet.ArcadeLogging.dll
    0 5473 5330 22 59 0 14748 3528 wait IJ -
    0:00.00 | | | | `-- /bin/sh -c export
    LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; .
    /tmp/MSBuildTemproot/tmp5c13d207e7a4487188f01bcfbfeb74bc.exec.cmd
    0 5474 5473 28 59 0 406867320 195692 uwait IJ -
    0:06.62 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m >>>>>> /nologo /clp:Summary /v:minimal /nr:false /warnaserror
    /p:TreatWarningsAsErrors=true /p:ContinuousIntegrationBuild=true
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/Build.proj
    /bl:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/log/Release/Build.binlog
    /p:Configuration=Release
    /p:RepoRoot=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/ >>>>>> /p:Restore=true /p:Build=true /p:Rebuild=false /p:Test=true
    /p:Pack=true /p:IntegrationTest=false /p:PerformanceTest=false
    /p:Sign=false /p:Publish=true /p:ArcadeBuildFromSource=true >>>>>> /p:CopyWipIntoInnerSourceBuildRepo=true /p:DotNetBuildOffline=true
    /p:CopySrcInsteadOfClone=true
    /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props
    /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/
    /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/
    /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/
    /p:SourceBuildUseMonoRuntime=
    -logger:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/net8.0/Microsoft.DotNet.ArcadeLogging.dll
    /p:ArcadeInnerBuildFromSource=true /p:DotNetBuildFromSource=true
    /p:RepoRoot=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/self/src/
    /p:ArtifactsDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/self/src/artifacts/
    /bl:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/self/src/artifacts/sourcebuild.binlog
    /p:ContinuousIntegrationBuild=true
    /p:SourceBuildOutputDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/
    /p:SourceBuiltBlob
    0 5684 5474 2 9 0 406769428 112740 uwait IJ -
    0:02.97 | | | | |--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/sdk/8.0.100/MSBuild.dll
    /nologo /nodemode:1 /nodeReuse:false /low:false
    0 5757 5474 9 59 0 406801372 139216 uwait IJ -
    0:01.45 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/sdk/8.0.100/MSBuild.dll
    /nologo /nodemode:1 /nodeReuse:false /low:false
    . . .

    Notes:

    I eventually killed process 5757 to let [03] progress to the next >>>>>> package.
    Such classfies dotnet8 as failed.

    I still have [04] stuck at build_port_done for dotnet-9.0.6 .


    In another bulk -Ca test, dotnet8 built fine but dotnet-9.0.6 seems
    to be stuck in build_port_done again:

    ID TOTAL ORIGIN PKGNAME
    PHASE TIME TMPFS
    CPU% MEM%
    . . .
    [25] 06:10:17 lang/dotnet | dotnet-9.0.6
    build_port_done 04:40:03 4.75 GiB
    . . .


    ===
    Mark Millard
    marklmi at yahoo.com

    I'd like to point out that I too have been experiencing this, although >>>> only on my amd64 builders and never on my arm64 builder. One thing Mark >>>> did not point out, though, is that the log for the build ends with >>>> saying that the wrkdirs unmount failed, specifically I see this as the
    last line in my own logs:

    umount: unmount of
    /usr/local/poudriere/data/.m/14amd64-default/01/wrkdirs failed: Device >>>> busy

    Confirmed for my context as well, for example:

    # tail -1 /usr/local/poudriere/data/logs/bulk/main-ZNV4-bulk_a-alt/2025-07-27_20h19m08s/logs/dotnet-9.0.6.log
    umount: unmount of /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/wrkdirs failed: Device busy

    Also:

    # df -m | grep dotnet
    /usr/local/poudriere/data/cache/tmp/wrkdirs/dotnet-9.0.6.BcQxQlcLsf 368348 137587 230761 37% /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/wrkdirs
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6 363202 132441 230761 36% /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/.npkg

    And:

    # umount /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/wrkdirs

    # umount /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/.npkg

    So: No complaints about the later manual umount's. Whatever blocked
    the original umount appears to have been a temporary condition.

    Also, now:

    # ls -loaT /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/wrkdirs
    total 2
    drwxr-xr-x 2 root wheel - 0 Jul 27 20:19:08 2025 .
    drwxr-xr-x 26 root wheel - 1984 Jul 29 01:24:15 2025 ..

    # ls -loaT /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6
    total 26
    drwxr-xr-x 3 root wheel uarch 3 Jul 29 01:24:15 2025 .
    drwxr-xr-x 4 root wheel uarch 4 Jul 29 10:07:13 2025 ..
    drwxr-xr-x 2 root wheel uarch 2 Jul 29 01:34:54 2025 All

    # ls -loaT /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6/All/
    total 1
    drwxr-xr-x 2 root wheel uarch 2 Jul 29 01:34:54 2025 .
    drwxr-xr-x 3 root wheel uarch 3 Jul 29 01:24:15 2025 ..


    And similarly to Mark, because it ends like this with absolutely no >>>> processes in the jail, there is nothing to kill and thus no way to get
    poudriere to finish off that job.

    Another note is that the tmpfs use is stall active for:

    # df -m | grep /25 | grep ^tmpfs
    tmpfs 523619 2370 521248 0% /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25
    tmpfs 2048 32 2015 2% /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/.p
    tmpfs 523712 2463 521248 0% /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/usr/local

    (So: over 4 GiBytes.)

    Of course, there are various other mount points
    matching:

    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/*/
    and:
    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/*/*/
    and:
    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/*/*/*/

    that are still active as well.

    Also another one was stuck at the end. It also got the
    umount "Device busy" failure notice:

    Cleaning for gatk-4.6.1.0_1
    umount: unmount of /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/28/wrkdirs failed: Device busy
    I noticed something new in a new 'bulk -Ca' example
    for the dotnet case. This was after:
    [1D:06:34:29] [10] [00:00:43] Finished lang/dotnet-host | dotnet-host-9.0.6: Success
    and 'poudriere status' was reporting build_port_done: a
    'ps -alxdww' then included:
    0 45401 1 20 45 0 406891940 200404 uwait IJ - 0:13.46 |-- /wrkdirs/usr/ports/lang/dotnet/work/bootstrap_sdk/dotnet /wrkdirs/usr/ports/lang/dotnet/work/bootstrap_sdk/sdk/9.0.103/MSBuild.dll /nologo /nodemode:1 /nodeReuse:true /low:false
    0 45402 1 29 0 0 406860132 201748 uwait IJ - 0:16.18 |-- /wrkdirs/usr/ports/lang/dotnet/work/bootstrap_sdk/dotnet /wrkdirs/usr/ports/lang/dotnet/work/bootstrap_sdk/sdk/9.0.103/MSBuild.dll /nologo /nodemode:1 /nodeReuse:true /low:false
    but no other references to dotnet builder processes were
    shown: no original parent process any more (other than: 1).
    Those might be what lead to "Device busy" for the umount?
    'kill 45401' worked, as did 'kill 45402' (but I was logged
    in as root). That still left it stuck at build_port_done .
    ===
    Mark Millard
    marklmi at yahoo.com
    --
    Posted automagically by a mail2news gateway at muc.de e.V.
    Please direct questions, flames, donations, etc. to news-admin@muc.de
    --- Synchronet 3.21a-Linux NewsLink 1.2
  • From Mark Millard@marklmi@yahoo.com to muc.lists.freebsd.ports on Sun Aug 10 07:06:37 2025
    From Newsgroup: muc.lists.freebsd.ports

    On Jul 31, 2025, at 16:52, Mark Millard <marklmi@yahoo.com> wrote:
    On Jul 30, 2025, at 06:31, Mark Millard <marklmi@yahoo.com> wrote:

    On Jul 29, 2025, at 14:58, Mark Millard <marklmi@yahoo.com> wrote:

    On Jul 29, 2025, at 10:10, Mark Millard <marklmi@yahoo.com> wrote:

    Naram Qashat <cyberbotx_at_cyberbotx.com> wrote on
    Date: Tue, 29 Jul 2025 14:14:56 UTC :

    On 2025-07-29 09:34, Mark Millard wrote:
    On Jul 26, 2025, at 11:46, Mark Millard <marklmi@yahoo.com> wrote: >>>>>>
    The other builders in the "bulk -Ca" run till are operating.

    # poudriere version
    poudriere-git-3.4.99.20250601

    Extractions of appearently related information follow . . .

    # poudriere status -b
    [main-ZNV4-bulk_a-alt] [2025-07-24_17h17m32s] [parallel_build] >>>>>>> Time: 1D:14:22:35
    Queued: 36640 Inspected: 0 Ignored: 361 Built: 31142 Failed: 141 >>>>>>> Skipped: 619 Fetched: 0 Remaining: 4377
    . . .
    [03] 05:47:01 lang/dotnet8 | dotnet8-8.0.6_4
    build 05:45:28 4.81 GiB 0% 0.5%
    [04] 06:39:07 lang/dotnet | dotnet-9.0.6
    build_port_done 05:59:17 4.75 GiB
    . . .

    The poudriere-devel output shows:

    . . .
    [1D:07:43:30] [04] [00:00:00] Building lang/dotnet | dotnet-9.0.6 >>>>>>> . . .
    [1D:08:23:20] [04] [00:39:50] Finished lang/dotnet | dotnet-9.0.6: >>>>>>> Success
    . . .
    [1D:08:35:36] [03] [00:00:00] Building lang/dotnet8 |
    dotnet8-8.0.6_4
    . . .

    # ls -lodT
    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/packages/All/dotnet-9.0.6.pkg
    -rw-r--r-- 1 root wheel uarch 758491155 Jul 26 01:40:52 2025
    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/packages/All/dotnet-9.0.6.pkg

    # find
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/ >>>>>>> -print
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6/All

    # find /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/ -name >>>>>>> '*dotnet-9*' -print
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/All/dotnet-9.0.6.pkg
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6

    # ls -loaT
    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/wrkdirs/
    total 2
    drwx------ 2 root wheel uarch 2 Jul 26 01:40:59 2025 .
    drwxr-xr-x 26 root wheel - 1984 Jul 26 01:33:37 2025 ..

    # ls -loaT /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/04/ >>>>>>> total 5082
    drwxr-xr-x 26 root wheel - 1984 Jul 26 01:33:37 2025 .
    drwx--x--x 15 root wheel - 832 Jul 24 17:19:30 2025 ..
    -rw-r--r-- 1 root wheel - 3 Jul 24 17:17:32 2025 .cpignore
    -rw-r--r-- 1 root wheel - 0 Jul 26 01:01:03 2025
    .need_rollback
    drwxr-xr-x 3 root wheel uarch 3 Jul 26 01:33:37 2025 .npkg
    -rw-r--r-- 1 root wheel - 0 Jul 26 01:33:37 2025
    .npkg_mounted
    drwxr-xr-x 4 root wheel - 192 Jul 24 17:19:31 2025 .p
    -rw-r--r-- 2 root wheel uarch 495 Aug 20 10:45:06 2023 .profile
    -rw-r--r-- 1 root wheel - 68 Jul 26 01:01:03 2025
    .tmpfs_blacklist_dir
    -r--r--r-- 1 root wheel uarch 6070 Jun 28 23:04:06 2025 COPYRIGHT >>>>>>> drwxr-xr-x 2 root wheel - 3008 Jun 28 23:03:57 2025 bin
    drwxr-xr-x 14 root wheel - 4672 Jun 28 23:04:06 2025 boot
    drwxr-xr-x 3 root wheel - 64 Jul 24 17:17:32 2025 compat
    dr-xr-xr-x 11 root wheel - 512 Jul 26 01:01:03 2025 dev
    drwxr-xr-x 485 root wheel uarch 32439 Jul 25 14:15:42 2025 distfiles >>>>>>> drwxr-xr-x 31 root wheel - 6784 Jul 26 01:01:57 2025 etc
    lrwxr-xr-x 1 root wheel - 8 Jul 24 17:17:32 2025 home ->
    usr/home
    drwxr-xr-x 4 root wheel - 4992 Jun 28 23:03:56 2025 lib
    drwxr-xr-x 3 root wheel - 512 Jun 26 22:28:15 2025 libexec
    drwxr-xr-x 2 root wheel - 0 Dec 4 14:52:10 2021 media
    drwxr-xr-x 2 root wheel - 0 Dec 4 14:52:10 2021 mnt
    drwxr-xr-x 2 root wheel - 0 Dec 4 14:52:10 2021 net
    drwxr-xr-x 2 root wheel - 0 Jul 24 17:17:32 2025 overlays
    drwxr-xr-x 5 root wheel uarch 8 Jul 24 17:19:23 2025 packages
    drwxr-xr-x 3 root wheel - 64 Jul 26 01:01:03 2025
    portdistfiles
    dr-xr-xr-x 1 root wheel - 0 Jul 26 08:55:43 2025 proc
    drwxr-xr-x 2 root wheel uarch 152 Jun 28 23:03:56 2025 rescue
    drwxr-x--- 3 root wheel - 384 Jul 24 17:17:32 2025 root
    drwxr-xr-x 2 root wheel - 9536 Jun 28 23:03:58 2025 sbin
    drwxrwxrwt 71 root wheel - 4480 Jul 26 01:48:28 2025 tmp
    drwxr-xr-x 16 root wheel - 896 Jul 24 17:17:32 2025 usr
    drwxr-xr-x 84 root wheel - 1408 Dec 4 14:52:10 2021 var
    drwx------ 2 root wheel uarch 2 Jul 26 01:40:59 2025 wrkdirs

    # find /tmp/ -name '*lock-*' -exec ls -lodT {} \;
    -rw-r--r-- 1 root wheel uarch 4 Jul 26 11:34:26 2025
    /tmp/poudriere.LZmiUvjmEy/lock-main-ZNV4-bulk_a-alt-update_stats.pid >>>>>>> -rw-r--r-- 1 root wheel uarch 0 Jul 24 17:17:34 2025
    /tmp/poudriere.LZmiUvjmEy/lock-main-ZNV4-bulk_a-alt-update_stats.flock >>>>>>>
    # more
    /tmp/poudriere.LZmiUvjmEy/lock-main-ZNV4-bulk_a-alt-update_stats.pid >>>>>>> 3615

    From "ps -alxd":

    . . .
    0 3615 3158 15 59 0 16868 4152 wait S 1
    22:19.56 | | | |-- sh: poudriere[main-ZNV4-bulk_a-alt]:
    html_json_main (sh)
    0 56410 3615 5 89 0 14532 3728 - R 1
    0:00.75 | | | | |-- /usr/bin/awk -v mini=yes -f /usr/bin/awk >>>>>>> main-ZNV4-bulk_a-alt/2025-07-24_17h17m32s/.poudriere.builders main-
    0 56411 3615 29 59 0 14532 2752 piperd S 1
    0:00.00 | | | | |-- /usr/bin/awk ORS=""; {print} END {print
    "\\n"}
    0 56412 3615 10 59 0 14108 2236 piperd S 1
    0:00.00 | | | | |-- /usr/bin/sed -e s/,\\([]}]\\)/\\1/g
    0 56413 3615 19 59 0 16868 4144 piperd S 1
    0:00.00 | | | | `-- sh: poudriere[main-ZNV4-bulk_a-alt]:
    html_json_main (sh)
    . . .

    Doing "ps -alxd" does not show a process tree for dotnet-9.0.6 but >>>>>>> does for dotnet8-8.0.6_4 :

    UID PID PPID C PRI NI VSZ RSS MWCHAN STAT TT
    TIME COMMAND
    . . .
    0 28395 3158 18 59 0 23524 11608 select I 1
    0:00.04 | | | |-- sh: poudriere[main-ZNV4-bulk_a-alt][03]:
    build_pkg (dotnet8-8.0.6_4) (sh)
    0 55498 28395 25 59 0 23524 11604 wait I 1
    0:00.00 | | | | `-- sh: poudriere[main-ZNV4-bulk_a-alt][03]:
    build_pkg (dotnet8-8.0.6_4) (sh)
    0 55499 55498 21 59 0 14216 3784 wait IsJ -
    0:00.02 | | | | `-- /usr/bin/make -C /usr/ports/lang/dotnet8
    build
    0 55524 55499 29 59 0 14668 3304 wait IJ -
    0:00.00 | | | | `-- /bin/sh -e /tmp/makedskEnT
    0 55525 55524 7 59 0 16204 4920 wait IJ -
    0:00.01 | | | | `-- bash ./build.sh --release-manifest
    release.json --clean-while-building --with-sdk /wrkdirs/usr/ports >>>>>>> 0 56836 55525 4 59 0 406855036 195184 uwait IJ -
    0:30.89 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet msbuild >>>>>>> /wrkdirs/usr/ports/lang/dotnet8/
    0 5126 56836 5 3 0 14748 3512 wait IJ -
    0:00.00 | | | | `-- /bin/sh -c export
    LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; .
    /tmp/MSBuildTemproot/tmpc8ecf97
    0 5127 5126 4 11 0 16284 5032 wait IJ -
    0:00.00 | | | | `-- bash
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/build.sh >>>>>>> --ci --configuration R
    0 5130 5127 1 59 0 16284 5376 wait IJ -
    0:00.02 | | | | `-- bash
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/eng/common/build.sh
    --pack --
    0 5330 5130 0 59 0 406784004 105688 uwait IJ -
    0:00.55 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m >>>>>>> /nologo /clp:Summary
    0 5473 5330 22 59 0 14748 3528 wait IJ -
    0:00.00 | | | | `-- /bin/sh -c export
    LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; . /tmp/MSBuildTemproot/tm >>>>>>> 0 5474 5473 28 59 0 406867320 195692 uwait IJ -
    0:06.62 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m >>>>>>> /nologo /clp:Sum
    0 5684 5474 2 9 0 406769428 112740 uwait IJ -
    0:02.97 | | | | |--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet
    /wrkdirs/usr/ports/lang/do
    0 5757 5474 9 59 0 406801372 139216 uwait IJ -
    0:01.45 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet
    /wrkdirs/usr/ports/lang/do

    A "ww"-added ps command output has:

    UID PID PPID C PRI NI VSZ RSS MWCHAN STAT TT
    TIME COMMAND
    . . .
    0 28395 3158 18 59 0 23524 11608 select I 1
    0:00.04 | | | |-- sh: poudriere[main-ZNV4-bulk_a-alt][03]:
    build_pkg (dotnet8-8.0.6_4) (sh)
    0 55498 28395 25 59 0 23524 11604 wait I 1
    0:00.00 | | | | `-- sh: poudriere[main-ZNV4-bulk_a-alt][03]:
    build_pkg (dotnet8-8.0.6_4) (sh)
    0 55499 55498 21 59 0 14216 3784 wait IsJ -
    0:00.02 | | | | `-- /usr/bin/make -C /usr/ports/lang/dotnet8
    build
    0 55524 55499 29 59 0 14668 3304 wait IJ -
    0:00.00 | | | | `-- /bin/sh -e /tmp/makedskEnT
    0 55525 55524 7 59 0 16204 4920 wait IJ -
    0:00.01 | | | | `-- bash ./build.sh --release-manifest
    release.json --clean-while-building --with-sdk
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk --with-packages >>>>>>> /wrkdirs/usr/ports/lang/dotnet8/work/packages -- -maxcpucount:3
    0 56836 55525 4 59 0 406855036 195184 uwait IJ -
    0:30.89 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet msbuild >>>>>>> /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/build.proj
    -bl:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/log/Debug/Build_0726085441.binlog
    -flp:LogFile=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/logs/Build_0726085441.log
    -flp:v=detailed -p:CleanWhileBuilding=true
    -p:CustomPrebuiltSourceBuiltPackagesPath=/wrkdirs/usr/ports/lang/dotnet8/work/packages
    -maxcpucount:3
    0 5126 56836 5 3 0 14748 3512 wait IJ -
    0:00.00 | | | | `-- /bin/sh -c export
    LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; .
    /tmp/MSBuildTemproot/tmpc8ecf970b04a4faea5680a0118915aaa.exec.cmd >>>>>>> 0 5127 5126 4 11 0 16284 5032 wait IJ -
    0:00.00 | | | | `-- bash
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/build.sh >>>>>>> --ci --configuration Release --restore --build --pack --publish -bl >>>>>>> /p:ArcadeBuildFromSource=true /p:CopyWipIntoInnerSourceBuildRepo=true >>>>>>> /p:DotNetBuildOffline=true /p:CopySrcInsteadOfClone=true
    /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props
    /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/
    /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/
    /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/
    /p:SourceBuildUseMonoRuntime= --nodereuse false
    0 5130 5127 1 59 0 16284 5376 wait IJ -
    0:00.02 | | | | `-- bash
    /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/eng/common/build.sh
    --pack --build --restore --test --ci --configuration Release --restore >>>>>>> --build --pack --publish -bl /p:ArcadeBuildFromSource=true
    /p:CopyWipIntoInnerSourceBuildRepo=true /p:DotNetBuildOffline=true >>>>>>> /p:CopySrcInsteadOfClone=true
    /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props
    /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/
    /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/
    /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/
    /p:SourceBuildUseMonoRuntime= --nodereuse false
    0 5330 5130 0 59 0 406784004 105688 uwait IJ -
    0:00.55 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m >>>>>>> /nologo /clp:Summary /v:minimal /nr:false /warnaserror
    /p:TreatWarningsAsErrors=true /p:ContinuousIntegrationBuild=true >>>>>>> /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/Build.proj
    /bl:"/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/log/Release/Build.binlog"
    /p:Configuration=Release
    /p:RepoRoot=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/ >>>>>>> /p:Restore=true /p:Build=true /p:Rebuild=false /p:Test=true
    /p:Pack=true /p:IntegrationTest=false /p:PerformanceTest=false
    /p:Sign=false /p:Publish=true /p:ArcadeBuildFromSource=true >>>>>>> /p:CopyWipIntoInnerSourceBuildRepo=true /p:DotNetBuildOffline=true
    /p:CopySrcInsteadOfClone=true
    /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props
    /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/
    /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/
    /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/
    /p:SourceBuildUseMonoRuntime=
    -logger:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/net8.0/Microsoft.DotNet.ArcadeLogging.dll
    0 5473 5330 22 59 0 14748 3528 wait IJ -
    0:00.00 | | | | `-- /bin/sh -c export
    LANG=en_US.UTF-8; export LC_ALL=en_US.UTF-8; .
    /tmp/MSBuildTemproot/tmp5c13d207e7a4487188f01bcfbfeb74bc.exec.cmd >>>>>>> 0 5474 5473 28 59 0 406867320 195692 uwait IJ -
    0:06.62 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk//dotnet msbuild /m >>>>>>> /nologo /clp:Summary /v:minimal /nr:false /warnaserror
    /p:TreatWarningsAsErrors=true /p:ContinuousIntegrationBuild=true >>>>>>> /wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/Build.proj
    /bl:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/log/Release/Build.binlog
    /p:Configuration=Release
    /p:RepoRoot=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/ >>>>>>> /p:Restore=true /p:Build=true /p:Rebuild=false /p:Test=true
    /p:Pack=true /p:IntegrationTest=false /p:PerformanceTest=false
    /p:Sign=false /p:Publish=true /p:ArcadeBuildFromSource=true >>>>>>> /p:CopyWipIntoInnerSourceBuildRepo=true /p:DotNetBuildOffline=true
    /p:CopySrcInsteadOfClone=true
    /p:DotNetPackageVersionPropsPath=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/PackageVersions.xdt.props
    /p:AdditionalSourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/obj/x64/Release/blob-feed/packages/
    /p:ReferencePackageNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/prereqs/packages/reference/
    /p:PreviouslySourceBuiltNupkgCacheDir=/wrkdirs/usr/ports/lang/dotnet8/work/packages/
    /p:SourceBuildUseMonoRuntime=
    -logger:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/artifacts/source-built-sdks/Microsoft.DotNet.Arcade.Sdk/tools/net8.0/Microsoft.DotNet.ArcadeLogging.dll
    /p:ArcadeInnerBuildFromSource=true /p:DotNetBuildFromSource=true >>>>>>> /p:RepoRoot=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/self/src/
    /p:ArtifactsDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/self/src/artifacts/
    /bl:/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/self/src/artifacts/sourcebuild.binlog
    /p:ContinuousIntegrationBuild=true
    /p:SourceBuildOutputDir=/wrkdirs/usr/ports/lang/dotnet8/work/dotnet-8.0.6/src/xdt/artifacts/source-build/
    /p:SourceBuiltBlob
    0 5684 5474 2 9 0 406769428 112740 uwait IJ -
    0:02.97 | | | | |--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/sdk/8.0.100/MSBuild.dll
    /nologo /nodemode:1 /nodeReuse:false /low:false
    0 5757 5474 9 59 0 406801372 139216 uwait IJ -
    0:01.45 | | | | `--
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/dotnet
    /wrkdirs/usr/ports/lang/dotnet8/work/bootstrap_sdk/sdk/8.0.100/MSBuild.dll
    /nologo /nodemode:1 /nodeReuse:false /low:false
    . . .

    Notes:

    I eventually killed process 5757 to let [03] progress to the next >>>>>>> package.
    Such classfies dotnet8 as failed.

    I still have [04] stuck at build_port_done for dotnet-9.0.6 .


    In another bulk -Ca test, dotnet8 built fine but dotnet-9.0.6 seems >>>>>> to be stuck in build_port_done again:

    ID TOTAL ORIGIN PKGNAME
    PHASE TIME TMPFS
    CPU% MEM%
    . . .
    [25] 06:10:17 lang/dotnet | dotnet-9.0.6
    build_port_done 04:40:03 4.75 GiB
    . . .


    ===
    Mark Millard
    marklmi at yahoo.com

    I'd like to point out that I too have been experiencing this, although >>>>> only on my amd64 builders and never on my arm64 builder. One thing Mark >>>>> did not point out, though, is that the log for the build ends with >>>>> saying that the wrkdirs unmount failed, specifically I see this as the
    last line in my own logs:

    umount: unmount of
    /usr/local/poudriere/data/.m/14amd64-default/01/wrkdirs failed: Device >>>>> busy

    Confirmed for my context as well, for example:

    # tail -1 /usr/local/poudriere/data/logs/bulk/main-ZNV4-bulk_a-alt/2025-07-27_20h19m08s/logs/dotnet-9.0.6.log
    umount: unmount of /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/wrkdirs failed: Device busy

    Also:

    # df -m | grep dotnet
    /usr/local/poudriere/data/cache/tmp/wrkdirs/dotnet-9.0.6.BcQxQlcLsf 368348 137587 230761 37% /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/wrkdirs
    /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6 363202 132441 230761 36% /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/.npkg

    And:

    # umount /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/wrkdirs

    # umount /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/.npkg

    So: No complaints about the later manual umount's. Whatever blocked
    the original umount appears to have been a temporary condition.

    Also, now:

    # ls -loaT /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/wrkdirs >>>> total 2
    drwxr-xr-x 2 root wheel - 0 Jul 27 20:19:08 2025 .
    drwxr-xr-x 26 root wheel - 1984 Jul 29 01:24:15 2025 ..

    # ls -loaT /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6
    total 26
    drwxr-xr-x 3 root wheel uarch 3 Jul 29 01:24:15 2025 .
    drwxr-xr-x 4 root wheel uarch 4 Jul 29 10:07:13 2025 ..
    drwxr-xr-x 2 root wheel uarch 2 Jul 29 01:34:54 2025 All

    # ls -loaT /usr/local/poudriere/data/packages/main-ZNV4-bulk_a-alt/.building/.npkg/dotnet-9.0.6/All/
    total 1
    drwxr-xr-x 2 root wheel uarch 2 Jul 29 01:34:54 2025 .
    drwxr-xr-x 3 root wheel uarch 3 Jul 29 01:24:15 2025 ..


    And similarly to Mark, because it ends like this with absolutely no >>>>> processes in the jail, there is nothing to kill and thus no way to get >>>>> poudriere to finish off that job.

    Another note is that the tmpfs use is stall active for:

    # df -m | grep /25 | grep ^tmpfs
    tmpfs 523619 2370 521248 0% /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25
    tmpfs 2048 32 2015 2% /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/.p
    tmpfs 523712 2463 521248 0% /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/usr/local

    (So: over 4 GiBytes.)

    Of course, there are various other mount points
    matching:

    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/*/
    and:
    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/*/*/
    and:
    /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/25/*/*/*/

    that are still active as well.

    Also another one was stuck at the end. It also got the
    umount "Device busy" failure notice:

    Cleaning for gatk-4.6.1.0_1
    umount: unmount of /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/28/wrkdirs failed: Device busy

    I noticed something new in a new 'bulk -Ca' example
    for the dotnet case. This was after:

    [1D:06:34:29] [10] [00:00:43] Finished lang/dotnet-host | dotnet-host-9.0.6: Success
    Looks like I copied the wrong line above (should have had no "-host").
    and 'poudriere status' was reporting build_port_done: a
    'ps -alxdww' then included:

    0 45401 1 20 45 0 406891940 200404 uwait IJ - 0:13.46 |-- /wrkdirs/usr/ports/lang/dotnet/work/bootstrap_sdk/dotnet /wrkdirs/usr/ports/lang/dotnet/work/bootstrap_sdk/sdk/9.0.103/MSBuild.dll /nologo /nodemode:1 /nodeReuse:true /low:false
    0 45402 1 29 0 0 406860132 201748 uwait IJ - 0:16.18 |-- /wrkdirs/usr/ports/lang/dotnet/work/bootstrap_sdk/dotnet /wrkdirs/usr/ports/lang/dotnet/work/bootstrap_sdk/sdk/9.0.103/MSBuild.dll /nologo /nodemode:1 /nodeReuse:true /low:false

    but no other references to dotnet builder processes were
    shown: no original parent process any more (other than: 1).

    Those might be what lead to "Device busy" for the umount?

    'kill 45401' worked, as did 'kill 45402' (but I was logged
    in as root). That still left it stuck at build_port_done .
    ===
    Mark Millard
    marklmi at yahoo.com
    --
    Posted automagically by a mail2news gateway at muc.de e.V.
    Please direct questions, flames, donations, etc. to news-admin@muc.de
    --- Synchronet 3.21a-Linux NewsLink 1.2