Trying windows local docker running on win11

[knmcguire]

This issue is to try out if the local docker running instructions would still work with windows 11 pro and docker windows containers (with hyper-V). This would be handy for debugging at least.

I'm here marking any issues I had going through this readme: https://github.com/ros2/ci/blob/master/windows_docker_resources/README.md

[knmcguire]

There are some errors in the that I get when trying to get this to run on windows:

 $ powershell $(Get-ItemProperty -Path 'HKLM:SOFTWARE\Microsoft\Windows NT\CurrentVersion\Update\TargetingInfo\Installed\Server.OS.amd64' -Name Version).Version
Get-ItemProperty : Cannot find path 'HKLM:\SOFTWARE\Microsoft\Windows NT\CurrentVersion\Update\TargetingInfo\Installed\Server.OS.amd64' because it does not exist.
At line:1 char:14
+ ... owershell $(Get-ItemProperty -Path 'HKLM:SOFTWARE\Microsoft\Windows N ...
+                 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : ObjectNotFound: (HKLM:\SOFTWARE\...Server.OS.amd64:String) [Get-ItemProperty], ItemNotFoundException
    + FullyQualifiedErrorId : PathNotFound,Microsoft.PowerShell.Commands.GetItemPropertyCommand

This needs to be the following for a regular desktop windows machine:

powershell $(Get-ItemProperty -Path 'HKLM:\SOFTWARE\Microsoft\Windows NT\CurrentVersion\Update\TargetingInfo\Installed\Client.OS.rs2.amd64\' -Name Version).Version

[knmcguire]

When building the docker file it doesn't like it either:

$ docker build --build-arg WINDOWS_RELEASE_VERSION=10.0.12345.678 --build-arg ROS_DISTRO=rolling -t ros2_windows_ci -f windows_docker_resources\Dockerfile windows_docker_resources
Sending build context to Docker daemon  226.8kB
Step 1/21 : ARG WINDOWS_RELEASE_ID=2009
Step 2/21 : ARG WINDOWS_RELEASE_VERSION=$WINDOWS_RELEASE_ID
Step 3/21 : FROM mcr.microsoft.com/windows/server:$WINDOWS_RELEASE_VERSION
manifest for mcr.microsoft.com/windows/server:10.0.12345.678 not found: manifest unknown: manifest tagged by "10.0.12345.678" is not found

10.0.12345.678 is a fake number which needs to be replaced with the value we get above. It seems to look for the same version number as server but that doesn't work.

This worked for me but I had to have hyper-V on as this is an older version of windows than what I'm running on my machine

docker build --build-arg WINDOWS_RELEASE_VERSION=ltsc2022 --build-arg ROS_DISTRO=rolling -t ros2_windows_ci -f windows_docker_resources\Dockerfile .

[knmcguire]

Also another thing that I'm hitting is the missing instructions for dealing with connextdds. I would physically need to remove these lines from the docker file.

ci/windows_docker_resources/Dockerfile

Lines 60 to 79 in 2f86d08

	# Setup environment variables needed for Connext
	ENV RTI_LICENSE_FILE C:\connext\rti_license.dat
	ENV CONNEXTDDS_DIR C:\connext\rti_connext_dds-7.3.0
	ENV RTI_OPENSSL_BIN C:\connext\openssl-3.0.12\x64Win64VS2017\bin
	ENV RTI_OPENSSL_LIB C:\connext\openssl-3.0.12\x64Win64VS2017\lib
	# Copy over necessary Connext files into container
	RUN IF NOT EXIST "C:\TEMP" mkdir C:\TEMP
	COPY rticonnextdds-src\ C:\TEMP\rticonnextdds-src
	RUN copy /b C:\TEMP\rticonnextdds-src\rti_connext_dds-7.3.0-pro-host-x64Win64.exe.??? C:\TEMP\rticonnextdds-src\rti_connext_dds-7.3.0-pro-host-x64Win64.exe
	RUN copy /b C:\TEMP\rticonnextdds-src\rti_connext_dds-7.3.0-pro-target-x64Win64VS2017.rtipkg.??? C:\TEMP\rticonnextdds-src\rti_connext_dds-7.3.0-pro-target-x64Win64VS2017.rtipkg
	COPY rticonnextdds-license\rti_license.dat $RTI_LICENSE_FILE
	# Install Connext
	RUN C:\TEMP\rticonnextdds-src\rti_connext_dds-7.3.0-pro-host-x64Win64.exe --mode unattended --unattendedmodeui minimalWithDialogs --prefix C:\connext
	RUN %CONNEXTDDS_DIR%\bin\rtipkginstall.bat -u C:\TEMP\rticonnextdds-src\openssl-3.0.12-7.3.0-host-x64Win64.rtipkg
	RUN %CONNEXTDDS_DIR%\bin\rtipkginstall.bat -u C:\TEMP\rticonnextdds-src\openssl-3.0.12-7.3.0-target-x64Win64VS2017.rtipkg
	RUN %CONNEXTDDS_DIR%\bin\rtipkginstall.bat -u C:\TEMP\rticonnextdds-src\rti_connext_dds-7.3.0-pro-target-x64Win64VS2017.rtipkg
	RUN %CONNEXTDDS_DIR%\bin\rtipkginstall.bat -u C:\TEMP\rticonnextdds-src\rti_security_plugins-7.3.0-host-x64Win64.rtipkg
	RUN %CONNEXTDDS_DIR%\bin\rtipkginstall.bat -u C:\TEMP\rticonnextdds-src\rti_security_plugins-7.3.0-target-x64Win64VS2017.rtipkg

Then I add this line to the environment variable CI_ARGS : --ignore-rmw rmw_connextdds

[knmcguire]

Maybe if conditional can be added to connext install if the RMW is ignored, to not install connext at all in the docker container

[knmcguire]

I also got this failure:

C:/ci/ws/build/osrf_testing_tools_cpp/googletest-1.14-extracted/ex-googletest1234/googletest-1.14.0

to

  C:/ci/ws/build/osrf_testing_tools_cpp/googletest-1.14-extracted/googletest-1.14-src

because: The system cannot find the path specified.

Still investigating how this is...

UPDATE:

this is due to the path lenght limitation apparently

[knmcguire]

Next up, after moving ci to a smaller dir, and now using hyper-V isolation and rebuild the docker for the 2025 windows image

I ran the full monty like in nightly_win_rel (without connextdds)

set CI_ARGS=--force-ansi-color --workspace-path C:\ci --ignore-rmw rmw_fastrtps_dynamic_cpp rmw_connextdds --repo-file-url https://raw.githubusercontent.com/ros2/ros2/rolling/ros2.repos --colcon-mixin-url https://raw.githubusercontent.com/colcon/colcon-mixin-repository/master/index.yaml --cmake-build-type Release --visual-studio-version 2022 --build-args --event-handlers console_cohesion+ console_package_list+ --cmake-args -DINSTALL_EXAMPLES=OFF -DSECURITY=ON -DAPPEND_PROJECT_NAME_TO_INCLUDEDIR=ON --test-args --event-handlers console_cohesion+ --retest-until-pass 2 --ctest-args -LE xfail --pytest-args -m \"not xfail\"

docker run --isolation=hyperv --rm -e ROS_DOMAIN_ID=1 -e CI_ARGS="%CI_ARGS%" -e GIT_CONFIG_GLOBAL="C:/ci/.gitconfig" -v "C:\ci_workspace":"C:\ci" ros2_windows_ci

But then

C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\MSBuild\Microsoft\VC\v170\Microsoft.CppCommon.targets(254,5): error MSB4018: The "CustomBuild" task failed unexpectedly. [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor-prefix\src\zenoh_c_vendor-build\cargo.vcxproj] [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor.vcxproj]
C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\MSBuild\Microsoft\VC\v170\Microsoft.CppCommon.targets(254,5): error MSB4018: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown. [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor-prefix\src\zenoh_c_vendor-build\cargo.vcxproj] [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor.vcxproj]
C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\MSBuild\Microsoft\VC\v170\Microsoft.CppCommon.targets(254,5): error MSB4018: at Go5(RegexRunner ) [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor-prefix\src\zenoh_c_vendor-build\cargo.vcxproj] [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor.vcxproj]
C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\MSBuild\Microsoft\VC\v170\Microsoft.CppCommon.targets(254,5): error MSB4018: at System.Text.RegularExpressions.RegexRunner.Scan(Regex regex, String text, Int32 textbeg, Int32 textend, Int32 textstart, Int32 prevlen, Boolean quick, TimeSpan timeout) [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor-prefix\src\zenoh_c_vendor-build\cargo.vcxproj] [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor.vcxproj]
C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\MSBuild\Microsoft\VC\v170\Microsoft.CppCommon.targets(254,5): error MSB4018: at System.Text.RegularExpressions.Regex.Run(Boolean quick, Int32 prevlen, String input, Int32 beginning, Int32 length, Int32 startat) [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor-prefix\src\zenoh_c_vendor-build\cargo.vcxproj] [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor.vcxproj]
C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\MSBuild\Microsoft\VC\v170\Microsoft.CppCommon.targets(254,5): error MSB4018: at System.Text.RegularExpressions.Regex.Match(String input, Int32 startat) [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor-prefix\src\zenoh_c_vendor-build\cargo.vcxproj] [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor.vcxproj]
C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\MSBuild\Microsoft\VC\v170\Microsoft.CppCommon.targets(254,5): error MSB4018: at Microsoft.Build.Shared.CanonicalError.Parse(String message) [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor-prefix\src\zenoh_c_vendor-build\cargo.vcxproj] [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor.vcxproj]
C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\MSBuild\Microsoft\VC\v170\Microsoft.CppCommon.targets(254,5): error MSB4018: at Microsoft.Build.Utilities.TaskLoggingHelper.LogMessageFromText(String lineOfText, MessageImportance messageImportance) [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor-prefix\src\zenoh_c_vendor-build\cargo.vcxproj] [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor.vcxproj]
C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\MSBuild\Microsoft\VC\v170\Microsoft.CppCommon.targets(254,5): error MSB4018: at Microsoft.Build.CPPTasks.VCToolTask.LogEventsFromTextOutput(String singleLine, MessageImportance messageImportance) [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor-prefix\src\zenoh_c_vendor-build\cargo.vcxproj] [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor.vcxproj]
C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\MSBuild\Microsoft\VC\v170\Microsoft.CppCommon.targets(254,5): error MSB4018: at Microsoft.Build.Utilities.ToolTask.LogMessagesFromStandardErrorOrOutput(Queue dataQueue, ManualResetEvent dataAvailableSignal, MessageImportance messageImportance, StandardOutputOrErrorQueueType queueType) [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor-prefix\src\zenoh_c_vendor-build\cargo.vcxproj] [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor.vcxproj]
C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\MSBuild\Microsoft\VC\v170\Microsoft.CppCommon.targets(254,5): error MSB4018: at Microsoft.Build.Utilities.ToolTask.HandleToolNotifications(Process proc) [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor-prefix\src\zenoh_c_vendor-build\cargo.vcxproj] [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor.vcxproj]
C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\MSBuild\Microsoft\VC\v170\Microsoft.CppCommon.targets(254,5): error MSB4018: at Microsoft.Build.Utilities.ToolTask.ExecuteTool(String pathToTool, String responseFileCommands, String commandLineCommands) [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor-prefix\src\zenoh_c_vendor-build\cargo.vcxproj] [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor.vcxproj]
C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\MSBuild\Microsoft\VC\v170\Microsoft.CppCommon.targets(254,5): error MSB4018: at Microsoft.Build.CPPTasks.TrackedVCToolTask.TrackerExecuteTool(String pathToTool, String responseFileCommands, String commandLineCommands) [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor-prefix\src\zenoh_c_vendor-build\cargo.vcxproj] [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor.vcxproj]
C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\MSBuild\Microsoft\VC\v170\Microsoft.CppCommon.targets(254,5): error MSB4018: at Microsoft.Build.CPPTasks.CustomBuild.ExecuteTool(String pathToTool, String responseFileCommands, String commandLineCommands) [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor-prefix\src\zenoh_c_vendor-build\cargo.vcxproj] [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor.vcxproj]
C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\MSBuild\Microsoft\VC\v170\Microsoft.CppCommon.targets(254,5): error MSB4018: at Microsoft.Build.Utilities.ToolTask.Execute() [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor-prefix\src\zenoh_c_vendor-build\cargo.vcxproj] [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor.vcxproj]
C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\MSBuild\Microsoft\VC\v170\Microsoft.CppCommon.targets(254,5): error MSB4018: at Microsoft.Build.CPPTasks.VCToolTask.Execute() [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor-prefix\src\zenoh_c_vendor-build\cargo.vcxproj] [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor.vcxproj]
C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\MSBuild\Microsoft\VC\v170\Microsoft.CppCommon.targets(254,5): error MSB4018: at Microsoft.Build.CPPTasks.TrackedVCToolTask.Execute() [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor-prefix\src\zenoh_c_vendor-build\cargo.vcxproj] [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor.vcxproj]
C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\MSBuild\Microsoft\VC\v170\Microsoft.CppCommon.targets(254,5): error MSB4018: at Microsoft.Build.BackEnd.TaskExecutionHost.Execute() [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor-prefix\src\zenoh_c_vendor-build\cargo.vcxproj] [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor.vcxproj]
C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\MSBuild\Microsoft\VC\v170\Microsoft.CppCommon.targets(254,5): error MSB4018: at Microsoft.Build.BackEnd.TaskBuilder.<ExecuteInstantiatedTask>d__26.MoveNext() [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor-prefix\src\zenoh_c_vendor-build\cargo.vcxproj] [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor.vcxproj]
C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\MSBuild\Microsoft\VC\v170\Microsoft.CppCommon.targets(254,5): error MSB8066: Custom build for 'C:\ci\ws\build\zenoh_cpp_vendor\CMakeFiles\ee477f97a1df703e7083751a0a972999\zenoh_c_vendor-mkdir.rule;C:\ci\ws\build\zenoh_cpp_vendor\CMakeFiles\ee477f97a1df703e7083751a0a972999\zenoh_c_vendor-download.rule;C:\ci\ws\build\zenoh_cpp_vendor\CMakeFiles\ee477f97a1df703e7083751a0a972999\zenoh_c_vendor-update_disconnected.rule;C:\ci\ws\build\zenoh_cpp_vendor\CMakeFiles\ee477f97a1df703e7083751a0a972999\zenoh_c_vendor-patch_disconnected.rule;C:\ci\ws\build\zenoh_cpp_vendor\CMakeFiles\ee477f97a1df703e7083751a0a972999\zenoh_c_vendor-configure.rule;C:\ci\ws\build\zenoh_cpp_vendor\CMakeFiles\ee477f97a1df703e7083751a0a972999\zenoh_c_vendor-build.rule;C:\ci\ws\build\zenoh_cpp_vendor\CMakeFiles\ee477f97a1df703e7083751a0a972999\zenoh_c_vendor-install.rule;C:\ci\ws\build\zenoh_cpp_vendor\CMakeFiles\0b5e054a4a77a0a611fa281698dd5557\zenoh_c_vendor-complete.rule;C:\ci\ws\build\zenoh_cpp_vendor\CMakeFiles\d7f8a2363a5f4b4b19e8e8098fbdd1ea\zenoh_c_vendor.rule;C:\ci\ws\src\ros2\rmw_zenoh\zenoh_cpp_vendor\CMakeLists.txt' exited with code 1. [C:\ci\ws\build\zenoh_cpp_vendor\zenoh_c_vendor.vcxproj]
---
Failed   <<< zenoh_cpp_vendor [25min 7s, exited with code 1]
Aborted  <<< fastdds [25min 26s]

Summary: 103 packages finished [57min 11s]
  1 package failed: zenoh_cpp_vendor
  1 package aborted: fastdds
  261 packages not processed
<== 'env.bat C:\pixi_ws\.pixi\envs\default\Scripts\colcon.EXE build --base-paths "src" --build-base "build" --install-base "install" --merge-install --event-handlers console_cohesion+ console_package_list+ --cmake-args -DBUILD_TESTING=ON --no-warn-unused-cli -DCMAKE_BUILD_TYPE=Release -DINSTALL_EXAMPLES=OFF -DSECURITY=ON -DAPPEND_PROJECT_NAME_TO_INCLUDEDIR=ON' exited with return code '1'

Seems like a memory thing but I still have over 50 Gb left on this disk. not much but must be enough or not?