[v2,0/8] Enable build system on macOS hosts

Message

Daniel Gomez via B4 Relay Sept. 6, 2024, 11:01 a.m. UTC

This patch set allows for building the Linux kernel for arm64 in macOS
with LLVM.

Patches are based on previous Nick's work and suggestions [1][2][3] to
enable the Linux kernel build system on macOS hosts.

macOS does not provide certain headers that are available in a GNU/Linux
distribution with development headers installed, usually provided by
the GNU C Library (glibc) and/or other projects. These missing headers
are needed as build dependencies. To address this, the patches depend
on a new Bee Headers Homebrew Tap formula [6][7][8] that provides them
together with a pkg-config file to locate the include directory.

To locate them, Makefiles include something like:
	$(shell $(HOSTPKG_CONFIG) --cflags bee-headers 2> /dev/null)

[6] Project:
https://github.com/bee-headers
[7] Headers repository:
https://github.com/bee-headers/headers.git
[8] Homebrew Tap formula:
https://github.com/bee-headers/homebrew-bee-headers.git

To set up the environment, documentation is provided via last patch in
this series.

More configurations and architectures as well as support for Rust
(from Finn Behrens [4] [5]) can be added in the future to extend build
support.

[1]: WIP: build Linux on MacOS
https://github.com/ClangBuiltLinux/linux/commit/f06333e29addbc3d714adb340355f471c1dfe95a

[2] Subject: [PATCH] scripts: subarch.include: fix SUBARCH on MacOS hosts
https://lore.kernel.org/all/[e-mail]/

[3] Subject: Any interest in building the Linux kernel from a MacOS host?
https://lore.kernel.org/all/CAH7mPvj64Scp6_Nbaj8KOfkoV5f7_N5L=[e-mail]/

[4] https://github.com/kloenk/linux/commits/rust-project_macos-dylib/

[5] https://kloenk.eu/posts/build-linux-on-m1-macos/

To: Masahiro Yamada <[e-mail]>
To: Nathan Chancellor <[e-mail]>
To: Nicolas Schier <[e-mail]>
To: Lucas De Marchi <[e-mail]>
To: Thomas Hellström <[e-mail]>
To: Rodrigo Vivi <[e-mail]>
To: Maarten Lankhorst <[e-mail]>
To: Maxime Ripard <[e-mail]>
To: Thomas Zimmermann <[e-mail]>
To: David Airlie <[e-mail]>
To: Daniel Vetter <[e-mail]>
To: William Hubbs <[e-mail]>
To: Chris Brannon <[e-mail]>
To: Kirk Reiser <[e-mail]>
To: Samuel Thibault <[e-mail]>
To: Paul Moore <[e-mail]>
To: Stephen Smalley <[e-mail]>
To: Ondrej Mosnacek <[e-mail]>
To: Catalin Marinas <[e-mail]>
To: Will Deacon <[e-mail]>
To: Marc Zyngier <[e-mail]>
To: Oliver Upton <[e-mail]>
To: James Morse <[e-mail]>
To: Suzuki K Poulose <[e-mail]>
To: Zenghui Yu <[e-mail]>
To: Greg Kroah-Hartman <[e-mail]>
To: Jiri Slaby <[e-mail]>
To: Nick Desaulniers <[e-mail]>
To: Bill Wendling <[e-mail]>
To: Justin Stitt <[e-mail]>
Cc: [e-mail]
Cc: [e-mail]
Cc: [e-mail]
Cc: [e-mail]
Cc: [e-mail]
Cc: [e-mail]
Cc: [e-mail]
Cc: [e-mail]
Cc: [e-mail]
Cc: [e-mail]
Cc: Finn Behrens <[e-mail]>
Cc: Daniel Gomez (Samsung) <[e-mail]>
Cc: [e-mail]

Signed-off-by: Daniel Gomez <[e-mail]>
---
Changes in v2:
- Add documentation and set this 'feature' as experimental.
- Update cover letter.
- Drop unnecessary changes. Patches removed:
	- kbuild: add header_install dependency to scripts
	- include: add endian.h support
	- include: add elf.h support
- Update Makefiles to find Bee Headers with pkg-config.
- Update file2alias to solve uuid_t conflicts inside Makefile as
suggested by Nicolas Schier.
- Adapt xe_gen_wa_oob to solve getprogname()/
program_invocation_short_name in runtime. as suggested by Lucas De
Marchi.
- Remove linux/version.h in accessibility/speakup as suggested by
Masahiro Yamada.
- Replace selinux patches with new Masahiro Yamada's patches:
	Message-id: [e-mail]
	Link: https://lore.kernel.org/all/[e-mail]/
- Replace tty/vt with new Masahiro Yamada's patch:
	Message-id: [e-mail]
	Link: https://lore.kernel.org/all/[e-mail]/
	(Already merged in the linux-next tag used)
- Replace scripts/kallsyms patch with Masahiro Yamada's patch:
	Message-id: [e-mail]
	Link: https://lore.kernel.org/all/[e-mail]/
	(Already merged in the linux-next tag used)
- Link to v1: https://lore.kernel.org/r/[e-mail]

---
Daniel Gomez (5):
      file2alias: fix uuid_t definitions for macos
      drm/xe: xe_gen_wa_oob: fix program_invocation_short_name for macos
      arm64: nvhe: add bee-headers support
      scripts: add bee-headers support
      Documentation: add howto build in macos

Masahiro Yamada (2):
      selinux: do not include <linux/*.h> headers from host programs
      selinux: move genheaders to security/selinux/

Nick Desaulniers (1):
      scripts: subarch.include: fix SUBARCH on macOS hosts

 Documentation/kbuild/llvm.rst                      | 78 ++++++++++++++++++++++
 arch/arm64/kernel/pi/Makefile                      |  1 +
 arch/arm64/kernel/vdso32/Makefile                  |  1 +
 arch/arm64/kvm/hyp/nvhe/Makefile                   |  3 +-
 drivers/gpu/drm/xe/xe_gen_wa_oob.c                 |  4 ++
 scripts/Makefile                                   |  4 +-
 scripts/mod/Makefile                               |  7 ++
 scripts/mod/file2alias.c                           |  3 +
 scripts/remove-stale-files                         |  3 +
 scripts/selinux/Makefile                           |  2 +-
 scripts/selinux/genheaders/.gitignore              |  2 -
 scripts/selinux/genheaders/Makefile                |  5 --
 scripts/selinux/mdp/Makefile                       |  2 +-
 scripts/selinux/mdp/mdp.c                          |  4 --
 scripts/subarch.include                            |  2 +-
 security/selinux/.gitignore                        |  1 +
 security/selinux/Makefile                          |  7 +-
 .../genheaders => security/selinux}/genheaders.c   |  3 -
 security/selinux/include/classmap.h                | 19 ++++--
 security/selinux/include/initial_sid_to_string.h   |  2 -
 20 files changed, 123 insertions(+), 30 deletions(-)
---
base-commit: ad40aff1edffeccc412cde93894196dca7bc739e
change-id: 20240807-macos-build-support-9ca0d77adb17

Best regards,

Comments

Jeff Xie Sept. 12, 2024, 12:02 p.m. UTC | #1

Thank you for submitting this patchset. This problem has troubled me
for two years.
I have always built the kernel in the docker container. I have tested
this patchset and it is very good.
Tested-by: Jeff Xie <[e-mail]>

On Fri, Sep 6, 2024 at 7:04 PM Daniel Gomez via B4 Relay
<[e-mail]> wrote:
>
> This patch set allows for building the Linux kernel for arm64 in macOS
> with LLVM.
>
> Patches are based on previous Nick's work and suggestions [1][2][3] to
> enable the Linux kernel build system on macOS hosts.
>
> macOS does not provide certain headers that are available in a GNU/Linux
> distribution with development headers installed, usually provided by
> the GNU C Library (glibc) and/or other projects. These missing headers
> are needed as build dependencies. To address this, the patches depend
> on a new Bee Headers Homebrew Tap formula [6][7][8] that provides them
> together with a pkg-config file to locate the include directory.
>
> To locate them, Makefiles include something like:
>         $(shell $(HOSTPKG_CONFIG) --cflags bee-headers 2> /dev/null)
>
> [6] Project:
> https://github.com/bee-headers
> [7] Headers repository:
> https://github.com/bee-headers/headers.git
> [8] Homebrew Tap formula:
> https://github.com/bee-headers/homebrew-bee-headers.git
>
> To set up the environment, documentation is provided via last patch in
> this series.
>
> More configurations and architectures as well as support for Rust
> (from Finn Behrens [4] [5]) can be added in the future to extend build
> support.
>
> [1]: WIP: build Linux on MacOS
> https://github.com/ClangBuiltLinux/linux/commit/f06333e29addbc3d714adb340355f471c1dfe95a
>
> [2] Subject: [PATCH] scripts: subarch.include: fix SUBARCH on MacOS hosts
> https://lore.kernel.org/all/[e-mail]/
>
> [3] Subject: Any interest in building the Linux kernel from a MacOS host?
> https://lore.kernel.org/all/CAH7mPvj64Scp6_Nbaj8KOfkoV5f7_N5L=[e-mail]/
>
> [4] https://github.com/kloenk/linux/commits/rust-project_macos-dylib/
>
> [5] https://kloenk.eu/posts/build-linux-on-m1-macos/
>
> To: Masahiro Yamada <[e-mail]>
> To: Nathan Chancellor <[e-mail]>
> To: Nicolas Schier <[e-mail]>
> To: Lucas De Marchi <[e-mail]>
> To: Thomas Hellström <[e-mail]>
> To: Rodrigo Vivi <[e-mail]>
> To: Maarten Lankhorst <[e-mail]>
> To: Maxime Ripard <[e-mail]>
> To: Thomas Zimmermann <[e-mail]>
> To: David Airlie <[e-mail]>
> To: Daniel Vetter <[e-mail]>
> To: William Hubbs <[e-mail]>
> To: Chris Brannon <[e-mail]>
> To: Kirk Reiser <[e-mail]>
> To: Samuel Thibault <[e-mail]>
> To: Paul Moore <[e-mail]>
> To: Stephen Smalley <[e-mail]>
> To: Ondrej Mosnacek <[e-mail]>
> To: Catalin Marinas <[e-mail]>
> To: Will Deacon <[e-mail]>
> To: Marc Zyngier <[e-mail]>
> To: Oliver Upton <[e-mail]>
> To: James Morse <[e-mail]>
> To: Suzuki K Poulose <[e-mail]>
> To: Zenghui Yu <[e-mail]>
> To: Greg Kroah-Hartman <[e-mail]>
> To: Jiri Slaby <[e-mail]>
> To: Nick Desaulniers <[e-mail]>
> To: Bill Wendling <[e-mail]>
> To: Justin Stitt <[e-mail]>
> Cc: [e-mail]
> Cc: [e-mail]
> Cc: [e-mail]
> Cc: [e-mail]
> Cc: [e-mail]
> Cc: [e-mail]
> Cc: [e-mail]
> Cc: [e-mail]
> Cc: [e-mail]
> Cc: [e-mail]
> Cc: Finn Behrens <[e-mail]>
> Cc: Daniel Gomez (Samsung) <[e-mail]>
> Cc: [e-mail]
>
> Signed-off-by: Daniel Gomez <[e-mail]>
> ---
> Changes in v2:
> - Add documentation and set this 'feature' as experimental.
> - Update cover letter.
> - Drop unnecessary changes. Patches removed:
>         - kbuild: add header_install dependency to scripts
>         - include: add endian.h support
>         - include: add elf.h support
> - Update Makefiles to find Bee Headers with pkg-config.
> - Update file2alias to solve uuid_t conflicts inside Makefile as
> suggested by Nicolas Schier.
> - Adapt xe_gen_wa_oob to solve getprogname()/
> program_invocation_short_name in runtime. as suggested by Lucas De
> Marchi.
> - Remove linux/version.h in accessibility/speakup as suggested by
> Masahiro Yamada.
> - Replace selinux patches with new Masahiro Yamada's patches:
>         Message-id: [e-mail]
>         Link: https://lore.kernel.org/all/[e-mail]/
> - Replace tty/vt with new Masahiro Yamada's patch:
>         Message-id: [e-mail]
>         Link: https://lore.kernel.org/all/[e-mail]/
>         (Already merged in the linux-next tag used)
> - Replace scripts/kallsyms patch with Masahiro Yamada's patch:
>         Message-id: [e-mail]
>         Link: https://lore.kernel.org/all/[e-mail]/
>         (Already merged in the linux-next tag used)
> - Link to v1: https://lore.kernel.org/r/[e-mail]
>
> ---
> Daniel Gomez (5):
>       file2alias: fix uuid_t definitions for macos
>       drm/xe: xe_gen_wa_oob: fix program_invocation_short_name for macos
>       arm64: nvhe: add bee-headers support
>       scripts: add bee-headers support
>       Documentation: add howto build in macos
>
> Masahiro Yamada (2):
>       selinux: do not include <linux/*.h> headers from host programs
>       selinux: move genheaders to security/selinux/
>
> Nick Desaulniers (1):
>       scripts: subarch.include: fix SUBARCH on macOS hosts
>
>  Documentation/kbuild/llvm.rst                      | 78 ++++++++++++++++++++++
>  arch/arm64/kernel/pi/Makefile                      |  1 +
>  arch/arm64/kernel/vdso32/Makefile                  |  1 +
>  arch/arm64/kvm/hyp/nvhe/Makefile                   |  3 +-
>  drivers/gpu/drm/xe/xe_gen_wa_oob.c                 |  4 ++
>  scripts/Makefile                                   |  4 +-
>  scripts/mod/Makefile                               |  7 ++
>  scripts/mod/file2alias.c                           |  3 +
>  scripts/remove-stale-files                         |  3 +
>  scripts/selinux/Makefile                           |  2 +-
>  scripts/selinux/genheaders/.gitignore              |  2 -
>  scripts/selinux/genheaders/Makefile                |  5 --
>  scripts/selinux/mdp/Makefile                       |  2 +-
>  scripts/selinux/mdp/mdp.c                          |  4 --
>  scripts/subarch.include                            |  2 +-
>  security/selinux/.gitignore                        |  1 +
>  security/selinux/Makefile                          |  7 +-
>  .../genheaders => security/selinux}/genheaders.c   |  3 -
>  security/selinux/include/classmap.h                | 19 ++++--
>  security/selinux/include/initial_sid_to_string.h   |  2 -
>  20 files changed, 123 insertions(+), 30 deletions(-)
> ---
> base-commit: ad40aff1edffeccc412cde93894196dca7bc739e
> change-id: 20240807-macos-build-support-9ca0d77adb17
>
> Best regards,
> --
> Daniel Gomez <[e-mail]>
>
>
>