diff options
| -rw-r--r-- | meta-uhmi/README.md | 101 | ||||
| -rw-r--r-- | meta-uhmi/meta-distributed-display-fw/README.md | 236 | ||||
| -rw-r--r-- | meta-uhmi/meta-distributed-display-fw/conf/layer.conf | 12 | ||||
| -rw-r--r-- | meta-uhmi/meta-distributed-display-fw/recipes-core/ucl-tools/files/ucl-launcher.service | 13 | ||||
| -rw-r--r-- | meta-uhmi/meta-distributed-display-fw/recipes-core/ucl-tools/ucl-tools_git.bb | 46 | ||||
| -rw-r--r-- | meta-uhmi/meta-distributed-display-fw/recipes-core/ula-tools/files/ula-node.service | 15 | ||||
| -rw-r--r-- | meta-uhmi/meta-distributed-display-fw/recipes-core/ula-tools/files/virtual-screen-def.json | 25 | ||||
| -rw-r--r-- | meta-uhmi/meta-distributed-display-fw/recipes-core/ula-tools/ula-tools_git.bb | 72 | ||||
| -rw-r--r-- | meta-uhmi/meta-distributed-display-fw/recipes-platform/packagegroups/packagegroup-distributed-display-fw.bb | 9 | ||||
| -rw-r--r-- | meta-uhmi/meta-rvgpu/README.md | 99 | ||||
| -rw-r--r-- | templates/feature/agl-uhmi/50_bblayers.conf.inc (renamed from templates/feature/agl-rvgpu/50_bblayers.conf.inc) | 1 |
11 files changed, 536 insertions, 93 deletions
diff --git a/meta-uhmi/README.md b/meta-uhmi/README.md index d9a3ee04..8f824724 100644 --- a/meta-uhmi/README.md +++ b/meta-uhmi/README.md @@ -1,7 +1,100 @@ ## Unified HMI support layer (meta-uhmi) "Unified HMI" is a common platform technology for UX innovation in integrated cockpit by flexible information display on multiple displays of various applications. Applications can be rendered to any display via a unified virtual display. -## Remote Virtio GPU Device support layer(meta-rvgpu) -The RVGPU rendering engine, operating on a client-server model, creates 3D rendering commands on a client device and transmits them to a server device via the network, where the server-side device performs GPU-based rendering and displays the results. For build instructions and testing methods, Refer to the README.md file in the meta-rvgpu directory. -RVGPU is OSS. For more details, visit the following URL: -https://github.com/unified-hmi/remote-virtio-gpu +Unified HMI consists of two main components. + +* Remote Virtio GPU Device(RVGPU): Render applications remotely in different SoCs/VMs. +* Distributed Display Framework: Flexible layout control of applications across multiple displays. + +The meta-uhmi currently supports x86, Raspberry Pi4, and Renesas Boards platforms. +There are two layers under meta-uhmi to support these two frameworks. + +## RVGPU support layer(meta-rvgpu) +RVGPU rendering engine, operating on a client-server model, creates 3D rendering commands on a client device and transmits them to a server device via the network, where the server-side device performs GPU-based rendering and displays the results. + +The meta-rvgpu currently supports `agl-image-weston`, `agl-ivi-demo-qt`, `agl-ivi-demo-flutter` as build images. + +RVGPU is OSS. For more details, visit the following URL: [Unified HMI - Remote Virtio GPU](https://github.com/unified-hmi/remote-virtio-gpu) + +## Distributed Display Framework support layer(meta-distributed-display-fw) +Distributed Display Framework is an open-source software layer that provides essential services for managing distributed display applications. This framework is designed to work with a variety of hardware and software configurations, making it a versatile choice for developers looking to create scalable and robust display solutions. + +Now, the meta-distributed-display-fw only supports build images that run on weston and for which the wayland-ivi-extension is available like `agl-image-weston`. + +Distributed Display Framework consists of three main components. + +* [ucl-tools](https://github.com/unified-hmi/ucl-tools): Unified Clustering Tools (UCL), launch applications for multiple platforms and manage execution order and survival. + +* [ula-tools](https://github.com/unified-hmi/ula-tools): Unified Layout Tools (ULA), application layout for virtual displays on virtual screen (mapped from physical displays). + +* [uhmi-ivi-wm](https://github.com/unified-hmi/uhmi-ivi-wm): apply ivi-layer and ivi-surface layouts to the screen using the layout design output by ula-tools. + +For more details about these frameworks, please visit our GitHub repository at the attached URL. + +## How to build +Follow the [AGL documentation](https://docs.automotivelinux.org/en/master/#01_Getting_Started/02_Building_AGL_Image/01_Build_Process_Overview/) for the build process, and set up the "[Initializing Your Build Environment](https://docs.automotivelinux.org/en/master/#01_Getting_Started/02_Building_AGL_Image/04_Initializing_Your_Build_Environment/)" section as described below to enable the AGL feature 'agl-uhmi'. For example: +``` +$ cd $AGL_TOP/master +$ source ./meta-agl/scripts/aglsetup.sh -m qemux86-64 -b qemux86-64 agl-demo agl-devel agl-uhmi +``` +After adding the feature, execute the command: +``` +$ bitbake <image_name> +``` +Replace the `<image_name>` with the appropriate values you want. We have confirmed the operation with the **agl-image-weston**. + +## How to setup and boot +For Environment setup instructions for each platform, refer to the following link in the AGL Documentation. +[Building for x86(Emulation and Hardware)](https://docs.automotivelinux.org/en/master/#01_Getting_Started/02_Building_AGL_Image/07_Building_for_x86_%28Emulation_and_Hardware%29/) +[Building for Raspberry Pi 4](https://docs.automotivelinux.org/en/master/#01_Getting_Started/02_Building_AGL_Image/08_Building_for_Raspberry_Pi_4/) +[Building for Supported Renesas Boards](https://docs.automotivelinux.org/en/master/#01_Getting_Started/02_Building_AGL_Image/09_Building_for_Supported_Renesas_Boards/) + +For Raspberry Pi 4 and Supported Renesas Boards, refer to the above URL for boot methods. +For x86 emulation (qemu), network bridge is required to enable communication with other devices when using RVGPU. Here’s an example procedure for your reference. +``` +$ sudo ip link add <bridge_name> type bridge +$ sudo ip addr add <IP address> dev <bridge_name> +$ sudo ip link set dev <interface> master <bridge_name> +$ sudo ip link set dev <bridge_name> up +``` +Replace the placeholders with the appropriate values: +- `<bridge_name>`: You can assign any name, for example: `br0` +- `<IP_address>`: Enter an available IP address, for example: `192.168.0.100/24` +- `<interface>`: Specify the network interface, for example: `eth0` + +To enable the use of the bridge, create or append /etc/qemu directory and /etc/qemu/bridge.conf file. +``` +allow <bridge_name> +``` +Make sure /etc/qemu/ has 755 permissions. +Create the following bash file named **run_qemu_bridge.sh** in any `<WORKDIR>`. +``` +#!/bin/bash + +KERNEL_PATH=$1 +DRIVE_PATH=$2 +BRIDGE_NAME="<bridge_name>" + +printf -v macaddr "52:54:%02x:%02x:%02x:%02x" $(( $RANDOM & 0xff)) $(( $RANDOM & 0xff )) $(( $RANDOM & 0xff)) $(( $RANDOM & 0xff )) + +qemu-system-x86_64 -enable-kvm -m 2048 \ + -kernel ${KERNEL_PATH} \ + -drive file=${DRIVE_PATH},if=virtio,format=raw \ + -cpu kvm64 -cpu qemu64,+ssse3,+sse4.1,+sse4.2,+popcnt \ + -vga virtio -show-cursor \ + -device virtio-net-pci,netdev=net0,mac=$macaddr \ + -netdev bridge,br=$BRIDGE_NAME,id=net0 \ + -serial mon:stdio -serial null \ + -soundhw hda \ + -append 'root=/dev/vda swiotlb=65536 rw console=ttyS0,115200n8 fstab=no' +``` +Save the file and run the following to start QEMU. +``` +sudo <WORKDIR>/run_qemu_bridge.sh <build_directory>/tmp/deploy/images/qemux86-64/bzImage <build_directory>/tmp/deploy/images/qemux86-64/agl-image-weston-qemux86-64.rootfs.ext4 +``` +When QEMU boot, you can log in to qemu on the terminal where you executed above command, so please assign an IP address there. + +For example: +``` +ifconfig <your environment> 192.168.0.100 netmask 255.255.255.0 +``` diff --git a/meta-uhmi/meta-distributed-display-fw/README.md b/meta-uhmi/meta-distributed-display-fw/README.md new file mode 100644 index 00000000..907d6275 --- /dev/null +++ b/meta-uhmi/meta-distributed-display-fw/README.md @@ -0,0 +1,236 @@ +## How to set up Distributed Display Framework + +To utilize the Distributed Display Framework, you need to set up each image with a distinct hostname and static IP address, and ensure that ivi-shell is running using the wayland-ivi-extension. Please note that the following configurations are examples and should be adapted to fit your specific network environment. + +### Run weston with ivi-shell + +Before setting unique hostnames and configuring static IP addresses, it is essential to start Weston with ivi-shell since the Distributed Display Framework controls the layout of applications using ivi-shell. To initialize ivi-shell, follow these steps: + +``` +ln -sf /etc/xdg/weston/weston_ivi-shell.ini /etc/xdg/weston/weston.ini +systemctl restart weston +``` + +Now that ivi-shell is properly initialized, you can proceed to set unique hostnames for your images. + +### Set Unique Hostnames + +Edit the `/etc/hostname` file on each image to set a unique hostname. Here are the suggested hostnames for the first two images: + +- **For the first image:** +``` +echo "agl-host0" | tee /etc/hostname +``` +- **For the second image:** +``` +echo "agl-host1" | tee /etc/hostname +``` + +### Assign Static IP Addresses + +Configure a static IP address for each image by editing the `/etc/systemd/network/wired.network` file. If this file does not exist, please create a new one. Use the following template and replace `<IP_address>` and `<Netmask>` with your network's specific settings: + +```ini +[Match] +KernelCommandLine=!root=/dev/nfs +Name=eth* en* + +[Network] +Address=<IP_address>/<Netmask> +``` + +Here is how you might configure the static IP addresses for the first two images: + +- **For the first image:** +``` +[Match] +KernelCommandLine=!root=/dev/nfs +Name=eth* en* + +[Network] +Address=192.168.0.100/24 +``` +- **For the second image:** +``` +[Match] +KernelCommandLine=!root=/dev/nfs +Name=eth* en* + +[Network] +Address=192.168.0.101/24 +``` + +Once the hostname and IP addresses settings are complete, please reboot to reflect these settings. + +### Customizing Virtual Screen Definitions + +Adjust the `/etc/uhmi-framework/virtual-screen-def.json` file to match your environment. In the folowing example, we assume an environment where two images, agl-host0 and agl-host1, each have a display output with a resolusion of 1920x1080(FullHD), arranged in order from left to right as agl-host0 and then agl-host1: + +``` +{ + "virtual_screen_2d": { + "size": {"virtual_w": 3840, "virtual_h": 1080}, + "virtual_displays": [ + {"vdisplay_id": 0, "disp_name": "AGL_SCREEN0", "virtual_x": 0, "virtual_y": 0, "virtual_w": 1920, "virtual_h": 1080}, + {"vdisplay_id": 1, "disp_name": "AGL_SCREEN1", "virtual_x": 1920, "virtual_y": 0, "virtual_w": 1920, "virtual_h": 1080} + ] + }, + "virtual_screen_3d": {}, + "real_displays": [ + {"node_id": 0, "vdisplay_id": 0, "pixel_w": 1920, "pixel_h": 1080, "rdisplay_id": 0}, + {"node_id": 1, "vdisplay_id": 1, "pixel_w": 1920, "pixel_h": 1080, "rdisplay_id": 1} + ], + "node": [ + {"node_id": 0, "hostname": "agl-host0", "ip": "192.168.0.100"}, + {"node_id": 1, "hostname": "agl-host1", "ip": "192.168.0.101"} + ], + "distributed_window_system": { + "window_manager": {}, + "framework_node": [ + {"node_id": 0, "ula": {"debug": false, "debug_port": 8080, "port": 10100}, "ucl": {"port": 7654}}, + {"node_id": 1, "ula": {"debug": false, "debug_port": 8080, "port": 10100}, "ucl": {"port": 7654}} + ] + } +} +``` + +Be sure to update the virtual_w, virtual_h, virtual_x, virtual_y, pixel_w, pixel_h, hostname, and ip fields to accurately reflect your specific network configuration. + +### Restarting Services +Once you have prepared the virtual-screen-def.json file and configured the system, you need to restart the system or the following services for the changes to take effect: +``` +systemctl restart uhmi-ivi-wm +systemctl restart ula-node +systemctl restart ucl-launcher +``` + +After restarting these services, your system should be ready to use the Distributed Display Framework with the new configuration. + +## How to use UCL (Unified Clustering) Framework + +The Unified Clustering (UCL) Framework provides a distributed launch feature for applications using remote virtio GPU (rvgpu). By preparing a JSON configuration, you can enable the launch of applications across multiple devices in a distributed environment. + +### Setting Up for Application Launch using UCL + +To facilitate the distributed launch of an application with UCL, you need to create a JSON configuration file that specifies the details of the application and how it should be executed on the sender and receiver nodes. Here's an example of such a JSON configuration named `app.json`: +``` +{ + "format_v1": { + "command_type" : "remote_virtio_gpu", + "appli_name" : "glmark2-es2-wayland", + "sender" : { + "launcher" : "agl-host0", + "command" : "/usr/bin/ucl-virtio-gpu-wl-send", + "frontend_params" : { + "scanout_x" : 0, + "scanout_y" : 0, + "scanout_w" : 1920, + "scanout_h" : 1080, + "server_port" : 33445 + }, + "appli" : "/usr/bin/glmark2-es2-wayland -s 1920x1080", + "env" : "LD_LIBRARY_PATH=/usr/lib/mesa-virtio" + }, + "receivers" : [ + { + "launcher" : "agl-host0", + "command" : "/usr/bin/ucl-virtio-gpu-wl-recv", + "backend_params" : { + "ivi_surface_id" : 101000, + "scanout_x" : 0, + "scanout_y" : 0, + "scanout_w" : 1920, + "scanout_h" : 1080, + "listen_port" : 33445, + "initial_screen_color" : "0x33333333" + }, + "env" : "XDG_RUNTIME_DIR=/run/user/200 WAYLAND_DISPLAY=wayland-1" + }, + { + "launcher" : "agl-host1", + "command" : "/usr/bin/ucl-virtio-gpu-wl-recv", + "backend_params" : { + "ivi_surface_id" : 101000, + "scanout_x" : 0, + "scanout_y" : 0, + "scanout_w" : 1920, + "scanout_h" : 1080, + "listen_port" : 33445, + "initial_screen_color" : "0x33333333" + }, + "env" : "XDG_RUNTIME_DIR=/run/user/200 WAYLAND_DISPLAY=wayland-1" + } + ] + } +} +``` + +In this example, the application glmark2-es2-wayland is configured to launch on the sender node `agl-host0` and display its output on the receiver nodes `agl-host0` and `agl-host1`. The `scanout_x`, `scanout_y`, `scanout_w`, `scanout_h` parameters define the size of the window, while `server_port` and `listen_port` ensure the communication between sender and receivers. + +### Launching the Application + +Once the JSON configuration file is ready, you can execute the application across the distributed system by piping the JSON content to the `ucl-distrib-com` command along with the path to the `virtual-screen-def.json` file: + +``` +cat app.json | ucl-distrib-com /etc/uhmi-framework/virtual-screen-def.json +``` + +This command will read the configuration and initiate the application launch process, distributing the workload as defined in the JSON file. + + +Please ensure that the JSON configuration file you create (`app.json` in the example) is correctly formatted and contains the appropriate parameters for your specific use case. + +**Note**: Please be aware that when using ivi-shell, applications will not be displayed unless layout configuration is specified as described later in this document. If you wish to display applications without specific layout configuration, you should run weston with desktop-shell. This distinction is crucial to ensure that your applications are visible in your chosen environment. + +## How to use ULA (Unified Layout) Framework + +The Unified Layout (ULA) Framework allows for the definition of physical displays on a virtual screen and provides the ability to apply layout settings such as position and size to applications launched using the UCL Framework. + +### Creating a Layout Configuration File + +To define the layout for your applications, you need to create a JSON file, such as `initial_vscreen.json`, with the necessary configuration details. This file will contain the layout settings that specify how applications should be positioned and sized within the virtual screen. Here is an example of what the contents of `initial_vscreen.json` file might look like: + +``` +{ + "command": "initial_vscreen", + "vlayer": [ + { + "VID": 1010000, + "coord": "global", + "virtual_w": 1920, "virtual_h": 1080, + "vsrc_x": 0, "vsrc_y": 0, "vsrc_w": 1920, "vsrc_h": 1080, + "vdst_x": 960, "vdst_y": 0, "vdst_w": 1920, "vdst_h": 1080, + "vsurface": [ + { + "VID": 101000, + "pixel_w": 1920, "pixel_h": 1080, + "psrc_x": 0, "psrc_y": 0, "psrc_w": 1920, "psrc_h": 1080, + "vdst_x": 0, "vdst_y": 0, "vdst_w": 1920, "vdst_h": 1080 + } + ] + } + ] +} +``` + +In this example, the application is renderd across the right half of the agl-host0 and the left half of agl-host1 display. + +In this configuration: + +- **vlayer** defines a virtual layer that represents a group of surfaces within the virtual screen. Each layer has a unique Virtual ID (VID) and can contain multiple surfaces. The layer's source (`vsrc_x`, `vsrc_y`, `vsrc_w`, `vsrc_h`) and destination (`vdst_x`, `vdst_y`, `vdst_w`, `vdst_h`) coordinates determine where and how large the layer appears on the virtual screen. + +- **vsurface** defines individual surfaces within the virtual layer. Each surface also has a VID, and its pixel dimensions (`pixel_w`, `pixel_h`) represent the actual size of the content. The source (`psrc_x`, `psrc_y`, `psrc_w`, `psrc_h`) and destination (`vdst_x`, `vdst_y`, `vdst_w`, `vdst_h`) coordinates determine the portion of the content to display and its location within the layer. + +### Applying the Layout Configuration + +Once you have created the `initial_vscreen.json` file with your layout configuration, you can apply it to your system using the following command: + +``` +cat initial_vscreen.json | ula-distrib-com +``` + +Executing this command will process the configuration from the JSON file and apply the layout settings to the virtual screen. As a result, the applications will appear in the specified positions and sizes according to the layout defined in the file. + +Ensure that `initial_vscreen.json` file you create accurately reflects the desired layout for your applications and display setup. + +**Note**: Due to the specifications of ivi_shell, when an application is stopped after being displayed, the image that was shown just before stopping remains on the screen. To avoid this, please eigther restart weston or display another image on ivi_shell to update the displayed content.
\ No newline at end of file diff --git a/meta-uhmi/meta-distributed-display-fw/conf/layer.conf b/meta-uhmi/meta-distributed-display-fw/conf/layer.conf new file mode 100644 index 00000000..ba8984fa --- /dev/null +++ b/meta-uhmi/meta-distributed-display-fw/conf/layer.conf @@ -0,0 +1,12 @@ +# We have a conf and classes directory, add to BBPATH +BBPATH .= ":${LAYERDIR}" + +# We have recipes-* directories, add to BBFILES +BBFILES += "${LAYERDIR}/recipes-*/*/*.bb \ + ${LAYERDIR}/recipes-*/*/*.bbappend" + +BBFILE_COLLECTIONS += "meta-distributed-display-fw" +BBFILE_PATTERN_meta-distributed-display-fw = "^${LAYERDIR}/" +BBFILE_PRIORITY_meta-distributed-display-fw = "8" + +LAYERSERIES_COMPAT_meta-distributed-display-fw= "scarthgap" diff --git a/meta-uhmi/meta-distributed-display-fw/recipes-core/ucl-tools/files/ucl-launcher.service b/meta-uhmi/meta-distributed-display-fw/recipes-core/ucl-tools/files/ucl-launcher.service new file mode 100644 index 00000000..37f289e6 --- /dev/null +++ b/meta-uhmi/meta-distributed-display-fw/recipes-core/ucl-tools/files/ucl-launcher.service @@ -0,0 +1,13 @@ +[Unit] +Description=ucl-launcher + +[Service] +Type=idle +ExecStart=/usr/bin/ucl-launcher +KillSignal=SIGTERM +TimeoutStopSec=10 +Restart=always +RestartSec=2 + +[Install] +WantedBy=multi-user.target diff --git a/meta-uhmi/meta-distributed-display-fw/recipes-core/ucl-tools/ucl-tools_git.bb b/meta-uhmi/meta-distributed-display-fw/recipes-core/ucl-tools/ucl-tools_git.bb new file mode 100644 index 00000000..cc26678b --- /dev/null +++ b/meta-uhmi/meta-distributed-display-fw/recipes-core/ucl-tools/ucl-tools_git.bb @@ -0,0 +1,46 @@ +SUMMARY = "Unified HMI Clustering Tools" +SECTION = "graphics" + +LICENSE = "Apache-2.0" +LIC_FILES_CHKSUM = "file://src/ucl-tools/LICENSE.md;md5=e789951aab02a3028d2e58b90fc933ba" + +FILESEXTRAPATHS:prepend := "${THISDIR}/files:" + +PN="ucl-tools" +PROVIDES += "ucl-tools" + +SRCREV = "80e83132834b5ab62875bc294332bd00cd559d5d" +BRANCH ?= "main" +SRC_URI = " \ + git://github.com/unified-hmi/ucl-tools.git;protocol=https;branch=${BRANCH} \ +" +PV = "0.0+git${SRCPV}" + +S = "${WORKDIR}/git" + +export GO111MODULE="auto" + +GO_IMPORT = "ucl-tools" +GO_INSTALL = " ${GO_IMPORT}/cmd/ucl-launcher ${GO_IMPORT}/cmd/ucl-distrib-com ${GO_IMPORT}/cmd/ucl-consistency-keeper ${GO_IMPORT}/cmd/ucl-ncount-master ${GO_IMPORT}/cmd/ucl-ncount-worker ${GO_IMPORT}/cmd/ucl-nkeep-master ${GO_IMPORT}/cmd/ucl-nkeep-worker ${GO_IMPORT}/cmd/ucl-timing-wrapper ${GO_IMPORT}/cmd/ucl-virtio-gpu-wl-send ${GO_IMPORT}/cmd/ucl-virtio-gpu-wl-recv" + +inherit go + +RDEPENDS:${PN} = "bash" +RDEPENDS:${PN}-dev = "bash" + +inherit systemd +SRC_URI += " file://ucl-launcher.service" + +REQUIRED_DISTRO_FEATURES = "systemd" +SYSTEMD_PACKAGES = "${PN}" +SYSTEMD_SERVICE:${PN} = "ucl-launcher.service" +SYSTEMD_AUTO_ENABLE:${PN} = "enable" +FILES:${PN} += " \ + ${@bb.utils.contains('DISTRO_FEATURES', 'systemd', '${systemd_system_unitdir}/${SYSTEMD_SERVICE}', '', d)} \ + " +do_install:append() { + if ${@bb.utils.contains('DISTRO_FEATURES','systemd','true','false',d)}; then + install -d ${D}${systemd_system_unitdir} + install -m 644 ${WORKDIR}/*.service ${D}/${systemd_system_unitdir} + fi +} diff --git a/meta-uhmi/meta-distributed-display-fw/recipes-core/ula-tools/files/ula-node.service b/meta-uhmi/meta-distributed-display-fw/recipes-core/ula-tools/files/ula-node.service new file mode 100644 index 00000000..edf69f3d --- /dev/null +++ b/meta-uhmi/meta-distributed-display-fw/recipes-core/ula-tools/files/ula-node.service @@ -0,0 +1,15 @@ +[Unit] +Description=ula-node +Requires=uhmi-ivi-wm.service +After=uhmi-ivi-wm.service + +[Service] +Type=idle +ExecStart=/usr/bin/ula-node +KillSignal=SIGTERM +TimeoutStopSec=10 +Restart=always +RestartSec=2 + +[Install] +WantedBy=multi-user.target diff --git a/meta-uhmi/meta-distributed-display-fw/recipes-core/ula-tools/files/virtual-screen-def.json b/meta-uhmi/meta-distributed-display-fw/recipes-core/ula-tools/files/virtual-screen-def.json new file mode 100644 index 00000000..2917ca87 --- /dev/null +++ b/meta-uhmi/meta-distributed-display-fw/recipes-core/ula-tools/files/virtual-screen-def.json @@ -0,0 +1,25 @@ +{ + "virtual_screen_2d" : { + "size" : {"virtual_w" : 3840, "virtual_h": 1080}, + "virtual_displays" : [ + {"vdisplay_id":0, "disp_name": "AGL_SCREEN0", "virtual_x":0, "virtual_y":0, "virtual_w":1920, "virtual_h":1080}, + {"vdisplay_id":1, "disp_name": "AGL_SCREEN1", "virtual_x":1920, "virtual_y":0, "virtual_w":1920, "virtual_h":1080} + ] + }, + "virtual_screen_3d" : {}, + "real_displays" : [ + {"node_id":0, "vdisplay_id":0, "pixel_w":1920, "pixel_h":1080, "rdisplay_id" : 0}, + {"node_id":1, "vdisplay_id":1, "pixel_w":1920, "pixel_h":1080, "rdisplay_id" : 0} + ], + "node" : [ + {"node_id":0, "hostname":"agl-host0", "ip":"192.168.0.100"}, + {"node_id":1, "hostname":"agl-host1", "ip":"192.168.0.101"} + ], + "distributed_window_system" : { + "window_manager":{}, + "framework_node":[ + {"node_id":0, "ula": {"debug":false, "debug_port":8080, "port":10100}, "ucl": {"port":7654}}, + {"node_id":1, "ula": {"debug":false, "debug_port":8080, "port":10100}, "ucl": {"port":7654}} + ] + } +} diff --git a/meta-uhmi/meta-distributed-display-fw/recipes-core/ula-tools/ula-tools_git.bb b/meta-uhmi/meta-distributed-display-fw/recipes-core/ula-tools/ula-tools_git.bb new file mode 100644 index 00000000..9b945a3f --- /dev/null +++ b/meta-uhmi/meta-distributed-display-fw/recipes-core/ula-tools/ula-tools_git.bb @@ -0,0 +1,72 @@ +SUMMARY = "Unified HMI Layout Tools" +SECTION = "graphics" + +LICENSE = "Apache-2.0" +LIC_FILES_CHKSUM = "file://src/ula-tools/LICENSE.md;md5=e789951aab02a3028d2e58b90fc933ba" + +FILESEXTRAPATHS:prepend := "${THISDIR}/files:" + +PN="ula-tools" +PROVIDES += "ula-tools" + +SRCREV = "4403efd88fd4e79b092787ac727afe996dd7ca12" +BRANCH ?= "main" +SRC_URI = " \ + git://github.com/unified-hmi/ula-tools.git;protocol=https;branch=${BRANCH} \ +" +PV = "0.0+git${SRCPV}" + +S = "${WORKDIR}/git" + + +export GO111MODULE="auto" + +GO_IMPORT = "ula-tools" +GO_INSTALL = " ${GO_IMPORT}/cmd/ula-distrib-com ${GO_IMPORT}/cmd/ula-node" + + +inherit go +RDEPENDS:${PN} = "jq bash" +RDEPENDS:${PN}-dev = "bash" + +inherit systemd + +SRC_URI += " \ + file://ula-node.service \ + file://virtual-screen-def.json \ + " + +REQUIRED_DISTRO_FEATURES = "systemd" +SYSTEMD_PACKAGES = "${PN}" +SYSTEMD_SERVICE:${PN} = "ula-node.service" +SYSTEMD_AUTO_ENABLE:${PN} = "enable" +FILES:${PN} += " \ + ${@bb.utils.contains('DISTRO_FEATURES', 'systemd', '${systemd_system_unitdir}/${SYSTEMD_SERVICE}', '', d)} \ + /etc/uhmi-framework/virtual-screen-def.json \ + " + +do_compile:append() { + export CGO_ENABLED="1" + ${GO} build -buildmode=c-shared -o ${GOPATH}/pkg/libulaclient.so -v -ldflags '-extldflags "-Wl,-soname=libulaclient.so"' ${GO_IMPORT}/pkg/ula-client-lib +} + + +do_install:append() { + if ${@bb.utils.contains('DISTRO_FEATURES','systemd','true','false',d)}; then + install -d ${D}${systemd_system_unitdir} + install -m 644 ${WORKDIR}/*.service ${D}/${systemd_system_unitdir} + fi + + install -d ${D}/etc/uhmi-framework + install -m 644 ${WORKDIR}/virtual-screen-def.json ${D}/etc/uhmi-framework + + install -d ${D}${libdir} + install -m 0755 ${GOPATH}/pkg/libulaclient.so ${D}${libdir} + + install -d ${D}${includedir} + install -m 644 ${GOPATH}/pkg/libulaclient.h ${D}${includedir} + +} + +FILES:${PN} += "${libdir}" +FILES:${PN} += "${includedir}" diff --git a/meta-uhmi/meta-distributed-display-fw/recipes-platform/packagegroups/packagegroup-distributed-display-fw.bb b/meta-uhmi/meta-distributed-display-fw/recipes-platform/packagegroups/packagegroup-distributed-display-fw.bb new file mode 100644 index 00000000..527184dc --- /dev/null +++ b/meta-uhmi/meta-distributed-display-fw/recipes-platform/packagegroups/packagegroup-distributed-display-fw.bb @@ -0,0 +1,9 @@ +SUMMARY = "Unified HMI Package Groups" +LICENSE = "Apache-2.0" + +inherit packagegroup + +RDEPENDS:${PN} += " \ + ucl-tools \ + ula-tools \ +" diff --git a/meta-uhmi/meta-rvgpu/README.md b/meta-uhmi/meta-rvgpu/README.md index b93e99d8..3d524fef 100644 --- a/meta-uhmi/meta-rvgpu/README.md +++ b/meta-uhmi/meta-rvgpu/README.md @@ -1,74 +1,3 @@ -## Remote Virtio GPU Device support layer(meta-rvgpu) -The RVGPU rendering engine, operating on a client-server model, creates 3D rendering commands on a client device and transmits them to a server device via the network, where the server-side device performs GPU-based rendering and displays the results. The meta-rvgpu currently supports x86, Raspberry Pi 4, and Renesas Boards platforms. -RVGPU is OSS. For more details, visit the following URL: -https://github.com/unified-hmi/remote-virtio-gpu - -## How to build -Follow the [AGL documentation](https://docs.automotivelinux.org/en/master/#01_Getting_Started/02_Building_AGL_Image/01_Build_Process_Overview/) for the build process, and set up the "[Initializing Your Build Environment](https://docs.automotivelinux.org/en/master/#01_Getting_Started/02_Building_AGL_Image/04_Initializing_Your_Build_Environment/)" section as described below to enable the AGL feature 'agl-rvgpu'. For example: -``` -$ cd $AGL_TOP/master -$ source ./meta-agl/scripts/aglsetup.sh -m qemux86-64 -b qemux86-64 agl-demo agl-devel agl-rvgpu -``` -After adding the feature, execute the command: -``` -$ bitbake <image_name> -``` -Replace the `<image_name>` with the appropriate values you want. We have confirmed the operation with the **agl-demo-platform**. - -## How to setup and boot -For Environment setup instructions for each platform, refer to the following link in the AGL Documentation. -[Building for x86(Emulation and Hardware)](https://docs.automotivelinux.org/en/master/#01_Getting_Started/02_Building_AGL_Image/07_Building_for_x86_%28Emulation_and_Hardware%29/) -[Building for Raspberry Pi 4](https://docs.automotivelinux.org/en/master/#01_Getting_Started/02_Building_AGL_Image/08_Building_for_Raspberry_Pi_4/) -[Building for Supported Renesas Boards](https://docs.automotivelinux.org/en/master/#01_Getting_Started/02_Building_AGL_Image/09_Building_for_Supported_Renesas_Boards/) - -For Raspberry Pi 4 and Supported Renesas Boards, refer to the above URL for boot methods. -For x86 emulation (qemu), network bridge is required to enable communication with other devices when using RVGPU. Here’s an example procedure for your reference. -``` -$ sudo ip link add <bridge_name> type bridge -$ sudo ip addr add <IP address> dev <bridge_name> -$ sudo ip link set dev <interface> master <bridge_name> -$ sudo ip link set dev <bridge_name> up -``` -Replace the placeholders with the appropriate values: -- `<bridge_name>`: You can assign any name, for example: `br0` -- `<IP_address>`: Enter an available IP address, for example: `192.168.0.100/24` -- `<interface>`: Specify the network interface, for example: `eth0` - -To enable the use of the bridge, create or append /etc/qemu directory and /etc/qemu/bridge.conf file. -``` -allow <bridge_name> -``` -Make sure /etc/qemu/ has 755 permissions. -Create the following bash file named **run_qemu_bridge.sh** in any `<WORKDIR>`. -``` -#!/bin/bash - -KERNEL_PATH=$1 -DRIVE_PATH=$2 -BRIDGE_NAME="<bridge_name>" - -printf -v macaddr "52:54:%02x:%02x:%02x:%02x" $(( $RANDOM & 0xff)) $(( $RANDOM & 0xff )) $(( $RANDOM & 0xff)) $(( $RANDOM & 0xff )) - -qemu-system-x86_64 -enable-kvm -m 2048 \ - -kernel ${KERNEL_PATH} \ - -drive file=${DRIVE_PATH},if=virtio,format=raw \ - -cpu kvm64 -cpu qemu64,+ssse3,+sse4.1,+sse4.2,+popcnt \ - -vga virtio -show-cursor \ - -device virtio-net-pci,netdev=net0,mac=$macaddr \ - -netdev bridge,br=$BRIDGE_NAME,id=net0 \ - -serial mon:stdio -serial null \ - -soundhw hda \ - -append 'root=/dev/vda rw console=ttyS0,115200n8 fstab=no' -``` -Save the file and run the following to start QEMU. -``` -sudo <WORKDIR>/run_qemu_bridge.sh <build_directory>/tmp/deploy/images/qemux86-64/bzImage <build_directory>/tmp/deploy/images/qemux86-64/agl-demo-platform-qemux86-64.ext4 -``` -When QEMU boot, assign an IP address. For example: -``` -ifconfig <your environment> 192.168.0.10 netmask 255.255.255.0 -``` - ## How to run RVGPU remotely Prepare two images, one as the Sender and the other as the Receiver. It is necessary for the Sender and Receiver to be within the same network. @@ -80,17 +9,10 @@ $ rvgpu-renderer -b <your_Area>@0,0 -p <Port_Number> & ``` Replace the placeholders with the appropriate values: -- `<your_UID>`: Specify according to your environment, for example:1001 -- `<your_Area>`: Enter an usable area for example: 1080x1488 - With the following command, you can know the usable area. - ``` - $ journalctl | grep -i "usable area" - # Example Output: - Nov 29 11:42:53 qemux86-64 agl-compositor[259]: [11:42:53.166] Usable area: 1080x1488+0,216 - ``` +- `<your_UID>`: Specify according to your environment, for example: 200 +- `<your_Area>`: Enter an usable area for example: 1920x1080 - `<Port_Number>`: Enter an available port number, for example: 55555 - **Sender side** Create the following shell script **run_remote_app.sh** in any `<WORKDIR>` for a smooth experience. ``` @@ -108,26 +30,25 @@ $@ Save the file and run the following to start weston. ``` -$ rvgpu-proxy -s 1080x1488@0,0 -n <IP_address_of_Receiver>:<Port_Number> & -$ <WORKDIR>/run_remote_app.sh weston --backend drm-backend.so -Swayland-0 --seat=seat_virtual -i 0 & +$ rvgpu-proxy -s <your_Area>@0,0 -n <IP_address_of_Receiver>:<Port_Number> & +$ EGLWINSYS_DRM_DEV_NAME=<RVGPU_DRM_DEVICE_PATH> <WORKDIR>/run_remote_app.sh rvgpu-wlproxy -s <your_Area> -S <your_WAYLAND_DISPLAY> & ``` Replace the placeholders with the appropriate values: - `<Port_Number>`: Port set in the renderer. - +- `<your_WAYLAND_DISPLAY>`: Specify your WAYLAND_DISPLAY socket name, for example: wayland-uhmi-0 +- `<RVGPU_DRM_DEVICE_PATH>`: Specify rvgpu drm device path generated by rvgpu-proxy, for example: /dev/dri/rvgpu_virtio0 After completing these steps, the Weston screen from the Sender will be transferred and displayed on the Receiver using rvgpu-proxy and rvgpu-renderer. You can verify that everything is functioning properly by launching wayland applications on the Sender side, such as: ``` -$ weston-simple-egl -f +$ WAYLAND_DISPLAY=<your_WAYLAND_DISPLAY> <WORKDIR>/run_remote_app.sh weston-simple-egl -f ``` You can also verify the touch or keyboard operation support of the RVGPU by using app such as ``` -$ weston-smoke -$ weston-editor +$ WAYLAND_DISPLAY=<your_WAYLAND_DISPLAY> <WORKDIR>/run_remote_app.sh weston-smoke +$ WAYLAND_DISPLAY=<your_WAYLAND_DISPLAY> <WORKDIR>/run_remote_app.sh weston-editor ``` -**Note**: There are known issues with mouse, such as the cursor becoming invisible and occasional flickering of a green screen. **Appendix** - By building the RVGPU on Ubuntu, it is possible to enable bidirectional remote rendering between the agl-demo-platform and Ubuntu. -For the build procedure on Ubuntu, see the following URL: https://github.com/unified-hmi/remote-virtio-gpu - +For the build procedure on Ubuntu, see the following URL: https://github.com/unified-hmi/remote-virtio-gpu
\ No newline at end of file diff --git a/templates/feature/agl-rvgpu/50_bblayers.conf.inc b/templates/feature/agl-uhmi/50_bblayers.conf.inc index 9a52762d..b138ba39 100644 --- a/templates/feature/agl-rvgpu/50_bblayers.conf.inc +++ b/templates/feature/agl-uhmi/50_bblayers.conf.inc @@ -1,3 +1,4 @@ BBLAYERS =+ " \ ${METADIR}/meta-agl-devel/meta-uhmi/meta-rvgpu \ + ${METADIR}/meta-agl-devel/meta-uhmi/meta-distributed-display-fw \ " |