**HomeScreen GUI Application / HomeScreen Service Guide** ==== Revision: 0.1 TOYOTA MOTOR CORPORATION Advanced Driver Information Technology 17th/June/2019 * * * ## Table of content - [Target reader of this document](#target-reader-of-this-document) - [Overview](#overview) - [Getting Start](#getting-start) - [Supported environment](#supported-environment) - [Build](#build) - [Configuring](#configuring) - [How to call HomeScreen APIs from your Application?](#how-to-call-homescreen-apis-from-your-application) - [Supported usecase](#supported-usecase) - [Software Architecture](#software-architecture) - [API reference](#api-reference) - [Sequence](#sequence) - [Initialize](#initialize-sequence) - [Tap Shortcut(deprecated)](#tap-shortcut-sequence) - [ShowWindow](#showwindow-sequence) - [On Screen Message / Reply Sequence(deprecated)](#on-screen-message-reply-sequence) - [ShowOnscreen](#showonscreen-sequence) - [ShowNotification](#shownotification-sequence) - [ShowInformation](#showinformation-sequence) - [Sample code](#sample-code) - [Limitation](#limitation) - [Next Plan](#next-plan) - [Appendix](#appendix) * * * ## Target reader of this document Application developer whose software uses HomeScreen. * * * ## Overview HomeScreen is built with a GUI application created with Qt(referred as HomeScreenGUI), and a service running on afb-daemon (referred as HomeScreenBinder). HomeScreen can start/switch applications run in AGL, also displays information such as onscreen messages. You can find these projects in AGL gerrit. - [homescreen(HomeScreenGUI)](https://gerrit.automotivelinux.org/gerrit/#/admin/projects/apps/homescreen) - [launcher(LauncherGUI)](https://gerrit.automotivelinux.org/gerrit/#/admin/projects/apps/launcher) - [agl-service-homescreen(HomeScreenBinder's binding library)](https://gerrit.automotivelinux.org/gerrit/#/admin/projects/apps/agl-service-homescreen) - [libhomescreen(library for application to communication with HomeScreenBinder]( https://gerrit.automotivelinux.org/gerrit/#/admin/projects/src/libhomescreen) - [libqthomescreen(library for qt application to communication with HomeScreenBinder based on libhomescreen)](https://gerrit.automotivelinux.org/gerrit/#/admin/projects/src/libqthomescreen) Also HomeScreenGUI is using libwindowmanager. * * * ## Getting Start ### Supported environment | Item | Description | |:------------|:----------------------------------| | AGL version | Grumpy Guppy | | Hardware | Renesas R-Car Starter Kit Pro(M3) | ### Build **Download recipe** ``` $ mkdir WORK $ cd WORK $ repo init -u https://gerrit.automotivelinux.org/gerrit/AGL/AGL-repo $ repo sync ``` Then you can find the following recipes. * `meta-agl-demo/recipes-demo-hmi/homescreen` * `meta-agl-devel/meta-hmi-framework/recipes-demo-hmi/launcher` * `meta-agl-demo/recipes-demo-hmi/agl-service-homescreen` * `meta-agl-demo/recipes-demo-hmi/libhomescreen` * `meta-agl-devel/meta-hmi-framework/recipes-demo-hmi/qlibhomescreen` **Bitbake** ``` $ source meta-agl/scripts/aglsetup.sh -m m3ulcb agl-demo agl-devel agl-appfw-smack agl-hmi-framework $ bitbake agl-demo-platform ``` ### Configuring To use HomeScreen API, an application shall paste the following configuration definition into "config.xml" of application. ``` ``` ### How to call HomeScreen APIs from your Application? HomeScreen provides a library which is called "libhomescreen". This library treats "json format" as API calling. For example, if an application wants to call "showWIndow()" API, the you should implement as below. At first the application should create the instance of libhomescreen. ``` LibHomeScreen* libhs; libhs = new LibHomeScreen(); libhs->init(port, token); ``` The port and token is provided by Application Framework Execute the "showWindow()" function. ``` libhs->showWindow("application_id", "display_area"); ``` Regarding the detail of showWindow() API, please refer [this](#homescreen-specific-api) section. The first parameter is the appid of application which want to display,liked "dashboard". And the second parameter corresponds to display_area which defined by windowmanager,usually "normal", so in this case "showWindow" the two parameters are proper string. See also our [Sample code](#sample-code). * * * ## Supported usecase 1. HomeScreenGUI sending showWindow event to applications - Applications using libhomescreen to subscribe the showWindow event, HomeScreenGUI will send showWindow event to applications. 2. Display OnScreen messages(deprecated) - Applications sending OnScreen messages to homescreen-service, and OnScreenAPP will get these message and display. 3. Get OnSreen Reply event(deprecated) - When OnScreen messages is displaying, OnScreenAPP will send a reply event to applications. 4. Display OnScreen by showWindow - When application who want to show OnScreen,it can call "showWindow",then OnScreenApp will display request OnScreen. 5. Hide OnScreen by hideWindow - When application who want to hide OnScreen which is displaying,it can call "hideWindow",then OnScreenApp will hide OnScreen. 6. Send OnScreen Reply by replyShowWindow - When user touch the button of OnScreen, OnScreenApp can call "relplyShowWindow" to send reply information back to application. 7. Show Notification on HomeScreenGUI - When application who want to display a notification,it can call "showNotification",then HomeScreenGUI will display the notification contents on the screen top area. 8. Show Information on HomeScreenGUI - When application who want to display a information,it can call "showInformation",then HomeScreenGUI will display the information contents on the screen bottom area. * * * ## Software Architecture The architecture of HomeScreen is shown below. HomeScreen is the service designed to be used by multiple applications. Therefore HomeScreen framework consists on two binder layers. Please refer the following figure. The upper binder is for application side security context for applications. The lower binder is for servide side security context. Usually application side binder has some business logic for each application, so the number of binders depend on the number of applications which use HomeScreen. On the other hand, regarding lower binder there is only one module in the system. This binder receives all messages from multiple applications (in detail, it comes from upper layer binder). The communication protocols between libhomescreen and upper binder, upper binder and lower binder, lower binder (homescreen-binding) are WebSocket. ![software-stack.png](parts/software-stack.png) * * * ## API reference "libhomescreen" and "agl-service-homescreen" provides several kinds of APIs. ### HomeScreen Specific API - LibHomeScreen::init (const int port, const std::string &token) ``` port [in] : This argument should be specified to the port number to be used for websocket token [in] : This argument should be specified to the token to be used for websocket Create connection to homescreen-service by port and token which provided by application framework. This API must be called before calling other api. ``` - LibHomeScreen::tapShortcut(const char *application_id) ``` application_id [in] : Tapped application id (label) This api is deprecated, recommend using showWindow. ``` - LibHomeScreen::onScreenMessage(const char *display_message) ``` display_message [in] : message for display This api is deprecated, recommend using showWindow/hideWindow to call onscreenapp. ``` - LibHomeScreen::onScreenReply(const char *reply_message) ``` reply_message [in] : message for reply This api is deprecated, recommend using replyShowWindow. ``` - LibHomeScreen::registerCallback(void(*event_cb)(const std::string &event, struct json_object *event_contents), void(*reply_cb)(struct json_object *reply_contents), void(*hangup_cb)(void)=nullptr) ``` event_cb [in] : This argument should be specified to the callback for subscribed event reply_cb [in] : This argument should be specified to the reply callback for call function hangup_cb [in] : This argument should be specified to the hangup callback for call function This api is deprecated, recommend using set_event_handler. ``` - LibHomeScreen::set_event_handler(enum EventType et, handler_func f) ``` et [in] : event name f [in] : event handler Setting event handler for Homescreen-Service Event. ``` - LibHomeScreen::call(const string& verb, struct json_object* arg) - LibHomeScreen::call(const char* verb, struct json_object* arg) ``` verb [in] : This argument should be specified to the API name (e.g. "tap_shortcut") arg [in] : This argument should be specified to the argument of API. And this argument expects JSON object Call homescreen-service verb. ``` - LibHomeScreen::subscribe(const string& event_name) ``` event_name [in] : This argument should be specified to the event name Subscribe homescreen-service event. Deprecated, recommend using set_event_handler. ``` - LibHomeScreen::unsubscribe(const string& event_name) ``` event_name [in] : This argument should be specified to the event name Unsubscribe homescreen-service event. Deprecated, recommend using set_event_handler. ``` - LibHomeScreen::showWindow(const char* application_id, json_object* json) ``` application_id [in] : This argument should be specified to the application's id json [in] : This argument should be specified to the json parameters Request to show the window of application_id, and set display area in json liked {"area":"normal.full"}. ``` - LibHomeScreen::hideWindow(const char* application_id) ``` application_id [in] : This argument should be specified to the application's id Request to hide the window of application_id. ``` - LibHomeScreen::replyShowWindow(const char* application_id, json_object* json) ``` application_id [in] : This argument should be specified to the onscreen reply to applilcation id json [in] : This argument should be specified to the json parameters Post reply information to who called showWindow. ``` - LibHomeScreen::showNotification(json_object* json) ``` json [in] : This argument should be specified to the json parameters. Post Notification to Homescreen which will display at top area of Homescreen. ``` - LibHomeScreen::showInformation(json_object* json) ``` json [in] : This argument should be specified to the json parameters. Post Information to Homescreen which will display at bottom area of Homescreen. ``` * * * ## Sequence ### Initialize Sequence ![initialize-set-event-handler](parts/initialize-set-event-handler.svg) ### Tap Shortcut Sequence ![tap_shortcut.svg](parts/tap_shortcut.svg) ### ShowWindow Sequence ![showWindow.svg](parts/showWindow.svg) ### On Screen Message / Reply Sequence ![on_screen_message.svg](parts/on_screen_message.svg) ### ShowOnScreen Sequence ![showOnScreen.svg](parts/showOnScreen.svg) ### ShowNotification Sequence ![showNotification.svg](parts/showNotification.svg) ### ShowInformation Sequence ![showInformation.svg](parts/showInformation.svg) * * * ## Sample code You can find sample implementation of HomeScreen as below. * `libhomescreen/sample/simple-egl` * `libhomescreen/sample/template` * * * ## Limitation None. * * * ## Next Plan None. * * * ## Appendix ``` @startuml title Application initialization phase entity App entity HomeScreenBinder entity HomeScreenGUI App->HomeScreenBinder: init(port, token) App->HomeScreenBinder: set_event_handler() note over HomeScreenBinder setup event handler the App wishes to receive ・LibHomeScreen::Event_ShowWindow ・LibHomeScreen::Event_HideWindow ・LibHomeScreen::Event_ReplyShowWindow end note @enduml ``` ``` @startuml title Application Callback Event TapShortcut phase entity App entity HomeScreenBinder entity HomeScreenGUI App->HomeScreenBinder: set_event_handler() note over App LibHomeScreen::Event_TapShortcut end note HomeScreenGUI->HomeScreenBinder: tapShortcut(application_id) HomeScreenBinder->App: event_handler(application_id) @enduml ``` ``` @startuml title Application callback event showWindow phase actor user entity "homescreen-service" as hss entity launcher entity App entity windowmanager as wm user-->launcher: tap app's icon launcher->hss: showWindow() note over hss,App {"application_id":"tapped application id", "parameter":{"area":"display area", ...}} end note hss->App: push showWindow event App->wm: activateWindow("application_name","display area") wm-->App: push syncDraw event App->App: display @enduml ``` ``` @startuml title Application Callback Event On Screen Message / Reply phase entity App entity HomeScreenBinder entity HomeScreenGUI HomeScreenGUI->HomeScreenBinder: set_event_handler() note over HomeScreenGUI LibHomeScreen::Event_OnScreenMessage end note App->HomeScreenBinder: set_event_handler() note over App LibHomeScreen::Event_OnScreenReply end note App->HomeScreenBinder: onScreenMessage(display_message) HomeScreenBinder->HomeScreenGUI: event_handler(display_message) HomeScreenGUI->HomeScreenBinder: onScreenReply(reply_message) HomeScreenBinder->App: event_handler(reply_message) @enduml ``` ``` @startuml title show/hide onscreen phase actor user entity "homescreen-service" as hss entity App entity onscreenapp entity windowmanager as wm == show onscreen == user->App: the operation request onscreen App->hss: showWindow() note over App,hss {"application_id":"onscreenapp", "parameter":{"area":"display area", "file":"qml file path", "data":{"the datas to onscreen qml"}}} end note hss->onscreenapp: push showWindow event note over hss,onscreenapp {"application_id":"onscreenapp", "parameter":{"area":"display area", "file":"qml file path", "data":{"the datas to onscreen qml"}, "replyto":"caller application id" }} end note onscreenapp->onscreenapp: get and save parameters onscreenapp->wm: activateWindow("onscreeapp", "display area") alt can show wm-->onscreenapp: push syncDraw event onscreenapp->wm: endDraw("onscreeapp") onscreenapp->onscreenapp: load and display qml file else can't show note over onscreenapp,wm do nothing end note end == hide onscreen == user->onscreenapp: tap onscreen's button onscreenapp->hss: replyShowWindow() note over onscreenapp,hss {"application_id":"the application id who called onscreenapp", "parameter": {"buttonName": "VOLUME_UP", "buttonPressMode": "shortPress", "buttonPressState": "release"}} end note hss->App: push replyShowWindow event App->App: call reply function App->hss: hideWindow("onscreenapp") hss->onscreenapp: push hideWindow event note over hss,onscreenapp {"application_id":"request hideWindow application id"} end note onscreenapp->wm: deactivateWindow("onscreenapp"); onscreenapp->onscreenapp: hide window @enduml ``` ``` @startuml title show notification on HomeScreen top area entity "homescreen-service" as hss entity homescreen entity App App->hss: showNotification() note over App,hss {"icon":"display icon", "text":"display text"} end note hss-> homescreen: push showNotification event note over hss,homescreen {"application_id":"request application id", "parameter":{"icon":"display icon", "text":"display text"}} end note homescreen->homescreen: display notification message 3s @enduml ``` ``` @startuml title show information on HomeScreen bottom area entity "homescreen-service" as hss entity homescreen entity App App->hss: showInformation() note over hss {"info":"display information"} end note hss-> homescreen: push showInformation event homescreen->homescreen: display information message 3s @enduml ```