1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
|
**HomeScreen GUI Application / HomeScreen Service Guide**
====
<div align="right">Revision: 0.1</div>
<div align="right">TOYOTA MOTOR CORPORATION</div>
<div align="right">Advanced Driver Information Technology</div>
<div align="right">21th/Nov/2018</div>
* * *
<div id="Table\ of\ content"></div>
## Table of content
- [Target reader of this document](#Target\ reader\ of\ this\ document)
- [Overview](#Overview)
- [Getting Start](#Getting\ Start)
- [Supported environment](#Supported\ environment)
- [Build](#Build)
- [Configuring](#Configuring)
- [How to call HomeScreen APIs from your Application?](#How\ to\ call\ HomeScreen\ APIs\ from\ your\ Application?)
- [Supported usecase](#Supported\ usecase)
- [Software Architecture](#Software\ Architecture)
- [API reference](#API\ reference)
- [Sequence](#Sequence)
- [Initialize](###Initialize\ Sequence)
- [Tap Shortcut(deprecated)](###Tap\ Shortcut\ Sequence)
- [ShowWindow](###ShowWindow\ Sequence)
- [On Screen Message / Reply Sequence(deprecated)](###On\ Screen\ Message\ /\ Reply\ Sequence)
- [ShowOnscreen](###ShowOnscreen\ Sequence)
- [ShowNotification](###ShowNotification\ Sequence)
- [ShowInformation](###ShowInformation\ Sequence)
- [GetRunnables](###GetRunnables\ Sequence)
- [Sample code](#Sample\ code)
- [Limitation](#Limitation)
- [Next Plan](#Next\ Plan)
- [Appendix](#Appendix)
* * *
<div id="Target\ reader\ of\ this\ document"></div>
## Target reader of this document
Application developer whose software uses HomeScreen.
* * *
<div id="Overview"></div>
## Overview
HomeScreen is built with a GUI application created with Qt(referred as HomeScreenGUI), and a service running on afb-daemon (referred as HomeScreenBinder).
HomeScreen can start/switch applications run in AGL, also displays information such as onscreen messages.
You can find these projects in AGL gerrit.
homescreen(HomeScreenGUI):
https://gerrit.automotivelinux.org/gerrit/#/admin/projects/apps/homescreen
launcher(LauncherGUI)
https://gerrit.automotivelinux.org/gerrit/#/admin/projects/apps/launcher
agl-service-homescreen(HomeScreenBinder's binding library):
https://gerrit.automotivelinux.org/gerrit/#/admin/projects/apps/agl-service-homescreen
libhomescreen(library for application to communication with HomeScreenBinder):
https://gerrit.automotivelinux.org/gerrit/#/admin/projects/src/libhomescreen
libqthomescreen(library for qt application to communication with HomeScreenBinder based on libhomescreen)
https://gerrit.automotivelinux.org/gerrit/#/admin/projects/src/libqthomescreen
Also HomeScreenGUI is using libwindowmanager.
<div id="Getting\ Start"></div>
## Getting Start
<div id="Supported\ environment"></div>
### Supported environment
| Item | Description |
|:------------|:----------------------------------|
| AGL version | Electric Eel |
| Hardware | Renesas R-Car Starter Kit Pro(M3) |
<div id="Build"></div>
### Build
**Download recipe**
```
$ mkdir WORK
$ cd WORK
$ repo init -u https://gerrit.automotivelinux.org/gerrit/AGL/AGL-repo
$ repo sync
```
Then you can find the following recipes.
* `meta-agl-demo/recipes-demo-hmi/homescreen`
* `meta-agl-devel/meta-hmi-framework/recipes-demo-hmi/launcher`
* `meta-agl-demo/recipes-demo-hmi/agl-service-homescreen`
* `meta-agl-demo/recipes-demo-hmi/libhomescreen`
* `meta-agl-devel/meta-hmi-framework/recipes-demo-hmi/qlibhomescreen`
**Bitbake**
```
$ source meta-agl/scripts/aglsetup.sh -m m3ulcb agl-demo agl-devel agl-appfw-smack agl-hmi-framework
$ bitbake agl-demo-platform
```
* * *
<div id="Configuring"></div>
### Configuring
To use HomeScreen API, an application shall paste the following configuration definition into "config.xml" of application.
```
<feature name="urn:AGL:widget:required-api">
<param name="homescreen" value="ws" />
<param name="windowmanager" value="ws" />
</feature>
```
* * *
<div id="How\ to\ call\ HomeScreen\ APIs\ from\ your\ Application?"></div>
### How to call HomeScreen APIs from your Application?
HomeScreen provides a library which is called "libhomescreen".
This library treats "json format" as API calling.
For example, if an application wants to call "showWIndow()" API, the you should implement as below.
At first the application should create the instance of libhomescreen.
```
LibHomeScreen* libhs;
libhs = new LibHomeScreen();
libhs->init(port, token);
```
The port and token is provided by Application Framework
Execute the "showWindow()" function.
```
libhs->showWindow("application_id", "display_area");
```
Regarding the detail of showWindow() API, please refer [this](#HomeScreen\ API) section.
The first parameter is the appid of application which want to display,liked "dashboard".
And the second parameter corresponds to display_area which defined by windowmanager,usually "normal",
so in this case "showWindow" the two parameters are proper string.
See also our [Sample code](#Sample\ code).
<br />
* * *
<div id="Supported\ usecase"></div>
## Supported usecase
1. HomeScreenGUI sending showWindow event to applications
- Applications using libhomescreen to subscribe the showWindow event,
HomeScreenGUI will send showWindow event to applications.
2. Display OnScreen messages(deprecated)
- Applications sending OnScreen messages to homescreen-service, and OnScreenAPP
will get these message and display.
3. Get OnSreen Reply event(deprecated)
- When OnScreen messages is displaying, OnScreenAPP will send a reply event to applications.
4. Display OnScreen by showWindow
- When application who want to show OnScreen,it can call "showWindow",then OnScreenApp will
display request OnScreen.
5. Hide OnScreen by hideWindow
- When application who want to hide OnScreen which is displaying,it can call "hideWindow",then OnScreenApp
will hide OnScreen.
6. Send OnScreen Reply by replyShowWindow
- When user touch the button of OnScreen, OnScreenApp can call "relplyShowWindow" to send reply information
back to application.
7. Show Notification on HomeScreenGUI
- When application who want to display a notification,it can call "showNotification",then HomeScreenGUI will
display the notification contents on the screen top area.
8. Show Information on HomeScreenGUI
- When application who want to display a information,it can call "showInformation",then HomeScreenGUI will
display the information contents on the screen bottom area.
9. Get runnables list
- When launcher starting, it want to get runnalbes list,it can call "getRunnables",then launcher will
receive the runnalbes list in reply.
* * *
<div id="Software\ Architecture"></div>
## Software Architecture
The architecture of HomeScreen is shown below.
HomeScreen is the service designed to be used by multiple applications.
Therefore HomeScreen framework consists on two binder layers. Please refer the following figure.
The upper binder is for application side security context for applications. The lower binder is for servide side security context.
Usually application side binder has some business logic for each application, so the number of binders depend on the number of applications which use HomeScreen.
On the other hand, regarding lower binder there is only one module in the system. This binder receives all messages from multiple applications (in detail, it comes from upper layer binder).
The communication protocols between libhomescreen and upper binder, upper binder and lower binder, lower binder (homescreen-binding) are WebSocket.
![software-stack.png](parts/software-stack.png)
* * *
<div id="API%20reference"></div>
## API reference
"libhomescreen" and "agl-service-homescreen" provides several kinds of APIs.
<div id="Home\ Screen\ Specific\ API"></div>
### HomeScreen Specific API
- [LibHomeScreen ()](api-ref/html/de/dd0/class_lib_home_screen.html#a724bd949c4154fad041f96a15ef0f5dc)
- [init (const int port, const std::string &token)](api-ref/html/de/dd0/class_lib_home_screen.html#a6a57b573cc767725762ba9beab032220)
- [tapShortcut(const char *application_id)](api-ref/html/de/dd0/class_lib_home_screen.html#a6ca8ff4a2aa019a735afaff713e0ef44)
- [onScreenMessage(const char *display_message)](api-ref/html/de/dd0/class_lib_home_screen.html#ac336482036a72b51a822725f1929523c)
- [onScreenReply(const char *reply_message)](api-ref/html/de/dd0/class_lib_home_screen.html#a6c065f41f2c5d1f58d2763bfb4da9c37)
- [registerCallback (void(*event_cb)(const std::string &event, struct json_object *event_contents), void(*reply_cb)(struct json_object *reply_contents), void(*hangup_cb)(void)=nullptr)](api-ref/html/de/dd0/class_lib_home_screen.html#a2789e8a5372202cc36f48e71dbb9b7cf)
- [set\_event\_handler(enum EventType et, handler_func f)](api-ref/html/de/dd0/class_lib_home_screen.html#ab1b0e08bf35415de9064afed899e9f85)
- [call (const string& verb, struct json_object* arg)](api-ref/html/de/dd0/class_lib_home_screen.html#a527b49dcfe581be6275d0eb2236ba37f)
- [call (const char* verb, struct json_object* arg)](api-ref/html/de/dd0/class_lib_home_screen.html#ab5e8e8ab7d53e0f114e9e907fcbb7643)
- [subscribe (const string& event_name)](api-ref/html/de/dd0/class_lib_home_screen.html#aa4c189807b75d070f567967f0d690738)
- [unsubscribe (const string& event_name)](api-ref/html/de/dd0/class_lib_home_screen.html#aac03a45cbd453ba69ddb00c1016930a6)
- [showWindow (const char* application_id, json_object* json)](api-ref/html/de/dd0/class_lib_home_screen.html#a69fc770cb3f94d30a10c2c8c81eb892f)
- [hideWindow (const char* application_id)](api-ref/html/de/dd0/class_lib_home_screen.html#a4dbaea6c7b310e8ce7207155ff11b32a)
- [replyShowWindow (const char* application_id, json_object* json)](api-ref/html/de/dd0/class_lib_home_screen.html#a6310b129fc85ef0623e2e2063950cc4b)
- [showNotification (json_object* json)](api-ref/html/de/dd0/class_lib_home_screen.html#a93ad567ed597a80a344ba82457c2bd7f)
- [showInformation (json_object* json)](api-ref/html/de/dd0/class_lib_home_screen.html#ada999aeb0444c964428bdf1ee236727f)
* * *
<div id="Sequence"></div>
## Sequence
<div id="InitializeSequence"></div>
### Initialize Sequence
![initialize-set-event-handler](parts/initialize-set-event-handler.svg)
<div id="TapShortcutSequence"></div>
### Tap Shortcut Sequence
![tap_shortcut.svg](parts/tap_shortcut.svg)
<div id="ShowWindowSequence"></div>
### ShowWindow Sequence
![showWindow.svg](parts/showWindow.svg)
<div id="OnScreenMessageSequence"></div>
### On Screen Message / Reply Sequence
![on_screen_message.svg](parts/on_screen_message.svg)
<div id="ShowOnscreenSequence"></div>
### ShowOnScreen Sequence
![showOnScreen.svg](parts/showOnScreen.svg)
<div id="ShowNotificationSequence"></div>
### ShowNotification Sequence
![showNotification.svg](parts/showNotification.svg)
<div id="ShowInformationSequence"></div>
### ShowInformation Sequence
![showInformation.svg](parts/showInformation.svg)
<div id="GetRunnablesSequence"></div>
### GetRunnables Sequence
![getRunnables.svg](parts/getRunnables.svg)
<div id="Sample\ code"></div>
# Sample code
You can find sample implementation of HomeScreen as below.
* `libhomescreen/sample/simple-egl`
* `libhomescreen/sample/template`
# Limitation
Now OnScreenApp is developing,approximately it will finished at GG.
# Next Plan
None.
# Appendix
```
@startuml
title Application initialization phase
entity App
entity HomeScreenBinder
entity HomeScreenGUI
App->HomeScreenBinder: init(port, token)
App->HomeScreenBinder: set_event_handler()
note over HomeScreenBinder
setup event handler the App wishes to receive
・LibHomeScreen::Event_ShowWindow
・LibHomeScreen::Event_HideWindow
・LibHomeScreen::Event_ReplyShowWindow
end note
@enduml
```
```
@startuml
title Application Callback Event TapShortcut phase
entity App
entity HomeScreenBinder
entity HomeScreenGUI
App->HomeScreenBinder: set_event_handler()
note over App
LibHomeScreen::Event_TapShortcut
end note
HomeScreenGUI->HomeScreenBinder: tapShortcut(application_id)
HomeScreenBinder->App: event_handler(application_id)
@enduml
```
```
@startuml
title Application callback event showWindow phase
actor user
entity "homescreen-service" as hss
entity launcher
entity App
entity windowmanager as wm
user-->launcher: tap app's icon
launcher->hss: showWindow()
note over hss,App
{"application_id":"tapped application id", "parameter":{"area":"display area", ...}}
end note
hss->App: push showWindow event
App->wm: activateWindow("application_name","display area")
wm-->App: push syncDraw event
App->App: display
@enduml
```
```
@startuml
title Application Callback Event On Screen Message / Reply phase
entity App
entity HomeScreenBinder
entity HomeScreenGUI
HomeScreenGUI->HomeScreenBinder: set_event_handler()
note over HomeScreenGUI
LibHomeScreen::Event_OnScreenMessage
end note
App->HomeScreenBinder: set_event_handler()
note over App
LibHomeScreen::Event_OnScreenReply
end note
App->HomeScreenBinder: onScreenMessage(display_message)
HomeScreenBinder->HomeScreenGUI: event_handler(display_message)
HomeScreenGUI->HomeScreenBinder: onScreenReply(reply_message)
HomeScreenBinder->App: event_handler(reply_message)
@enduml
```
```
@startuml
title show/hide onscreen phase
actor user
entity "homescreen-service" as hss
entity App
entity onscreenapp
entity windowmanager as wm
== show onscreen ==
user->App: the operation request onscreen
App->hss: showWindow()
note over App,hss
{"application_id":"onscreenapp",
"parameter":{"area":"display area", "file":"qml file path",
"data":{"the datas to onscreen qml"}}}
end note
hss->onscreenapp: push showWindow event
note over hss,onscreenapp
{"application_id":"onscreenapp",
"parameter":{"area":"display area", "file":"qml file path",
"data":{"the datas to onscreen qml"},
<font color=red >"replyto":"caller application id"
}}
end note
onscreenapp->onscreenapp: get and save parameters
onscreenapp->wm: activateWindow("onscreeapp", "display area")
alt can show
wm-->onscreenapp: push syncDraw event
onscreenapp->wm: endDraw("onscreeapp")
onscreenapp->onscreenapp: load and display qml file
else can't show
note over onscreenapp,wm
do nothing
end note
end
== hide onscreen ==
user->onscreenapp: tap onscreen's button
onscreenapp->hss: replyShowWindow()
note over onscreenapp,hss
{"application_id":"the application id who called onscreenapp",
"parameter": {"buttonName": "VOLUME_UP", "buttonPressMode": "shortPress", "buttonPressState": "release"}}
end note
hss->App: push replyShowWindow event
App->App: call reply function
App->hss: hideWindow("onscreenapp")
hss->onscreenapp: push hideWindow event
note over hss,onscreenapp
{"application_id":"request hideWindow application id"}
end note
onscreenapp->wm: deactivateWindow("onscreenapp");
onscreenapp->onscreenapp: hide window
@enduml
```
```
@startuml
title show notification on HomeScreen top area
entity "homescreen-service" as hss
entity homescreen
entity App
App->hss: showNotification()
note over App,hss
{"icon":"display icon", "text":"display text"}
end note
hss-> homescreen: push showNotification event
note over hss,homescreen
{"application_id":"request application id",
"parameter":{"icon":"display icon", "text":"display text"}}
end note
homescreen->homescreen: display notification message 3s
@enduml
```
```
@startuml
title show information on HomeScreen bottom area
entity "homescreen-service" as hss
entity homescreen
entity App
App->hss: showInformation()
note over hss
{"info":"display information"}
end note
hss-> homescreen: push showInformation event
homescreen->homescreen: display information message 3s
@enduml
```
|