From b6da690604cb25c51ea05fea255f1541fb91c93a Mon Sep 17 00:00:00 2001 From: "hannes.kuchelmeister" Date: Tue, 17 Mar 2020 10:47:29 +0100 Subject: [PATCH] take evaluation from outline --- .../bpmn_evaluation_input_data_generation.pdf | Bin 0 -> 19465 bytes 30_Thesis/sections/60_evaluation.tex | 87 ++++++++++++++++++ 2 files changed, 87 insertions(+) create mode 100644 30_Thesis/figures/60_evaluation/bpmn_evaluation_input_data_generation.pdf diff --git a/30_Thesis/figures/60_evaluation/bpmn_evaluation_input_data_generation.pdf b/30_Thesis/figures/60_evaluation/bpmn_evaluation_input_data_generation.pdf new file mode 100644 index 0000000000000000000000000000000000000000..c024b142bab313c55bfd03427ef028ae38fc3da3 GIT binary patch literal 19465 zcmZsB19T?O({60rd817>ww-Kj+qP}nwz;uw+qUhEle@n^zVqFC?wmQ@U6`(_?lb-L zbPbuDum}wUEei};(^d653^RZpU~6Cj!_5t#lQOn3but66{ADS?0000w5pydiV~4-B zmA;d)u(6@7kueM}FN~v;gR#Cfj9b=~y0k4W8&cOz&F&loWyX%A&H^GRI1F=>jQ~Of zH5aWBM|?KM=d*VfQ5#i_@q{@-j64ls$}TiEHj9X(s8P<%1V^_-*1&zs`x-6z)1FcW zLqcoYMZ@EcO~Uu8@uk7@S%;#0(EVi4cE4fPXmY2_+7tZZ^v;yNT}B-33pz?SZp zrQjHEprv0W9IZzUng-Ap*hV=;!8H1{z(ORcbPC^fT9-hf=c(*&)A%Bbg)VFgY^V56 zBkm7`50|{NUl+rxmmFKQYjPW#k$U1U7)4#=N~vqner>DBQ&Ju)mmH1REm06Vf<-!B z==KpN+EKvV4dU#nX>(C_j-ZwTbY5kPu9snLqloJ~>ZjcBZ}M)dlr`loeUS6_d1h6` z&efxBqLL|r1+>n;lO&oP!qCy?6&{tfB9X8VBnbW}ARCN?Nm4H336eUzHxZbz97{er zE=EU+mc04Mc6HmYhS#$_(B2iK(SHZAivI|X#dx^5J~SvXai>1U-0CP?STbqS-mHq* znL!R`Jd};SO%$1&x%+w^`g3hz&)pzu$=H|acZ&n()48UlrR}q3k~p-rG!-)GlOt;o ziwRPQRK?s786)pFp4T%siWY2tnkXv0RmdInND+8d>7B|W9|?2lQI?e2t%Mv|zwlAt zy(lug>MEp6o90JH1*BC#KUIy(Pv;!fsTYqo8Y#9+*90 z{i&iD?U|etKYORtek`2*nloin$JUd)$RHn8trkW++i(J^<>ZD|&9Z6DMzeW-0uC#EB37ca z3~C2VAEm7kHRQ(qqF@OK{nUD5=UsHWvtOakH{f#Xv#Oc?bP5&so7&Z?@yu2glWKiV zHS_2^)MDSOahbR6*%JF5zi|j%ee-$(E(`nqc=h98f0U0l`eOj*HFRh{w;-vn>dF0( z$?i$krsi$rtj_mEZ24n=@;%h}9x*aGir}^MiS*rcu?jTc@d>ei8{j;Bh-#Fi27H%3 ze7?3{v(&v?2jMQv^PmQaq`^Faz34%OZ*A87JE4j+q#gkk#8O*X^AlQ+CJm%HK`5mt zb>yw@%8)&*;gnkixJdG&kOzI37@#S9$)TylrgW;7j}}{Opym@r#ZF3%%Ud1{mhMs@ zUqEKJ>pGg}%h%;Tij6SB-#-K+V9@6*FlXC=Su3^UZ+$#)#M*?TJ;&_q_p3ywvNd4v z!xB_!oOIPIPgv1=m(4k3DBY|5*qe{1y~k~cyUy&BIJ~+C4unh~{kLw9mUXoaU-kVD zHyznI%A=F9DW$QpyR`T{*~pHe&>@A5zx-CigooOn~QU0iP`3lUcjb>)Jgl)N=urmmxcg9eT|3veLzo(u6QB8^A~xP;m_ zCtxW1+c#}shnn(*<5fm&^zhceN$a;ybBV4FYO)O{ih87vd?w+@D+S#v6{NSOS3mB6 zQdm=h^YCCU7r@9%QKhF=BBip^2y*u(COj@)@oa`?i|D)XY zZ7iS!#hJ{vhRt)kemQip+PW_uf%;-1A%fWUg>yRhe=6A*q6Nnq7Wh}sb=v&xE(?{0 zxtNHfmipTX))sz?gR){kTMZhBa9P;ow-d0tDX*jJ4CcJ zmsU|k4@ev^hrv}1fiv=Ctr&(?57DvT9p#jKOJr#9Ai)^`!zQpmw`EP!_PRrU$b-DC zfv=GoZRu6;wO|sw7Rw&hAfkrSCQ~`!nFvh_XOK8(V0A*9v)Luc3M}sQ!Hx>E>`(hO z7>hzuN59fSUElJ)XIjHa(3=+0!uMQ#fqU)92f-NI82x9}|J(WpFa80Ef9k(5!N9`6 z@{htlB-8)E$-e;Pmz$HQqSIgS0C02v!}xpA>C^uu0CYkE00sb^q5j|UFQoie#_(Sm zJuL^zzr_D){9EJSC7p<^jnn_?&xD4ah91EBU(oui^!NUcJB} z3?KtA{L4K#eFx*eeKGv^SvqNBBXfO0TQ`8_Ulu)p`L7R*Y#adXe`yQ-wfk4y5%3RY z{u>}g9c-QL{+BQRw(&3Se?wCIYuQ2H#?kH{TZZocWs3ux9Gs2+O9}ne5;k@*H#Ald z75sND{|v0c|B8(5Fa7`EHv9j$_5Z`|e}?|w0M7tmWM*Pw{lAd> z$je`-7X)o z+4ey=KH+ghZC+DP6Es{AALTc4`oS= zsDA~?sQA%Mst6{&L-CSGd>#rc#ejXmg&KwP1;&e#!l8OW%OmF zj|XR92eOo5=p9*x4aY#M3oTO!W8Ixz0N8GuDD!IM;zIWrG&0}B*oix13SPzzr`;0I zpE$fYimHHg3mXh^F~jrXrhXMr#O{7A`ehh0N5Il!XuF%xCXt^r#Gnh4I7?VSVaFp^ zQuq^>&%^^`&)@!{VAEG-AtM%uflbg8z}*w`J(tQI62t(yb62D9sRr+#W$Udj(@(3&eAQyhycEns5sXe3VxD-wyI1W~ABmfR;bY%exi#2G|Y znAHQolCl+hj>(df3eXYvI#DJhPD|Y%Dk~L_slPW4o61r0f*NPvy$s1{44>kOdDNm) zVrjQ5!?`TWC73WvhsP)wo@og5k*K4`oNA z3IjHFSiz(Dx*XLFoz@@WvNd4(dNXWuJxSn#-1*@cb%5Gp>j^`y75lUYbX<#!iSTKD z3QN}deG2o@wNdih4WyOmwp_axfe#GFX&(_Ad>ve-G0|J1=braD{*&8vj`seu{K2BT zPszS3fKX1RO}0bPhPTWy4PPcxH?H=SdF)5S9Gq~%4+sF9BSw6hA|~^`{3o>IV3h); zVrGc&A*~#HZ`7>mtwIsSXZ>oP$M*a=N|A*%T%rp=pZRn8hL9 z%4BMwUCCx5ioEtyG~`UIgtI{;S@NOt-%i9~v*Lgp8Th$5Yx?Ym+I|WsVLKe7L8(-S zx+cdoW8l!DxnLY{7*VC((0Tk@HYB#DCex}V_9_1C0%f`jBk^NlG86PEUaNR(-Y5#b zBI;VyAx$ptifvLZV`_(hs$ATK4iUXZWfe_LSTtoDni*_Wonxo=ERN;cCSnojpCj!T zb5l3XJdB$0?-44pJ1?Y!?_XabPfX*@h&H4x+8xc;-765erjPZgM(-2+bSl&g9_eZp zBQUW8Uf_Jexg&H3Y`_f zLO`p81OY3*u7F?4eli8d`Bp4b2Zg~AeU{g}Q-lK~7-d3G=+kVugEATL!UiM zL;RT}E`s4r8xT|)I%-g+ zUe0{{MUdEHmQ-F=w$4mjI?k4VdS9TTXgNo@FkaBiuvM}l!gKiH|NK)?M&I}RfLFp3 z9H@){hG);c{Wk7IZBH^MF}P>Sy+uy-X3*UU{rBUiwUsB72#)HXQklvI3N$6*AOZ=ty`lvB-^92K?kYm-s8ZlQ0ZF%UhUtv2HsW<)WgCpDMy(+Rptg>RWJBJM_{98XZ%A z94dMDqdT9Zny?C*n~)?~cnUZDkRTZuN+gC3Ya&L*Kg%ZJoJR~h^ARBzX43YV6VsJ3 zx|e01XDh60Hj>4TwXc$O{w@!S4B$V5_mclC{vcjog zHRjnYKl5<9X{|Ub(U;I5CoMx|MZ}E7jXswD)Ee7k@w)&?r!u5Bwd>IGflT!CF;}Cj zERIlbYQpmfg2yN(rdLsCu+c()S5cwgBS)7aHs?(_uxsyUkV%>ZN35_ zu%OTCP9p!ho-mQYwUzD4Tydouwe9g$nVlLva)a@f+>c$nuu+}kyyl#Q86YAP5d;|z zt1IbhuZ@J=@aQar@p~emm|ATzz<4&izYd0{I28&=n;@!oj?@r=1KoR*I8p}S6`2rw zUpJOQgrOM{yKWQ>b&uLyhFnUj9oU^OtwHB3{w%?r5HPRv^C!GmDJi`NKUX2HK*6I7 zv`E1*2$^G!jle>(4Oii{Wdse#QRMB?4DcAoJ;!AV014fJ9 zOv{@qA8WHUAub2FxxTGW<8>_vTeNsA8=MGLJgm&@FVvwoooz=cc!?o_Teaa9K#+Q| zsOkH=K=BK(ea1ixpkhFa?yC`odN--7Uu0^d0k3eIseq72Mn`P^Ngx!Ufouemu~^C4 zIPeE-EY70^+_(uK1Bf`F(F}7D5)t)(_yheFl=+0BZBNvnU2k1)MLzuBIbWSRf^U94 zUEPvBr3#IM`)@f#nh-Ml!w*|%`Ru0)gLsm^7cP*7ml7?p%r89XHa@XaA@JaLP zbE28>BOoM{aYfFX*9dp?bufgB0#Z(@pK|nIlDq1;LqU&wI%;ZSzc|kdl(Tg!V4|d9nryq084|L7+TF=<@K6L3bmo9qt?(78hPEpEOG+DX>iqVrbI8A=1 z9E++~h&XDYV-Nu@k+)G_)RD3=Tm5QvPEiy<5N+vDWfVQlWu-o+e%Ab64ZH>7MASUW zblRm`+Vo|Tz*>)^t%9&*2L&YSBbXoNr+0How z_s`LlTDTn6FN*eK>^UbzO8&G#pe3qwD7TbUR7O@-#+0WB8<&#o<=jr%2)3E(!sH?4 z9{5~!3c6tW?01669{bGIs$5I4oSHg{7!v=oYP50L!zb2)R&NH|EFL5_^MtZ8WOHng}#TsXb+w@ zxf<109*yM2Fd%vb_iFOh=#bIG$DD(L<0vCM_sSWBDZqlQSI1f@aqnHH)#`KzaT?+C z8uI-v33Iz|2sJjf=Qg`^+gAO3&pP%qIIixb`whGMPYdBLI8UiA&6?*epc62&F6I1X`Y% z(+FTG=zJhW8H%`NSqLRZQVj-?elZ1p;Qb=~p$|DhocA2WcQahjr72)mQzc4Ak#E-0 zrru#L-W5uBxs%;j(H{oJ1h`gJ)YRa0V$#c(Re zYK&NJn2MFJjfUZjD#b9DN=XNLykuMpNdhjQO-p<}?=#1ZP{$nm7L0 z9UkHMn44Y3r!#@%Uw>$_LZxfE-qvk>zRszvdN%x9+x2=nZdo$^9L^d>mM$_47kVsv z`sjV+pZ!dnwxnbx;{heu7Q*D*g;zQ}m&%&kPqjw~=ep!3Cw7ko4)2`h zEWE#miQ>bSw?u`2adku{G~VMs+_A9*NbO<9hcP1!mt+yuI7fof3InyytUk@j65Tkv zc}=F3RT(YA`D(wqNY8ss6dzd$>mx7-V-DQrV({4!*f)2%!i-9@N%D>Y?y1HxhDrR~ z>7$ZU&7&}qHpe3>Bxysk@G5TqT(22EZ`U7^=|Iv{SXwY3|ZD>oC4DQ;lw zygo5nf6EeN40waQ^C6+punOa=;^5#F@UA3kT7_{$3@nA%$56p3;zO5@ z)%M>Oe>~$ooZ8v<72OsEP{Cf)Y->_S!$#vOYjQ8qvn~JR6zOk{IVH+#x*vTac|Tj z=)*Shqr?7%J&hzjD&O*+1WQG`v~+y#a5v;9TA!C@51SfYurc%jhIT|7U$A*(({oIsFWOP|^}Bndr}AZu!Tw}7plrWuqXbQz9m3#06(6*JR$ zn0%d;uYPfw879Q7#&nN`T|HFC5@v8XTO#N|0GdY%_wK zy=6Y=QVRSMivHU`=^Ag(+r=b4k!j-nGOAsBQTo!D*9`N4x5Fw*DI{BvwnVlq!%-GKk05*OvHxMh=>bC z2q961%Y0Vnpx-)q%lN?8d1_`T+~4#?OLL?p=oX;Q&Socj%1wDqdGZ(LXC9;E&NR4K z1nzC8ji=7Ue~DX1A72_xj!#hi%^?X3i<6&&;geH#&V@>GRwBwjJIK!=EJl7F?a+bCe=srpMV`YI7;=v}{ z?ZEhlV{)p-gc%msaH-4!u6-}x5bqGn4DZa6iLK+O--n;)=ws_W`%sgp&My^*%Al#? zrxMx))ZxH4p?iVCIrGk`7v8_A3 znFW^sIpHz5%B1T%Cl|)6;=9O0^ti}X1i9=x-iL{*Y_(%K9$q$jqGa}=p zyhnR{fE>tCx$b znJ(1Tn>P2o>r%oV=cO&T(u-U1tjHr%hPAqHnJ zl%JID$@ns*s(L@ee!&nI4*$X!p9(3iD-O==&m`84zZvCY-d272+`ox-*YX*E zQR_PhhBV-d<$x{UNSt@{fq*jg6NAvRrr0|+^|ONrGxF1-XIIwLc@oqXSfqH^)}sz( zi<*9#kIugNS)xU{TmCe8Pkn#+ob?!nA=}$9{g4xi=yrXFG$ShjJ_U>(o!wc9u&&id z`2&VG7`h+EgiQ#6JqvxZNO^J@CQ7vBuzHNF?F%n_1%WCJ^kg6^@mOd{<_P45&>G6E zj%{E5>NIdP_qpJ$pnvJ)2xC_Yv$&k-&w1SAXQ7u~}v&?wClGrZMh`NJ z_6!#NF<-`SciGNdC804`&wHwB*+Ja;l5HMM4&ZWh(mf9eemb}+U3_gV z4I6o?eIMS>3y>(50jMiw8R>GWF!U&hXj{An_N-JjVrA&`jns0#rmmC?+s)=C#<%QL z!YpOB?$eEj=5MEb7W2(khYiZohDFzlyBl(q?#|Cc!dv67C0x#PI@pdvfwwu{v<4{Fy4y-HJDpBT(wy9g7gsAEl4Liban2MQ_zkWOPvX?j42|H|8tT%A2m?x$QIFXZ&Gat$oK7KW)|RmXg8UNyAcR8QQ`v zAYDphP0m<)@T{B}VHkr;xF_8|%!m^0&BY{jDFY?HdN#YS&)gd{e;`z)H#odX=lVX^ z(b=HJXykZOzKT7$eT0@&V=;FZ8=XjFfl5zCGn}^gx?*bRkKmiBeNas8o$xHQM}b| z^BFq}`er*ZQy_YjTQHyy`$6^S_-g%F^6}F{_X|clE^^P=h|OUXHv!eW;tXEk{{4#8nuC98Tpm{65#+W_(%TlE%x8=L8y1A_DUL> zl|QpBlBv&}nEwz%n@D6g}s$OfD=KQ$6&f@beUsrdl zCRV0)1YJt4r@ZwnuFzrv)}A;YVvazC=FhIR;GQ52_eL1`NLLvFPKar-{3-L z5ee7Mzjb4+Lcgv?RdQAnyvggDOhn#h{}A6M?hULj;{+3|ym^4(b5)>IbTfQUi8gT% zVf?Yb@%aQ6N0`Ql;bmjqYwI&U>+mHU=-|4oVfKwgeVoEm1sBDpdN31xm8kaTve;Lb zkC{;1n^%ukfrKQ{_y{(_m_oi#&*0oKAyg+(r@8OSga0S!2*=6}H{oFp zLJ`O`Kj6B`e%TGT>jLx{qG*oP0Ou-;pHe!ysE>KczU`ZmLtn$@jsIixm8@G&#SX!g zl>+1N0hg32!SN%jPn+BnIho6`36{CbAu2{Y0gu9>DJqX|f{jyx7+O+EUPisnK)K3# znU;!Bj}%L<+mPx3Uo+HuMCF*PnK5v1JO-AcqUutjk>!A^*@Dd&h&?5JD?iA2q1clH zTToJWmLsY5S5cG;W$|Y}D(Xma;=HGV#6D9?`a^v+?TNX}&tpmbC=CN20}p3+7mUn2 z7!XBT2vH;z_ywM%KDR0CtHZDaEPB=9MR_VN;rk~$jz^PvshaJyDKXZU#s!kG0%T?D zwyKP5{9+!@WOF`fIqYc%5XS>9o%YwMsmkrv;;XND(7--ZHrv;`Zrm1Lhm8SOpQlxV zN#~hzl4H73lnu+8kISPLT~G5DgqT_+v*`ebJ1G&zW<4O;IsX(Wua$~J^|)!4{q3pI z%9HdRez4QJDgw*ZMW!!Fbg-JT^6%VZ9Q@iId?RGNB9Chr)y> zF#4I;#4Xc={W5Dff|H$80W%1j=NAGnia`F)CngVHdt97)wQCM|gHru-NKZ$Ix{H0f z+zq!S$I`f_+qYM!T%jIzPc6RO&HBU7E0bO}r!0GBGS|tGp)%c%hqJSaSH?5ZxEr@C zNxQ{_wF=qPlN-_lAQn7R`UAgHWWDSE|!mN{i z=?!Dlx+nlFq|*WYHpjKj^r2Pcw(FyW9A+y{t2fSSYuLj?A(f1wlNt09OfYUB?7s+8 z&>a!D#2InjWEe&I+M%pIZG}#x| zFE_2TA$e`xRljTBT)3O!ncmAlDhimU#Zuj6N%#aXCie)cmwD;EXkNz|)Mjv$=4xxY zf}|5Qm<|FLlSj^S4?re;1(7>Q3`hJPw{}RKgiH^EW^_m_x18n|mvJe5z@dsS=gv<{ zVj>;+4Fmf=wDiM@j{IoHZi#8CmK$0VE#I~z4{nb_J*Y4WkQMnY!5;O?AX9`L7=Xte z;1B{$?z1=9vj9heWBDYOAYf9tHufQF0*b*gH&g8xp)MM;C?UO*Tk1lQFIdt$ZXBMX z9V^>vJ9MpB$=c(3(C;atnY&v5lupiOeTl8{^P|yoI*UsYk(>2#313wP>m$PRV^FfD z`}Lfv$I#;wYxW`*BsZZp^0jLyYM<5^NPc{iI;q|!);r$W^D;6jg9v8$@eCYjK)Pps z5YaLtL?8r;H1?!y4gk~HoomI7bSS_w@=}X6Sd=t?*9*yz$b_~4@x#)|T;Rc7r2B)6 z#J+nPDq~Wc_Eg^Ww9iVuP%96jFMSyi-NhttEKUC)EPM4#*kcSx7)-RWsZ?_br=lnY zxDN5?eoKhA?{U*n_X|+rzP2F@jOnA;;guh1bTo>~0gGr8N8rHT<9uC3H-#5+KUc5Vtw;d{j8{9&41>d0~ zj=3wVAsRLe7${XT;jL_92W71)3LfU9g1Lf$yn&6wdjs$-jIQ zJZC|u3OL`!yq4rF6|IfpuUey5-|h~DFtTECycnwtEK4Aw4Wk;OHmwZD#ejel5tB6Z zg2k+J=~}JRxez4TSKafQP^FxKX4;csO}WRhSO4g=IHU;h%bT)nWUpVfUyVz~wI7%O zA$5+?HYg|-dX_Vo=d7eT&8Vl5Dkhv?21}1H+ghC)a{G8WI^v1BNWiY<#VqC`C@W9A zDleI=5<)swRK0R6B}HYH=R|V$fmm3_#J=RU){G1Qdj}F+)TtSzSN(VZH+#;3Y3zWz z?K;FnB0GO2xh287DA9%dFM<9F(Wn-Bc#twQ3RjtxpboM1l^F(CAtRG?WXMp z?Kb3pC`Ej+VqXn8+T$+T%C2nWcYCyc@%hq6-68lueIxO~?R1^pOx%8weUUACeh)Z~ ze>boAevXcU*9CTMjK&Tc;NE|Zn1UZdcyEi>bOB?I3UI1ah(4;WKpgrfLE^|M=j2LZI{~?+zspzS(KyjP=4_kh-Tm8a71ClD01C(98L6qK|OIR~57f?kK| z;tlhdBYOE$m|M_NC(oYi!R<^yQG=z8aI+BV6Ajs#--j>MBv!aAUxs6`oc}G@!(VEL z^&RyaHA*l&4~DI1+fSPwgT`--7h2XQ>|4Ml;AU!b;$v~qC~q(Obi=7>Ze}jG4l_02 zIvG$n%6U)U0!-0^m4hFdQjlD`jmUrF+i&j`hBYRB&G3c&MaAHH>NF0A6`oI+N0^_h zkJ@RDWIMRiZ@c$AhE^Z;;r9{zPWz4atyzx0{f5(su@#&n@ZHPGO)%4^dVubRyB*vU zO*lw?`}2dLoaAB5!XZYp&)I?Rh`9 zy1%uI@IDDq0^$z+8h`vfjt~;G? zf@~jWD)cj~XOMS4Q$K9K`y7S0WT;b(_vfnK+-`2j?Cf>^d#Fd~n}RQd&OUI)eIZbV z|60p{EBfD`a`IX~Po1rTnjZFvxuJETsT!ba`m=j=dxCAjZC(vopL2Il^pkx;XZo_F z2WO7CGn5j>j4-@vi13RNHzlu0ybo#a$;ka3^!FTEiEVIJ#+~glTQAz)+en{ro@t*k zuZf>oyc9bpAz!?Bheuw`KZt#pzUjY_zvE|#J1M;Y zP{)M1QL|4BYnSN~c@BxwN2hwD-3T;(4O?`DBYc^QS-fD*seieWZ}ys2sbQQ(qnFn0vlc@Zo63O+K(bC3yt9 zjF9hdGKfzL^!=rBzcm>1j&{8>!JPD29L}hbCfHD)$mp64vN>|8dKhu9Hn~-bA z^zzWJ)d}L#>*9oaE_KDf0xSJtd*?8?2NrQ(>fd2~F#dv6#0IKr4xHlx!+z5~~#fszNpNxFEQkd^WKB z=yZM2yA155uX>U7)SmDSXe;o~UbYZh!4n|y8_4rrLZ6c3r<8PZoXtHXW9%j$N>A;& z{G~{4?=yK^Iw_ve*2m2(w^C+1)6)+*S0cMr$TwV4;m441m(8|1i3u}lk zN3NZ*oqk{c>mVLqzT3>MTHBnEY@ugfg_`X)^MjD-r;BRs4wI*fWU3Up3$@L4CuM`a z4|S%C#dY!2C8;bqp6-hJf=;W;wD~!*p}PY4VDLIK(kwz4hj?rB8JzXfjH|2@(Dr1UqH`byxCk;z{Kg-@-xcOz5HZ<|A<=bo`|>(Y4$j+9s$Tg%bvwaM##rn0nGx*&7Y_ulp#3Sc|5LI*GLeFt!#up{!u z5^t=hF?zCh{Lk5+FdCZ}Y_#xn*0$yn4p&o7aF%$(RkH0i><8UR!PC}?87{^vZ>`r5 z&*Ok87uOq@AJ5a~zEex~A17MjmWSZ^|FgTw9uSkaeOHWK^U^hR;r(B4#6 zpPc>hjYZbV^yP@M2sNiVOAuvuF648Y7eZY+H6EnSIPSOsTMwE2`9@WAo0~c}H}-kg zZ7YPgWdbv!f5(hqsDj2Sb}a!Ss>CYKur)^DH%Bne2|^8Z2@{Mi0$4m8Ep)$BM*pqM zf%zf>fioR8;?(X!)L!|aLhtB!k&lFC3!{I^!bzf_5;SDTcZ?rMzbPNS`g{&8a^d(6 zGWgGIxI~;q(_JI(9BRq}QetV~tbRQ5Ixl1KyA&T3gc{X=xZeBxwc6&ZDO3slS0SQ^ zU9LCfMl8m$Y7S`)-Y|@Jk9Z9nTbTq_4W_vAF?D{+c1D(g*p^`bg!eR%+{DG9kZ7*W+WZchuIA_m(Zj~Ky8&l&3iI6g!B;UHV&0e~5cy^}wvzN8 zh6%C#xuano<~>EA6-H$2>@4Mt(kuHW9B6MnUS)jFIlMy&lCj05=~+mG>ACF0d@=&gM1$6*)PBpe>6G$??=coAH zhl^a9`c*2s&}2jU8Vg%pjga>8SRzkPdJsy|ZG{{hRNHtmv@xMVdnE{NsX5T2SQ$I4 z;DCT1&p~(B96XfUJhu7^$n;o&9Vcv0C{iVj(l*!O{MrlgfG`*p3A3LxMd^U4JP|m_ z1xcshT{mG7a+sAz>cA6pXCq_m;hM?tnYP4r3O*kwI8KI2XD$B)9 zv{Eh00?~q&G4;L=LzGRjhz7KnZ4%jeGD_s}8X#1HkskSn6ph(obN=G3e`hamrtNnt zq3e^BlDDXutm6VrM;;l?1rBXs`htl%exKWVBwgzx1S|$Cep*nTFNRR$*rN~!jTEsb zBEzuo*++$2V!RXEG$>3_^1WMbmNI_P-`AJDjiQr9c!xF}N|!L8-;NP#69?xh&;0B7 z`WoOhP)jL^BCR1+X;(++VIku}Gu`;~>i>h*IQo{NuoBc~Tqs1egMn!s0xKG1D}66P zvfG|H%^O8m+VIav$qo}jaMPWDgk_*hixVA~2OOE>S?`%U|MI1+2~V#SfgV$z6gv%Y zwjTDDq`>&0pL9sgDG}2F^$_({H}PgIn#L@UU<*ndIt;CKNmakof?WT1Y_y#U38k3Y z$=3Lw6hf)v`kyNqTEcW~hOBG}&{K-JIh;&CSA9*^B&{RKYV#OGHuKV(O?XdFkgZ+R z)qw>wGtfFFnzg1P{1T}9<9jlFidGPq0O`mk^rC?FObZ#w^*x66@w51Zm0?jQXl`K8 z$bgvB3(^h~$c>CZ>t3N-JT)s_`k(wbS`g=ot=ad{YwPcm5XXq(p3mHF81jv;2`IM> z##i|I<64PH+f7TQj)(d#W;%)}uk9TJ{6h3Yr%GmUTO$bumkt@dJ8y2SU4a%Z6J-V~ z`Q>=@+RdDeY`Q}1i*V9nNmXRjcvg)=%o_93Ps7X2?7xGWHkR>!Ux&c&z;s5$(ug+# z>%vm@l?#NNyAU4gA=8$&nVgDQmc`D8+;YE1lC2DTY80Oqqx@;1t!7!S(@95(&&oC@ zuHysZJP_Z!;y4wtvq6I2A-G`o=(05nPqa^gkahdyQT%FD7$>Keq07!YlNn|jA z0G)P`N4U;R9|zHhYaVP?de_#HNjXSDeIDo6VA9qverTU8Y+A*3>&gi)wAk=GoTa`) zrc#NqLCW9Y%DmqLQhvZs2`i#K9(~c-%FXt?zBv4%K&hP5@FB4Xs*U81b`kUdUyVd2 z@+TPX;qM^YB>n)Q3B329Xc6MX?x*1vY#{n(E^3->23Mf_=3N(k_oqkCamSk9Q0vk2 z72LuyLzRf_f_S;=g7U`?EAmkL+JeG1B{5N2GIp_As*L% zNk-ZlBpdH1HuI6~3{jotBhEYi3z&8qUElynb&={A;;pS8l)-g(@nMs~2?u0PYWHLw72k=7C{mf(hgicY`+iG2vJr5 zfEbLS3SLkRQXesBp)q9Q=%cI8PeHZUeODc^(=XUD-w{axi9M|pR>V199SK9A6|$cI zir7+Aa#^4iyWbw_L_K=E&EtkDw5`MAMsLht*>YU1S$m?nvHsG(GNZ|97>}l^N6V5` zz>>9DkcxmuT@p5;X%U0wqM+Q061U9JLB>t|oJI$c;RhWN?66+x&5?r~3dr7|Q~3BA zg0O+HXN)6vKi(d_Mg&MXFv4@jZ)0ah@p#A45RgMA2bD@9Q^d3?W6$$yfUm&6B8>0p zeV#d-IW=*}sOA`KLi)qcj<81>=$lqND=Q{q=m9zz5Fm5RyZ6PwnGL^l zKboH-<@x0qdYR=G8E6Tm1&_3RY@Mj%aywc~jPr6keF0dAmsPkz+x+5CU?%qvQ6CU6 zf@$#i@ckZ8#Qe6vj~M3xc632qNC`-O;{X)^*ccU(PT(yD4yZsdJ#Iiu)_Ji0+t}Fl z>LGu2;@=%RNSoe}Y@BZWBg;Lbq%Iks=~)e6D)15g-oaJ}XbC%yppOZr2&Sl5jxH`2 zKWr7GoRf+J!4lK26-|&P=--nUAQqGOv0V&|>*N5}1u{v??=h#V{s!iu6uPJk%)$x| zMK4yk8Z-eEU?yuP8&y{KP8dWTZQ!~Ci4<+nvJL&WWV-|k6RBg-1S*iXI-~S6L(^=9 z0^kgpOhG~w_}t&_i3#LcEL-6HZiu_kORf%7Zbwi#;~Y%9IK}ktTWI^tYbk?Lxg=uY zt)Q3%=RAC9wWPiFKy!88tBeMlR56MazGf)DyhM`t<#A_cFkFcV>Z;s@|^T^!PHGbl4&Fz!9} zL2{xZHJMtG~>o12O*S+pW<0eW-OWJ&$K?rfG%>iZ)U`t0KI(8dAL zcYw5!h0za8(xJ81;;XwL#|KwfO5Fq&F7{DU(?1;FS2e;PUWc&PF| zj+Y*h?a}2)TZZ-^%p^KzX3kvH%B`e~yc&dxX2;AJF{7CwmuS22M3J;vAtB{)OA=w9 zSCKWEirk_lVc8*_mi?K$U6ENNe_J?C{^=lnkB`}>{W`F_8@Gylx@y|m$u`w68D zh3}8>!^QXd;I;*GHCp(nKgI?kS|Ft`Xz9z8pL`diU8#)YwJm6VWhxP7t4iqWNlbXi(?!1Ud6@9jB#b(?PeqDp_hIstcJU4r`L^YO1$ znxgA^)6Dax6V0QWv*XOfcyQ^>l`ZAE34{3UIC8Rze(1@^%3o!Fe5+REQs&_u$F=Rw zAZEF!*)AsRe`l+Hm66%^)bzT2^J__ZOv@_m26|s!2hC}kd0~Psn6%-%7&>Fx6EWC&X+RTIIb5SbvB!nyy=m9u0PEre2=@-k!F&wHzq!QKW$2NN|;EdYIhlQ zJ;TWxM1p;xVljKW{p|q!*=bzs;@1<@BbiGGjJC8?lf6ei#5S9#J+t~rm63YY{X%-~ zA;)~)P@rAgsLy$F(+6wa+-Re-lsgpMp^8CDzI7Ud{J53&Q=L(6jZv*hs{uU{emkCK zn{o}VaPQ$UCSE*A+-L$57}V0x64{W?Ms*MG?v~aBdmeIFC5=rFWwJ%vVpiDsxHnj~ zhx>L#sH^(Qwif65F`pQ|D9oS_*_#wydtY){sj7L{b4|zHpl)uDz{NFx z()Y}YHNLHOUmrZzjhk*%>DP?&4w;lPRAGa2a@gQV?`EI=iyQI2*Ykf!jwO)RX?|ob zaqIHJC!2po7nJB2=cI9hL(94zbe|BLa*k~+dsMK*rKU2ePRcd8(n7no$R^=hzS_or2>*LnltXbfg45vg>feK+wC-6cXPCP!(_yrS zSDKNFRZ=4xb)r`)2X_wfs+|mn7ES&3OTMo@HDh@t z=iS%rZmrL~=kzg&uc}+w8Fs)q!Sr`-J()OOUc-q_Iv#juWc`NlABZ96*8bYJb)!4~p6Pv{K#SNz_C0nclwGCoj)n56p{ZQ@S#(HtBx_7O4_Fa>bjiduE4-W(C zQ%dQw5obzmkcx=0%^=$(cJ_5mH9yqCZwh_DRmrC>j3XADPk|)CB z-%lbGp{4d1Pr#n#i@*VP**h@o+>9(le3lQxarWj;mM`BY2*6`HK_UCFct}w`an{CC zK@BjbP{@EWiAV;BAP52wNSdJs*h*MFe71#v=feR&teb_HjnW6`AdEH9S)pxXBBY=b zSh4(earith1WW2N1%wqRYTScSq)h_pEiI3!z38s z0tyYH(J08!=mrQrX&^+UF4QO_#KrUNKoCNxCG$0i0wT#aPlIS==yMH(=yW6!^X;e< zG@(AzsNe!S8iXXkXLd9QO^x||X>=m;do*98gXB4LmWWu$5*J~xE+#*igZc{ng6$Iu nk)WeKS1dGJ0T+oa8h9*~#1fWBf_WFBgLImjzW$EAJJtRV0R%MR literal 0 HcmV?d00001 diff --git a/30_Thesis/sections/60_evaluation.tex b/30_Thesis/sections/60_evaluation.tex index ae66802..996f51a 100644 --- a/30_Thesis/sections/60_evaluation.tex +++ b/30_Thesis/sections/60_evaluation.tex @@ -1,2 +1,89 @@ \chapter{Evaluation} \label{ch:Evaluation} + +In this chapter the prototype is evaluated in terms of its functionality and its properties. + +We will generate all possible valid configurations for one use case i.e. generate all possible valid configurations for the forest use case. + +Generate groups with preferences (explicit preferences) and configuration state (which would be for example the currently existing forest). + +\section{Group Types During Evaluation} +\label{sec:Evaluation:GroupTypes} + +\begin{itemize} + \item Groups shall be generated with random preferences + \item With grouped preferences: people adhere more or less to one profile (Forest Owner, Athlete, Consumer, Environmentalist) + \item Group of only one profile type: rather homogenous group +\end{itemize} + +\section{Metrics} +For the evaluation metrics to evaluate by are needed. + +\label{sec:Evaluation:Metrics} + +\subsection{Random Individual} +When comparing a group to individual scores, a member of the group is randomly chosen. As metric of difference used metrics are MSE, RMSE and similar metrics. +% see: https://medium.com/@george.drakos62/how-to-select-the-right-evaluation-metric-for-machine-learning-models-part-1-regrression-metrics-3606e25beae0 or https://en.wikipedia.org/wiki/Error_metric + +\subsection{Satisfaction} +As a metric on overall satisfaction within the group we propose a threshold metric that defines a user as satisfied if his score is above a threshold of 60\% and as unsatisfied with a score of less than 40\%. Now we can measure group satisfaction by amount of members being satisfied, neutral and unsatisfied. + +\subsection{Group Score} +The group score metric is to simply take the score the recommender has given to a group. This score can be compared with other configurations' score. + + +\section{Questions to Answer During the Evaluation} +\label{sec:Evaluation:Questions} + +\begin{itemize} + \item Main question: How does the group decision differ from the decision of a single decision maker? (random individual) + \item How much impact does the configuration state have on the recommendation outcome? (random individual, satisfaction) + \item How many group members are satisfied by the group decision on average? (satisfaction) + \item Is the recommender fair, i.e. no user type is always worse off than others? (satisfaction) + \item How does the amount of stored finished configurations relate to recommendation quality? (Compare the recommended configuration to the best possible configuration in terms of score using MSE and similar and in terms of satisfaction and random individual) + \item How much higher is the score of the best configuration compared to average? (group score, satisfaction, random individual) +\end{itemize} + +\section{Generating Data} +\label{sec:Evaluation:GeneratingGroups} + +For the forest use case, the idea is that there are multiple types of user profiles. Each group profile is represented by a neutral, negative or positive attitude to an attribute value. Now during data generation the attitude is converted to a preference using a normal distribution. \autoref{fig:Evaluation:DataGeneration} shows how we convert the user profile to preferences. + +\pgfplotsset{height=5cm,width=\textwidth,compat=1.8} +\pgfmathdeclarefunction{gauss}{2}{% + \pgfmathparse{1/(#2*sqrt(2*pi))*exp(-((x-#1)^2)/(2*#2^2))}% +} +\begin{figure} + \begin{tikzpicture} + \begin{axis}[ + every axis plot post/.append style={ + mark=none, domain=0:1, samples=50, smooth + }, + axis x line*=bottom, + xmin=0, + xmax=1, + ymin=0.1, + xticklabel style={ + /pgf/number format/precision=3, + }, + xtick={0,0.25, 0.5, 0.75,1}, + hide y axis] + \addplot [draw=red][very thick] {gauss(0.25,0.1)} node[text=red][above,pos=0.5] {negative}; + \addplot [draw=blue][very thick] {gauss(0.5,0.05)} node[text=blue][above,pos=0.48] {neutral}; + \addplot [draw=green!60!black][very thick] {gauss(0.75,0.1)} node[text=green!60!black][above,pos=0.5] {positive}; + \end{axis} + \end{tikzpicture} + \caption{Distribution of preferences for a user type.} +\label{fig:Evaluation:DataGeneration} +\end{figure} + +These user profiles can be used to generate rather homogenous groups but also to create groups that have interests that are more conflicting. For completely random groups a uniform distribution is used to create more chaotic groups. The whole process is shown in \autoref{fig:Evaluation:GeneratingDataProcess}. + + + +\begin{figure} + \centering + \includegraphics[width=1\textwidth]{./figures/60_evaluation/bpmn_evaluation_input_data_generation.pdf} + \caption{The process used for generating data for the evaluation.} + \label{fig:Evaluation:GeneratingDataProcess} +\end{figure} \ No newline at end of file