Assessing a Mixture Model for Clustering with the ...

31
HAL Id: inria-00073163 https://hal.inria.fr/inria-00073163 Submitted on 24 May 2006 HAL is a multi-disciplinary open access archive for the deposit and dissemination of sci- entific research documents, whether they are pub- lished or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers. L’archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d’enseignement et de recherche français ou étrangers, des laboratoires publics ou privés. Assessing a Mixture Model for Clustering with the Integrated Classification Likelihood Christophe Biernacki, Gilles Celeux, Gérard Govaert To cite this version: Christophe Biernacki, Gilles Celeux, Gérard Govaert. Assessing a Mixture Model for Clustering with the Integrated Classification Likelihood. RR-3521, INRIA. 1998. inria-00073163

Transcript of Assessing a Mixture Model for Clustering with the ...

Page 1: Assessing a Mixture Model for Clustering with the ...

HAL Id: inria-00073163https://hal.inria.fr/inria-00073163

Submitted on 24 May 2006

HAL is a multi-disciplinary open accessarchive for the deposit and dissemination of sci-entific research documents, whether they are pub-lished or not. The documents may come fromteaching and research institutions in France orabroad, or from public or private research centers.

L’archive ouverte pluridisciplinaire HAL, estdestinée au dépôt et à la diffusion de documentsscientifiques de niveau recherche, publiés ou non,émanant des établissements d’enseignement et derecherche français ou étrangers, des laboratoirespublics ou privés.

Assessing a Mixture Model for Clustering with theIntegrated Classification Likelihood

Christophe Biernacki, Gilles Celeux, Gérard Govaert

To cite this version:Christophe Biernacki, Gilles Celeux, Gérard Govaert. Assessing a Mixture Model for Clustering withthe Integrated Classification Likelihood. RR-3521, INRIA. 1998. �inria-00073163�

Page 2: Assessing a Mixture Model for Clustering with the ...

ISS

N 0

249-

6399

ap por t de r ech er ch e

INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET EN AUTOMATIQUE

Assessing a Mixture Model for Clustering withthe Integrated Classification Likelihood

Christophe Biernacki, Gilles Celeux, Gerard Govaert

No 3521

THEME 4

Page 3: Assessing a Mixture Model for Clustering with the ...
Page 4: Assessing a Mixture Model for Clustering with the ...

��������������� ��������������������������� �!�#"$����%���&����� '(�)��*+��*��, �-����!�.�/�����0"$�1�2�����)3546�!���1�2�87��)92���1�1*������

:<;.=?>A@CBEDGF.;.HJI<>KHL=?MONQP R�>TSVUW>KXKXAHY@�:<HYXKHLZ�[6S\U^]L=ENG=C_`U^DbaQNGHY=B

c&dfeg�h/i<jlknmogqpfrts uvmxwLy5h1u�w{zbuvmxg�mt|Ts}uTmow{y~ h2|T�n|�uTeCg�hC|��1wLg�zfrxh�bhC|

�V�Tw{��h1u�mt|v�

��s}z�zQwL��u ~ h!�vhC��dfhC�v��d�h�yq�{�Y�{�b��j j��L�qz�s{�{hC|

�����C�� �f�{�{��� h5zf�TwLzQwY|�h�s{|v|�h?|T|Tmoyf�Js�g<mx�nuTpf�vh�g<w ~ hCr&mxy�s��rxpQ|�uvh��s}y�s{rx�b|Tmo|<|Th1u�uvmxy��� �mxuTd¡uTdfhmoyfhC�{��s uTh ~ �1rts{|v|�mx¢Q�Cs uTmow{y�romo£{hromodfwnw ~%¤�� mxuTd�uTdfmt|¥zfpf�vzQwY|�hL¦{uvdfh§wL¨�|�hC�T©Lh ~�~ s}uvs-s}�vh§s{|v|�mo�{y�h ~ uTw-pfybª£nyfw  �y��1rop�|�uThC�v|.p�|Tmoyf�!s«g�s}�nmogqp�g¬s­zQwY|�uvh�vmxwL�TmnwLzQhC�vs}uTw{� ¤ c&dfh�moyYuThC�{��s uTh ~ �w{g�zfroh1uvh ~ rxmo£{hCrxmodfwnw ~s{zfzf�vwE�bmxg�s uvmxwLy®mt| ~ h�vmx©Lh ~  �m¯uvdfw{pbu�uvdfh­uTdfhCw{�vh1uvmo�Cs}r ~ mx°®�1pfrxuTmohC|&hCy��1wLpfyYuTh�vh ~  �dfhCy�s{zfzf�vwE�nmog�s uTªmoyf��uTdfh<mxyYuvh�{��s uvh ~ wL¨�|Th�v©{h ~ romo£{hromodfwnw ~%¤­± pfg�h�vmo�Cs}r�h1�bzQhC�Tmog�hyYuv|­wLyJ|�mogqp�ros}uTh ~ s}y ~ �Th?s}r ~ s uvsw{²%uTd�h­�vhC|TpfrxuTmoyf�<³T´¥µ���TmxuThC�Tmow{y�|Tdfw  �uvd�s u&mxu&zGh�T²¶w{�vg�|¥ 6hCrxr·¨Gw}uTd�²¶w{����dfwnwY|�moyf�-s-g�m¯�nuvpf�Th­g�w ~ hrs{y ~ s��vhroh© s}yYu�ynpfgq¨Gh�«w}²O�1rop�|�uTh��| ¤ ³¸yWzQs}�TuTmt�1pfrts}�?¦b³T´¥µ¹s}z�zQh?s}��|&uTw®¨Gh2g�w{�vh!�vw{¨fp�|�u�uTdQs}y^º¥³T´uvw!©nmxwLros}uTmow{y<w}²»|�wLg<h�w{²Quvdfh�g�mx�Yuvpf�vh�g<w ~ hCr�s{|v|Tpfg�zbuTmow{y�|Os{y ~ m¯u¥�s}y�|ThrohC�1u\s/yYp�gq¨Gh�Ow}²%�rxp�|�uThC�v|rohCs ~ moyf�<uTw�s�|�hCy�|�mo¨froh!z�s}�TuTmxuTmow{y�mxyf�<w}²�uTd�h ~ s u�s ¤¼W½Y¾·¿vÀqÁ � Â��{� g�mx�nuTpf�vhqg�w ~ hrK¦»�1rop�|�uTh�vmoyf��¦·moyLuvh�L�vs}uTh ~ romo£{hromodfwnw ~ ¦·º¥³T´Ã��TmxuThC�Tmow{y%¦·�1wLg�zfrxhuTh ~moyYuThC�{��s uTh ~ romx£Lhromxd�wYw ~ ¦b³T´¥µÄ��TmxuThC�Tmow{y ¤

ÅtÆ»ÇTÈÊÉCË&Ç�Ì�ÍoÈÊÎKÏ1Ð

Unite de recherche INRIA Rhone-Alpes655, avenue de l’Europe, 38330 MONTBONNOT ST MARTIN (France)

Telephone : 04 76 61 52 00 - International: +33 4 76 61 52 00Telecopie : 04 76 61 52 52 - International: +33 4 76 61 52 52

Page 5: Assessing a Mixture Model for Clustering with the ...

"$*��2���+������������������ ���������1�2��2� ��� 46�1�q�����13�4¥�/���1�q�������2�1������ �1� ���.�2�1���������1�q��4¥� 46�1�q�����13��2�-������q����!�����

��� ����� � � ± w{pQ|2zf�vw{zGwL|Tw{y�| ~ h���dfw{mt|Tmx�2p�yÄg<w ~ eCrxh ~ h®g��rts}yf�Lh ~ s}yQ|2pfyĨfpfu ~ h��rosL|T|Tmx¢Q�s}ªuvmxwLy�z�s}�!g�s �bmog�mo|vs uvmxwLy ~ h�rts5©n�vs{mo|Thg-¨fros{y��1h��1rts{|v|Tm¯¢Qs{yYuTh<mxyYu��C�{���h ¤ ��wLpf�2�1h�² s{mx�vh{¦�yfw{p�|!s��Gh?�)ªuvw{y�|«rohC|«zQwLmxyYuv|«w{¨Q|�hC�T©��C|§s{pb�^�1rts{|v|�h?|�moy��1wLyfynpfhC|§z�s}�­pfy^wLz��C�vs}uThCpf� ~ p^g�s �bmxg-pfg s®zGwL|�uThC�Tmow{�vm ¤µ�� s{zfzf�vwE�bmxg�s uvmxwLy ~ h�ros5©n��s}mt|�hCgq¨frts}y��h��1w{g�zfr �1u��h®moyYu��C�{���h�s}moy�|TmVw{¨buvhynpfh®h?|�u2hCy�|Tpfm¯uvh®���Cs}romt|!�Ch|vs}yQ|.�ThCy��1wLyLuv�ThC�.rxh?|Ozf�vw{¨froeg�hC|OuTd"�Cw{�vm #Ypfh?| ~ � s{zfzf�vwE�bmxg�s uvmxwLy ~ h§ros/©n��s}mt|�hCgq¨frts}y��h6wL¨�|Th�v©��h¥moyLu��1ª�L���Ch ¤�$ h?|Oh1�bz%��vmxg�hyYu�s uTmow{y�|Tpf�VrohC| ~ w{yfy"�ChC|.���hCrxrohC|Ohu\|�mogqp�r&�ChC|Omorxrop�|�uT�vhyYuVroh�¨QwLy®�1w{g�zGw{�TuThCg<hCyYu~ p¹�1�vm¯uve�vh<³T´¥µ�hCyÄ���?|�p�r¯u�s}yYu2zQwLpf�?¦('5rts�²¶w{mt|¦.��dfw{mt|Tmx�!pfy�h�²¶w{�vg�h ~ h�g�w ~ eroh®h1uqp�y y�w{gq¨��Th ~ h�rosL|T|ThC|&zGh�TuTmoyfhCyLu ¤ ³¸r�|)� sE©{eC�Th/yfw{uvs{g<g�hCyLu*#Ypfhqrxh2��TmxuTeC�Th!³T´¥µÄh?|�u�¨GhCs{p��1wLpfz5g�w{moy�|§|Thy�|Tmo¨frxh+#Ypfhroh-��TmxuTeC�Th-º6³T´,'®pfy�s}��p�|�uvhg�hyYu­g-� ~ mown��Th ~ p^g�w ~ eroh ~ hqg��rts}yf�Lhqs}pf� ~ wLyfy"�ChC|«h1u«zQs}�v©YmohyYu.'�vh1uvhyfmo��rohC|&g�w ~ erohC| ~ wLyfy�s{yLu�romxhCp/'-p�yfh2�1rts{|v|�mx¢Q�Cs uTmow{y�zQhC��uvmxy�hyYuTh ~ h?| ~ w{y�y"�h?| ¤0$Á �?� ¿ ��1 � � g<w ~ eCrxh ~ h�g��rts}y��{h{¦��1rts{|v|�mx¢Q�s}uTmow{y%¦»©n��s}mt|�hCgq¨frts}yQ�1hqmoyYu��C�{���h{¦��1�vm¯uve�vh<º¥³T´«¦»©n�vs{m¯ª|Thg-¨frts}y��h­�w{g�zfr �1u��Ch!mxyYu���{���hL¦b�1�vm¯uve�vh­³T´¥µ ¤

Page 6: Assessing a Mixture Model for Clustering with the ...

� , �-���.������4\���1�2�

��moyfmxuTh�g�m¯�nuvpf�Th�g�w ~ hCro|2s{�Th��w{g�g�w{yfro�^p�|Th ~ s{|!s5¨Qs{|Tmo|­²¶wL�2�1rop�|�uvh�qs{y�s}ro�b|�mt|�� |Thh�²¶wL�!mxy�|�uvs{y��1h�J�µ�sL��dfrts}y�s{y ~ º&sL|�²¶wL� ~ ������ ¤�� yfh!s ~ ©Es{yYuvs}�Lh§w{²�g�w ~ hrxªK¨Qs{|Th ~ �rxpQ|�uvh�vmxyf�<mt|\uvd�s u�mxu�zf�Tw ©nm ~ hC|s¹zf�Th?�1mt|�h^²¶�vs{g<hC 6wL�T£¹²¶w{�5s{|v|�h?|T|Tmxy���uvdfhJ�vhC|TpfrxuTmoyf�¹z�s{��uvm¯uvmxwLy�|®w{²!uTdfh ~ s u�s¹s}y ~ hC|TzQh?�1mts}rorx�¡²¶w{���d�wYwY|�moyf��s��vhroh© s}yYu�ynpfgq¨Gh�«w}²O�1rop�|�uTh��| ¤� g�w ~ hCr¯ªÊ¨�s{|Th ~ �rxp�|�uThC��g�w ~ hr�mo|«s�z�s}��s}g�h1uv�Tmt�«¢�yfmxuThg�mx�nuTpf�vh�g�w ~ hCr&��dQs}��s{�)uvh�vm��Ch ~ ¨n�Ämxuv|-²¶w{�vg5¦ ~ hCyfw}uvh ~�� moy¹uvdfmt|�s}�TuTmt�1roh{¦��¶²¶w{��mxyQ|�u�s}y��h � mt|<s� s{p�|v|�mts}y�g<mx�nuTpf�vh­ �dfwL|Th­�w{g�zGw{yfhCyLu�|¥d�sE©{h«uTdfh!|vs}g�h­©Es{�Tmts}yQ�1h­g�s}uT�vm¯��6s}y ~ uTd�h­ynpfg-¨QhC��� w{²uvdfh<g<mx�nuTpf�vh��1w{g�zGw{yfhCyYuv| ¤ ´6d�wYwY|�moyf��s��vhroh© s}yYu­g<w ~ hCrO�1w{yQ|�mt|�u�|§¨Gw}uvd�moy���d�wYwY|�moyf�®mxuv|«²¶wL�Tg �s{y ~ uTd�hqynpfgq¨Gh�«w}²V�1wLg�zQwLyfhyYuv|�� ¤ ³¸y5uTd�h-º&sE�{h?|�mts}y�²¶�vs{g�h ¥w{�v£G¦Qs� ¥sE��w}²V|ThrohC�)uvmxy���s�g�w ~ hrs{g�w{yf��� g<w ~ hCro| ������� ��� �!�#" mt|-��d�wYwY|�moyf�5uvdfh�g�w ~ hCr6w{²�dfmx�LdfhC|�u-zGwL|�uThC�Tmow{�-zf�vw{¨�s{¨fmxromxu�� ¤ º¥�º&sE�LhC|6uTdfhCw{�vhg5¦nuTd�h!zQwY|�uvh�vmxwL�¥z��TwL¨�s}¨fmorom¯u���w{² �%$ �Lmx©Lhy�uTdfh ~ s}uvs'& mo|

(�) � $+* &-,�. / )0& * �%$ ,1(�) �2$ ,3 "

465 � / )0& * � 4 ,1(�) � 4 , �d�h�vh / )0& * � $ ,�mt|«uTdfh�moyYuTh�L�vs}uTh ~ w{�/g�s}�v�{moy�s}r�romx£Lhromxdfwnw ~ w{²\uvdfh�g<w ~ hCr � $ s}y ~ (�) � $ ,§mo|/mxuv|z��Tmow{��zf�TwL¨�s}¨�mxrom¯u�� ¤ c&dnp�|C¦}s{|v|�pfg�moyf��uvd�s uOs}rorLg�w ~ hCro|�d�sE©{h\h�#Yp�s}rYzf�vmxwL��zf�vw{¨Qs}¨fmorxmxuTmohC|C¦ ��dfwnwL|Tmxy���uTdfhg�w ~ hCrL �mxuTdquTdfh¥dfmo�{dfh?|�u�zQwY|�uvh�vmxwL��zf�vw{¨�s{¨fmorxmxu��/mo|�h�#Ypfmo© s}rohyYu�uvw­|ThrohC�1u�uTd�h6g�w ~ hrn �mxuTdquTdfh6ros{�T�LhC|�umoyYuThC�{��s uTh ~ rxmo£{hCrxmodfwnw ~»¤ c&d�h¥º&sE�{h?|�mts}y/³¸yb²¶wL�Tg�s}uTmow{y<´6�vm¯uvh�vmxwLy7� º¥³T´8�w}²Gkb��dn &s}�9�������Y�:�;·zf�vw ©nm ~ h?|¦p�y ~ h�6�ThC�{pfrts}�vmxu��q�1wLy ~ mxuTmow{y�|C¦Ys2�ThCrxmts}¨froh§s{zfzf�vwE�nmog�s uvmxwLyquvw!uTdfh«mxyYuvh�{��s uvh ~ romx£Lhromxd�wYw ~»¤+ rxuTd�w{pf�Lduvdfh/�ThC�{pfrts}�vmxu����w{y ~ m¯uvmxwLy�|¥²¶w{��º¥³T´ ~ w�yfw{u�dfw{r ~ ²¶wL��s{|v|�h?|T|Tmoyf�2uvdfh!ynpfgq¨Gh�&w}²O�1wLg�zQwLyfhyYuv|8� moys<g�mx�Yuvpf�vh!g<w ~ hCrA¦fuTdfhC�Th/mt|�s}y�mxyQ�1�vhCs{|Tmoyf��zf�vsL�)uvmo�Cs}r»|�p�zfzQwL��u�²¶wL��m¯u�|�p�|Th/mxy5uvdfmo|§�1w{yYuvh1�nu<� |Thh­²¶w{�moy�|�uvs{y��1h'�f��s}roh�5s}y ~ ��s ² uvh�v� ������f¦Q��wYh ~ h�/s}y ~W� sL|T|Th�vg�s}yÄ�����Y�� ¤>= w  ¥h©{hC�C¦Qp�|Tmxyf��uTdfh�º¥³T´��TmxuThC�Tmow{y�²¶w{��sL|T|ThC|v|�moyf��s<g<mx�nuTpf�vh!g�w ~ hr» �dfhCy5�{�vw{pfzfmoyf�-uTdfh ~ s uvs<zf�vhC|ThyYu�|�|�wLg<h ~ ��sE �¨�sL��£n| ¤

���TwLg¬s«uTdfhCw{�vh1uvmo�Cs}rbzGw{moyLuVw{²G©nmoh !¦Ys­�w{y ~ m¯uvmxwLy<w{²G© s{rxm ~ mxu��2w}²GuTdfh�º¥³T´ s}zfz��TwE�bmog�s}uTmow{y-mo|.uvd�s uuvdfh&hC|�uTmog�s uTh ~ ©LhC�)uvw{��z�s}��s}g�huTh��w}²�uTdfh&g�w ~ hrbmt|� 6hCrxrn �mxuTdfmoyquvdfh&z�s}��s}g�huTh�.|Tz�s{�h ¤ ��w{�.g�m¯�nuvpf�Thg�w ~ hCro|C¦bm¯²�uTd�h/uT�vpfh/g<w ~ hCr»d�s{|?�A@CBD� �w{g�zGw{yfhCyLu�|¦Yuvdfhy#�FEA�A@·w}²�uTdfh/g�mx�nmoyf��zf�vw{zGw{�TuTmow{yQ| �moror�uThCy ~ uvwG�hC�Tw¹sL|�uvdfh�|vs}g�zfrohJ|Tm��ChWuThCy ~ |�uTw¹moyb¢�yfmxu��{¦�uTdnp�|�uTdfh �1w{�v�vhC|TzQwLy ~ moyf��hC|�uTmog�s}uTh ~z��TwLzQwL��uvmxwLy�|V �morxr·¨Gh«wLy®uvdfh«¨Gw{p�y ~ s}�v��w}²%uvdfh­z�s}��s}g�h1uvh�¥|�z�sL�1h'� |Thh mxuT£nmxy�s}y ~ ��pf¨fmoy � ���Y�«²¶w{�s<g�w{�vh/zf�vhC�1mt|Th«moy�|Tmx�LdLuH ¤

���TwLg s�zf��s{�1uTmt�s{r�zQwLmxyYu�w{²!©Ymoh !¦&uvdfh^moyYuTh�L�vs}uTh ~ romo£{hromodfwnw ~�~ wnh?|®yfw{u®uvs{£{hWmoyLuvw s{�C�1wLpfyYuuvdfh��rxp�|�uThC�Tmoyf�Wzfp��TzGwL|Th®s u2d�s{y ~ ²¶w{�<|�hCrxh?�)uTmoyf�^s5g�mx�Yuvpf�vh�g<w ~ hCr\moy¹s5g�w ~ hrxªK¨�sL|�h ~ �1rop�|�uvh�vmxy��zGh��|TzQh?�)uTmo©{h ¤- |Os«�w{y�|Th�#YpfhCy��1hL¦ m¯²QuTdfh&�1wL�T�vhC�1u�g�w ~ hrbmt|.yfw}u.moyquvdfh¥² s}g�mxro�!w}²·�1wLy�|�m ~ hC�Th ~ g�w ~ hrt|¦º¥³T´���TmxuThC�Tmow{y- �mxrornuThCy ~ uTw­w ©{h�vhC|�uTmog�s uvhVuTd�h&�w{�v�Th?�)u.|�mI�h¥�ThC�Ls{� ~ rohC|v|»uvdfh��1rop�|�uTh��|.|�hCz�s}��s uvmxwLyJ� |Thhº¥moh�vy�s{��£nm»s}y ~ � w © s}hC��u!�����Y�2s}y ~ knh?�)uvmxwLy�i�w}²�uTd�h!zf�Th?|�hCyYu�s{��uvmo�rxh«²¶w{�§mxrorxpQ|�uv�vs}uTmow{y�|6 ¤

³¸y�uTd�mo|�s{��uvmo�rxhL¦f ¥h­z��TwLzQwY|�h/s}y5³¸yYuThC�{��s uTh ~ ´6rts{|v|Tm¯¢Q�Cs uvmxwLy�µ%mo£{hCrxmodfwnw ~ � ³T´¥µ-&��TmxuThC�Tmow{y� �dfmt��ds{mxg�|2s{y�|T 6hC�Tmoyf��uTdfh�s{¨Qw ©Lh�g<hCyYuTmow{yfh ~ romog<mxuvs}uTmow{y�|2w}²�º¥³T´ ¤ ³¸y¹knhC�1uTmow{y¹�b¦�uTdfh�g<mx�nuTpf�vh�g�w ~ hr²¶��s}g�hC 6wL�T£!²¶wL�\�1rop�|�uThC�Tmoyf�!mt|V�vh©nmxhC 6h ~ s{y ~ uTd�h ~ m&�GhC�ThCy��1h?|V¨Gh1u� ¥hhy�uvdfh�romx£Lhromxd�wYw ~ s}y ~ uTdfh§�rosL|�ª|Tmx¢Q�s}uTmow{y5rxmo£{hCrxmodfwnw ~ s}�vh/|�uT�vhC|v|Th ~»¤ ³¸yJknhC�1uTmow{y^�<uTd�h2³T´¥µÄ�1�vm¯uvh�vmxwLy5mo|�z��Th?|�hCyLuvh ~ s}y ~�~ mo|v�1p�|v|Th ~»¤kbhC�)uvmxwLy�i2mt| ~ hC©{w{uTh ~ uvw2ynpfg�h�vmo�Cs}rQh1�bzQhC�Tmog�hyYuv|\w{y®|Tmxg-pfrts uTh ~ s}y ~ �Th?s}r ~ s}uvs2|Th1u�| ¤K `~ mo|v�1pQ|T|TmxwLy|ThC�1uTmow{y�hy ~ |¥uTdfh!z�s{zQhC� ¤

L-LNMKO PHQHR�S

Page 7: Assessing a Mixture Model for Clustering with the ...

i

� ����������� �5�2�����+46����%���&�����

³¸y g�w ~ hrxªK¨Qs{|Th ~ �rxpQ|�uvh�vmxyf�Q¦»w{¨�|Th�v© s uvmxwLy�|«s{�Th�s{|v|Tpfg�h ~ uvw5¨Qh�s�|Ts{g<z�rxh<²¶�vw{g#s�¢�yfmxuTh�g�m¯�nuvpf�Thw{²Vzf�vw{¨�s{¨fmxromxu�� ~ mo|�uT�vmx¨�pbuTmow{y�| ¤ ³¸y�s®g-pfrxuTmo©Es{�Tmts uvh-�rxp�|�uThC�Tmoyf���1w{yYuvh1�nuC¦· ¥h-s}�vhqg�s{mxyfro�W�1wLy��1hC�Tyfh ~ �mxuTd � s{p�|v|�mts}y ~ mt|�uv�Tmo¨fpbuvmxwLy�| ¤ �fwL��|�mog�zfrxmt�1mxu��{¦Q 6h!�vhC|�uT�vmt�)u�s uTuThyYuvmxwLy�uvw�uTd�mo|�|TmxuTp�s}uTmow{y ¤ º6pfu�uTdfh³T´¥µÄ��TmxuThC�Tmow{y5�s{y5¨Qhq|�uT��s}mo�{dYuT²¶w{�v ¥s{� ~ ro� ~ h1¢Qyfh ~ moy5w}uTd�h�§�w{yYuTh�Yu�|�s{|C¦b²¶w{�§mxy�|�uvs{y��1hL¦buTd�h2ros}uThCyLu�rosL|T|§g�w ~ hr8� |Thh!²¶wL�«moy�|�uvs}yQ�1h��V©Lh�vm¯uTu-�����}i ¥mxyJ �dfmo��d�s�g�m¯�nuTp��Th-w}²Vgqp�r¯uvmx© s}�vmts uThqgqpfrxuTmoyfw{g�mts}r~ mo|�uT�vmx¨�pbuTmow{y�|&mt|�moyn©{w{ro©{h ~»¤

³¸yJuTdfh<gqpfrxuTmo© s}�vmos}uTh � s}p�|v|�mts}yWg�mx�nuTpf�vh-g�w ~ hCrA¦ ~ s}uvs7&G. )0& � ����� ��� &���,�moy��-s{�Th<s{|v|�p�g<h ~uvw�¨Qh2s�|vs}g�zfroh«²¶�vw{g s<zf�TwL¨�s}¨�mxrom¯u�� ~ mo|�uT�vmx¨�pbuTmow{y5 �mxuTd ~ hyQ|�mxu��

� ) &�� * � � � �� ,K.���� 5 ��� ��� )0&�� *�� � , �A� ¤ ��

 �d�h�vh«uvdfh � � � |�s{�Th­uvdfh!g�m¯�bmoyf��zf�vw{zGw{�TuTmow{y�|>)��7B � � B��­²¶w{��s{rxr��7.�� ����� � � � s{y ~ 3 � � � .���,s{y ~ � ) � *�� � , ~ hCyfw}uvhC|VuTdfh! {ª ~ mxg�hCy�|�mow{yQs}r � s{p�|T|Tmts}y ~ hy�|Tmxu��- �mxuTd�g�hCs{y#" � s}y ~ © s}�vmos{y��1h�g�s}uT�vm¯�$ �  �m¯uvd � � . )�" � � $ � ,�¦«s{y ~% . ) � �:��� ����� � � � � � ��� ��� � � � , ~ hyfw{uTh?|®uvdfh�©LhC�1uTw{��z�s{�vs{g<huThC�w{²\uvdfh�g�m¯�nuTp��Th � s}u/dQs}y ~»¤ c&d�h�²¶w{�vg � w}²�s � s}p�|v|�mts}y�g�m¯�nuTp��Th ~ hCzQhCy ~ |!h?|T|ThyYuvmos{rxro�Ww}²¥uTdfhsL|T|Tpfg�zbuvmxwLy�|O�1wLy��1hC�Tyfmoyf�«uTdfh��w{g�zGw{yfhCyLuO© s}�vmts}y��h6g�s uv�Tmt�1h?|&$ � � |Thh�º&s}yb¢�hCr ~ s}y ~ �§s ² uThC�T��� ���L�wL�q´6hrohpb�Js{y ~ � w © s{h�Tu-� ��L��²¶w{�!s ~ h1u�s}morxh ~ zf�vhC|ThyYuvs}uTmow{y�w}²¥|Tw{g�h<g�hCs}y�mxyf�{²¶pfrOs{|v|�p�g<zfuTmow{y�|6 ¤³¸y^knh?�)uvmxwLy�iQ¦bg<wY|�u�w{²�uvdfwL|Th­²¶w{�vg�|& �moror%¨Qh2�w{y�|Tm ~ h�vh ~»¤

c&dfh�g�mx�nuTpf�vh�g�w ~ hrbmt|.u��nzfmo�Cs}rorx�-s}y�mxyQ�1w{g�zfroh1uvh ~ s u�s­|�uT�vp��1uTpf�vh�g�w ~ hr � |Thh $ hg�z�|�uThC�C¦Yµ�s{mx� ~s{y ~ ��pf¨fmoy�� �Y�L� ¤ c&d�h/�w{g�zfroh1uvh ~ s u�s<s{�Th' . ) ' � ��� ��� � ' � ,K. ) )0& � �)( � , ����� � � ) &�� �)( � ,!, �d�h�vh.uTdfhOg�mt|T|Tmxy�� ~ s u�s�s}�vh ( . ) ( �:� ��� ���)( � ,�¦E �mxuTd ( � . )+*,� ��� ��� ��� *-� � ,·s}�vh.¨fmxyQs}�v� �Wª ~ mog�hy�|TmxwLy�s}r©LhC�1uTw{��|% �mxuTd#*-� � .��\mx²Qs}y ~ w{yfro�/m¯² &��Gs{�Tmt|ThC|»²¶�vw{g �w{g�zGw{yfhCyLu.� ¤.± w}uvhVuvd�s u («~ h1¢�yfh?|.s�z�s{��uvm¯uvmxwLy( . ) ( � ��� ��� � ( � ,6w{²�uvdfh!w{¨�|Th�v©{h ~�~ s}uvs'&  �m¯uvd%( � .0/�&��+1�*-� � .���2 ¤

c&dfh!wL¨�|Th�v©{h ~ rxwL�}ªÊrxmo£{hCrxmodfwnw ~ w{² ²¶w{�&uvdfh2|Ts{g�zfrxh & � ��� ����� & � mt|

3�) �A� � ,K.�� � 5 �5476�8

9 ��� 5 ��� � � ) & � *�� � ,�: � �A� ¤ ��

c&dfh2�w{g�zfroh1uvh­row{�{ªKromo£{hromodfwnw ~ w}² ²¶w{�&uTd�h2�1w{g�zfroh1uvh!|Ts{g<z�rxh ' mt|

; 3�) �A� � ,K.�� � 5 � ��� 5 � * � � 4<6=8 ) � � � )0& � *>� � , � �A� ¤ �

³¸y-uTd�h&�rxpQ|�uvh�vmxyf�­rom¯uvh��s uTp��ThL¦ m¯uOmt|�s{ro|Tw­£Yy�w  �y-s{|�uvdfh��1rts{|v|�mx¢Q�s}uTmow{y2row{�{ªKromo£{hromodfwnw ~ � º¥�T�Ys}yYu&� ������ ¤³¸y®uTdfh«g<mx�nuTpf�vh«s{zfzf�vwLsL��d<w{²%g�w ~ hrxªK¨�sL|�h ~ �1rop�|�uTh�vmoyf�!uTd�h§w{¨Q|�hC�T©Lh ~ rxwL�}ªÊrxmo£{hCrxmodfwnw ~ mo|6g�s �bmxg�mI�h ~pQ|�moyf�q�LhyfhC�vs{rxro�2uvdfh?� � s{rx�Lw{�vm¯uvdfgN�A��h ~ yfh�&s}y ~®� s{rx£Lh�§�����{i; ¤ ³¸y®uvdfh«�rosL|T|Tm¯¢G�s uvmxwLy®s}zfz��TwYs{��dw{²�g�w ~ hrxªK¨�sL|�h ~ �1rop�|�uThC�Tmoyf��¦�uvdfh��rosL|T|Tmx¢Q�s}uTmow{yÄrow{�}ªÊromx£Lhromxdfwnw ~ mt|qg�s �bmog�m��Ch ~ p�|Tmoyf���LhyfhC�vs{rxro��s´6rts{|v|Tm¯¢Q�Cs uvmxwLy@� � �K´A� ���s}ro�{wL�TmxuTd�g �K´6hrohpf��s}y ~ � w © s}hC��u!�����L� ¤

BDC L�BFE

Page 8: Assessing a Mixture Model for Clustering with the ...

³Êu§mt|�h?s{|Tmxro��|ThhCy5uTd�s}u�uTdfh2wL¨�|Th�v©{h ~ row{�}ªÊromx£Lhromxdfwnw ~ s}y ~ uTd�hq�1rts{|v|�mx¢Q�Cs uTmow{y�row{�}ªÊromx£Lhromxdfwnw ~ s}�vhromoyf£{h ~  �mxuTd�uTd�h/²¶w{rorxw  �moyf���ThCros}uTmow{y; 3�) � � � ,K. 3�) � � � ,-E�� ; ) �A� � , �A� ¤ i; �d�h�vh

� ; ) � � � ,K. E ��� 5 ��� � 5 � * � � 4<6=8 � � ��� � �

 �mxuTd � � � . � ��� )0&�� � � � ,3 �� 5 � � � � )0&�� � � � , �A� ¤ ��

~ hyfw{uTmoyf��uTdfh®�w{y ~ mxuTmow{yQs}rOzf�vw{¨�s{¨fmorxmxu��5uTd�s}u<&���s}�vmt|�h?|§²¶�vw{g#uTdfh@�Yuvd�g<mx�nuTpf�vh®�1wLg�zQwLyfhyYu )���� ���s}y ~ ��� � �D� , ¤c&dfh�h #LpQs uTmow{y �A� ¤ i �|Tdfw  �|�uTd�s}u�uvdfh��1rts{|v|�mx¢Q�s}uTmow{y row{�{ªKromo£{hromodfwnw ~ �s}y`¨Qh��vh�Ys}� ~ h ~ sL|�s

��TmxuThC�Tmow{y�zGhy�s{rxmI�moyf��uTd�h2rxwL�}ªÊrxmo£{hCrxmodfwnw ~  �mxuTd E�� ; ) �A� � , ¤� y ~ ¦�� ; ) � � � ,6mt|�uvdfh2�vhCs{rxmI�Cs}uTmow{yw{²­s��vs{y ~ wLg�©Es{�Tmts}¨�rxh� �m¯uvd¡g�h?s}y��7) � � � ,)¦\uvdfh5hyYuT�vw{zn��w}²«uTdfh�²¶p � �� �rosL|T|Tmx¢Q�s}uTmow{y g�s}uT�vm¯�� .�/ � � � 2L¦

� ) � � � ,K. E ��� 5 ��� � 5 � � � � 476�8 � � � � � �

s{y ~  �m¯uvd�© s{�Tmts}y��h

�Vs}��)�� ; ) � � � , ,K.�� � 5 � ��� 5 � � � � 4<6=8 � � � � E

�� � 5 �9 ��� 5 � � � � 476�8 � � � :

��

c&d�h-hCyLuv�TwLzn��� ) �A� � , � |Thh®´6hrohpb�Js{y ~ kbw{�vw{g�hyfd�w^� �����mo|­s�g<h?s{|Tpf�vhqw}²\uTdfh�s}¨fmorom¯u��Ww{²VuTdfh�^ªÊ�w{g�zGw{yfhCyLu<g�m¯�nuTp��Th5g�w ~ hr � uvw z��Tw ©nm ~ h�s��vhroh© s}yYu�z�s}�TuTmxuTmow{y w}²«uTdfh ~ s}uvs )0& �:����� ��� & � , �³Ê²§uTdfh�g�m¯�nuTp��Th5�1wLg<zGw{y�hyYuv|<s}�vh� ¥hror�|�hCz�s}��s uvh ~ ¦.uvdfh��rosL|T|Tmx¢Q�s}uTmow{yÄg�s uv�Tmx� � uvhy ~ |quvw ~ h1¢�yfhs^z�s}�TuTmxuTmow{yÄw{²<)0& � ����� � � & � ,!s}y ~ � ) � � � ,�� � ¤ º¥pbu<m¯²�uvdfh�g�mx�nuTpf�vh��w{g�zQwLyfhyYu�|qs}�vh®zGwnw{�vrx�|ThzQs}��s uTh ~ ¦�� ) � � � ,6d�s{|§s-rts}�v�{h/© s}ropfh ¤� |�s��w{y�|Th�#YpfhCy��1hL¦YzGhyQs}rom��Cmxyf��uvdfh!row{�}ªÊromx£Lhromxdfwnw ~  �mxuTdE��7) � � � ,)¦\wL� E�� ; ) �A� � ,)¦V² sE©{wL�v|-g�m¯�nuvpf�Th?|�rxh?s ~ moyf��uTwÄs �1rop�|�uvh�vmxy���w{²§uTd�h ~ s uvs� �mxuTd uTdfh�L�Th?s uvhC|�u&hC©nm ~ hCy��1h ¤ ³¸y5² sL�)u�uTd�h2�vs{y ~ wLg © s}�vmos{¨froh ; 3�) � � � ,6d�s{|�¨GhhCyWhg�zfrow �{h ~ sL|�s��1�vm¯uvh�vmxwLy²¶wL�§s{|v|ThC|v|�moyf�-uTdfh2ynpfg-¨QhC��w}²O�1rop�|�uThC�v|�s{�Tmt|Tmxyf�-²¶�vw{g s � s{p�|v|�mts}y5g�m¯�nuvpf�Th!g�w ~ hCr � º¥moh�vy�s{��£nm%s}y ~� w © s{h�Tu­�����Y�� ¤

³¸y®z��vsL�)uTmt�s{r�|Tm¯uvp�s uvmxwLy�|¦LuTd�h���1wLg<z�pbuTh�uvdfh«��TmxuThC�Tmow{y ; 3�) � � � ,.mxy�uvdfh�²¶wLrxrow  �moyf�! ¥sE� ¤ µ�h1u�� ¨Gh«uTdfh/g�s �bmogqpfg romx£Lhromxd�wYw ~ � g ¤ r ¤ <h?|�uvmxg�s}uTh­w}²%uvdfh«g�mx�nuTpf�vh«©LhC�1uTw{�¥z�s{�vs{g<huThC�¥s{y ~ roh1u � )�� ,\¨Qhuvdfhq�w{�v�Th?|�zGw{y ~ mxyf��h?|�uvmxg�s uvh2g�s uv�Tmx��w{²�uvdfhq�rosL|T|Tm¯¢G�s uvmxwLy5g�s}uT�vm¯� �  �dfhC�Th � )�� ,&mo| ~ h�vmx©Lh ~ ²¶�vw{g�K� ¤ ���¨n�q�vhzfrts{�mxy��') � � � � � ,� �mxuTd%) �� � � �� � , ¤ c&dfh�g�mt|T|Tmxy��/�rxpQ|�uvh�Vmoy ~ mt�s}uTw{��| * � � s{�Th&�vhzfrts{�h ~  �mxuTd

�*-� � .�� � mx² �"! 8$# ��% � � � � )�� ,K. �� w{uTdfhC�T �mt|�h ¤

L-LNMKO PHQHR�S

Page 9: Assessing a Mixture Model for Clustering with the ...

�³¸y�uTd�h-²¶wLrxrow  �moyf��¦· ¥h< �moror ~ hyfw{uTh�� � �¶²¶w{� �^s �bmogqpfg �.wY|�uvh�vmxwL�Tm &uvdfh<²¶pfy��)uvmxwLy�z��Tw ©nm ~ mxy���LpfhC|v|Th ~ © s{rxpfh?|&²¶w{�&uvdfh!g�mo|v|Tmxyf� ~ s}uvs-²¶�vw{g(h?|�uvmxg�s uvh/©Es{rxp�h!w}² ��

�( . � ��) � , �c&d�h&�rosL|T|Tmx¢Q�s}uTmow{y<rxmo£{hCrxmodfwnw ~ ��TmxuThC�Tmow{y ; 3�) � � � ,� 6wL�T£b|� 6hCrxr� �dfhy<uTd�h�g<mx�bmxy��­z��TwLzQwL��uvmxwLy�|.s}�vh�vhC|�uT�vmt�)uTh ~ uvwW¨Qh�h #Yp�s}r ¤ º¥pbuC¦�m¯uquThy ~ |/uTwWw ©Lh�vhC|�uTmog�s uTh-uTd�h®�1w{�v�vhC�)u!ynpfg-¨QhC�2w}²��1rop�|�uTh��|/ �dfhCyy�w®�Th?|�uv�Tmt�)uvmxwLy�mt|�z�rosL�1h ~ wLy5uTdfhqg<mx�bmxy��®zf�vw{zGw{�TuTmow{y�| �A|�hChqº¥mxhC�Ty�sL��£nmV� ��Y� ¤ c&dfhq�Th?s{|Tw{y5w}².uTd�mo|¨GhdQsE©Ymow{�&mt|¥uTd�s}u�uTdfh!�rosL|T|Tm¯¢G�s uvmxwLy�row{�{ªKromx£Lhromxd�wYw ~ ; 3�) � � � , ~ wnhC|&yfw{u&zGhyQs}rom��Ch«uvdfh!ynpfgq¨Gh��w{²zQs}��s}g�h1uvh��|Omxy®uTdfh­g�m¯�nuTp��Th«g<w ~ hCr ¤ º¥pbu?¦Lmx²�sq�rosL|T|Tmx¢Q�s}uTmow{y�rxmo£{hCrxmodfwnw ~ �1�vmxuTh�vmow{y� ¥w{pfr ~ zf�vw{zGh�vrx�zGhyQs}rom��Ch�uTdfh��w{g�zfroh1�bmxu���w{²6uvdfh®g�w ~ hrK¦.m¯u-�w{pfr ~ ¨Qh�h1�bzQh?�)uvh ~ uTwJzf�Tw ©nm ~ h�s5²¶hCsL|�mo¨froh�hC|�uTmog�s uThw{²�uvdfhq�w{�v�Th?�)u&yYp�gq¨Gh��w{²O�w{g�zGw{yfhCyLu�|&mxy^s�g�mx�nuTpf�vh!�{mo©nmxyf���vmo|Th/uTw�zQs}�TuTmxuTmow{yfmoyf�<uTdfh ~ s u�s- �mxuTduvdfhq�L�Th?s uvhC|�u§h©nm ~ hy��h ¤ c&dfmt|§zGhy�s{rxmI�h ~ �1rts{|v|Tm¯¢Q�Cs uvmxwLy^�1�vm¯uvh�vmxwLyWmo|§uTdfh-mxyYuvh�{��s uvh ~ �rosL|T|Tm¯¢G�s uvmxwLyromo£{hromodfwnw ~ uTdQs u� ¥h ~ hC|v�1�vmx¨Gh/mxy�uTd�h!yfh1�nu§|ThC�)uvmxwLy ¤

� � *�� , �-����!�.�/����� 46�1�q�����13�4¥�/���1�q�8��)92���1�1*������

¢�yfmxuTh�g�m¯�nuvpf�Th�g�w ~ hr&mt|<��dQs}��s{�)uvh�vm��Ch ~ ¨n� uTdfh�ynpfgq¨Gh��w{²«�1wLg<zGw{y�hyYuv|'� s{y ~ uvdfh�©LhC�1uTw{�zQs}��s}g�h1uvh� . ) � � � ��� ��� � � � � � ����� � � � � , ��� h®s}mog#uvwW¢�y ~ uvdfh®g�m¯�nuvpf�Th�g�w ~ hCr\rohCs ~ mxyf��uvwWuTdfh�L�Th?s uvhC|�u§h©nm ~ hy��hq²¶wL�­�rxpQ|�uvh�vmxyf��uTdfh ~ s}uvsJ& ¤< �rosL|T|Tmo�Cs}r� ¥sE��²¶w{�!��dfwnwY|�moyf�®mxu­mt|«uTw5|�hCrxh?�)u­uTdfhg�w ~ hCr»g�s}�bmxg�mI�moyf�<uTdfh!moyYuTh�L�vs}uTh ~ romx£Lhromxd�wYw ~ ¦

) �� � ��A,K. s}�v� # ��%��� � / )0& * � � � ,

 �d�h�vh/ )0& * � � � ,K.����� � / ) & * �A� � �) ,��K) * �A� � , � � � ¤ �

 �mxuTd

/ )0& * � � � �� ,K. ��� 5 � � )0&�� * �A� � �) , �s{y ~�� ��� � ¨Ghmoyf��uTd�h2z�s}��s}g�huTh��|Tz�sL�1h!w}²�uTd�h2g�w ~ hr �  �m¯uvd�� �1wLg<zGw{y�hyYuv|�s{y ~ �K) * � � � ,s�yfwLy�mxyb²¶wL�Tg�s}uTmo©{h�w{�2s� ¥hCs}£nro�^moyb²¶w{�vg�s uTmo©{h�zf�vmow{� ~ mt|�uv�Tmo¨fpbuvmxwLy�w{y ²¶w{�/uTd�h®|Ts{g<h�g�w ~ hCr ¤J �rosL|T|Tmt�s}r\ ¥sE��uTw s}zfzf�vwE�bmxg�s}uTh�� � ¤ �;/mt|2uvwJp�|Th®uvdfh�º¥³T´ �1�vmxuTh�vmow{y � |Thh�²¶w{�-mxy�|�uvs{y��1h��!s{|v|2s}y ~�§s ² uThC�T�J� ���Y��

476�8 / ) & * �A� � , � 476�8 / ) & * �A� � � � , E�� ��� �� 4<6=8 )�-, � � � ¤ �  �d�h�vh � mt|¥uTdfh!g ¤ r ¤ h?|�uvmxg�s}uTh!w}²

� . �"! 8 # ��%� / )0& * � � � �) ,s{y ~ � ��� � mo|�uvdfh�ynpfgq¨Gh�.w}²Q²¶�ThCh&z�s}��s}g�h1uvh��|�moy-uTdfh�g�w ~ hr �  �mxuTd����1wLg<zGw{y�hyYuv| ¤ º¥pbu?¦Ls{|.|ThhCys{¨Qw ©Lh{¦ uvdfmt|\s}z�zf�TwE�bmog�s uTmow{y<mt|Vyfw{u\© s}rom ~ moy�uTdfh§g<mx�nuTpf�vh§�w{yYuTh�Yu\s{y ~ g�w{�vhw ©Lh��uTdfh§hg�zfrow �Yg�hCyLu

BDC L�BFE

Page 10: Assessing a Mixture Model for Clustering with the ...

w{²Quvdfh�moyYuTh�L�vs}uTh ~ romo£{hromodfwnw ~ �A� ¤ � ~ wnhC|Vyfw}uVu�s}£Lh�mxyYuTw2sL��w{pfyYuOuTd�h§s}¨fmorom¯u��-w}²GuTdfh�g�mx�nuTpf�vh�g�w ~ hruvw��{mo©{h/h©nm ~ hy��h­²¶w{��s��1rop�|�uTh�vmoyf��|�uv�Tp��1uTpf�vh/w}²�uTdfh ~ s uvs ¤

³¸y�|�uTh?s ~  ¥hq�w{y�|Tm ~ h��uvdfh<mxyYuThC�{��s uvh ~ rxmo£{hCrxmodfwnw ~ w}²Ouvdfh-�w{g�zfroh1uvh ~ s}uvs#) & �)( , � w{�§moyYuThC�{��s uTh ~�rosL|T|Tmx¢Q�s}uTmow{y�romo£{hromodfwnw ~

/ )0& � ( * � � � ,K. � �� � / ) & �)( * �A� � �� ,��K) * �A� � , � � � ¤ �

 �d�h�vh

/ ) & �)( * �A� � �) ,K. ��� 5 � � )0& � �)(�� * �A� � �) , �mxuTd � ) & �!� (�� * � � � �� ,K.���� 5 ����� ���� � � ) & � *>� � ,�� � ��� �

º¥pbu?¦% ¥h<s{�Th<|�uvmxror.² s{�h ~  �mxuTd�uTd�h<z��TwL¨frxhCg�uTd�s}u«uvdfh�º¥³T´�s}z�zf�TwE�bmog�s uTmow{y5²¶wL�­uTdfh�row{�Ls{�TmxuTd�g w{²�A� ¤ �«mt|!yfw}u2© s{rxm ~ |Tmoy��1h�uvdfh�hC|�uTmog�s uTh?|/w}²�|�wLg�h<w{²6uvdfh�zf�vw{zGw{�TuTmow{y�|­ �morxr\¨Qh�wLyJuvdfh®z�s{�vs{g<huThC�|Tz�sL�1h¥¨QwLpfy ~ s{�T�2 �d�hy<hC|�uTmog�s}uTmoyf�­uTdfh�g�mx�nuTpf�vh&g<w ~ hCrf �mxuTd�s§uvwnw­rts}�v�{h¥ynpfgq¨Gh�Ow{²·�w{g�zGw{yfhCyLu�| ¤

c�wW�1mo�v�pfgq©LhyYu/uTdfmt| ~ mx°®�1pfrxu��{¦�m¯u2mt|/w}²&mxyYuvh�vhC|�u­uvwWmo|Tw{rts uvhquvdfh®�1wLyYuT�vmx¨fpfuTmow{y w}²¥uTdfh�g�mo|v|Tmxyf�~ s uvs ( uTwquTdfh ~ hyQ|�mxu�� / )0& � ( * � � � ,�¨n���1w{y ~ m¯uvmxwLyfmoyf�2w{y (�¤ c&dfh�²¶wLrxrow  �mxy��2rxhCg�g�s2zf�Tw ©nm ~ hC|VuTdfh��pQ|�uvm¯¢Q�Cs uvmxwLy�²¶wL�&uTdfmt| ¤ µ%h1u . ) � ��� ����� � � � ,)¦ � . ) � � ����� � � � � ,¥s}y ~ � ��� � .�� ��� �� ( ��� � ¤�6½ � �¹����������� �K) * �A� � ,K. �K) ��* � � � ,��K)� * � � � ,������ �

/ )0& �)( * � � � ,+. / ) & * ( � �A� � , / ) ( * �A� � , ��\�Twnw}² �

/ )0& � ( * � � � , . � � � / )0& �)( * �A� � �) ,��K) * � � � , . � � � / )0& * ( � �A� � �) , / ) ( * �A� � �) ,��K) * �A� � , . � � � / )0& * ( � �A� � � � , / ) ( * �A� � � K, �K) ��* � � � ,��K)� * �A� � , � !. �#" �� � / ) & * ( � �A� � � � ,��K) �A* �A� � , �

�%$ � � / ) ( * �A� � � �,��K)& * � � � , ! �

y ~ ¦f ¥h/d�sE©{h

/ )0& * ( � �A� � , . � �� � / ) & * ( �!� � � �� , �K) ��* �A� � ,��K)& * � � � , � '

L-LNMKO PHQHR�S

Page 11: Assessing a Mixture Model for Clustering with the ...

. �#" � � / )0& * (��!� � � � � , �K) ��* �A� � , � �%$ � � �K)& * � � � , !. � "�� � / )0& * (��!� � � � � , �K) ��* � � � , � �

���TwLg( �dfmt��d�mxu�²¶w{rorow  �|¥uTd�s}u

/ ) & �)( * �A� � ,K. � ) & * ( � �A� � , � ) ( * � � � , ���½ �¹�b��� ������� ����������� � ����� � �K) * � � � ,<. �K) � * �A� � , �K)� * �A� � ,������������ ��� ������� ��������������� � �"!�� ��� �$#!���%� �'&"�(�*)+�(���,,�-&'�,��� � ���.�0/1�2�'����� �3��� � ��� � �'! � � �(�44�*#'�5��� �%��6&!���7�4���3� �'� ���� � �(��� �5�.8 �4�(�9) ���6:2�;�,��� � �2�,� ���.8 �%!�� ��� �<#!�>=5� � � � �(�?���@� �A� �'! � BC� ��&!���D� ��&�E4�(�$� ���,� �GF2H-H@I%�2�BC��! �@�2�<&���� �J� ��&�KL� � � �MF2H-H@ION�P |T|Tpfg�moyf��¦fsL|&mxyWµ%hCg�g�s�� ¤ �L¦nuTd�s}u �K) * � � � , . �K) ��* �A� � ,��K)& * � � � ,�¦b ¥h/d�sE©{h

4<6=8 / ) & * ( � �A� � ,K. 476�8 �#" � � / )0& * (��!� � � � � , �K) ��* � � � , � �± w   uvdfh2º¥³T´�s}z�zf�TwE�bmog�s uTmow{y�mo|&© s{rxm ~ ²¶w{� / )0& * ( � �A� � ,)¦

4<6=8 / )0& * ( � �A� � , � # ��%Q 476�8 / ) & * ( �!� � � � � ,+ESR ��� �� 476�8 � � ¤ � �d�h�vh R ��� � mo|­uvdfh�ynpfgq¨Gh�!w{²V²¶�ThCh��1w{g�zGw{yfhCyYuv|­mxy � ¤�± w{uTh-uTd�s}u!uTdfh�©LhC�)uvw{�­g�s �bmxg�mI�moyf��uTdfh�w{y ~ m¯uvmxwLy�s}r6rxmo£{hCrxmodfwnw ~ 4<6=8 / ) & * ( � �A� � � � ,/ �mxuTd¹�vhC|TzQh?�)u-uTw � mo|-yfw}u �� ¤ ��w{�-mxy�|�uvs{y��1hL¦�²¶w{�-s� s{p�|v|�mts}y g�m¯�nuTp��ThW �mxuTd�yfwÄ�vhC|�uT�vmo�1uTmow{y zfrts{�1h ~ w{y uTdfhW© s{�Tmts}y��h5g�s}uT�vm¯�¡²¶w{�vg5¦\uvdfmo|®©{hC�1uTwL��mo|) )T& � ��U � , � ����� � )T& � �U � ,!,¥ �d�h�vh

T& � . � �� � 5 � *-� � &��s{y ~

U � . � �� � 5 � * � � ) & � E T& � , ) & � E T& � , @ ���w{� 4<6=8 / ) ( * � � � ,­uvdfh�º¥³T´ s{zfzf�vwE�nmog�s uvmxwLy mt|-yfwJrow{yf�Lh�<s}zfzfromt�s}¨�rxh�|Tmoy��1h�uTdfh�hC|�uTmog�s uTh?|qw{²|Tw{g�h2g�mx�bmxyf��zf�vw{zGw{�TuTmow{y�|«�s}yJ¨Qh-w{yWuvdfh-¨Gw{p�y ~ s}�v��w}²OuTd�h-z�s{�vs{g�h1uThC�«|Tz�s{�h ¤ º6pfu§uTd�h�vhqmt|§yfwy�hh ~ ²¶w{�!s{yY��s}zfzf�vwE�bmxg�s}uTmow{yW²¶wL�/�Cs}rt�1pfrts uvmxy�� / ) ( * �A� � , ¤� �)uvp�s}roro�{¦�sWVQs u!zf�vmow{� ~ mt|�uv�Tmo¨fpbuvmxwLy²¶wL� �mt|6s $ mo�Tmt��dfroh1u ~ mo|�uT�vmo¨fpbuTmow{y�XJ)�Y � ��� ��� Y�,�� |Thh $ moh¨Gw{rxu&s{y ~ ��wL¨QhC��u­� ��}i!w{�&��mt��d�s}� ~ |Tw{y�s}y ~� �vhhCy�� ���n� ¥s}y ~ uvdfh[ZLh �·�ThC�b|�yfw{y5moyb²¶w{�vg�s uvmx©Lh ~ mo|�uT�vmo¨fpbuTmow{y5mt|§s4XJ))� 1 � ��� ���H� � 1 � ,>� |Thh2��wL¨QhC��u�����{i; ¤ c&dfhCy%¦f ¥h­dQsE©{h

/ ) ( * � � � ,K. � � �-\� � ��� � ��� ] ) �GY�,

] )�Y�, ����� ] )5Y�,2^ 3 �`_ � 5 � ! �

BDC L�BFE

Page 12: Assessing a Mixture Model for Clustering with the ...

 �d�h�vh � . �Cs}� ~ / � � � � � |�pQ��d�uvd�s u * � � .���2;)�� � � �D� , �³Êu�²¶wLrxrow  �|6uTd�s}u

/ ) ( * �A� � ,K. ] ) �MY�,] )�Y�, � ] )� ��� Y�, ��� � ] )� � � Y�,

] )� � Y:� , �³¸y�uvdfh/z�s}�TuTmt�1pfrts}���Cs{|Th'� w}².mxyYuvh�vhC|�u6LY .��{¦�m¯u�rohCs ~ |6uTw

/ ) ( * � � � ,K. ��� ��� � � � ) �FE �:, �) � �FE �:, � �

��moy�s}roro�{¦&m¯²! ¥hWw{zbu�²¶w{��uvdfhGZLh �·�ThC�n|�y�w{y�mxyf²¶w{�vg�s}uTmo©{hWzf�vmow{� ~ mt|�uv�Tmo¨fpbuvmxwLy�²¶w{��uvdfh^zf�vw{zGw{�TuTmow{yQ|)5Y .�� 1 � ,)¦Luvdfh!moyLuvh�L�vs}uTh ~ �1rts{|v|Tm¯¢Q�Cs uvmxwLy�row{�}ªÊromx£Lhromxdfwnw ~ u�s}£LhC|6uTdfh/²¶wL�Tg

4<6=8 / )0& �)( * �A� � , � # ��%Q 476�8 / ) & * ( �!� � � � � ,+ESR ��� �� 476�8 � 476�8 ] ) � � , � ��� 5 � 476�8 ] ) � � �� ,E�� 4<6=8 ] ) �� , E 4<6=8 ] )� � � � , � �A� ¤ ���;

�§yb²¶w{�TuTp�y�s uvhro� ( mt|¥pfyf£nyfw  �y ¤ ³Êu�g�hCs{y�|6uTd�s}u¥uvdfh/w{¨b��h?�)uvmx©Lh�²¶pfy��1uTmow{y�uTw�¨Gh«g�s �bmog�m��Ch ~ mxy � � ¤ �mt|«pfy�sE© s}moros{¨froh ¤§� h<�ThCzfrosL�1h!uvdfh<g<mt|v|�moyf� ~ s uvs (  �mxuTd��( . � ��)� ,� �dfh�vh mt|/s}y^h?|�uvmxg�s}uThqw{² ��E¤ ��mxyQs}rorx�� 6h/zf�vw{zGwL|Th§uvdfh2�1�vmxuTh�vmow{y

³T´¥µ ) � � � , . # ��%Q 4<6=8 / )0& * ( � �A� � � � , E R ��� �� 4<6=8 � 4<6=8 ] ) � � , � ��� 5 � 4<6=8 ] ) � � �� ,E�� 476�8 ] ) �� ,+E 476�8 ] ) � � � , � �A� ¤ �{��

 �mxuTd � . �Cs}� ~ / � � � � � |�pQ��d�uvd�s u * � � .���2;)�� � � �D� , �

knwLg�h2�1w{g�g�hyYu�|�s}�vh«moy5w{� ~ h� ¤� ¤ $ h?|�z�m¯uvh2s�|�wLg<hC �d�s u��1wLg�zfrxmt�s}uTh ~ h�nz��Th?|T|TmxwLy%¦b³T´¥µ mo|�|Tmog<z�rxh2s{y ~ hCs{|Tmorx�®�w{g�zfpbuvh ~»¤� ¤�� ¨n©Ymow{pQ|�ro��w}uTd�h����dfw{mt�1h?|qw{²CY � sL|%Y . ��-s}�vh�zGwL|v|Tmx¨froh� �dfhy |�zGhC�m¯²¶�nmoyf�^uvdfh5zf�Tmow{� ~ mt|�ª

uT�vmx¨�pbuTmow{y �K)& * �A� � , ¤ º¥pbuC¦� ¥h^|�hChWyfw¹z�s{��uvmo�pfrts}���vhCs{|Tw{y yfw{u®uTwÄp�|ThGZLh �·�ThC�b|�zf�Tmow{�~ mt|�uv�Tmo¨fpbuvmxwLy ¤

B M������������������������! "�#��� $��%&����'HM�����(&�)���*���#+-, �.,#���*�*��+/�0��'��21354763 �98&:&�;'��*�������)�<����+/�0�*���������*���#���=�����*� >?�)�0����'HM+-, �.,����*�*��+/�0��'����@���&�A+#� M���+B:�+DCE��������F��)�G(����*���6M����A���<����+/�0�*'��)�H�*�)�JIK:&�������L�6M�(MI"'��<(����<'�N�OK���6M���S)P�P�Q&��'��"��O"�)%@�����=�6M�)�<����+/�0�*'����������JRS'��$� M��*���6M�����TA����8U'�� �V�6M�(>LE'�8W����� S)P�P�X��?�)�6M-8W�Y��'HM��*��(����*��(Z,

L-LNMKO PHQHR�S

Page 13: Assessing a Mixture Model for Clustering with the ...

�&�

� ¤ ³¸y5uTdfhq³T´¥µ¹�1�vm¯uvh�vmxwLy%¦buvh�vg�|§yfw}u ~ hzGhy ~ mxyf��w{y�uTdfh-|Ts{g<z�rxhq|TmI�h�Äs}zfzGhCs{� ¤ c&dfh�5�s{yW¨Qh�1wLy�|�m ~ hC�Th ~ y�h�{romo�{mo¨frxh2|Tmoy��1h/uvdfh2h�v�vw{�&g�hCs}yWw{²�uvdfhqº¥³T´ s}zfzf�vwE�bmxg�s}uTmow{y�mxy � � ¤ �;&mt|��')��:, ¤= wnh ¥h©Lh�?¦���s ² uvh�v� ��� ���Y��<g�hyYuvmxwLyfh ~ uvd�s u�hCg�zfmx�vmt�s}r«h1�bzGh�vmxhCy��1hWd�sL|�²¶wLpfy ~ uvdfhJº¥³T´s}zfz��TwE�bmog�s}uTmow{y�uTw�¨Qh!g�wL�Th/s{�C�1pf��s uvh«moy5zf�vsL�)uvmo�h«uvd�s}y�uTd�h��')���,6hC�T�vw{�¥uvh�vg |�p��{�{h?|�u ¤ �fw{�mxyQ|�u�s}y��h{¦ dfh6g<hCyYuTmow{y�|�zf�vmxwL� ~ mt|�uT�vmx¨fpfuTmow{y�|�rxh?s ~ moyf�§uTw«s{y��') �� ��� � ,»hC�T�vw{���vs}uTdfhC��uvd�s}y��'))��,²¶w{�6uTdfh/º¥³T´ s}zfz��TwE�bmog�s}uTmow{y ¤+ |¥sq�w{y�|Th�#YpfhCy��1h§uTdfh­moyLuv�Tw ~ pQ�)uTmow{y�w}²»uThC�Tg�|6yfw ~ hzGhy ~ mxyf�w{y Jmoy�uTdfh!³T´¥µ���TmxuThC�Tmow{y�g�s}£{h?|&|�hCy�|�h ¤

i ¤&� dfhy�uvdfh � � |2s{�Th�rts}�v�{h�hy�w{pf�Ld%¦�y�s{g�hro��s{|!uTdfh � � � |2s}�vh<² s}�!²¶�vw{g �f¦� 6h®�Cs}y�p�|Th�uTdfhs}zfz��TwE�bmog�s}uTmow{y�w}²�uvdfh � s}g�g�s<²¶pfy��1uTmow{y5 �mxuTd�uTdfhqknuTmo�Tromxy��-²¶wL�Tg-pfrts

] ) � � ��, � ��� ��� �� %��C)!E � ,H) � �-, ��� �²¶w{�®rts}�v�{h5© s}ropfh?|®w}² � ¤ c&dYpQ|¦��s{ro�pfrts uTmoyf� 476�8 / ) ( * � ,<p�|Tmxy���uTdfmt|�s{zfzf�vwE�nmog�s uvmxwLy¡s}y ~�ThCg�w ©Ymoyf�-uTdfh/uvh�vg�|&w}².w{� ~ h���')��:, � sL|T|Tpfg�moyf�quvd�s u�� .�� ) -,!&rxh?s ~ |¥uvw

4<6=8 / ) ( * � � � , � ��� 5 � � 476�8 � E 476�8 � )�Y>E �� , ��� 5 � 476�8 � E )�Y:�FE �� , 476�8 �knmoy��1h

# ��%� 476�8 / ) ( * � � � � �,K. ��� 5 � � 4<6=8 � �

 �dfhy�Y .��>1 � ¦Luvdfh!³T´¥µ��1�vm¯uvh�vmxwLy� ¥w{p�r ~ �Th ~ p��h«uvw³T´¥µ�) � � � , . # ��%Q 4<6=8 / ) & * (�� �A� � � � , � # ��%� / ) ( * �A� � � �,

EWR ��� �� 4<6=8 %E �NE �� 476�8 ��uTd�s}u�mo|C¦

³T´¥µK) �A� � ,K. # ��%� 476�8 / ) & � ( * �A� � �� ,-E�� ��� �� 4<6=8 � �A� ¤ �?�³Êuqg�hCs{y�|­uTd�s}u2³T´¥µ� 6wLpfr ~ �vh ~ p��1h<uTw5uvdfh���� ��º¥³T´ s{zfzf�vwE�nmog�s uvmxwLyJw}²¥uTd�h�rxwL�Ls}�vmxuTdfg#w{²uTdfh2�w{g�zfroh1uvh!mxyYuThC�{��s uvh ~ rxmo£{hCrxmodfwnw ~  �dfhCy5hCs{��d � ¨Qh?�1w{g�h?|&ros{�T�Lh­sL| Juvhy ~ |�uTw�mxyf¢�yfmxu�� ¤� º¥pbu?¦Ymxu6mt|Vy�w}uVuv�Tpfh« �dfhy7�#mo|\�{�vhCs uvh�Ouvd�s}y�uvdfh«�w{�v�Th?�)uVynpfg-¨QhC�\w}²»g�mx�Yuvpf�vh«�1wLg�zQwLyfhyYuv||�moy��h2|�wLg<h/w{²�uTd�h � � � |¥uThCy ~ |&uvw � ¤

� ¤ c&dfh®³T´¥µ ��TmxuThC�Tmow{y�d�sL|2|Tw{g�h�rxmoyf£  �m¯uvdÄuTd�h�s}zfz��TwE�bmog�s}uTmow{y w}²&uTd�h®mxyYuvh�{��s uvh ~ w{¨Q|�hC�T©Lh ~rxmo£{hCrxmodfwnw ~ ¦Y¢���|�u&zf�vw{zGwL|Th ~ moy5´6dfhChC|Thg�s}y�s}y ~ kYuTpfu � ���������;)¦ns}y ~ g�w{�vh§zf�vhC�mo|Thro� ~ h1u�s}morxh ~s}y ~5~ mt|v�1p�|v|�h ~ moyJ´6dfmt��£{h�vmoyf�<s{y ~2= hC��£Lh�vg�s}yA��� ��Y� ¤c&dfmt|Os}zfzf�vwE�bmxg�s}uTmow{y/²¶w{�Os«�{hCyfh��s}rLmxy��w{g�zfroh1uvh ~ s uvs§g�w ~ hr � mo|.sL|�²¶wLrxrow  �| ¤ µ%hu ' . )0& � ( ,¨Qh¥uvdfh��1w{g�zfroh1uvh ~ s uvs§ �m¯uvd ~ hy�|Tm¯u���� ) ' * �!� , ¤ c&dfh¥g�mo|v|Tmxyf� ~ s}uvs ( d�sE©LhVuvdfh��1w{y ~ m¯uvmxwLy�s}r~ hyQ|�mxu�� � ) ( * & �!� �� , . � ) ' * �A�) ,

/ )0& * � �� , � �A� ¤ �C�;

BDC L�BFE

Page 14: Assessing a Mixture Model for Clustering with the ...

�L�

s}y ~ uvdfh-´6dfhh?|�hCg�s}ybª�kYuTpfu � �K´\ª�k &s}z�zf�TwE�bmog�s uTmow{y®uvs}£LhC|¥uvdfh/²¶w{�vg

4<6=8 � / )0& * � �� ,��K) * � , � 4<6=8 � � ) ' * �A�) ,��K) * � , E 476�8 �-) ' * � � � , � � @� 476�8 � 476�8 / ) & * �A��� , E � � 476�8 � �A� ¤ �i

 �dfh�vh � mt|�uvdfh g ¤ r ¤ hC|�uTmog�s uTh w}² ¡~ hC�Tmo©{h ~ ²¶�TwLg�uTdfh w{¨Q|�hC�T©Lh ~ |vs}g�zfrohA& w{²-|Tm��Ch O¦� s}y ~ � @ ~ hCyfw}uvmxyf�¡uTd�h�ynpfg-¨QhC��w{²2z�s}��s}g�huTh��|�²¶wL�5�Th?|�zGhC�1uTmo©{hro�¡uTdfh�moy��1wLg<z�rxhuTh ~ s uvss}y ~ uTdfh��w{g�zfroh1uTh ~ s}uvs�g<w ~ hCro| ¤ |!|�dfw  �yJmxy¹´6dfmt��£{h�vmoyf��s{y ~�= hC��£{hC�Tg�s{yG�������Y��)¦GuTd�mo|s}zfz��TwE�bmog�s}uTmow{y�mo| ~ h ~ p��h ~ ²¶�TwLg uTd�h!m ~ hCyYuTmxu��

/ )0& * � ,K. �-) ' * � , � / )0& * � � , �K) * � , � � ) ' * ��!� ,��K) * � , � �A� ¤ �?�

/ ) & * � ,Os}y ~ � ) ' * � , ~ hCyfw}uvmxy��!�Th?|�zGhC�1uTmo©{hro�!uvdfh�g�s}�v�{moy�s}rbromo£{hromodfwnw ~ ²¶w{�VuTdfh�moy��w{g�zfroh1uTh~ s u�s§s{y ~ uTd�h¥�w{g�zfroh1uTh ~ s u�sf¦ s}y ~ � ) & * ��!� ,%s{y ~ � ) ' * � � , ~ hy�w}uTmoyf��uvdfh&�1w{�v�vhC|TzQwLy ~ moyf���w{moyYu ~ mo|�uT�vmx¨�pbuTmow{y�|&w{²�uvdfh/w{¨�|Th�v©{h ~ w{���1wLg�zfrxhuTh ~ s}uvs<s}y ~ uTdfh!z�s{�vs{g�h1uThC� ¤+ z�zfrx�nmoyf�<uTdfhº¥³T´ s}zfz��TwE�bmog�s}uTmow{y5uvw�uvdfh�yYp�g<hC�vs}uTwL�«s}y ~J~ hCyfw{g�moy�s uvw{�­w}²Vuvdfh<|ThC�w{y ~ uThC�Tg w{² � � ¤ �E��)¦s}y ~ p�|Tmxyf�quTdfh«² s{�1u6uvd�s u¥uTd�h ~ s}uvs ' s}�vh«�w{g�zfroh1uvh ~ |Tw2uvd�s u¥m¯u�|&|�pb°®�mxhCyLu�|�uvs uvmo|�uTmt�|6g�s u���duTdfh/h�nzGhC�1uTh ~ |Tpb°®�1mohyYu�|�u�s uTmt|�uTmt�|&�{mo©{hCy7&�s{y ~ � � |�s<�1wLy�|�h #Ypfhy��h{¦YuTd�h«g ¤ r ¤ h?|�uvmxg�s uvhC|w}² ²¶�vw{g uvdfh/w{¨�|Th�v©{h ~®~ s}uvs &�s}y ~ ²¶�vw{g uvdfh!�1w{g�zfroh1uvh ~�~ s u�s �' s{�Th«uTdfh!|vs}g�h ¤ qrxh?s ~ |6uTw� � ¤ �Ci; ¤³¸yJuvdfh�g�m¯�nuTp��Th��1wLyLuvh1�nuC¦» ¥h<d�sE©{h � . � @+. � ��� � s{y ~ uvdfh�´\ª¸kJs}zfzf�vwE�bmxg�s}uTmow{yJ�w{y�|Tmo|�uv|mxy��vhzfrts{�mxyf�-uTd�h­g�mt|T|Tmoyf� ~ s u�s *-� �  �m¯uvd � � � )�� ,\²¶w{� .�� ��� ��� � �s{y ~ � .�� ��� ��� � � s}y ~ m¯urxh?s ~ |¥uvw

476�8 � / ) & * � � � �) ,��K) * � � � , � 4<6=8 � � ) �' * �A� � �) ,��K) * �A� � , E ��� 5 �

�� � 5 � � � � )�� , 4<6=8 ) � � � )�� , , ���mxy�s{rxro�{¦fuTdfh-´\ª�k�s}zfzf�vwE�bmxg�s}uTmow{y�w{²�uvdfh!row{�Ls{�TmxuTd�g w}²�uTdfh!moyYuTh�L�vs}uTh ~ wL¨�|�hC�T©Lh ~ rxmo£{hCrxmodfwnw ~�Th?|�p�r¯u�|&mxy�uTd�h/²¶w{rorxw  �moyf���1�vm¯uvh�vmxwLy

´&k ) � � � , . # ��%Q 476�8 / )0& * � ) , �!� � � � � , E R ��� �� 476�8 � 476�8 ] ) � � , � ��� 5 � 476�8 ] ) T � � �� ,E�� 476�8 ] ) �� , E 476�8 ] ) � � � , � � ) � � � , � �A� ¤ � �;

L-LNMKO PHQHR�S

Page 15: Assessing a Mixture Model for Clustering with the ...

�E�

 �dfh�vhT � .

�� � 5 � � � � ) , �= hC�ThL¦f 6h/g�s}£Lh­u� 6w<w{¨�|Th�v© s uvmxwLy�| ¤

� ��mo�v|�uC¦�moy�uvdfh®g�mx�Yuvpf�vh��1wLyLuvh1�nuC¦�uTdfh�º6³T´$s}z�zf�TwE�bmog�s uTmow{y mt|!yfw}u2© s{rxm ~ ²¶w{�2¨Gw}uvd�uTdfhynpfg�hC�vs}uTw{� � � )0& �� * � , s{y ~ uTdfh ~ hyfwLg<moy�s}uTw{� � � ) ' �) * � , w}²?� � ¤ �?� ¤ º¥³T´ mo|pQ|�h ~ dfhCpf�vmo|�uTmt�s{rxro��s{|&mt|�w{² uThy�p�|Th ~ moy�uvdfmt|��1wLyLuvh1�nu ¤

� kbhC�1wLy ~ m¯u®|Thhg�|<uvd�s u�uTd�h�vh�mt|�rom¯uTuTroh ~ m �·h�vhy��h5¨Qhu� 6hChy ´&k ) � � � ,qs{y ~ uTdfhWº¥³T´��TmxuThC�Tmow{y

º6³T´ ) �A� � ,+. / ) & * �A� � ��� , E � ��� �� 4<6=8 � �A� ¤ �E��º¥w{uTd¡��TmxuThC�Tmts s}�vh��1wLg�z�s}�vh ~ wLy¹uvdfh5¨�s{|Tmo|<w{²«ynpfg�h�vmo�Cs}r¥h1�bzGh�vmxg�hyYu�|-moy¡uTdfh5yfh�Yu|ThC�1uTmow{y ¤

� � � ���&�.�146�q�¹�¥�����&�.�)�����-���

� h^�1wLg�z�s}�vh�uvdfhWzf��s{�1uTmt�s}r&¨Ghd�sE©nmow{��w}²!�1�vmxuTh�vmts�º¥³T´ ) � � � ,�¦�´&k ) � � � ,-s}y ~ ³T´¥µ�) �A� � ,2²¶w{���d�wYwY|�moyf�5uvdfh®²¶wL�Tg � s{y ~ uTd�h�ynpfgq¨Gh�'� w}²§�w{g�zGw{yfhCyLu�|2w{²�s^g<mx�nuTpf�vh�g�w ~ hCr6wLy�uTdfh�¨�s{|Tmo|w{²«ynpfg�h�vmt�s}r¥h1�bzGh�vmxg�hCyLu�|�w{y¡¨Qw{uTd�|�mogqp�ros}uTh ~ s}y ~ �vhCs}r ~ s}uvs ¤ knmoy��1hL¦\moy uvdfmt|�s}�TuTmt�1roh� ¥h5s}�vhmoyYuThC�Th?|�uvh ~ moy!g<w ~ hCr¯ªÊ¨�sL|�h ~ �1rop�|�uvh�vmxy���¦? 6hV�vhC|�uT�vmt�)u�s}u�uThCyYuTmow{y/uTw � s}p�|v|�mts}y!g�mx�nuTpf�vhC| ¤ c&dfhV²¶w{�vg �w{²·uTdfh«g<mx�nuTpf�vh�g�w ~ hrGmt| ~ h¢�yfh ~ ¨Y�<z�s{�vs{g<huThC�TmI�moyf�/uTd�h§�1w © s}�vmts}y��h�g�s}uT�vm¯�@$ � w}²%s2�w{g�zGw{yfhCyLumoyWuvh�vg�|­w{²Vm¯u�|«hCmx�Lhyn© s}ropfh ~ h?�1wLg<zGwL|TmxuTmow{y%¦·s{| ~ h©Lhrow{zGh ~ moy�º&s{yb¢�hr ~ s{y ~ ��s}² uTh�v� �������{�;�s}y ~´6hCrxhCpb��s{y ~ � w ©Es{h�Tu ��� ��L��1¦ $ � . R ��� � � ��� @� � i ¤ � �; �d�h�vh R � . * $ � * ��� � ~ hyfw{uTmoyf�<uTdfh!ynpfg-¨QhC��w}².©Es{�Tmts}¨�rxh?|¦ � � mt|&uvdfh!g�s uT�vmx�®w}².hmo�{hyn©LhC�)uvw{��|\w{²$ � s{y ~ � � mo|§s ~ mos{�{w{yQs}r»g�s uv�Tmx�»¦f|�p���d�uvd�s u * � � * . �{¦f �mxuTd�uTd�h!yfw{�vg�s}rom��Ch ~ hmo�{hyn© s}ropfh?|&w}²&$ �wLy�uvdfh ~ mts}�Lw{y�s{r»mxyWs ~ hC��Th?s{|Tmxy��-wL� ~ hC� ¤ c&d�h­zQs}��s}g�h1uvh� R � ~ h1uThC�Tg�moyfhC|¥uvdfh2©Lw{ropfg�h­w{²�uvdfh �Yuvd�L�TwLpfz%¦ � � mxuv|�w{�vmxhCyYuvs uvmxwLy­s{y ~ � � mxuv|�|�d�s{zQh ¤ º¥�«s{rxrow  �moyf��|�wLg�hO¨fpbu�yfw{u�s}ror}w{²YuvdfhC|Th�#Yp�s{yLuvm¯uvmxh?|·uTw© s{�T�<¨Qhu� 6hChy��{�vw{pfz�|C¦Y 6h«w{¨bu�s}moy®hCsL|�morx��moyYuTh�vzf�vh1uvh ~ g�w ~ hrt|6 �dfmo��d�s}�vh§s}z�zf�TwLzf�vmos}uTh�uvw ~ h?|T��Tmo¨Qh© s{�Tmow{p�|q�1rop�|�uvh�vmxy��^|�mxuTp�s}uTmow{y�| ¤�= hC�ThL¦� ¥h��w{y�|Tm ~ h�vh ~ � � ~ m �·h�vhyYuqg�w ~ hrt|2�vhrts uvh ~ uvw ~ m&�GhC�ThCyLusL|T|Tpfg�zbuvmxwLy�|�w{y5uvdfhq�L�TwLpfz5© s}�vmos{y��1h/g�s uv�Tmt�1h?|§s}y ~ uTdfh2z��TwLzQwL��uvmxwLy�|�w}².uvdfhqg�mx�Yuvpf�vh2g�w ~ hr � � �w{²\uvdfhC|Th�g<w ~ hCro|!s{�Th�wL¨buvs{mxyfh ~ ¨n�^sL|T|Tpfg�mxy���h #Yp�s}r.w{� ~ m �·h�vhyYu!©{wLrxpfg�h?|¦�|Td�s{zQh?|¦%wL�TmohyYu�s uTmow{yQ|wL�«z��TwLzQwL��uvmxwLy�| ¤ �\mx�LdLu/g�w ~ hrt|/s{|v|�pfg�h ~ mts}�{wLy�s}r�© s}�vmos{y��1h-g�s uT�vmt�1hC|C¦»s}y ~ ²¶w{p��«g�w ~ hrt|!s{|v|Tpfg�h|TzfdfhC�Tmt�s{rG|Td�s{zQh?| ¤ c�s}¨froh-�­zf�vw ©nm ~ h?|Vuvdfh ~ hC|Tmx�Ly�s uvmxwLy�s{y ~ uvdfh!��d�s}��s{�1uTh�vmt|�uvmo�C|Vw}²�uTdfh2� �qg�w ~ hrt| ¤³¸y�s}rorQh�nzGh�vmog<hCyYuv|C¦{uvdfh«�rxp�|�uThC�Tmoyf�2dQsE©{h�¨GhhCy ~ hC�Tmo©{h ~ ²¶�TwLg¬uvdfh§g ¤ r ¤ h?|�uvmxg�s uvh � w}²»uTd�h§g�m¯�nuvpf�Th©LhC�1uTw{��z�s{�vs{g<huThC�.s}uOd�s}y ~ w{¨fuvs}moyfh ~  �mxuTd-uTdfh � � s{rx�Lw{�vm¯uvdfg ¤ c�w­�Lh1uV|Thy�|Tmx¨�rxh¥g�s �bmxg�s�¦ uTdfh � �s{rx�Lw{�vm¯uvdfg�mo|/moyfmxuTmts uvh ~ mxy�uTdfh<²¶wLrxrow  �mxy��� &sE� � ��mx��|�u?¦»uTd�h®´A� � s{rx�Lw{�vm¯uvdfg�mo|/��s}y��uTmog�hC|­²¶�vw{g��s}y ~ w{g �hyYuThC�v| ¤ c&dfh2��d�wL|Thy�yYp�gq¨Gh�� ~ hzGhy ~ |�wLy�uvdfh/²¶hCs}uTpf�vhC|�w}²�uTdfh ~ s}uvs<uvw�¨Qhq�rosL|T|Tmx¢�h ~»¤c6�nzfmt�s}roro����mxy���Th?s{|ThC|¥ �mxuTd5uTd�hq|Ts{g�zfrxh2|TmI�h2s}y ~ uvdfhq|Tz�s{�h ~ mog<hCy�|TmxwLy ¤ ³Êu§mt|�|TzQh?�1mx¢�h ~ ²¶wL��hCsL��dh�bzQhC�Tmog�hyYu6dfhC�Th?s ² uvh� ¤ c&dfhCy%¦YuTdfhC�Th­s}�vh�u� ¥wqzGwL|v|�mo¨fmorxmxuTmohC| � hCm¯uvdfh�6uTd�h!´A� � s}ro�{wL�TmxuTdfg zf�vw ©nm ~ h ~

BDC L�BFE

Page 16: Assessing a Mixture Model for Clustering with the ...

�?�

g�w ~ hr zf�vw{zGw{�TuTmow{y ©Lw{ropfg�h |�dQs}zGh wL�TmohyYuvs}uTmow{y� � R�� � ¢f�bh ~ ¢f�bh ~ |�zfd�h�vmo�Cs}r ± � � R � � � ¢f�bh ~ © s}�vmos{¨frxh |�zfd�h�vmo�Cs}r ± � � R�� � ¢f�bh ~ ¢f�bh ~ ¢f�bh ~ ~ mts}�Lw{y�s{r� � R � � � ¢f�bh ~ © s}�vmos{¨frxh ¢f�bh ~ ~ mts}�Lw{y�s{r� � R�� � � ¢f�bh ~ ¢f�bh ~ © s}�vmos{¨froh ~ mts}�Lw{y�s{r� � R � � � � ¢f�bh ~ © s}�vmos{¨frxh © s}�vmos{¨froh ~ mts}�Lw{y�s{r� � R ; � ¢f�bh ~ ¢f�bh ~ ¢f�bh ~ ¢��nh ~� � R � ; � ¢f�bh ~ © s}�vmos{¨frxh ¢f�bh ~ ¢��nh ~� � R ; � � ¢f�bh ~ ¢f�bh ~ © s}�vmos{¨froh © s}�vmts}¨froh� � R � ; � � ¢f�bh ~ © s}�vmos{¨frxh © s}�vmos{¨froh © s}�vmts}¨froh� � R � � ��� @ � ¢f�bh ~ ¢f�bh ~ © s}�vmos{¨froh ¢��nh ~� � R ��� � ��� @ � ¢f�bh ~ © s}�vmos{¨frxh © s}�vmos{¨froh ¢��nh ~� � R � � � � @� � ¢f�bh ~ ¢f�bh ~ ¢f�bh ~ © s}�vmts}¨froh� � R ��� � � � @� � ¢f�bh ~ © s}�vmos{¨frxh ¢f�bh ~ © s}�vmts}¨froh� � � R�� � © s}�vmos{¨froh ¢f�bh ~ |�zfd�h�vmo�Cs}r ± � � � R � � � © s}�vmos{¨froh © s}�vmos{¨frxh |�zfd�h�vmo�Cs}r ± � � � R�� � © s}�vmos{¨froh ¢f�bh ~ ¢f�bh ~ ~ mts}�Lw{y�s{r� � � R � � � © s}�vmos{¨froh © s}�vmos{¨frxh ¢f�bh ~ ~ mts}�Lw{y�s{r� � � R�� � � © s}�vmos{¨froh ¢f�bh ~ © s}�vmos{¨froh ~ mts}�Lw{y�s{r� � � R � � � � © s}�vmos{¨froh © s}�vmos{¨frxh © s}�vmos{¨froh ~ mts}�Lw{y�s{r� � � R ; � © s}�vmos{¨froh ¢f�bh ~ ¢f�bh ~ ¢��nh ~� � � R � ; � © s}�vmos{¨froh © s}�vmos{¨frxh ¢f�bh ~ ¢��nh ~� � � R ; � � © s}�vmos{¨froh ¢f�bh ~ © s}�vmos{¨froh © s}�vmts}¨froh� � � R � ; � � © s}�vmos{¨froh © s}�vmos{¨frxh © s}�vmos{¨froh © s}�vmts}¨froh� � � R � � ��� @ � © s}�vmos{¨froh ¢f�bh ~ © s}�vmos{¨froh ¢��nh ~� � � R ��� � ��� @ � © s}�vmos{¨froh © s}�vmos{¨frxh © s}�vmos{¨froh ¢��nh ~� � � R � � � � @� � © s}�vmos{¨froh ¢f�bh ~ ¢f�bh ~ © s}�vmts}¨froh� � � R ��� � � � @� � © s}�vmos{¨froh © s}�vmos{¨frxh ¢f�bh ~ © s}�vmts}¨froh

c�s{¨froh<� � $ h?|T��TmozbuvmxwLy�w{²�uTd�hq� � � s}p�|v|Tmos{y�g�m¯�nuvpf�Th!g�w ~ hCro| ¤

L-LNMKO PHQHR�S

Page 17: Assessing a Mixture Model for Clustering with the ...

�Ci

s�yfw�hg�zbu��^�1rop�|�uThC�­zQs}�TuTmxuTmow{yJs{y ~ uvdfh � � s{rx�Lw{�vm¯uvdfg�mo|­moyfm¯uvmos}uTh ~  �mxuTd�uTdfh<z�s}��s}g�huTh�«© s}ropfhC|~ h�vmx©Lh ~ ²¶�vw{g uvdfmo|�zQs}�TuTmxuTmow{y%¦VwL�<uTdfh^´A� �ls}ro�{w{�vmxuTdfg zf�vw ©nm ~ h ~ z�s{��uvm¯uvmxwLy�|- �m¯uvd s}u<rohCsL|�u�w{yfhhCg�zbu����1rop�|�uThC�§s}y ~ uTd�h � � s}ro�{w{�vmxuTdfg mt|�moyfm¯uvmos}uTh ~ �quTmog�hC|� �mxuTd5��s}y ~ wLg �1hCyYuTh��| ¤

����� ����� ������������������������� �!��#"��w{�Oh?s{��d��Ww{yYuTh§´¥s{�Trow«h�bzQhC�Tmog�hyYuC¦L 6h&�{hCyfh��s uvh��W�­|Ts{g<z�rxh?|�²¶�TwLg$hCsL��dqu��nzGh&w}²»|�mogqpfrts uvh ~<~ s u�s ¤

$ ��� ��� % Á ������1 ���� ½ �E� À'& �)(� &+*\½ � ½-, � Á .Q½ � 1 �#/0/ &+,21� h�|Tmxg-pfros}uTh ~ s­²¶wLpf��ª¸�1wLg�zQwLyfhyYu � s}p�|v|Tmos{yqg�m¯�nuvpf�Th� �mxuTd<uvdfh�²¶w{rorow  �mxyf�/|vs}g�zfroh�|�mI�hL¦ ~ mog<hCy�|TmxwLys{y ~ z�s}��s}g�h1uvh�&© s}ropfhC| � w{yfh!w{²�uvdfhq�W��|Tmxg-pfros}uTh ~�~ s}uvs�|Th1uv|�mo| ~ mt|TzfrosE�Lh ~ mxy#��mx�Lpf�vh<�;� s;! �

%. � �=� � . � � � . � � �43 " � . ) � � � , @ $ � . �� � . � � �43 " � . )65 � � ,1@ $ � . ���7 . � � �43 "7. )98 � � ,1@ $

7. ���: . � � �43 "

:. )<; � � ,1@ $

:. � �

³¸y<uvdfmo|\h1�bzGh�vmxg�hyYu\s{rxrbuvdfh§� �/g�w ~ hCro|Og�hCyLuvmxwLyfh ~ moy®c�s{¨froh!�¥ ¥h�vh��1wLy�|Tm ~ hC�Th ~ ¦} �mxuTd�uvdfh�ynpfgq¨Gh�w{²��1rop�|�uTh��|6©Es{�T�nmoyf�!²¶�vw{g w{y�h�uTw�|Th©{hCy�s}y ~ �!¨QhCmxy��<|Th1u6uTw��W� ¤ �.h���1hCyLu�s}�Lh�w}²���dfwnwY|�moyf�qs-�1w{p�zfrxh) �A� � ,­mt| ~ mt|TzfrosE�Lh ~ moy¹c�s{¨frxh���²¶w{�-º¥³T´¬s}y ~ ´&k»¦�|Tmxy��h®¨Gw}uTd¹��TmxuThC�Tmts5�{mo©{h�h�fs{�)uvrx�JuTdfh�|Ts{g�hs{y�|T 6hC���¶³¸y�² s{�)u?¦Lmoy�s{rxrGh1�bzGh�vmxg�hyYu�|\ ¥h§�1wLy�|Tm ~ hC�Th ~ ¦LuTdfhC�Th�mt|6©{h�v�<rxmxu�uvrxh ~ m&�GhC�ThCy��1h�¨Gh1u� ¥hhCy�º¥³T´s{y ~ ´&k ¤ 1¦�s}y ~ moy�c�s}¨froh/�q²¶wL�&³T´¥µ ¤ c&dfh«² sE©{wL�TmxuTh/�1wLpfzfroh ) �A� � ,\w}².º6³T´�s}y ~ ´&k�� �Th?|�z ¤ ³T´¥µ 6mo|~ hzfmt�)uvh ~ mxy���mo�{pf�vh��� ¨ �¶�vhC|Tz ¤ �A� !&²¶w{�&uTd�h ~ s u�s�|�hu ~ mo|TzfrtsE�{h ~ moy#��mo�{p��Th�� � s; ¤ c&dfwL|Th­¢��{pf�vhC|z��Tw ©nm ~ h&mo|Tw}ª ~ hyQ|�mxu��2hroromxz�|ThC|�²¶wL�VhCsL��d<�w{g�zGw{yfhCyLu ¤ ³Êu6mo|O�vhg�s{�T£ s}¨�rxh6uTd�s{y�º6³T´ s}y ~ ´&k�|ThrohC�1uOuTdfhh�fs{�)u«g<w ~ hCr� �mxuTd^uTdfh-h1�fs{�1u§ynpfgq¨Gh�­w}²V�1wLg�zQwLyfhyYuv| ¤ ³T´¥µ zf�Th²¶h��|§s�u� ¥w}ª¸�1wLg�zQwLyfhyYu�g�m¯�nuvpf�Thw{²�uvdfh/²¶w{�vg � � � R � � � �� �dfmt��d�g�s{£{hC|�|ThyQ|�h­²¶�vw{g uvdfh2�1rop�|�uTh�vmoyf��zQwLmxyYu�w}²�©nmxhC  ¤

$ ��� �>= �@? Á ���� & � ½ , � & ÁA, � 1�B��"���C� & � , � &DC ����� ½c&d�hq|�mxuTpQs uTmow{yW ¥hq�w{y�|Tm ~ h��dfhC�Thqd�s{|�¨GhhCyW¢���|�u«zf�TwLzQwY|�h ~ mxyJº¥w� ~ wL�Ls}y �������L�&s}y ~ s}rt|�w®�w{y�|Tm¯ª~ h�vh ~ moy�´6hrohpf�Ws{y ~ knwL�TwLg�hyfdfw���� ���� ¤ ³Êu«mt|­s�¢�©Lh1ª¸�1w{g�zGw{yfhCyYu � s}p�|v|Tmos{yWg<mx�nuTpf�vhq �mxuTdJuTdfh²¶wLrxrow  �moyf�<��dQs}��s{�)uvh�vmo|�uTmt�| �

#.FE �43 � .F5� � . � � � � " � . ))�,� � � � � �,� � � � ,1@ $ � . �� � . � � �GE " � . )<H � 3 � �-� � 3 � H � 3 � �-� � 3 , @ $ � . ���7 . � � � � "

7. ))� � � �I5 � � � � �)5 , @ $

7. ��#: . � � � 5 "

:. ))�)J � � 3 � 8 � ;;, @ $

:.F5 ���K . � � � H "

K. )98 � ; � �GJ � � 3 , @ $

K.L; � �

��w{�Ouvdfmo|\h1�bzGh�vmxg�hyYu?¦{w{y�rx�quTdfh�h�bsL�)uVg�w ~ hr � � � R � � �Qd�s{|O¨GhhCy®�1wLy�|�m ~ hC�Th ~  �dfhCy��Tp�yfyfmoyf�/uTdfh� ��s}ro�{w{�vmxuTdfg5¦buvdfh2ynpfgq¨Gh�«w}²O�1rop�|�uTh��|�mt|�© s}�v�nmxy��-²¶�vw{g w{y�h/uTw®hCmx�LdLu§s{y ~ � . 3 � ¤ �.h���1hCyYuvs}�Lhw{².��d�wYwY|�moyf�-uTdfh!ynpfg-¨QhC��w}²O�1wLg�zQwLyfhyYuv|?� mt| ~ mt|�z�rosE�Lh ~ mxyWc�s}¨froh!i<²¶w{��º¥³T´«¦G´&k�s}y ~ ³T´¥µ ¤f� hy�w}uTh­uvd�s u§º¥³T´�s{y ~ ´&k®uvhy ~ uTw�w ©Lh�vhC|�uTmog�s uTh§uTdfh!�vmo�{dYu�yYp�gq¨Gh��w}².�1wLg<zGw{y�hyYuv| �¶¢�©{h�\ �d�h�vhCs{|

BDC L�BFE

Page 18: Assessing a Mixture Model for Clustering with the ...

�E�

� * � � � � i � � � �� ���'� � R�� � � � � ��� � � � ���� � R � � � � � � � � � � �� � R�� � � � � i � � � ���� � R � � � � � � � � � � �� � R�� � � � � � � � � � �� � R � � � � � � � � � � � �� � R ; � � � � � � � � �� � R � ; � � � � � � � � �� � R ; � � � � � � � � � �� � R � ; � � � � � � � � � �� � R � � ��� @ � � � � � � � � �� � R ��� � ��� @ � � � � � � � � �� � R � � � � @� � � � � � � � � �� � R ��� � � � @� � � � � � � � � �� � � R�� � � � � � � � � �� � � R � � � � � � � � � � �� � � R�� � � � � � � � � �� � � R � � � � � � � � � � �� � � R�� � � � � � � � � � �� � � R � � � � � � � � � � � �� � � R ; � � � � � � � � �� � � R � ; � � � � � � � � �� � � R ; � � � � � � � � � �� � � R � ; � � � � � � � � � �� � � R � � ��� @ � � � � � � � � �� � � R ��� � � � @ � � � � � � � � �� � � R � � � � @� � � � � � � � � �� � � R ��� � � � @� � � � � � � � � ����� � i �i �Y� � � �

c�s}¨froh2� � �fwLpf���1rop�|�uThC�v| � zQhC�v�hyYuvs{�{h­w}²O��dfwnwL|Tmxyf�2) � �!� ,6¨n��º¥³T´�s}y ~ ´&k ¤

L-LNMKO PHQHR�S

Page 19: Assessing a Mixture Model for Clustering with the ...

� �

� * � � � � i � � � �� � � � � R�� � � � �W� � � � � �U�� � R � � � � � � � � � � �� � R�� � � � � � � � � � �U�� � R � � � � � � � � � � �� � R�� � � � � � � � � � �� � R � � � � � � � � � � � �� � R ; � � � � � � � � i� � R � ; � � � � � � � � �� � R ; � � � � � � � � � �� � R � ; � � � � � � � � � �� � R � � ��� @ � � � � � � � � �� � R ��� � ��� @�� � � � � � � � �� � R � � � � @� � � � � � � � � �� � R ��� � � � @� � � � � � � � � �� � � R�� � � � � � � � � � � �� � � R � � � � � � � � � � �� � � R�� � � i � � � � � �� � � R � � � � � � � � � � �� � � R�� � � � � � � � � � �� � � R � � � � � = � � � � � � ���� � � R ; � � � � � � � � �� � � R � ; � � � � � � � � �� � � R ; � � � � � � � � � �� � � R � ; � � � � � � � � � �� � � R � � ��� @�� � � � � � � � �� � � R � � � ��� @ � � � � � � � � �� � � R � � � � @� � � � � � � � � �� � � R ��� � � � @� � � � � � � � � ����� � � �}i i� � � � �

c�s}¨froh!� � ��w{pf���rxp�|�uThC�v| � zQhC�v�hyYuvs{�{h­w}²O��dfwnwL|Tmxy�� ) � �!� ,6¨n�®³T´¥µ ¤

BDC L�BFE

Page 20: Assessing a Mixture Model for Clustering with the ...

� �

³T´¥µÄ² sE©{w{��|¥uTd�h2²¶w{p��«�1wLg�zQwLyfhyYu«|Tw{ropbuTmow{y ¤ c&dfmo|�²¶w{pf�­�1rop�|�uTh�­|�wLrxpfuTmow{y%¦Qg<hC�T�Lmxy����1wLg<zGw{y�hyYuv|!�s{y ~ �<mxyYuvw�w{yfh2�rxp�|�uThC�C¦�mo|�s��vhCsL|�wLy�s}¨�rxh/|�wLrxpfuTmow{y5s{|�mxu«s}z�zQh?s}��|¥²¶�TwLg ��mx�Lpf�vh!�f¦f �dfmt��d5zf�Tw ©nm ~ hC|uvdfh ~ hCy�|Tm¯u��-w}²·uTdfh§zf�Tw{��hC�1uTmow{y�|.w{²Gh?s{��d�g�m¯�nuTp��Th§�w{g�zGw{yfhCyLuVwLy<uTdfh�²¶wLpf�\�wYwL� ~ mxy�s}uTh?|Os �bhC| ¤ c&d�mo||Tw{ropbuvmxwLy�d�sL|�s}rt|�w<¨GhhyW|ThrohC�1uTh ~ p�|Tmoyf�<uTdfh ± �¥´ ��TmxuThC�Tmow{y�w}²V´6hrohpb�5s}y ~ knwL�TwLg<hCyfdfw%���������; ¤$ ��� ��� � ,�ÁA,%¿ B��"���?� & � , ��1 ���� ½ �� h<yfw   �1wLy�|�m ~ hC�«h�nzGh�vmog<hCyYu§²¶�vw{g#s®g�mx�nuTpf�vh-w{²6s®p�yfm¯²¶wL�Tg#s{y ~ s � s}p�|v|Tmos{y^�1rop�|�uvh� ¤ � yfhqw{²uvdfh��W�5|Tmxg-pfrts uTh ~�~ s u�s�|Th1u�|!mt| ~ mt|�zfrtsE�{h ~ moy ��mx�Lpf�Th��5s}y ~ uvdfh�g�m¯�nuvpf�Th®��dQs}��s{�)uvh�vmo|�uTmt�|/s{�Th�s{|²¶wLrxrow  �| � �. � ��� � . �� )0&-, . � � 3 � � � � 3 ^�� � � � ��� )�� � , ^�� � � � ��� )�� � ,� �� �y�w{ybª � s}p�|v|Tmos{y��1rop�|�uThC�

� � � 3 � � )0& * )6J � J � � , @ � � , �� �� �� s}p�|v|�mts}y5�1rop�|�uThC��

 �d�h�vh ^�� � � � ��� ~ hyfw{uThC|§uTd�h<moy ~ mt�s}uTwL�§²¶pfyQ�)uTmow{y�w}²Vuvdfh<mxyYuThC�T© s{r � E � � � � ¤«� d�hyJ�vpfyfy�mxyf��uTd�h � �s{rx�Lw{�vm¯uvdfg5¦�wLyfrx�JuTdfh�g�w ~ hCr � � R�� �¥mo|2�w{y�|Tm ~ h�vh ~ ¦ ��mo|q© s}�v�Ymoyf��²¶�vw{g wLyfh�uTw5¢Q©{h®s}y ~ �%. � � ¤�.hC�v�hyYuvs{�{h�w{²«��dfwnwL|Tmoyf� � mt| ~ mo|TzfrtsE�{h ~ mxy�c�s}¨froh5� ¤ ³¸y¡uTdfmt|��sL|�h5º¥³T´ d�s{|�s ~ mt|Ts{zfzGw{moyLuvmxy��¨GhdQsE©Ymow{� ¤ c&dfmt|2h1�fs{g<z�rxh®d�mx�Ldfrxmo�{dYu�|qs5uvhy ~ hCy��1� w}²�uvdfmt|-��TmxuThC�Tmow{y%¦.s}ro�vhCs ~ �Jg�hyYuTmow{y�h ~ moyÄuTdfhmoyYuT�vw ~ p��)uvmxwLy ��� d�hy�uTd�h��1rop�|�uvh�vmxy��!g<w ~ hCr�s uVdQs}y ~ �¶d�h�vh�s � s{p�|v|�mts}y�g�m¯�nuvpf�Th�g�w ~ hCr ~ wnh?|Oyfw}u¢�u/ ¥hror�uTdfh ~ s}uvs�¦%º6³T´ÃuThy ~ |­uTw�w ©{hC�Th?|�uvmxg�s uvh2uvdfh�yYp�gq¨Gh�/w}²&�1w{g�zGw{yfhCyYuv| ¤'� y^uvdfh��1w{yYuv�vs{�T�L¦³T´¥µ moy��1rop ~ h?|2s�uThC�Tg �7) � � � ,)¦�zGhy�s{rxmI�moyf�5w ©{hC�Trts}z�zfmxy����1rop�|�uThC�v|C¦%¨�s{ros{y��1moyf��uTdfh�rts{��£^w{²\¢fu2w{²uvdfh ~ s}uvs�uTw5uTd�h<g�w ~ hCr\s u!d�s{y ~ s}y ~ �s{y�¨Gh<uTdfwLpf�{dYu2w}²&s{|/g�w{�vh<�TwL¨fp�|�u­uvw5©Ymow{rts uvmxwLy�|­w}²¥uTdfhg�w ~ hCr%|�zGhC�m¯¢Q�Cs uvmxwLy�|¥uTd�s{yWº6³T´«¦fsL|&m¯u§s{zfzGhCs}��|&moy�uvdfmt|&h1�bzQhC�Tmog�hyYu ¤

����� � ��� ��� �2 ��"-��#"$ �>= ��� � ( ½�� 1  %�� & �G(0? ��1 1G½Y¾ � ½ �c&d�mo|6¢���|�u�h�bs{g�zfrxh­w{y��vhCs}r ~ s}uvs<�1wLy��1hC�Ty�|6pfyfm ~ mog�hy�|TmxwLy�s}r ~ s uvs ¤.� h!�1wLy�|Tm ~ hC�¥uTdfh­²¶w{p��¥g�w ~ hCro|sE© s{mxrts}¨froh!moy ~ mxg�hCy�|�mow{yWwLyfhJ� � � R � �K¦ � � � R�� �ʦ � � R � � �ʦ � � � R � � � � �m¯uvd�� . � ��� ��� � E®s}y ~ � . � �<uTw�w{g�zfpbuvh�uTdfh®º¥³T´«¦�´&k s{y ~ ³T´¥µ��1�vm¯uvh�vmos�w{y�uTd�h�� ���hC�TpfzfuTmow{y ~ pf��s uvmxwLy�|/w}²¥uTdfh � r ~ ��s{m¯uvdb²¶pfr�Lh�b|Th�#� ���Cs{rxmoyfm­s}y ~ º¥w  �g�s}y ����� � ¤ ± pfg�h�vmo�Cs}r�© s{rxpfh?|�w}²­uTd�hC|Th^�1�vm¯uvh�vmos�s}�vh5�Th?|�zGhC�1uTmo©{hCrx�~ mo|TzfrtsE�{h ~ moy�c�s}¨�rxh?|$��¦f�2s}y ~ � ¤ ³¸y®uvdfwL|Th�u�s}¨frohC|C¦ � ± �nmxy ~ mo�Cs uvhC|C¦Ymoy�s{rxr·�sL|�h?|\¨�pbu¥wLyfh{¦Yuvd�s u¥uTdfh� ��s}ro�{w{�vmxuTdfg ~ m ~ y�w}u«�w{yn©{hC�T�Lh«²¶wL��uTd�h-�1wLyb¢��Lpf�vs}uTmow{y5s u§dQs}y ~»¤ �fwL��uvdfhq|Tw{ropbuTmow{yW|ThrohC�)uvh ~ ¨n�º¥³T´ � g�w ~ hr � � R � � �% �m¯uvd2� . 5;)¦b³T´¥µ mt|&yfw}u�sE© s}moros{¨froh��n¨fpbu�uvdfh/�Th?s{|Tw{y�²¶wL�6uvdfmt|&mo|&yfw{u&uTdfh/yfwLy�w{yn©{hC�T�Lhy��h/w}² � �Ħ·¨fpfu«mxu­mt| ~ pfh2uvw®uTd�h2² s{�1u§uvd�s u«uTdfh�� � w{zGh��s uTwL�§rohCs ~ |�uvw�s ~ hC�{hCyfh��s uvhzQs}�TuTmxuTmow{y � uvdf�ThCh��1rop�|�uThC�v|qmxy�|�uTh?s ~ w{²¥²¶wLpf�H ¤ º¥³T´$s{y ~ ´&kÄ|ThrohC�)uqsJ�1w{p�zfrxh�) � � � ,­¢fu�uvmxyf�J 6hCrxruvdfh-|ThC�w{y ~ zGhCs{£5w}²OuTd�h ~ hCy�|�mxu�� � |Thh ��mo�{pf�vh2i � s � �dfhC�Th?s{|§³T´¥µÄzf�vh1²¶h��|§s�g�m¯�nuTp��Th2 �mxuTd�g�w{�vh|ThzQs}��s uTh ~ �1wLg<zGw{y�hyYuv| � |Thh ��mo�{pf�vhqi �¶¨ ¤ �Ww{�vhw ©Lh�?¦fmxu­mt|§ ¥w{�TuTdWy�w}uTmoyf��uTd�s}u­³T´¥µ mo|§uTdfh�|Tw{roh��TmxuThC�Tmow{y���dfwnwL|Tmxy��'� . � ²¶w{��|Tw{g�h/w}²�uvdfh!g�w ~ hrt| ¤

L-LNMKO PHQHR�S

Page 21: Assessing a Mixture Model for Clustering with the ...

���

−2 0 2 4 6 8 10

−4

−2

0

2

4

x1

x2

4 clusters

−2 0 2 4 6 8 10

−4

−2

0

2

4

BIC

x1

x2

−2 0 2 4 6 8 10

−4

−2

0

2

4

ICL

x1

x2

�As6uT�vpfh!z�s{��uvm¯uvmxwLy �¶¨ &º¥³T´\ª�´&k®z�s{��uvm¯uvmxwLy � ��¥³T´¥µ z�s}�TuTmxuTmow{y

��mo�{pf�vh�� � �fwLpf���1rop�|�uThC�v|& �mxuTd ~ m&�GhC�ThCyYu�w ©{h�vrts}zfzfmoyf� ¤

� � � � i � � � �º¥³T´ � � � �{� � � $A$ � � �´&k � � � �W� � � $A$ � � �³T´¥µ � � � � = � i ��� � �

c�s{¨froh­i � º¥w�� ~ w{�Ls{y � |6|vs}g�zfrohC| � zQhC�v�hyYuvs{�{h­w}²O��dfwnwL|Tmxyf���  �m¯uvd�uTdfh!g�w ~ hr � � � R � � � ¤� � � � i �

º¥³T´ � ��� � �U� i´&k � ��� � �U� i³T´¥µ � ����� � � �

c�s}¨�rxh2� �V± w{ybª � s}pQ|T|Tmos{y��rxp�|�uThC��|Ts{g�zfrxh?| � zGh���1hCyLu�s}�Lh­w{²���dfwnwY|�moyf���  �mxuTd�uvdfh!g�w ~ hr � � R�� � ¤� * � � � � i � � ��� � R � � ªÊin�b� ª¸�L��� ª¸�f�E� ª¸�L�}i ª¸�{�n� ª¸�L�L� �� � R � � � ªÊin�b� ª¸�L�L� ª�� �� �#���A= ± ±� i� � � R � � ªÊin�b� ªÊin��� ª¸�f��� ª¸�L�}i ª¸�{� � ª¸�{�"� �� � � R � � � ªÊin�b� ª¸�f�E� ª�� �� ± ± ±� ��� � � R � � � � � R � � � � � � R � � � � � R � � � � � � R � � � � R � �

c�s{¨frxh�� � º6³T´�© s}ropfhC|¥²¶wL�&uTdfh � r ~ ��s}mxuTdf²¶pfr%�{hC�b|�hC� ¤

BDC L�BFE

Page 22: Assessing a Mixture Model for Clustering with the ...

���

−5 0 5 10 15 200

0.01

0.02

0.03

0.04

0.05

0.06

0.07

0.08

Den

sity

Axis 1

Class 1Class 2Class 3Class 4Class 5

0 5 10 15 20 250

0.01

0.02

0.03

0.04

0.05

0.06

0.07

0.08

Den

sity

Axis 2�As&s �bmt|&w{yfh �¶¨ �s}�bmo|6u� ¥w

0 5 10 15 20 250

0.01

0.02

0.03

0.04

0.05

0.06

0.07

0.08

Den

sity

Axis 30 5 10 15 20 25

0

0.01

0.02

0.03

0.04

0.05

0.06

0.07

0.08

Den

sity

Axis 4� ��&s �bmt|¥uTdf�vhh � � &s}�bmo|6²¶w{p����mo�{pf�vh2� � º¥w�� ~ w{�Ys}y � |6�rosL|T| ~ hy�|Tm¯uvmxh?|&zf�vw}��hC�1uTh ~ wLy�uvdfh/²¶w{p����1wnw{� ~ moy�s uvh­s}�nh?| ¤

−1 0 1 2 3 4 5 6

−3

−2

−1

0

1

2

3

x1

x2

��mo�{p��Th!� �K pfy�m¯²¶wL�Tg s{y ~ s � s}p�|v|�mts}y��1rop�|�uTh� ¤

L-LNMKO PHQHR�S

Page 23: Assessing a Mixture Model for Clustering with the ...

�U�

� * � � � � i � � ��� � R � � ªÊin�b� ª¸�L��� ª¸�f�E� ª¸�L�}i ª¸�{�n� ª¸�L�L� �� � R � � � ªÊin�b� ª¸�L�L� ª�� �� � = � � ± ±� i� � � R � � ªÊin�b� ªÊin�L� ª¸�f��� ª¸�L�}i ª¸�L��� ª¸�{�{i �� � � R � � � ªÊin�b� ª¸�f�?� ª�� �� ± ± ±� ��� � � R � � � � � R � � � � � � R � � � � � R � � � � � � R � � � � R � �c�s{¨froh-� � ´&k�©Es{rxp�hC|¥²¶w{�&uvdfh � r ~ �Qs}mxuTdb²¶pfr��{hC�n|Th� ¤

� * � � � � i � � ��� � R � � ªÊin�b� ª¸�L�Y� ª¸�}i;� ªKiQ� � ªÊin��� ªÊi�� �� � R � � � ªÊin�b� ª¸�L��� ª¸���� ± ± ±� �� � � R � � ªÊin�b� ª����"� ª¸�}ib� ªÊ���� ± ±� �� � � R � � � ªÊin�b� ª¸�f�?� ¿ =�� � ± ± ±� ��� � � R � � � � � R � � � � � � R � � � � � � R � � � � R � � � � R�� �c�s}¨�rxh � � ³T´¥µ�© s}ropfh?|¥²¶w{�&uTd�h � r ~ ��s{m¯uvdb²¶pfr��Lh�b|Th� ¤

0.5 1 1.5 2 2.5 3 3.5 4 4.5 5 5.50

10

20

30

40

50

60

70BIC

Durations in minutes

Fre

quen

cy ,

dens

ity

0.5 1 1.5 2 2.5 3 3.5 4 4.5 5 5.50

10

20

30

40

50

60

70ICL

Durations in minutes

Fre

quen

cy ,

dens

ity

�As&º¥³T´ �¶¨ &³T´¥µ��mo�{p��Th/i � $ hy�|Tmxu���hC|�uTmog�s uvmxwLy�²¶wL�&uTdfh � r ~ ��s}mxuTdf²¶pfr%�{hC�b|�hC� ¤

BDC L�BFE

Page 24: Assessing a Mixture Model for Clustering with the ...

�f�

$ �>= �>= %%� ½ , � (  ½ /��b�E� � ½ , �C���mo�{pf�vh®� �As ~ mt|�z�rosE�b|­rxwL�}ªÊzQwLzfpfrts uvmxwLy�©Lh��|�p�|­row{�{ª ~ hCy�|Tm¯u�� � mxyÄd�s{¨fmxuvs}yYu�|�� £Yg®��w{²&���?��uTw  �y�|/w{²uvdf�vhh��f�vhyQ��d ~ hz�s{��uvg<hCyYuv| � c� 6w ~ hCy�|�hCrx�YªÊzQwLzfpfrts uvh ~�~ hzQs}�TuTg�hyYuv|®mxy�uvdfhJ|Tpf¨fpf�v¨�|�w{²/�Os{�Tmt|¦kbhmoyfh1ª�kbs}moyYu�ª $ hCyfmt|Os}y ~'= s{pbuv|�ª ~ h1ª�knhmoyfh{¦}s{y ~ w{yfh&�vpf��s}r ~ hzQs}�TuTg�hyYu6´6w{��|�h ~ p�knp ~ � |Tw{p��v�h � �hybª|Tp�|O����� �\w{²Yuvdfh��f�vhyQ��d­zGw{z�pfros}uTmow{y%¦ � w{�vr ~­� m ~ h � h¨!w}²n³ ± k � �Js u������������� � � ���������������������������� ���!� �" �#�$���$�#%�&��#�'��(���)��*���,+ ¤ ��w{�6uTdfmt|¥¨fmx© s{�Tmts uvh ~ s}uvsq|Th1u?¦n 6h­�1w{yQ|�m ~ h�&s}rorQuTdfh!� �qg<w ~ hCro| ~ h?|�ª��Tmo¨Gh ~ moy�c�s{¨frxh��< �m¯uvd � . � ��� ��� � 3 s{y ~ �J. � � ¤< ror.uTdfh���TmxuThC�Tmts�² sE©Lw{�«uTdfh�g�w ~ hr � � � R � ; �s{y ~  ¥h§�vhC|�uT�vmt�)u¥s}u�uvhyYuTmow{y�uTw-uTdfmt|¥g<w ~ hCr ¤ c�s}¨�rxh>�q�Lmx©LhC|¥º6³T´ s{y ~ ³T´¥µ�© s}ropfhC|6²¶wL��� .�� ��� ��� � 3 ¤º¥³T´`s}y ~ ´&k^��dfwnwL|Th«uvdfhqg�w ~ hCr � � � R � ; �� �mxuTdA� . Jf¦Q �dfh�vhCsL|�³T´¥µÄdfh?|�mxuvs}uThC|§¨Qhu� 6hChy#� . �s{y ~ � .�J ¤ c&dfh<u� ¥w}ª¸�1rop�|�uvh�/|�wLrxpfuTmow{yJdQs{|/s}y�mxyYuThC�Th?|�uvmxy���moyLuvh�vzf�vh1uvs}uTmow{y |�moy��1h<w{y�h<�rxp�|�uThC�/mo|�rxwY|�hCrx� �vhrts uTh ~ uTwÄ´6w{��|�h ~ p¡knp ~ s}y ~ uTdfh�w}uTd�h���1rop�|�uvh�<mo|<�1rowL|Thro� �ThCros}uTh ~ uTw^uvdfh��Os{�Tmt|qs{�Th?s~ hz�s{��uvg<hCyYuv| � uvdfh2z�s{��uvm¯uvmxwLy�|�s{�Th ~ hCzfmo�1uTh ~ mxy#��mx�Lpf�vhq� �¶¨ � �� ¤ c&dfh/uTd��ThCh2�1rop�|�uvh�§|Tw{ropbuvmxwLy5|Tzfrom¯u´6wL�v|Th ~ p^knp ~ mxyYuvw-u� ¥w��1rop�|�uTh��| ¤

$ �>= ��� B 1 Á ���"1�/�� ½ � & / & �C�f� & ÁA, ��1 & �¹�f� Á 1 ÁA1�¾� h�s{y�s}ro� �h ~ ~ s uvsIJ¶w{��s¹�{row{¨�s{r�zf�vhC�1mozfmxuvs}uTmow{y �1romog�s}uTwLrxwL�{�¹uvd�s u�d�s{|�¨QhChy zf�vw ~ p��h ~ s u�uTdfhZLw{moyYu®³¸y�|�uTmxuTpbuvhW²¶w{��uvdfhJkYuvp ~ � w}²/uTdfh uvg�wL|Tzfdfh�vh^s}y ~ � �hCs{y ¤ c&dfhC�¡s{�ThWsE© s}moros{¨froh�wLy�uTdfh� w{�vr ~W� m ~ h � h¨ s u-��.�/0��.$�!+�/#�1�2 �.#�,������3���/�������(�45� " ��3�.$���#��67+8�,4 ¤ c&dfh<|�zQs uTmts}r��vhC|Tw{ropbuTmow{y^w{²uvdfmt|§�1romog�s}uTwLrxwL�{�®mt|«� ¤ � ~ hC�{�vhhC|�mxyWrts uvm¯uvp ~ hqs{y ~ rxwLyf�{mxuTp ~ h{¦f �d�mo��dWrohCs ~ |&uTw�s�|�hu§w}².u� ¥hro©{h��iLi

�{��g�s}z�|«�vhzf�vhC|ThyYuTmoyf��|�uvs}uTmow{y�|«w{�«zQwLmxyYu�|'� zfmx�nhCro|6�s}u­ �d�mo��d^g�wLyLuvdfro�5sE©Lh��s}�Lh!zf�Th?�1mozfmxuvs uvmxwLy� mxyWg�g7&d�sE©Lh/¨QhChyW�vhC�1wL� ~ h ~ w{��h�Yuv�vs{zQwLros}uTh ~ ¦n²¶w{��h?s{��d5moy ~ mo©Ym ~ p�s{r��Cs}rohy ~ s{��g�w{yYuTd ¤ ��mx�Lpf�vh �|Tdfw  �|�|�pQ��d-s­g�s}z2²¶wL��uTdfh&g�w{yYuTd-w}²�ZLs{yYpQs}�v� ¤ c&dfh&rts}y ~-~ s u�s�²¶wL��uTdfmt|O�1romxg�s}uTw{row{�L�/mo|�uvs{£{hCy2²¶�vw{guvdfh«µ�h�Ys uTh?|\s{y ~�� mxrorog<w{u�u �������U�;.�1romxg�s}uTw{row{�L�{¦L �dfmo��d�mo|6¨�s{|Th ~ wLy�uTd�h§dfmt|�uvw{�vmo�Cs}rQ�Th?�1w{� ~ w}²%��s}moy�Ys}pf�Lh/g<h?s{|Tpf�vhg�hyYuv| ¤ c&dfh2wb�1h?s}y5zf�vhC�mxzfmxuvs}uTmow{yWh?|�uvmxg�s uvhC|«s}�vh/²¶�TwLg uvdfh �Wmt�1�vw  ¥sE©Lh/kbw{pfy ~ mxyf��§yfmxu�� �Jk9� '�KknzQhCy��1hC�-�����L�)¦·s}y ~ uTd�h-�1romog�s}uTwLrxwL�{��mo|­¨�sL|�h ~ w{yJsE©Lh��s}�LhC|¥²¶w{�­uvdfhqzGh�vmxw ~ � �Y� �uvw5� ���Y� ¤

��w{rorxw  �moyf�2�.wL|v|Th ���������;)¦Y 6h§zf�ThªKz��Twb�1h?|T|Th ~ uvdfh ~ s uvs2mxy�uTdfh§²¶w{rorxw  �moyf�2 &sE� ¤+ |6m¯u&mt|V² s{�V²¶�vw{g¨Ghmoyf�<yfw{�vg�s}rorx� ~ mt|�uv�Tmo¨fpbuvh ~ ¦bs-yfw{yfªKromxy�hCs}�\uT��s}y�|�²¶w{�vg  ¥sL|V¢���|�u&s{zfzfromxh ~�� uvdfh­zQw  ¥h� � ¤ �{�/w{²�hCsL��d�vhC�w{� ~  &s{|§uvs}£Lhy ¤ ³Êuv| ~ mog�hy�|TmxwLy� &s{|§uTd�hy �Th ~ p��1h ~ ©nmts��V�vmoy��1moz�s}r6´6wLg�zQwLyfhyYu y�s{rx�b|Tmo|/s}y ~ ¥h/h1�bzGh�vmxg�hyYuvh ~ w{y�uTdfh/¢Q�v|�u&u� 6w�zf�vmxyQ�1moz�s}r%�w{g�zQwLyfhyYu�| ~ hzfmt�)uvh ~ moy%��mo�{pf�vh �#� s ¤

� h��1w{yQ|�m ~ h�vh ~ uTdfh�g�wL|�u!�{hCyfh��s}r�g�w ~ hr � � � R � ; � �\s}y ~ uvdfh�yYp�gq¨Gh�!w}²¥�1rop�|�uvh��|­mo|/© s}�v�nmxy��²¶�vw{g � .��­uTw�� . � � ¤K= h�vh{¦n ¥h ~ m ~ yfw{u¥moyfmxuTmts uTh­uvdfh � � s}ro�{w{�vmxuTdfg ²¶�vw{g s�´A� � s}ro�{w{�vmxuTdfgzQs}�TuTmxuTmow{y ¤ �1uTp�s{rxro�{¦Vmxu®s}zfzGhCs{�Th ~ uTdQs u�²¶w{�-uTdfmt| ~ s}uvs |�hu<moyfmxuTmts uTmoyf��²¶�TwLg sJ��s}y ~ w{g zGwL|Tm¯uvmxwLyrohCs ~ |.uvw2s/ros{�T�Lh�.rxmo£{hCrxmodfwnw ~ uTd�s{y�p�|�moyf�2sq´A� ��moyfmxuTmts}rom��?s uvmxwLy ¤ c&dnp�|C¦{ ¥h���s}y-uTdfh � � s}ro�{w{�vmxuTdfg�<. � �­uTmog�hC|.²¶�vw{g s/�vs{y ~ wLg zQwY|�mxuTmow{y�s{y ~ ��dfwL|Th&uTdfh«|�wLrxpbuvmxwLy�zf�Tw ©nm ~ moyf�­uTdfh�rts}�v�{h?|�uOromx£Lhromxdfwnw ~»¤��mo�{pf�vh®� ~ mt|TzfrosE�b|­© s}ropfhC|­w{²6º¥³T´�s}y ~ ³T´¥µ ¤ º¥³T´ ��TmxuThC�Tmow{y�mxyQ�1�vhCs{|ThC|«g�w{yfw{uTmt�s{rxro�W �m¯uvd � s}y ~~ wYh?|&yfw}u�zf�vw ©nm ~ h­hC©nm ~ hCy��1h­²¶wL��s}yn�J� © s}ropfh ¤ � y�uTdfh2�w{yYuT��s}�v�{¦Y³T´¥µ��{mo©{h?|&s-z��Th²¶h�vhy��h«²¶wL�&uTdfh|Th©Lhybª¸�1rop�|�uThC�v|/z�s{��uvm¯uvmxwLy ~ mt|�zfrtsE�{h ~ mxy ��mo�{pf�vh7�5²¶w{�-¨Qw{uTd�uvdfh®u� ¥w5¢���|�uqz��Tmoy��1moz�s{r6�1wLg�zQwLyfhyYuv|s{y ~ uTd�h-�1wL�T�vhC|TzGw{y ~ moyf��g�s}z^w{².uTdfh- 6wL�Tr ~»¤ �f�vw{gF��mx�Lpf�vh ��� s;&mxu­|Thhg�|�uTd�s}u ~ h?�1rts}�vmxyf��²¶wL�§yfw�rxpQ|�uvh�vmxyf�<|�uv�TpQ�)uTp��Th­mxy�uTdfmt|&¨fm ~ mog<hCy�|TmxwLy�s}r ~ s u�s-|Th1u&mt|6y�w}u&�Th?s}romo|�uTmt�«s{y ~ uvd�s u¥uTd�h/|Th©Lhybª¸�1rop�|�uThC�zQs}�TuTmxuTmow{y5|�hCrxh?�)uTh ~ ¨n��³T´¥µ �Cs}zbuvpf�vhC|¥uTd�h!dfmx�Ld ~ hy�|Tm¯u����ThC�{mow{y�|&s}z�zQh?s}�vmxyf��moy�uTdfmt| ~ s u�s�|�hu ¤

L-LNMKO PHQHR�S

Page 25: Assessing a Mixture Model for Clustering with the ...

�L�

2 3 4 5 6 7 8 9 10 11 120

1

2

3

4

5

6

7

8

9

10

log−population

log−

dens

ity (

inha

b/km

2)

Seine−Saint−DenisHauts−de−SeineCorse du Sud

2 4 6 8 10 120

1

2

3

4

5

6

7

8

9

log−populationlo

g−de

nsity

(in

hab/

km2)

BIC

2 4 6 8 10 120

1

2

3

4

5

6

7

8

9

log−population

log−

dens

ity (

inha

b/km

2)

ICL

� s6uv�Tp�h­zQs}�TuTmxuTmow{y �¶¨ �º6³T´\ªÊ³T´¥µ z�s}�TuTmxuTmow{y �A� ¥³T´¥µ z�s}�TuTmxuTmow{y

��mo�{pf�vh2� � �f�vhyQ��d ~ hCz�s}�TuTg�hCyLu�| ¤

�1�vm¯uvh�vmxwLy � � � i � ��º¥³T´ ªv�E�W�U� ª����{i{i ¿ ����� � ª����{i � ªv�&�L�}� �³T´¥µ ªv�E�W�U� ¿ � � $�$ ¿ ��� $A$ ª����{i� ª§�{�&��� �

c�s}¨froh � � º¥³T´�s{y ~ ³T´¥µ�©Es{rxp�hC|¥²¶w{�&uvdfh!¨GhC|�u�g<w ~ hCr � � � R � ; ��wLy�uvdfh<�f�vhy���d ~ hCz�s}�TuTg�hyYu ~ s}uvs ¤

-100 0 100

-50

050

��mo�{pf�vh � � �^w{yYuTdfro��sE©{h��s}�Lh�zf�Th?�1mozfmxuvs uvmxwLy �¶moy¹g�g7!²¶wL�2uTd�h�g�w{yYuTd w}² ZLs{ynp�s}�v� ¤ c&dfh�|�zQs uTmts}r�vhC|Tw{ropbuvmxwLy�mt|§� ¤ � ~ h�{�vhh?|&mxy�rts uTmxuTp ~ h2s}y ~ row{yf�Lm¯uvp ~ hL¦b �dfmo��d5�vhC|Tpfrxuv|&moy�s5�Ci{i �}�-mog�s}�{h ¤

BDC L�BFE

Page 26: Assessing a Mixture Model for Clustering with the ...

�{�

0 2 4 6 8 10 12 14 16 18 20−4.45

−4.4

−4.35

−4.3

−4.25

−4.2

−4.15

−4.1

−4.05

−4x 10

4

Number of clusters

Crit

eria

val

ues

BICICL

��mo�{pf�vhq� � º¥³T´ s{y ~ ³T´¥µ © s}ropfh?|� �m¯uvd�uTdfh!g�w ~ hr � � � R � ; � ��s}zfzfromoh ~ uTw<uTd�h2µ%h�Ys uvhC|��:�Jk9� ~ s}uvs ¤

0 2 4 6 8 10 12 14 16−6

−4

−2

0

2

4

6

x1

x2

-100 0 100

-50

050

�As\uTd�h/¢��v|�u�u� ¥w-zf�vmoy��1moz�s}r%�w{g�zGw{yfhCyLu�| �¶¨ ��1w{�v�vhC|TzQwLy ~ moyf�qg�s}z5w{²�uTd�h! 6wL�Tr ~

��mx�Lpf�vh � � knh©Lhybª¸�1rop�|�uTh��zQs}�TuTmxuTmow{y�w}²�uvdfh2µ%hC�Ls}uThC|��:��k9� z��Th?�1mozfm¯u�s uvmxwLy ~ s}uvs ¤

L-LNMKO PHQHR�S

Page 27: Assessing a Mixture Model for Clustering with the ...

�}i

� � �1��46�������1�2�

knuvs uvmo|�uTmt�s{r�s}yQs}ro�n|Tmt|�w{²Q¢Qyfm¯uvh�g�m¯�nuTp��Th?|Vs}�vh&hg�zfrow �{h ~ moy�|�uvs}uTmt|�uvmo�Cs}rfg�w ~ hCrxromxy��­ �mxuTd�u� ¥w ~ m&�GhC�ThCyLuz�pf�TzGwL|ThC| ¤ ³¸yWw{yfhqzQhC�v|TzQh?�)uvmx©Lh{¦f¢Qyfm¯uvhqg�mx�Yuvpf�vhqs}�vh!hC|v|�hCyYuTmts}rorx���ThC�Ls{� ~ h ~ sL|��1wLg�zQhuTmxuTw{��|�uvw®yfwLyzQs}��s}g�h1uv�Tmt� ~ hy�|Tmxu�� hC|�uTmog�s uvmxwLy �A|�hCh �\|v�1w{¨Qs}�®s}y ~¡� hC|�uJ�����L�f¦6��wL¨QhC��u^�����"��wL�®��wnh ~ hC��s}y ~� s{|v|Th�vg�s{y`�����n� ¤ ³¸y s}y�w}uTd�h�®©nmoh !¦&¢�yfmxuTh�g�m¯�nuTp��ThJs{�Th^�w{y�|Tm ~ h�vh ~ s{|�sÄzQw  ¥h�T²¶pfr� &sE� w{²g�w ~ hCrxromxy��2mxy��1rop�|�uvh�¥s}y�s{rx�b|Tmo|?�A|�hCh �f��s}roh�<s}y ~ �§s ² uThC�T��� ����/wL� �^�µ�s{��dfrts}y�s{y ~ º&s{|�²¶w{� ~ � ���� ¤³¸y<¨Gw}uTd�|Tm¯uvp�s uvmxwLy�|¦}��d�wYwY|�moyf�/s§�vhroh© s{yLu�²¶w{�vg � ²¶w{��uvdfh&g<w ~ hCrfs}y ~ s{|v|ThC|v|�moyf�§s/|Thy�|Tmx¨�rxh¥ynpfgq¨Gh�� w{²��1wLg�zQwLyfhyYuv|&mt|�s{y�mog�zQwL��u�s}yYu&uvs{|T£ ¤

� dfhCy<uTdfh��w{y��h�vyqw}²Gg�m¯�nuTp��Th&g�w ~ hrorxmoyf�/mt| ~ hyQ|�mxu��2hC|�uTmog�s uvmxwLy%¦}w{p���ynpfg�hC�Tmt�s{rYh�bzQhC�Tmog�hyYuv|�w{yb¢Q�Tg uTd�s}u�uTd�h-º¥³T´Ãs}zfz��TwE�bmog�s}uTmow{y�w}²Ouvdfh2moyLuvh�L�vs}uTh ~ wL¨�|Th�v©{h ~ romx£Lhromxd�wYw ~ �Cs}yW¨Ghq�vh�Ls{� ~ h ~sL|&sq�vhCsL|�wLy�s}¨froh�uvwYwLrG²¶w{���1wLg<zQs}�vmxyf�-g�m¯�nuTp��Th/g�w ~ hrt| ¤ ´6dfwnwY|�moyf�-uTdfh«²¶w{�vg(w}²�uTdfh/g�w ~ hr � s}y ~uvdfh­yYp�gq¨Gh�&w}².�1w{g�zGw{yfhCyYuv|�� ¨n��w{zfuTmog<mI�Cs}uTmow{y�w}²�uvdfh/º6³T´��1�vm¯uvh�vmxwLy� �morxr·�{hCyfh��s}roro�<�vhC|Tpfrxu¥moy�s�Lwnw ~ s}zfz��TwE�bmog�s}uTmow{y®w{²�uvdfh ~ hy�|Tmxu���uTw�¨Gh­h?|�uvmxg�s}uTh ~%¤ �O�bzQhC�Tmog�hyYuv| ~ h?|T��Tmo¨Gh ~ moyWknhC�1uTmow{y�i ¤ � ¤ �s{y ~ knhC�1uTmow{y5i ¤ � ¤ �«d�mx�Ldfrxmo�{dYu&uTd�mo|�|vs uvmo|�² s{�1uTwL�T��¨Ghd�sE©nmow{�&w}².º¥³T´�moyWs<|TzGhC�)u�s{�pfros{�& ¥sE� ¤

� dfhCy uTdfh�moyYuTh�vhC|�u2moy g�mx�nuTpf�vh�g<w ~ hCrxromoyf�Wmo|!�rxpQ|�uvh�2s}yQs}ro�n|Tmt|!��dfwnwL|Tmxyf�5s5|�hCy�|Tmx¨froh�ynpfgq¨Gh�w{²6�1rop�|�uThC�v| � mo|­w{²¥�1�vp��mos{r�mog�zQwL��u�s}y��h ¤ ³¸y�uTd�mo|!�rxp�|�uThC�Tmoyf�5�1wLyLuvh1�nuC¦·uvdfh�º¥³T´ �1�vm¯uvh�vmxwLyJmt|­rxh?|T|�w{yn©nmxyQ�1moyf� ¤ ³¸y�z�s}�TuTmt�1p�ros{�C¦»mxu!uThCy ~ |/uvwWw ©{h�vhC|�uTmog�s uvh2uTd�h�yYp�gq¨Gh� � w}²��1rop�|�uThC�v|/ �dfhCyJuvdfh�¢fuw{²�uvdfh ~ s u�s-uTw�uTd�h!g<mx�nuTpf�vh/g�w ~ hr%mt|�yfw{u&©Lh�v�®�{wnw ~»¤ �O�bzGh�vmxg�hyYu�moy^knhC�1uTmow{y�i ¤ � ¤ �<s{y ~ s}ror»uTdfhh�bzQhC�Tmog�hyYuv|­moy�knh?�)uvmxwLy�i ¤ ��s}�vhqmorxrop�|�uT��s uvmxwLy�|­w}²¥|Tp���d s�¨Ghd�sE©nmow{�/w}²¥º6³T´ ¤ ³¸y�uTd�mo|!�w{yYuTh�Yu?¦» 6hz��TwLzQwY|�h ~ g�s �bmog<mI�moyf�<uTd�h!mxyYuThC�{��s uvh ~ �w{g�zfroh1uvh ~ rxmo£{hCrxmodfwnw ~ ��s uvdfh�&uvd�s}y�uTdfh!moyYuThC�{��s uTh ~ wL¨�|�hC��ª©Lh ~ romx£Lhromxdfwnw ~ uTw�|ThrohC�1u�¨Qw{uTd^s��vhroh© s{yLu�²¶wL�Tg � w{²�g�w ~ hr�s}y ~ s��vhroh© s{yLu�ynpfg-¨QhC��w}²V�rxp�|�uThC�v|� ¦nuTdfh!g�mt|T|Tmoyf�<�rxpQ|�uvh��moy ~ mt�s uvw{��|&¨QhCmxy��<�vhz�rosL�1h ~ ¨n��uTd�hmo��g�s}�bmxg-pfg s<zQwY|�uvh�vmxwL�Tm·h?|�uvmxg�s uvw{��| ¤��mo�v|�uTro�{¦�uTdfh-³T´¥µ¹�1�vmxuTh�vmow{y5�Th?|�p�r¯uvmxyf�®²¶�TwLg uvdfh-s{zfzf�vwE�nmog�s uvmxwLy�w{²�uvdfmt|§moyYuTh�L�vs}uTh ~ �w{g�zfroh1uvh ~ rom¯ª£Lhromxd�wYw ~¹~ wYh?|qy�w}u<|Tp �·h�-uTdfh�rts{��£ w}²�uvdfhwL�ThuTmt�s}r���p�|�uTmx¢Q�s}uTmow{y¹w{²�uTdfh5º¥³T´ s}zfz��TwE�bmog�s}uTmow{y uTwuvdfh�moyLuvh�L�vs}uTh ~ w{¨Q|�hC�T©Lh ~ romo£{hromodfwnw ~ ²¶wL�!g<mx�nuTpf�vh�g�w ~ hr ¤ knh?�1wLy ~ ro�{¦%²¶�vw{g s5zf�vsL�)uvmo�Cs}rOzGw{moyLu2w{²©nmoh !¦·uvdfh-³T´¥µ �1�vmxuTh�vmow{yJ|ThhCg�|«uvw��Lmx©Lh-s}y s}y�|T ¥h�«uTw�uTdfh�zf��s{�1uTmt�s}r�zGwL|v|�mo¨frohquvhy ~ hCy��1�Ww{²6º¥³T´uvwqw ©Lh�vhC|�uTmog�s}uTh&uvdfh«ynpfg-¨QhC�6w{²��1rop�|�uTh��|¥s{|Vmxu�s}zfzGhCs{�v|V²¶�TwLg ynpfg�hC�Tmt�s{r�h1�bzGh�vmxg�hCyLu�|\moy�|ThC�1uTmow{y�|i ¤ � ¤ �qs}y ~ i ¤ � ¤�� huC¦nmxu&�Cs}y®¨Gh«|Tdfw  �y��¶uTdf�vw{pf�Ld�ynpfg�h�vmo�Cs}r�h�bzQhC�Tmog�hyYuv|6yfw}u¥�ThCzQwL��uvh ~ d�h�vh�.uvd�s u³T´¥µ wLpbuTzGh�T²¶w{�vg�|/dfhpf�vmt|�uvmo���1�vmxuTh�vmtsf¦ ~ hC©{hCrxwLzQh ~ ²¶wL�2s{|v|�h?|T|Tmxy���g�mx�Yuvpf�vh<g�w ~ hCro|!moyÄs5�1rop�|�uvh�vmxy��|Th1uTuTmoyf��¦·s{| �� � � º&s}yb¢Qhr ~ s}y ~ �§s ² uThC�T�������{�;¥ �dfmt��d5uThy ~ |�uvw®pfy ~ h�vhC|�uTmog�s}uThquTdfh-yYp�gq¨Gh�§w{²�rxpQ|�uvh��|«sL|«|Tdfw  �y^moyÄ´6hCrxhCpb�^s}y ~ knw{�vw{g�hCyfdfwA��� ����1¦QwL�§uvdfh�hyYuT�vw{zn�5�1�vm¯uvh�vmxwLy ± �&´ �K´6hCrxhCpb�s{y ~ kbw{�vw{g�hyfd�wJ� ����;� �dfmt��dJh�bdfmx¨�m¯u�|!s ~ h?�1hCzbuTmo©{h�¨Ghd�sE©nmow{�«uTw5��dfwnwL|Th<s��ThCrxhC© s}yYu«²¶wL�Tg � w{²uvdfh!g�m¯�nuvpf�Th/g�w ~ hr�s{|�|Tdfw  �y�moy5º6moh�vy�sL��£YmK��� ���n� ¤

|§�1wLg�z�s}�vh ~ uTw®uTdfh-mxyYuThC�{��s uvh ~ w{¨�|Th�v©{h ~ romo£{hromodfwnw ~ ¦fuTd�h2mxyYuvh�{��s uvh ~ �1wLg�zfrxhuTh ~ rxmo£{hCrxmodfwnw ~moy��rxp ~ hC|5s}yÃs ~f~ mxuTmow{y�y�s}r­hyYuT�vw{zn� uThC�Tg �7) � � � ,® �dfmt��d ² sE©Lw{��|® ¥hror¯ª¸|�hCz�s}��s uvh ~ �rxp�|�uThC�v|�s}y ~ �d�mo��d^mt|�uvdfh<hC|v|�hCyLuvmos{r ~ m&�·h�vhy��hq¨Gh1u� ¥hhy^º¥³T´Ãs{y ~ ³T´¥µ ��TmxuThC�Tmts ¤ c&d�h2² s{�1u§uvd�s u­uTdfh<s}zfz��TwE�bmxªg�s}uTmow{yWrohCs ~ mxyf��uvw®³T´¥µÄmt|� ¥hrorf��p�|�uTmx¢�h ~ �1wLyLuv�vs{�T�®uTw�uvdfh-º¥³T´`s}zfz��TwE�bmog�s}uTmow{y5|�hChg�|&uvw®d�sE©{h2sromxu�uTroh/zf��s{�)uvmo�Cs}r·mog<zQs{�)u ¤ ³¸y�wLpf�&h1�bzGh�vmxg�hyYu�|¦b ¥h­s{ro|Tw��1w{g�zfpfuTh­uTdfh ��� �­º6³T´ s}zfz��TwE�bmog�s}uTmow{y®w{²³T´¥µ � ��# ¤ � ¤ �?� ¤ c&dfmt|!s}zfz��TwE�bmog�s}uTmow{y ~ m ~ yfw{u2�{mo©{h ~ m&�GhC�ThCyYu!s{y�|T 6hC�/uTd�s{yJuvdfh�³T´¥µ��1�vm¯uvh�vmxwLy¨Gw}uvd�²¶wL�¥��d�wYwY|�moyf�quTdfh­²¶w{�vg � w}²�uTdfh­g�m¯�nuTp��Th/g�w ~ hr»s}y ~ uTd�h­ynpfg-¨QhC�&w}²��rxp�|�uThC�v|8� mxy5s}rorGuTdfh|Tmx��h1�bzGh�vmxg�hyYu�|¥uTd�s}u� 6h!�1wLy�|Tm ~ hC�Th ~»¤

BDC L�BFE

Page 28: Assessing a Mixture Model for Clustering with the ...

�L�

� ��� �!�#�!��� �0"

mxuT£nmoy%¦� ¤ s}y ~ ��pf¨�mxy%¦ $q¤ º ¤ ��� ��L�� ¤ �\|�uTmog�s uvmxwLy�s{y ~'= �nzQw{uTdfh?|�mt|Oc�hC|�uTmoyf�/mxy ��mxy�m¯uvh��Wm¯�nuvpf�Th�Ww ~ hrt| ¤�� �2��� �'�2� � � ��� �9B1�2���(��� � � ����� �5��!$�2����� !���� �5�� /�¦ $ �%¦ �Y�Eª��{� ¤

� �Cs{rxmoyfmK¦ 2¤ s{y ~ º6w  �g�s{y 2¤}��¤ ��� ��U� ¤- µ%wnwL£qs uV|Tw{g�h $ s u�s­w{y-uTdfh � r ~ �Qs}mxuTdb²¶pfr � h�b|�hC� ¤ �-�'�;����&����A� �5��� ����!��)¦ � � ¦f�L�Y�?ª¸���L� ¤

º&s}yb¢Qhr ~ ¦ Z ¤ $-¤ s}y ~ ��s ² uvh�v� 2¤ � ¤ ��� ��{�; ¤ �Ww ~ hCr¯ªÊ¨�sL|�h ~ � s{p�|v|�mts}yWs}y ~ y�w{y � s}pQ|T|Tmos{y��rxpQ|�ªuThC�Tmoyf� ¤ / ���( � �����!��)¦ $ � ¦ � �{� ª1�L�f� ¤

º¥mxhC�TyQs{��£nmA¦�´ ¤ ��� ��Y� ¤ ´6d�w{mx� ~ h!g�w ~ erohC|&hCy5�rosL|T|Tmx¢Q�s}uTmow{y ¤ �Vd $-¤ uvdfhC|Tmo|C¦ �«c§´`´6wLg<z�mxeC�{yfh ¤º¥mxhC�TyQs{��£nmA¦»´ ¤ s{y ~ � w © s}hC��u?¦ � ¤ ��� ��Y�� ¤ �§|Tmoyf��uTd�h�´6rts{|v|�mx¢Q�s}uTmow{yWµ%mo£{hCrxmodfwnw ~ uTwW´6dfwnwL|Th!uTdfh

± pfg-¨QhC��w}²\´6rop�|�uvh��| ¤ � �(1�'�%�5��������!���� �'! �%� �'&����A� �5��� �5��!���¦ =�� ¦��b¦bin�b�1ªÊiY�Y� ¤º¥w�� ~ w{�Ys}y%¦ =q¤ �������{�; ¤ ´6dfwnwL|Tmxyf�«uTd�h ± pfg-¨QhC�Vw}²%´6w{g�zQwLyfhyYu¥´6rop�|�uTh��|.moy-uvdfh��Wmx�nuTpf�vh1ª1�Ww ~ hr

�§|Tmxy���s ± h  ³¸yb²¶w{�vg�s uTmow{yQs}r�´6w{g�zfroh1�bm¯u���´6�TmxuThC�Tmow{y¡w}²§uvdfhW³¸yn©{hC�v|Th1ª1��mo|Tdfh�<³¸yb²¶wL�Tg�s uvmxwLy�^s uv�Tmx� ¤ � � � �(��� �5��� � � �'& � � ������ � !�� �5��� ��P¥kbzf�Tmoyf�Lh�Tª �OhC�Trts}�Q¦ = hm ~ hro¨QhC�T� ¤

º¥�T�Ys}yYuC¦n� ¤ � ¤ ��� ������ ¤ µ�s}�v�{h­kfs}g�zfroh/��hC|Tpfr¯u�|¥²¶w{� � zbuvmxg�mI�Cs}uTmow{y�º&sL|�h ~ ´6rop�|�uTh�vmoyf�'�^h1uTd�w ~ | ¤� �(��� �'�2� � ��� � �(����� � !�� �5��� ��¦ ��¦f�f�1ªÊi{i ¤

´6hrohpf�·¦ � ¤ s}y ~ � w © s}hC��u?¦ � ¤ �������Y�� ¤� ´6rts{|v|�mx¢Q�s}uTmow{y � � ro�{w{�vmxuTdfg s{y ~ u� 6w^kYuvwn��dQs{|�uTmt��Oh��|�mow{yQ| ¤ � �(1�'�%�A� �5��� ���(��� � � ����� �5��!�[� �'&��4� �A� ���(�;������)¦ � $ ¦f���?� ªÊ�L�L� ¤´6hrohpf�·¦ � ¤ s{y ~ � w © s}hC��u?¦ � ¤ ��� ��L�� ¤ � s{p�|v|�mts}y�z�s{�v|Tmxg�wLyfmxwLp�|!�1rop�|�uThC�Tmoyf�Wg�w ~ hrt| ¤�� � �&� ��� �

B ��!����'� ���5��� �Q¦ = �%¦Q� �f�1ª��:�L� ¤´6hrohpf�·¦ � ¤ s}y ~ knw{�vw{g�hCyfdfw�¦ � ¤ ��� ����; ¤ yJhCyLuv�TwLzn����TmxuThC�Tmow{y5²¶wL�­sL|T|ThC|v|�moyf��uvdfh-ynpfg-¨QhC�«w{²

�1rop�|�uTh��|&moy5s<g�mx�Yuvpf�vh!g<w ~ hCr ¤�� �2��� �'�(�0� ��� � ������ � !�� ����� ��¦ �%� ¦»� �L� ª¸�f�?� ¤´6dfhChC|Thg�s}y%¦�� ¤ ¦Vs{y ~ kYuvpbu �L¦ Z ¤ ��� ���� ¤ º&sE�LhC|Tmos{yÄ´6rts{|v|�mx¢Q�Cs uTmow{y � pbuvwn´6rts{|v|9 � c&dfhCw{�v��s}y ~

�Th?|�p�r¯u�| ¤ ³¸y���sE�n�Ys ~ ¦J� ¤ ¦V�Vmts uvhC|T£Y�Yª�knd�s{zfmx�vw�¦ � ¤ ¦\s}y ~ ��uTdnpf�vp�|vs}g-� � h ~ | ¤ ¤ &(8(� ��! ��W���� �'�()L����&��!� �[����!��28 ������ ��&��4� �A������� �����}¦Qzfz ¤ ���1ª1�{� ¤ � ³&�V�vhC|v|¦ �WhCyfrow<�Os{�T£·¦Q´ 2¤

´6dfmt��£{hC�Tmoyf��¦ $-¤ � ¤ s}y ~#= hC��£Lh�vg�s{y%¦ $-¤ �������n� ¤ �V°��mxhCyYu zfz��TwE�bmog�s}uTmow{y�|¥²¶wL��uTd�h �^s}�v�{moy�s{rµ%mo£{hCrxmodfwnw ~ w{²�º&sE�{h?|�mts}y ± hu� 6wL�T£b|¥ �m¯uvd = m ~f~ hCy��Vs{�Tmts}¨�rxh?| ¤ �G��! � ��� �������(� � ����� ¤ = � ¦%���f�ª�b�E� ¤

´6pbuvrxhC�C¦ 2¤ s}y ~ ´6w{� ~ h�vw}ª¸º¥�vs! �sf¦ �-¤ ���������; ¤ �Wmoyfmogqpfg = hCrxromoyf�{hC� $ mt|�uvs}yQ�1h@�6|�uvmxg�s uvmxwLy�²¶w{���mxyfmxuTh?�Wmx�nuTpf�vh8�Ww ~ hrt| ¤"� �(��� �'�2� � � ��� � �����!$� �����A� �5��� ����!��2� �����6!���� �5��� � ��� ¦b� �n� �}ªv� �}�{� ¤

$ hg�z�|�uTh�?¦ 2¤ � ¤ ¦\µ�s{mx� ~ ¦ ±2¤ � ¤ s}y ~ ��pf¨fmoy%¦ $-¤ º ¤ �����Y�L� ¤ �^s �bmogqpfg�µ�mx£Lhromxdfwnw ~ ²¶w{�<³¸ybª�1wLg<z�rxhuTh $ s}uvs2©nmts!uvdfh � � rx�Lw{�vm¯uvdfg ¤"� �(��� ���(� � � ��� � BC�(���2�#���A� �5��� �5��!��(�$��� !���� �5�� /�¦ � � ¦�1ª¸��� ¤

L-LNMKO PHQHR�S

Page 29: Assessing a Mixture Model for Clustering with the ...

���$ mxhC¨QwLr¯u?¦@Z ¤ s}y ~ ��wL¨QhC��u?¦f´ ¤ � ¤ �������{i; ¤ �\|�uTmog�s uTmow{y�w}² ��moyfmxuTh �Wmx�nuTpf�vh $ mt|�uv�Tmo¨fpbuvmxwLy�|6uTdf�vw{pf�Ld

º&sE�{hC|Tmts}y�kfs}g�zfromxyf� ¤ � �2��� �'�2� � � ��� �9B1�2���(��� � � ����� �5��!��(��� �6!���� �5� ¦�º­¦����%¦��"�{�}ªÊ�n�}� ¤�\|v�1wL¨�s}�?¦�� ¤ $-¤ s}y ~�� h?|�u?¦8� ¤ �������Y��<º&sE�{hC|Tmts}y ~ hy�|Tmxu�� hC|�uTmog�s uvmxwLy s}y ~ moyb²¶h�vhy��hWp�|Tmxyf�g�m¯�nuTp��Th?| ¤�� �(��� ���(�0� � ����� �����!$� ��� � � ����� �5��!$�2� ����� !���� ����� ��¦ ��� ¦��Y�{�Eª¸����� ¤�V©Lh�vm¯uTuC¦Qº ¤ k ¤ �������{i; ¤ � � �����$�6&2� ! �5��� � � ���0� � � ����� �(����-������ �G� &'���7��P�µ%wLy ~ wLy � ´6d�s{zfg�s}y��= s{rxr ¤

�f��s}roh�L¦�´ ¤ s{y ~ ��s ² uvh�v�{¦ q¤ � ¤ ��� ���� ¤ = w   �Js}yn� ´6rop�|�uvh��|�� � dfmo��d ´6rop�|�uTh�vmoyf�#�Wh1uvdfw ~ � y�|T ¥h��|«©nmts%�Ww ~ hrxªÊº&sL|�h ~ ´6rxpQ|�uvh� yQs}ro�n|Tmt| ¤ c�h?��dfyfmt�s}rV��hzGw{�Tu ± w ¤ �L� ��¦ $ hCz�s}�TuTg�hCyLuw}²VkYuvs}uTmt|�uvmo�C|¦G��yfmo©{hC�v|Tm¯u���w{² � s{|Tdfmoyf�}uvw{y ¤ �Ac�w�s}z�zQh?s}��moy � �2 ���%� ��� � �(��� �'�2� ¤ �!s{|v|C¦n� ¤ � ¤ s{y ~ ��s ² uvh�v�{¦ 2¤ � ¤ �������Y�� ¤ º&sE�{h?|8��s{�1uTwL� ¤ � �(��� ���(�0� � ����� �����!�� �����A� �5��� ����!��2� �����6!���� �5��� �Q¦ ��� ¦Q�}�{�}ª�� �L� ¤

µ%hC�Ls}uThC|C¦ $-¤ � ¤ s}y ~�� mororxg�w}uTuC¦Q´ ¤ Z ¤ �������U�; ¤ �WhCs{y�knh?s{|Tw{y�s{r�s}y ~ knz�s uvmos{r��Vs{�Tmts}¨�mxrom¯u�� � s}p��{h1ª�1wL�T�vhC�1uTh ~ ¦ � rxwL¨�s}r»�V�vhC�mxz�m¯u�s uTmow{y ¤ � ��� ��� ��� �5��� ���(� � �(��� ���(� � ��� �;�.,� � �2� � �2� ¦ � � ¦»�{�L�1ª��?�Y� ¤

�^�Cµ�s{��d�ros{y%¦ � ¤ Z ¤ s}y ~ º¥sL|�²¶wL� ~ ¦ � ¤ � ¤ ��� ���� ¤ ���*#!����� � �G�6&!���7��� � � � ��� � ��! �[� �'& �����;��!�� �5��� � �� � � �;� � � ��������`P ± h  � w{�v£ � �^s{�v�hr $ h£n£{hC� ¤�.wL|v|�hL¦�´ ¤ ��� ����; ¤ = mxhC�vs{�v��dfmt�s{r?�Ww ~ hrxªK¨Qs{|Th ~ ´6rxp�|�uThC�Tmoyf� ��w{�®µ�s{�T�Lh $ s}uvs{|Th1u�| ¤ c�h?��dfyfmt�s}r

��hzGw{�TuC¦ $ hCz�s}�TuTg�hyYu�w}²VkYu�s uTmt|�uTmt�|C¦!��yfmo©{hC�v|Tm¯u���w}²K�Wmxy�yfhC|Tw}u�s ¤��s}² uTh�v�{¦ 2¤ � ¤ �������L� ¤ º¥sE�LhC|Tmos{yG�Ww ~ hCr«knhrohC�1uTmow{y mxy�knwb�1mts}r���hC|ThCs}����d �  �m¯uvd ~ mo|v�1p�|v|TmxwLy ¤

³¸y � �6!����(� � ����!$�2� � � ���@� &��2� �����D�¶h ~%¤ � ¤ � ¤ �^s{�v| ~ hCy )¦«zfz ¤ �{�{�ªv���L� ¤ ´¥s}gq¨��Tm ~ �{hL¦��^sL|T| ¤ �º¥rosL��£Y ¥hrort| ¤

��h ~ yfh�?¦·� ¤ q¤ s{y ~5� s{rx£Lh� =q¤ � ¤ ��� ��}i ¤ �Wmx�Yuvpf�vh ~ hyQ|�mxuTmohC|C¦Qg�s}�nmogqp�g romx£Lhromxd�wYw ~ s}y ~ uTdfh� ��s}ro�{wL�TmxuTd�g ¤ � � � B ��8 ����)O¦ = ��¦»� �L� ª¸�{��� ¤��mt��d�s}� ~ |Tw{y%¦&k ¤ s}y ~ � �vhhCy%¦\� ¤ Z ¤ ��� ���n� ¤ ��pfrxro�¡º&sE�LhC|Tmos{y y�s{rx�b|Tmo|�w{²>�Wmx�nuTpf�vhC|� �mxuTd�s{y

��yf£nyfw  �y ± pfg-¨QhC�­w{²¥´6w{g�zGw{yfhCyLu�| �  �m¯uvd ~ mt|T�p�|v|�mow{y ¤ � �2��� �'�(� � � ��� �DB1�2���(� ���A� �5��� ����!��2���� !���� �5�� /�¦ � � ¦Q� ���1ª��:�L� ¤

��wL¨QhC��u?¦n´ ¤ � ¤ ��� ���{i; ¤9� � �>/1�2�'����� � � � �(��! ��1� � ��!�������� �� � � ���2� � �5��! �G� �5�.8�� ����� � ¤V± h  � w{�v£ �knzf�vmxy��{h�Tª �Oh�vros{� ¤

��wL¨QhC��u?¦n´ ¤ � ¤ ��� ���"� ¤ �Wmx�nuTpf�vhC|.w{² $ mo|�uT�vmo¨fpbuTmow{yQ| � ³¸yb²¶h�vhy��h�s}y ~ �\|�uTmog�s uTmow{y ¤ �G�2�<:��28 � � �(����G� ��� � � �(�� � ��� � �<��! ����! � ¤ � h ~ | ¤ � moro£n| ��¤ � ¤ ¦·��mo��d�s{� ~ |�wLyWk ¤ s{y ~ knzfmoh�Lhrod�s}rxuThC� $-¤ Z ¤ ¤µ%wLy ~ w{y � ´6dQs}zfg�s}y�� = s}ror ¤

��wnh ~ h�?¦�� ¤ s{y ~�� s{|v|�hC�Tg�s{y%¦�µ ¤ �������n� ¤ �V�vsL�)uvmo�Cs}r/º¥sE�LhC|Tmos{y $ hCy�|�mxu�� �\|�uTmog�s uTmow{y �§|Tmxyf��Wmx�Yuvpf�vhC|&w}² ± wL�Tg�s{ro| ¤ � �2��� �'�2�0� � ��� � �����!�� � � � � ����� �5��!��(� �$��� !���� ����� ��¦ �A= ¦ ���{i}ª1�U�L� ¤

kb��dn &s}�9�{¦ � ¤ ��� �Y� � ¤ �\|�uTmog�s}uTmoyf��uTdfh $ mog�hy�|Tmow{y^w{²\sJ�Ww ~ hCr ¤ �����(�7�4� � � � � ����� �5��!�)¦ ��¦Gi �f�ªi"�{i ¤

BDC L�BFE

Page 30: Assessing a Mixture Model for Clustering with the ...

�Y�

knzGhy��h�?¦G� ¤Q��¤ �������{�; ¤ � row{¨�s{r � �1h?s}yfmt�/�V�vhC�mxzfmxuvs}uTmow{yW²¶�vw{g uTd�h �Jk9� ~ pf�vmxy��^� �n�:� ª1�f�/s}y ~´6w{g�z�s{�Tmt|�wLy�|6uTw � uTd�h�«´6romxg�s uvw{row{�Lmxh?| ¤ � �(��� ���(�0� ��� �*�.,� � �¦���¦%�C� �f�1ª��C�Y��� ¤

L-LNMKO PHQHR�S

Page 31: Assessing a Mixture Model for Clustering with the ...

Unit e de recherche INRIA Lorraine, Technopole de Nancy-Brabois, Campus scientifique,615 rue du Jardin Botanique, BP 101, 54600 VILLERS LES NANCY

Unit e de recherche INRIA Rennes, Irisa, Campus universitaire de Beaulieu, 35042 RENNES CedexUnit e de recherche INRIA Rhone-Alpes, 655, avenue de l’Europe, 38330 MONTBONNOT ST MARTIN

Unit e de recherche INRIA Rocquencourt, Domaine de Voluceau, Rocquencourt, BP 105, 78153 LE CHESNAY CedexUnit e de recherche INRIA Sophia-Antipolis, 2004 route des Lucioles, BP 93, 06902 SOPHIA-ANTIPOLIS Cedex

EditeurINRIA, Domaine de Voluceau, Rocquencourt, BP 105, 78153 LE CHESNAY Cedex (France)��������� ������ �������� �� ���

ISSN 0249-6399