Clusterização sobre o dataset NIPS 1987-2015

In [4]:
import numpy as np
import pandas as pd
import matplotlib.pyplot as plt 
from time import time
%matplotlib notebook
In [53]:
dataset = pd.read_csv('NIPS_1987-2015_transpose.csv')
In [55]:
dataset = dataset.drop('Unnamed: 0', axis=1)
In [3]:
X = pd.read_csv('NIPS_1987-2015_remodeled_755.csv')
y = X.loc[:, 'y']
X = X.drop('y', axis=1)
In [5]:
X_300 = pd.read_csv('NIPS_1987-2015_remodeled_300.csv')
y_300 = X_300.loc[:, 'y']
X_300 = X_300.drop('y', axis=1)

Gaussian Mixtures

Modelo de mistura gaussiana são modelos probabilísticos para representar populações distribuidas de forma normalizada. Em geral, gaussian mixtures não necessitam de conhecimento prévio sobre qual subpopulação do conjunto de dados um certo ponto pertence, dessa forma se caracteriza como um modelo não-supervisionado, podendo aprender as subpopulações automaticamente.

Um exemplo de mistura gaussiana de três distribuições normais.
mixture model

Por ser um modelo probabilístico, podemos dizer que esse método é um K-Means mais ameno, onde a classificação de um ponto não é deterministico e sim é calculada uma probabilidade de tal ponto pertencer a um subconjunto.

Um exemplo disso é a imagem abaixo, onde podemos notar a pobabilidade de um ponto pertencer a um ou outro cluster

kmeansvsgmm

Para um modelo uni-dimensional temos a seguinte fórmula:

$$ p(x) = \sum_{i=1}^K\phi_i \mathcal{N}(x \;|\; \mu_i, \sigma_i) $$

$$ \mathcal{N}(x \;|\; \mu_i, \sigma_i) = \frac{1}{\sigma_i\sqrt{2\pi}} \exp\left(-\frac{(x-\mu_i)^2}{2\sigma_i^2}\right) $$

$$ \sum_{i=1}^K\phi_i = 1 $$

Onde, uma mistura de modelos gaussianos (GMM) é parametrizada por dois tipos de valores, os pesos dos componentes de mistura ($\phi_k$) e o componente de médias ($\mu_k$) e variâncias/covariâncias ($\sigma_k$), para cada componente $k_i$ no conjunto de $K$ componentes.

Expectation-Maximization

O algoritmo de EM é um procedimento eficiente e iterativo de calcular o Maximum Likelihood (máxima verossimilhança) na presença de dados faltantes. Com a utilização desse algoritmo temos o objetivo de estimar parâmetros do modelo para qual os dados são mais prováveis de apresentar.

Cada iteração do algoritmo de EM consiste me dois passos:

  • Estimation: Os dados faltantes são estimados para cada ponto $x_i \in X$ dado os parâmetros do modelo;
  • Maximization: Consiste em maximizar as estimativas calculadas no passo anterior de acordo com os parâmetros do modelo, então esse passo atualiza os valores de $\phi_k$, $\mu_k$ e $\sigma_k$.

O processo se repete até o ponto de convergência do algoritmo, gerando um maximum likelihood.

Exemplo do algoritmo _EM_ atualizando parâmetros de dois componentes.
EMloop

Escolhendo um K

Para essa etapa do problema encontramos diversos desafios, entre eles:

  • Recursos computacionais;
  • Métricas com valores anormais;
  • Difícil tomada de decisão sem conhecer todas as possibilidades (constante incerteza).

KMeans

K Means, também chamado de médias móveis, realiza agrupamentos de pontos no conjunto de dados com base na distância de cada ponto para os centróides de cada cluster. Dessa forma esse método se torna dependente de uma boa inicialização de seus centróides e a criação de seus clusters são de forma deterministica.

Para o KMeans, foi utilizada o método do cotovelo (Elbow) juntamente com a métrica de silhueta e Calinski.

Elbow Method

O método de Elbow análise o valor do erro quadrático entre os clusters (Within-Clusters Sum of Squares, WCSS) , no caso do sklearn a inertia.

Elbowmethod

Silhouette Score

A silhueta é definida pela formula

$$ S = \frac{(b-a)}{max(a,b)} $$

Sendo:

  • $a$: Distância média entre um ponto e os outros da mesma classe.
  • $b$: Distância média entre um ponto e os outros da classe mais próxima.

Esse coeficiente esta no intervalo $]-1,1 [$ sendo que quanto mais próximo de 1 o coeficiente é ótimo e quanto mais perto de -1 o pior, valores perto de 0 podem demonstrar overlapping entre os clusters.

Calinski

Calinski analisa a dispersão média entre os clusters e quanto maior o seu valor melhor.

In [2]:
# importa o dataset 
data = pd.read_csv('data_remake.csv')
In [3]:
# Descrição 

print(data.head())
data.shape
  Unnamed: 0  abalon  abbeel  abbot  abbrevy  abc  abel  abernethy  abl  \
0     1987_1       0       0      0        0    0     0          0    2   
1     1987_2       0       0      0        0    0     0          0    1   
2     1987_3       0       0      0        0    0     0          0    2   
3     1987_4       0       0      0        0    0     0          0    0   
4     1987_5       0       0      0        0    0     0          0    1   

   abnorm   ...    zhou  zhu  zien  zilberstein  zon  zoo  zoom  zou  zoubin  \
0       0   ...       0    0     0            0    0    0     0    0       0   
1       0   ...       0    0     0            0    0    0     0    0       0   
2       0   ...       0    0     0            0    0    0     0    0       0   
3       0   ...       0    0     0            0    0    0     0    0       0   
4       0   ...       0    0     0            0    0    0     0    0       0   

   zurich  
0       0  
1       0  
2       0  
3       0  
4       0  

[5 rows x 5986 columns]
Out[3]:
(5811, 5986)
In [4]:
import matplotlib.pyplot as plt
from sklearn.metrics import silhouette_score
from sklearn.metrics import calinski_harabaz_score
from sklearn.cluster import KMeans

def kmeans_analysis(input_data, tot_range=[1,20]):
        """
            Método que realiza algumas análises no modelo KMeans.
            
            As análises são plotadas e os vetores resultados são retornados ao final da função.
            
            Métodos utilizados:
            
            Elbow Method:
                O método de Elbow análise o valor do erro quadrático entre os clusters, no caso do sklearn a inertia
            
            Silhouette Score:
                A silhueta é definida pela formula (b-a)/max(a,b) sendo:
                - a: distância média entre um ponto e os outros da mesma classe.
                - b: distância média entre um ponto e os outros da classe mais próxima.
            
                Esse coeficiente esta no intervalo ]-1,1 [ sendo que quanto mais próximo de 1 o coeficiente é ótimo
                e quanto mais perto de -1 o pior, valores perto de 0 podem demonstrar overlapping entre os clusters.
                
            Calinski:
                Calinski analisa a dispersão média entre os clusters e quanto maior o seu valor melhor.
                
                Obs*: O método de calinski é um pouco mais complexo de explicar aqui, vou linkar referências ao
                      ao final do notebook.
            
        """
        
        erro = []
        silhueta = []
        calinski = []
        
        
        # Realiza para todos os k 
        for k in range(tot_range[0], tot_range[1]+1):
            modelo = KMeans(n_clusters=k).fit(input_data)
            
            # Inertia
            erro.append(modelo.inertia_)
            
            # Silhueta
            silhueta.append( silhouette_score(input_data, modelo.labels_) )
            
            # Calinski
            calinski.append( calinski_harabaz_score(input_data, modelo.labels_) )
        

        
        # Plot do Elbow Method
        plt.figure(1)
        
        plt.xlabel('Clusters')
        plt.ylabel('Inertia')
        plt.grid(True)
        plt.xticks(range(tot_range[0], tot_range[1]+1))
        
        plt.plot( range(tot_range[0], tot_range[1]+1), erro, c='blue')
        plt.scatter(range(tot_range[0], tot_range[1]+1), erro, c='red')
    
    
        # Plot Silhueta
        plt.figure(2)
        
        plt.xticks(range(tot_range[0], tot_range[1]+1))
        plt.title('Silhueta')
        plt.xlabel('Clusters')
        plt.ylabel('Silhueta')
        plt.grid(True)
        
        plt.plot(range(tot_range[0], tot_range[1]+1), silhueta )
        plt.scatter(range(tot_range[0], tot_range[1]+1), silhueta, c='red')
        # Plot Calinski
        plt.figure(3)
        
        plt.xlabel('Clusters')
        plt.ylabel('Y')
        plt.xticks(range(tot_range[0], tot_range[1]+1))
        plt.grid(True)
        
        plt.plot(range(tot_range[0], tot_range[1]+1), calinski)
        plt.scatter(range(tot_range[0], tot_range[1]+1), calinski, c='red')
        plt.show()
        
        return [erro ,calinski, silhueta]
In [6]:
kmeans_analysis(data.iloc[:1000, 1:5000], [2,50])
---------------------------------------------------------------------------
NameError                                 Traceback (most recent call last)
<ipython-input-6-82670fe8e8d3> in <module>()
----> 1 kmeans_analysis(data.iloc[:1000, 1:5000], [2,50])

<ipython-input-4-009a98977167> in kmeans_analysis(input_data, tot_range)
     86         plt.show()
     87 
---> 88         return result[erro ,calinski, silhueta]

NameError: name 'result' is not defined

Gaussian Mixtures

Para a escolha de um K ótimo, utilizamos a métrica BIC, juntamente com a AIC, que quando minimizadas apontam a melhor escolha de um K.

BIC (Bayesian information criterion)

Em estatística o BIC é um critério para seleção de modelos dentro de um conjunto finito de modelos, sendo que o modelo com menor BIC é o escolhido. Para contornar o caso de overfitting o BIC adiciona um termo de penalização para o numero de parâmetros em um modelo. Pode ser usado para escolher o número de clusters de acordo com a complexidade intrínseca presente em um conjunto de dados.

In [6]:
from sklearn.mixture import GaussianMixture

Com o uso de GMM e coletando as métricas BIC e AIC, conseguimos plotar os gráficos seguintes. Porém, nenhum deles nos mostrou resultados utilizáveis, tanto pelos valores altamente discrepantes, como pela alta variação das métricas conforme o número de componentes aumentava.

Dataset $[5804 x 755]$

In [4]:
n_components = np.arange(1, 10)
models_gmm = [GaussianMixture(n_components=n, covariance_type='full', max_iter=300).fit(X)
          for n in n_components]

plt.plot(n_components, [m.bic(X) for m in models_gmm], label='BIC_GMM')
plt.plot(n_components, [m.aic(X) for m in models_gmm], label='AIC_GMM')
plt.legend(loc='best')
plt.xlabel('n_components')
plt.show()
In [5]:
n_components = np.arange(10, 25)
models_gmm = [GaussianMixture(n_components=n, covariance_type='full', max_iter=300).fit(X)
          for n in n_components]

plt.plot(n_components, [m.bic(X) for m in models_gmm], label='BIC_GMM')
plt.plot(n_components, [m.aic(X) for m in models_gmm], label='AIC_GMM')
plt.legend(loc='best')
plt.xlabel('n_components')
plt.show()
In [3]:
n_components = np.arange(25, 35)
models_gmm = [GaussianMixture(n_components=n, covariance_type='full', max_iter=300).fit(X)
          for n in n_components]

plt.plot(n_components, [m.bic(X) for m in models_gmm], label='BIC_GMM')
plt.plot(n_components, [m.aic(X) for m in models_gmm], label='AIC_GMM')
plt.legend(loc='best')
plt.xlabel('n_components')
plt.show()
In [56]:
gmms_diag = draw_aic_bic(np.arange(10, 300), X, title='Diag covariance', cov='diag')

Após tais testes recorremos a literatura [4] e encontramos uma implementação do algoritmo EM, onde é feita a proposta de um algoritimo robusto para EM, com diferente tipo de penalização (Kullback-Leibler). Essa proposta é feita para encontrar um número ótimo de clusters a partir da calibração da penalização.

Seguindo a literatura, testamos a aplicação de 100 clusters no nosso dataset com tamanho igual a $[5804x755]$, o que difere das 300 features apresentadas na literatura. Essa decisão foi tomada, com o objetivo que depois esse número de clusters seja reduzido utilizando as técnicas apresentadas no artigo.

In [12]:
from EM import expectationMaximisation2

thresholdConvergence = 1
epsilon = .01
deltaInit = 0
L = len(X)
B = 755
K = 100
In [13]:
P,Pi,Rpost,logScore,logScores = expectationMaximisation2(X.values,
                                                         K,
                                                         L,
                                                         B,
                                                         thresholdConvergence,
                                                         200)
1 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   755
Initial logScore:  -111593790.555
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
2 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   755
Initial logScore:  -105857470.069
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
3 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   755
Initial logScore:  -123214254.018
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
4 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   755
Initial logScore:  -112637265.636
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
5 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   755
Initial logScore:  -109217488.48
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
6 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   755
Initial logScore:  -106335920.263
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
7 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   755
Initial logScore:  -113944546.816
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
8 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   755
Initial logScore:  -103879551.479
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
9 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   755
Initial logScore:  -106227420.009
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
10 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   755
Initial logScore:  -101085078.82
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
11 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   755
Initial logScore:  -108642866.794
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
12 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   755
Initial logScore:  -119726529.461
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
13 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   755
Initial logScore:  -113895530.042
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
14 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   755
Initial logScore:  -104551884.838
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
15 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   755
Initial logScore:  -104319542.857
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
16 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   755
Initial logScore:  -110616055.716
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
17 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   755
Initial logScore:  -93221010.8575
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
18 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   755
Initial logScore:  -109561259.026
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
19 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   755
Initial logScore:  -79276184.2579
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
20 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   755
Initial logScore:  -95571793.6208
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
21 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   755
Initial logScore:  -111817903.603
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
22 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   755
Initial logScore:  -106040561.171
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
23 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   755
Initial logScore:  -75923491.6215
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
24 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   755
Initial logScore:  -122944770.245
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
25 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   755
Initial logScore:  -111259017.621
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
E-step ...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  16 / Last logScore:  -30567128.3959 / New log score:  -30565605.5469 / Difference attained:  1522.84897841
Current pi parameter:  [[  1.72295089e-04]
 [  3.34707609e-06]
 [  1.18888707e-02]
 [  1.37834689e-02]
 [  1.72294969e-06]
 [  1.34390120e-02]
 [  1.43024063e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.61873799e-02]
 [  2.23981538e-02]
 [  2.87730434e-02]
 [  1.72294969e-04]
 [  4.20281909e-02]
 [  3.17841202e-02]
 [  4.61096427e-02]
 [  5.16884907e-04]
 [  1.27467085e-02]
 [  1.94875194e-02]
 [  1.72294969e-06]
 [  1.37839430e-02]
 [  2.62999454e-02]
 [  1.72294969e-04]
 [  1.33802889e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33802889e-05]
 [  1.72294969e-06]
 [  1.33802889e-05]
 [  9.01048864e-06]
 [  3.24623547e-02]
 [  1.72294980e-04]
 [  1.34249872e-02]
 [  3.49784478e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  1.98822586e-02]
 [  2.54971390e-02]
 [  2.31622226e-02]
 [  1.91229843e-02]
 [  1.33802889e-05]
 [  1.39425353e-02]
 [  1.99033406e-05]
 [  1.33802889e-05]
 [  2.44655240e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.26948809e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.48105697e-02]
 [  3.11828904e-02]
 [  4.53976299e-02]
 [  1.72294969e-04]
 [  1.33802889e-05]
 [  3.54973344e-02]
 [  2.63610631e-02]
 [  2.21741603e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33802889e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.75576289e-02]
 [  1.72294982e-04]
 [  1.33802889e-05]
 [  1.72294969e-04]
 [  1.33802889e-05]
 [  1.72294969e-06]
 [  1.94022274e-02]
 [  2.17066535e-02]
 [  1.60795221e-05]
 [  1.03376981e-03]
 [  2.39250484e-02]
 [  3.33883893e-02]
 [  2.18750670e-02]
 [  1.72294969e-04]
 [  1.04793138e-04]
 [  2.00028925e-02]
 [  1.72294969e-06]
 [  1.27450966e-05]
 [  1.41376490e-02]
 [  1.33802889e-05]
 [  1.60365912e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.06550659e-02]
 [  1.54744180e-05]
 [  1.72294969e-04]
 [  3.10098491e-02]
 [  1.33802889e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  17 / Last logScore:  -30565605.5469 / New log score:  -30564292.3275 / Difference attained:  1313.21944768
Current pi parameter:  [[  1.72295089e-04]
 [  3.34707892e-06]
 [  1.19643598e-02]
 [  1.37835996e-02]
 [  1.72294969e-06]
 [  1.34390120e-02]
 [  1.49886551e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.61859187e-02]
 [  2.25721770e-02]
 [  2.87727834e-02]
 [  1.72294969e-04]
 [  4.17660284e-02]
 [  3.21650737e-02]
 [  4.59523376e-02]
 [  5.16884907e-04]
 [  1.27060446e-02]
 [  1.94610640e-02]
 [  1.72294969e-06]
 [  1.38041276e-02]
 [  2.61888030e-02]
 [  1.72294969e-04]
 [  1.33803002e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803002e-05]
 [  1.72294969e-06]
 [  1.33803002e-05]
 [  9.01049626e-06]
 [  3.22053906e-02]
 [  1.72294980e-04]
 [  1.32916608e-02]
 [  3.49658716e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.01533827e-02]
 [  2.54249412e-02]
 [  2.32965149e-02]
 [  1.88750774e-02]
 [  1.33803002e-05]
 [  1.37854059e-02]
 [  1.99033412e-05]
 [  1.33803002e-05]
 [  2.44651851e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.24680733e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.48108326e-02]
 [  3.11828396e-02]
 [  4.49684639e-02]
 [  1.72294969e-04]
 [  1.33803002e-05]
 [  3.54668535e-02]
 [  2.63610644e-02]
 [  2.22263037e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803002e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.76602731e-02]
 [  1.72294982e-04]
 [  1.33803002e-05]
 [  1.72294969e-04]
 [  1.33803002e-05]
 [  1.72294969e-06]
 [  1.92383639e-02]
 [  2.17076966e-02]
 [  1.60795226e-05]
 [  1.03376981e-03]
 [  2.34853038e-02]
 [  3.37326057e-02]
 [  2.17640241e-02]
 [  1.72294969e-04]
 [  1.04793141e-04]
 [  2.01585391e-02]
 [  1.72294969e-06]
 [  1.27451074e-05]
 [  1.43004697e-02]
 [  1.33803002e-05]
 [  1.60365917e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.10199856e-02]
 [  1.54744185e-05]
 [  1.72294969e-04]
 [  3.09647507e-02]
 [  1.33803002e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  18 / Last logScore:  -30564292.3275 / New log score:  -30563598.8718 / Difference attained:  693.455669954
Current pi parameter:  [[  1.72295089e-04]
 [  3.34707891e-06]
 [  1.20605756e-02]
 [  1.37872853e-02]
 [  1.72294969e-06]
 [  1.34390145e-02]
 [  1.51688894e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.61847143e-02]
 [  2.27481844e-02]
 [  2.87717437e-02]
 [  1.72294969e-04]
 [  4.16233095e-02]
 [  3.23356820e-02]
 [  4.58452218e-02]
 [  5.16884907e-04]
 [  1.27505033e-02]
 [  1.96018276e-02]
 [  1.72294969e-06]
 [  1.39573837e-02]
 [  2.61880383e-02]
 [  1.72294969e-04]
 [  1.33803002e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803002e-05]
 [  1.72294969e-06]
 [  1.33803002e-05]
 [  9.01049623e-06]
 [  3.17483841e-02]
 [  1.72294980e-04]
 [  1.32667077e-02]
 [  3.48063969e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.02493966e-02]
 [  2.54986257e-02]
 [  2.36763847e-02]
 [  1.86375860e-02]
 [  1.33803002e-05]
 [  1.38156883e-02]
 [  1.99033355e-05]
 [  1.33803002e-05]
 [  2.44654903e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.24375567e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.48301999e-02]
 [  3.11348218e-02]
 [  4.51066972e-02]
 [  1.72294969e-04]
 [  1.33803002e-05]
 [  3.54946352e-02]
 [  2.63611632e-02]
 [  2.22300008e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803002e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.77240387e-02]
 [  1.72294982e-04]
 [  1.33803002e-05]
 [  1.72294969e-04]
 [  1.33803002e-05]
 [  1.72294969e-06]
 [  1.93122459e-02]
 [  2.16772755e-02]
 [  1.60795180e-05]
 [  1.03376981e-03]
 [  2.34529770e-02]
 [  3.37721301e-02]
 [  2.15386543e-02]
 [  1.72294969e-04]
 [  1.04793111e-04]
 [  2.01567377e-02]
 [  1.72294969e-06]
 [  1.27451073e-05]
 [  1.42999317e-02]
 [  1.33803002e-05]
 [  1.60365871e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.10354256e-02]
 [  1.54744141e-05]
 [  1.72294969e-04]
 [  3.05383335e-02]
 [  1.33803002e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  19 / Last logScore:  -30563598.8718 / New log score:  -30562965.8496 / Difference attained:  633.022204313
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708181e-06]
 [  1.20606483e-02]
 [  1.38013236e-02]
 [  1.72294969e-06]
 [  1.34390147e-02]
 [  1.50087397e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.61845144e-02]
 [  2.28719832e-02]
 [  2.87717342e-02]
 [  1.72294969e-04]
 [  4.15238499e-02]
 [  3.25665775e-02]
 [  4.60557886e-02]
 [  5.16884907e-04]
 [  1.28266348e-02]
 [  1.96545911e-02]
 [  1.72294969e-06]
 [  1.41605493e-02]
 [  2.61809138e-02]
 [  1.72294969e-04]
 [  1.33803118e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803118e-05]
 [  1.72294969e-06]
 [  1.33803118e-05]
 [  9.01050404e-06]
 [  3.15945694e-02]
 [  1.72294980e-04]
 [  1.32666910e-02]
 [  3.48040765e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.05110730e-02]
 [  2.54935505e-02]
 [  2.36050294e-02]
 [  1.84790837e-02]
 [  1.33803118e-05]
 [  1.39803098e-02]
 [  1.99033375e-05]
 [  1.33803118e-05]
 [  2.44656318e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.22223414e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.48104814e-02]
 [  3.10129374e-02]
 [  4.49551885e-02]
 [  1.72294969e-04]
 [  1.33803118e-05]
 [  3.55508254e-02]
 [  2.63612933e-02]
 [  2.22599841e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803118e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.77163747e-02]
 [  1.72294982e-04]
 [  1.33803118e-05]
 [  1.72294969e-04]
 [  1.33803118e-05]
 [  1.72294969e-06]
 [  1.96409023e-02]
 [  2.15128442e-02]
 [  1.60795196e-05]
 [  1.03376981e-03]
 [  2.33735386e-02]
 [  3.38062944e-02]
 [  2.14212508e-02]
 [  1.72294969e-04]
 [  1.04793122e-04]
 [  2.01264817e-02]
 [  1.72294969e-06]
 [  1.27451184e-05]
 [  1.42996509e-02]
 [  1.33803118e-05]
 [  1.60365887e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.11745468e-02]
 [  1.54744157e-05]
 [  1.72294969e-04]
 [  3.01780440e-02]
 [  1.33803118e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  20 / Last logScore:  -30562965.8496 / New log score:  -30562532.4305 / Difference attained:  433.419134632
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708256e-06]
 [  1.20606483e-02]
 [  1.39539838e-02]
 [  1.72294969e-06]
 [  1.34390135e-02]
 [  1.48355300e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.61758103e-02]
 [  2.29158663e-02]
 [  2.87609274e-02]
 [  1.72294969e-04]
 [  4.14590214e-02]
 [  3.25636977e-02]
 [  4.60293946e-02]
 [  5.16884907e-04]
 [  1.30472786e-02]
 [  1.96869090e-02]
 [  1.72294969e-06]
 [  1.43008479e-02]
 [  2.60165193e-02]
 [  1.72294969e-04]
 [  1.33803148e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803148e-05]
 [  1.72294969e-06]
 [  1.33803148e-05]
 [  9.01050606e-06]
 [  3.13658407e-02]
 [  1.72294980e-04]
 [  1.32666908e-02]
 [  3.48037459e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.07534231e-02]
 [  2.54703519e-02]
 [  2.35447747e-02]
 [  1.84351246e-02]
 [  1.33803148e-05]
 [  1.41595884e-02]
 [  1.99033432e-05]
 [  1.33803148e-05]
 [  2.44657040e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.21813362e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.48104747e-02]
 [  3.10132299e-02]
 [  4.48892115e-02]
 [  1.72294969e-04]
 [  1.33803148e-05]
 [  3.56648440e-02]
 [  2.63612113e-02]
 [  2.24026134e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803148e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.77119938e-02]
 [  1.72294982e-04]
 [  1.33803148e-05]
 [  1.72294969e-04]
 [  1.33803148e-05]
 [  1.72294969e-06]
 [  1.96306188e-02]
 [  2.13439019e-02]
 [  1.60795242e-05]
 [  1.03376981e-03]
 [  2.32597036e-02]
 [  3.39456846e-02]
 [  2.15504748e-02]
 [  1.72294969e-04]
 [  1.04793151e-04]
 [  1.99941350e-02]
 [  1.72294969e-06]
 [  1.27451212e-05]
 [  1.42971962e-02]
 [  1.33803148e-05]
 [  1.60365933e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.10975799e-02]
 [  1.54744200e-05]
 [  1.72294969e-04]
 [  3.00649567e-02]
 [  1.33803148e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  21 / Last logScore:  -30562532.4305 / New log score:  -30562039.1497 / Difference attained:  493.280765451
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708276e-06]
 [  1.20606470e-02]
 [  1.39848708e-02]
 [  1.72294969e-06]
 [  1.34390126e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.60679848e-02]
 [  2.29183115e-02]
 [  2.86136235e-02]
 [  1.72294969e-04]
 [  4.13518549e-02]
 [  3.25568005e-02]
 [  4.63315510e-02]
 [  5.16884907e-04]
 [  1.27500572e-02]
 [  1.98092419e-02]
 [  1.72294969e-06]
 [  1.43028186e-02]
 [  2.60165568e-02]
 [  1.72294969e-04]
 [  1.33803155e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803155e-05]
 [  1.72294969e-06]
 [  1.33803155e-05]
 [  9.01050658e-06]
 [  3.13474514e-02]
 [  1.72294980e-04]
 [  1.32666908e-02]
 [  3.48022646e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.10216300e-02]
 [  2.53345804e-02]
 [  2.35004723e-02]
 [  1.84326484e-02]
 [  1.33803155e-05]
 [  1.43668278e-02]
 [  1.99033421e-05]
 [  1.33803155e-05]
 [  2.44657253e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20537467e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.48104134e-02]
 [  3.11068252e-02]
 [  4.47249230e-02]
 [  1.72294969e-04]
 [  1.33803155e-05]
 [  3.56651866e-02]
 [  2.63607123e-02]
 [  2.25683830e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803155e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.75579831e-02]
 [  1.72294982e-04]
 [  1.33803155e-05]
 [  1.72294969e-04]
 [  1.33803155e-05]
 [  1.72294969e-06]
 [  1.96004861e-02]
 [  2.12214427e-02]
 [  1.60795233e-05]
 [  1.03376981e-03]
 [  2.32585960e-02]
 [  3.41634178e-02]
 [  2.16218365e-02]
 [  1.72294969e-04]
 [  1.04793146e-04]
 [  2.00908916e-02]
 [  1.72294969e-06]
 [  1.27451220e-05]
 [  1.42087481e-02]
 [  1.33803155e-05]
 [  1.60365924e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.11785358e-02]
 [  1.54744192e-05]
 [  1.72294969e-04]
 [  2.99787403e-02]
 [  1.33803155e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  22 / Last logScore:  -30562039.1497 / New log score:  -30561462.0996 / Difference attained:  577.050159786
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708262e-06]
 [  1.20606473e-02]
 [  1.41559139e-02]
 [  1.72294969e-06]
 [  1.34390115e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.59665602e-02]
 [  2.29263154e-02]
 [  2.86008382e-02]
 [  1.72294969e-04]
 [  4.13540980e-02]
 [  3.24664747e-02]
 [  4.64182209e-02]
 [  5.16884907e-04]
 [  1.25771054e-02]
 [  1.98364906e-02]
 [  1.72294969e-06]
 [  1.43056910e-02]
 [  2.60165828e-02]
 [  1.72294969e-04]
 [  1.33803150e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803150e-05]
 [  1.72294969e-06]
 [  1.33803150e-05]
 [  9.01050623e-06]
 [  3.12892822e-02]
 [  1.72294980e-04]
 [  1.32666907e-02]
 [  3.48013166e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.10207333e-02]
 [  2.51862730e-02]
 [  2.31120099e-02]
 [  1.84246518e-02]
 [  1.33803150e-05]
 [  1.44722842e-02]
 [  1.99033442e-05]
 [  1.33803150e-05]
 [  2.44657226e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20531261e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.48101637e-02]
 [  3.11853788e-02]
 [  4.46839959e-02]
 [  1.72294969e-04]
 [  1.33803150e-05]
 [  3.56652283e-02]
 [  2.63606562e-02]
 [  2.25733087e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803150e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.75308029e-02]
 [  1.72294982e-04]
 [  1.33803150e-05]
 [  1.72294969e-04]
 [  1.33803150e-05]
 [  1.72294969e-06]
 [  1.94694520e-02]
 [  2.12126135e-02]
 [  1.60795250e-05]
 [  1.03376981e-03]
 [  2.32561544e-02]
 [  3.42867419e-02]
 [  2.19703134e-02]
 [  1.72294969e-04]
 [  1.04793157e-04]
 [  2.01587003e-02]
 [  1.72294969e-06]
 [  1.27451215e-05]
 [  1.41283289e-02]
 [  1.33803150e-05]
 [  1.60365941e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.14262484e-02]
 [  1.54744208e-05]
 [  1.72294969e-04]
 [  2.99783630e-02]
 [  1.33803150e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  23 / Last logScore:  -30561462.0996 / New log score:  -30560402.0369 / Difference attained:  1060.06263352
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708213e-06]
 [  1.20606481e-02]
 [  1.46587929e-02]
 [  1.72294969e-06]
 [  1.34390114e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.61826459e-02]
 [  2.30610972e-02]
 [  2.86000607e-02]
 [  1.72294969e-04]
 [  4.13520897e-02]
 [  3.23975863e-02]
 [  4.62416399e-02]
 [  5.16884907e-04]
 [  1.25807300e-02]
 [  1.99818650e-02]
 [  1.72294969e-06]
 [  1.43240247e-02]
 [  2.60028491e-02]
 [  1.72294969e-04]
 [  1.33803130e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803130e-05]
 [  1.72294969e-06]
 [  1.33803130e-05]
 [  9.01050491e-06]
 [  3.13210389e-02]
 [  1.72294980e-04]
 [  1.32666907e-02]
 [  3.47998632e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.08702832e-02]
 [  2.52842123e-02]
 [  2.24086701e-02]
 [  1.82896498e-02]
 [  1.33803130e-05]
 [  1.44691883e-02]
 [  1.99033471e-05]
 [  1.33803130e-05]
 [  2.44656666e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20529179e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.48101673e-02]
 [  3.13575118e-02]
 [  4.48044324e-02]
 [  1.72294969e-04]
 [  1.33803130e-05]
 [  3.56652283e-02]
 [  2.63606485e-02]
 [  2.25750444e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803130e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.73854162e-02]
 [  1.72294982e-04]
 [  1.33803130e-05]
 [  1.72294969e-04]
 [  1.33803130e-05]
 [  1.72294969e-06]
 [  1.94690554e-02]
 [  2.15359263e-02]
 [  1.60795273e-05]
 [  1.03376981e-03]
 [  2.32379967e-02]
 [  3.42869076e-02]
 [  2.20496180e-02]
 [  1.72294969e-04]
 [  1.04793172e-04]
 [  2.03321229e-02]
 [  1.72294969e-06]
 [  1.27451196e-05]
 [  1.43004495e-02]
 [  1.33803130e-05]
 [  1.60365964e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.06525460e-02]
 [  1.54744231e-05]
 [  1.72294969e-04]
 [  2.99781972e-02]
 [  1.33803130e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  24 / Last logScore:  -30560402.0369 / New log score:  -30560071.2482 / Difference attained:  330.788684193
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708185e-06]
 [  1.20606485e-02]
 [  1.48377967e-02]
 [  1.72294969e-06]
 [  1.34390116e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.61692847e-02]
 [  2.30876698e-02]
 [  2.84576196e-02]
 [  1.72294969e-04]
 [  4.13506240e-02]
 [  3.24116311e-02]
 [  4.61754846e-02]
 [  5.16884907e-04]
 [  1.25976408e-02]
 [  1.99850268e-02]
 [  1.72294969e-06]
 [  1.44745395e-02]
 [  2.58442730e-02]
 [  1.72294969e-04]
 [  1.33803119e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803119e-05]
 [  1.72294969e-06]
 [  1.33803119e-05]
 [  9.01050415e-06]
 [  3.11265889e-02]
 [  1.72294980e-04]
 [  1.32666907e-02]
 [  3.47953105e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.06757397e-02]
 [  2.55677860e-02]
 [  2.25444360e-02]
 [  1.82637335e-02]
 [  1.33803119e-05]
 [  1.43104050e-02]
 [  1.99033465e-05]
 [  1.33803119e-05]
 [  2.44654286e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527810e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.48000012e-02]
 [  3.13578539e-02]
 [  4.48673884e-02]
 [  1.72294969e-04]
 [  1.33803119e-05]
 [  3.56652320e-02]
 [  2.63606189e-02]
 [  2.25799835e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803119e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.73821694e-02]
 [  1.72294982e-04]
 [  1.33803119e-05]
 [  1.72294969e-04]
 [  1.33803119e-05]
 [  1.72294969e-06]
 [  1.94692631e-02]
 [  2.15367475e-02]
 [  1.60795269e-05]
 [  1.03376981e-03]
 [  2.30880468e-02]
 [  3.42870068e-02]
 [  2.20331402e-02]
 [  1.72294969e-04]
 [  1.04793169e-04]
 [  2.03466553e-02]
 [  1.72294969e-06]
 [  1.27451185e-05]
 [  1.43004875e-02]
 [  1.33803119e-05]
 [  1.60365960e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.09000869e-02]
 [  1.54744227e-05]
 [  1.72294969e-04]
 [  2.99776585e-02]
 [  1.33803119e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  25 / Last logScore:  -30560071.2482 / New log score:  -30559627.9702 / Difference attained:  443.277990025
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708170e-06]
 [  1.20606485e-02]
 [  1.51619611e-02]
 [  1.72294969e-06]
 [  1.34390117e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.61064280e-02]
 [  2.30877040e-02]
 [  2.83275183e-02]
 [  1.72294969e-04]
 [  4.13506730e-02]
 [  3.24743014e-02]
 [  4.61756342e-02]
 [  5.16884907e-04]
 [  1.27492202e-02]
 [  1.99854993e-02]
 [  1.72294969e-06]
 [  1.44943666e-02]
 [  2.56718983e-02]
 [  1.72294969e-04]
 [  1.33803113e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803113e-05]
 [  1.72294969e-06]
 [  1.33803113e-05]
 [  9.01050373e-06]
 [  3.09978410e-02]
 [  1.72294980e-04]
 [  1.32666907e-02]
 [  3.47456276e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.06632433e-02]
 [  2.56715589e-02]
 [  2.26705486e-02]
 [  1.82643333e-02]
 [  1.33803113e-05]
 [  1.41276686e-02]
 [  1.99033456e-05]
 [  1.33803113e-05]
 [  2.44653618e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527466e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.47722218e-02]
 [  3.13579933e-02]
 [  4.49834142e-02]
 [  1.72294969e-04]
 [  1.33803113e-05]
 [  3.56652878e-02]
 [  2.63605153e-02]
 [  2.26299368e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803113e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.73816410e-02]
 [  1.72294982e-04]
 [  1.33803113e-05]
 [  1.72294969e-04]
 [  1.33803113e-05]
 [  1.72294969e-06]
 [  1.94693499e-02]
 [  2.15368301e-02]
 [  1.60795262e-05]
 [  1.03376981e-03]
 [  2.30880929e-02]
 [  3.42871172e-02]
 [  2.18816605e-02]
 [  1.72294969e-04]
 [  1.04793164e-04]
 [  2.04607131e-02]
 [  1.72294969e-06]
 [  1.27451179e-05]
 [  1.43004874e-02]
 [  1.33803113e-05]
 [  1.60365952e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.07687101e-02]
 [  1.54744219e-05]
 [  1.72294969e-04]
 [  2.99580341e-02]
 [  1.33803113e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  26 / Last logScore:  -30559627.9702 / New log score:  -30559160.7169 / Difference attained:  467.253318399
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708161e-06]
 [  1.20606485e-02]
 [  1.55074010e-02]
 [  1.72294969e-06]
 [  1.34390125e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.60186813e-02]
 [  2.30877055e-02]
 [  2.82390132e-02]
 [  1.72294969e-04]
 [  4.13506568e-02]
 [  3.25637662e-02]
 [  4.61765224e-02]
 [  5.16884907e-04]
 [  1.29195396e-02]
 [  1.99855775e-02]
 [  1.72294969e-06]
 [  1.46505935e-02]
 [  2.54992986e-02]
 [  1.72294969e-04]
 [  1.33803110e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803110e-05]
 [  1.72294969e-06]
 [  1.33803110e-05]
 [  9.01050350e-06]
 [  3.08481558e-02]
 [  1.72294980e-04]
 [  1.32666907e-02]
 [  3.46320139e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.05035694e-02]
 [  2.56712859e-02]
 [  2.27429247e-02]
 [  1.82804072e-02]
 [  1.33803110e-05]
 [  1.41271429e-02]
 [  1.99033456e-05]
 [  1.33803110e-05]
 [  2.44656297e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527446e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.46490296e-02]
 [  3.13581762e-02]
 [  4.51322331e-02]
 [  1.72294969e-04]
 [  1.33803110e-05]
 [  3.56652861e-02]
 [  2.63604612e-02]
 [  2.27442209e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803110e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.73685211e-02]
 [  1.72294982e-04]
 [  1.33803110e-05]
 [  1.72294969e-04]
 [  1.33803110e-05]
 [  1.72294969e-06]
 [  1.94694898e-02]
 [  2.15365464e-02]
 [  1.60795262e-05]
 [  1.03376981e-03]
 [  2.30881450e-02]
 [  3.42870767e-02]
 [  2.18814872e-02]
 [  1.72294969e-04]
 [  1.04793164e-04]
 [  2.03367954e-02]
 [  1.72294969e-06]
 [  1.27451176e-05]
 [  1.43004874e-02]
 [  1.33803110e-05]
 [  1.60365953e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.08435912e-02]
 [  1.54744220e-05]
 [  1.72294969e-04]
 [  2.98019618e-02]
 [  1.33803110e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  27 / Last logScore:  -30559160.7169 / New log score:  -30558475.6705 / Difference attained:  685.046415627
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708130e-06]
 [  1.20606483e-02]
 [  1.61420385e-02]
 [  1.72294969e-06]
 [  1.34390153e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.60884400e-02]
 [  2.30877134e-02]
 [  2.80839995e-02]
 [  1.72294969e-04]
 [  4.13891475e-02]
 [  3.25632940e-02]
 [  4.61785665e-02]
 [  5.16884907e-04]
 [  1.30216735e-02]
 [  1.99873910e-02]
 [  1.72294969e-06]
 [  1.48419212e-02]
 [  2.54991304e-02]
 [  1.72294969e-04]
 [  1.33803097e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803097e-05]
 [  1.72294969e-06]
 [  1.33803097e-05]
 [  9.01050266e-06]
 [  3.08412980e-02]
 [  1.72294980e-04]
 [  1.32666907e-02]
 [  3.46321767e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.03801524e-02]
 [  2.56715563e-02]
 [  2.27430111e-02]
 [  1.84352740e-02]
 [  1.33803097e-05]
 [  1.41268147e-02]
 [  1.99033472e-05]
 [  1.33803097e-05]
 [  2.44631576e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527439e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.44668872e-02]
 [  3.13585242e-02]
 [  4.51145048e-02]
 [  1.72294969e-04]
 [  1.33803097e-05]
 [  3.56652763e-02]
 [  2.63604314e-02]
 [  2.27443557e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803097e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.72284553e-02]
 [  1.72294982e-04]
 [  1.33803097e-05]
 [  1.72294969e-04]
 [  1.33803097e-05]
 [  1.72294969e-06]
 [  1.94695033e-02]
 [  2.15364073e-02]
 [  1.60795275e-05]
 [  1.03376981e-03]
 [  2.30881741e-02]
 [  3.42871593e-02]
 [  2.18823343e-02]
 [  1.72294969e-04]
 [  1.04793173e-04]
 [  2.00202717e-02]
 [  1.72294969e-06]
 [  1.27451164e-05]
 [  1.43004758e-02]
 [  1.33803097e-05]
 [  1.60365965e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.07588118e-02]
 [  1.54744232e-05]
 [  1.72294969e-04]
 [  2.96350632e-02]
 [  1.33803097e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  28 / Last logScore:  -30558475.6705 / New log score:  -30557625.5875 / Difference attained:  850.083014995
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708138e-06]
 [  1.20606487e-02]
 [  1.67141032e-02]
 [  1.72294969e-06]
 [  1.34390154e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.60503341e-02]
 [  2.30878955e-02]
 [  2.80823721e-02]
 [  1.72294969e-04]
 [  4.13508325e-02]
 [  3.25630647e-02]
 [  4.61189262e-02]
 [  5.16884907e-04]
 [  1.31531282e-02]
 [  2.00221056e-02]
 [  1.72294969e-06]
 [  1.49897421e-02]
 [  2.54991659e-02]
 [  1.72294969e-04]
 [  1.33803100e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803100e-05]
 [  1.72294969e-06]
 [  1.33803100e-05]
 [  9.01050287e-06]
 [  3.08414283e-02]
 [  1.72294980e-04]
 [  1.32666906e-02]
 [  3.48027694e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.02940324e-02]
 [  2.56716146e-02]
 [  2.27434457e-02]
 [  1.84362386e-02]
 [  1.33803100e-05]
 [  1.41265513e-02]
 [  1.99033468e-05]
 [  1.33803100e-05]
 [  2.42928986e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527385e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.44658872e-02]
 [  3.13587281e-02]
 [  4.49669783e-02]
 [  1.72294969e-04]
 [  1.33803100e-05]
 [  3.56652764e-02]
 [  2.63604171e-02]
 [  2.27442982e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803100e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.72106637e-02]
 [  1.72294982e-04]
 [  1.33803100e-05]
 [  1.72294969e-04]
 [  1.33803100e-05]
 [  1.72294969e-06]
 [  1.94694998e-02]
 [  2.15363351e-02]
 [  1.60795271e-05]
 [  1.03376981e-03]
 [  2.30881906e-02]
 [  3.42872427e-02]
 [  2.18814694e-02]
 [  1.72294969e-04]
 [  1.04793170e-04]
 [  1.96081406e-02]
 [  1.72294969e-06]
 [  1.27451167e-05]
 [  1.43002787e-02]
 [  1.33803100e-05]
 [  1.60365962e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.06746101e-02]
 [  1.54744229e-05]
 [  1.72294969e-04]
 [  2.96347326e-02]
 [  1.33803100e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  29 / Last logScore:  -30557625.5875 / New log score:  -30557313.4556 / Difference attained:  312.131922752
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708152e-06]
 [  1.20606487e-02]
 [  1.67126171e-02]
 [  1.72294969e-06]
 [  1.34390153e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.59270947e-02]
 [  2.30881609e-02]
 [  2.80816111e-02]
 [  1.72294969e-04]
 [  4.13505314e-02]
 [  3.25629480e-02]
 [  4.61896389e-02]
 [  5.16884907e-04]
 [  1.32692947e-02]
 [  2.01557122e-02]
 [  1.72294969e-06]
 [  1.49897524e-02]
 [  2.54991708e-02]
 [  1.72294969e-04]
 [  1.33803106e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803106e-05]
 [  1.72294969e-06]
 [  1.33803106e-05]
 [  9.01050324e-06]
 [  3.08413419e-02]
 [  1.72294980e-04]
 [  1.32666906e-02]
 [  3.48044778e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.01603475e-02]
 [  2.56716307e-02]
 [  2.27433840e-02]
 [  1.84369109e-02]
 [  1.33803106e-05]
 [  1.41265399e-02]
 [  1.99033420e-05]
 [  1.33803106e-05]
 [  2.42926799e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527452e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.44656172e-02]
 [  3.13588400e-02]
 [  4.49673226e-02]
 [  1.72294969e-04]
 [  1.33803106e-05]
 [  3.56652765e-02]
 [  2.63604056e-02]
 [  2.27437284e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803106e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.71715757e-02]
 [  1.72294982e-04]
 [  1.33803106e-05]
 [  1.72294969e-04]
 [  1.33803106e-05]
 [  1.72294969e-06]
 [  1.94694922e-02]
 [  2.15362873e-02]
 [  1.60795232e-05]
 [  1.03376981e-03]
 [  2.30883599e-02]
 [  3.42874662e-02]
 [  2.18814791e-02]
 [  1.72294969e-04]
 [  1.04793145e-04]
 [  1.97378708e-02]
 [  1.72294969e-06]
 [  1.27451172e-05]
 [  1.42997222e-02]
 [  1.33803106e-05]
 [  1.60365923e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.05213830e-02]
 [  1.54744191e-05]
 [  1.72294969e-04]
 [  2.96347190e-02]
 [  1.33803106e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  30 / Last logScore:  -30557313.4556 / New log score:  -30557151.8383 / Difference attained:  161.617293447
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708179e-06]
 [  1.20606485e-02]
 [  1.68802409e-02]
 [  1.72294969e-06]
 [  1.34390151e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.58425803e-02]
 [  2.30873617e-02]
 [  2.80809979e-02]
 [  1.72294969e-04]
 [  4.13503984e-02]
 [  3.25629104e-02]
 [  4.63444455e-02]
 [  5.16884907e-04]
 [  1.32675145e-02]
 [  2.01572317e-02]
 [  1.72294969e-06]
 [  1.49897522e-02]
 [  2.54990933e-02]
 [  1.72294969e-04]
 [  1.33803117e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803117e-05]
 [  1.72294969e-06]
 [  1.33803117e-05]
 [  9.01050397e-06]
 [  3.08413209e-02]
 [  1.72294980e-04]
 [  1.32666906e-02]
 [  3.48044768e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.01594603e-02]
 [  2.56716313e-02]
 [  2.27434756e-02]
 [  1.84375085e-02]
 [  1.33803117e-05]
 [  1.41279994e-02]
 [  1.99033435e-05]
 [  1.33803117e-05]
 [  2.42926966e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527066e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.43843160e-02]
 [  3.13588921e-02]
 [  4.49673718e-02]
 [  1.72294969e-04]
 [  1.33803117e-05]
 [  3.56652766e-02]
 [  2.63603968e-02]
 [  2.27436620e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803117e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.70377947e-02]
 [  1.72294982e-04]
 [  1.33803117e-05]
 [  1.72294969e-04]
 [  1.33803117e-05]
 [  1.72294969e-06]
 [  1.94694908e-02]
 [  2.15361815e-02]
 [  1.60795244e-05]
 [  1.03376981e-03]
 [  2.30897952e-02]
 [  3.42875257e-02]
 [  2.18814723e-02]
 [  1.72294969e-04]
 [  1.04793153e-04]
 [  1.97325916e-02]
 [  1.72294969e-06]
 [  1.27451183e-05]
 [  1.42334562e-02]
 [  1.33803117e-05]
 [  1.60365935e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.05693913e-02]
 [  1.54744203e-05]
 [  1.72294969e-04]
 [  2.96347189e-02]
 [  1.33803117e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  31 / Last logScore:  -30557151.8383 / New log score:  -30557108.5115 / Difference attained:  43.3268024996
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708180e-06]
 [  1.20606485e-02]
 [  1.68897436e-02]
 [  1.72294969e-06]
 [  1.34390151e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.58357587e-02]
 [  2.30869728e-02]
 [  2.80803309e-02]
 [  1.72294969e-04]
 [  4.13503761e-02]
 [  3.25628895e-02]
 [  4.63481216e-02]
 [  5.16884907e-04]
 [  1.32679056e-02]
 [  2.01568240e-02]
 [  1.72294969e-06]
 [  1.49897522e-02]
 [  2.54987704e-02]
 [  1.72294969e-04]
 [  1.33803117e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803117e-05]
 [  1.72294969e-06]
 [  1.33803117e-05]
 [  9.01050399e-06]
 [  3.08413159e-02]
 [  1.72294980e-04]
 [  1.32666906e-02]
 [  3.48044770e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.01590924e-02]
 [  2.56716313e-02]
 [  2.27433925e-02]
 [  1.84381674e-02]
 [  1.33803117e-05]
 [  1.41279745e-02]
 [  1.99033399e-05]
 [  1.33803117e-05]
 [  2.42927012e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527056e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.42935927e-02]
 [  3.13589179e-02]
 [  4.49673777e-02]
 [  1.72294969e-04]
 [  1.33803117e-05]
 [  3.56652767e-02]
 [  2.63603586e-02]
 [  2.27436547e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803117e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.70388948e-02]
 [  1.72294982e-04]
 [  1.33803117e-05]
 [  1.72294969e-04]
 [  1.33803117e-05]
 [  1.72294969e-06]
 [  1.94694911e-02]
 [  2.15362209e-02]
 [  1.60795216e-05]
 [  1.03376981e-03]
 [  2.30965947e-02]
 [  3.42877031e-02]
 [  2.18814720e-02]
 [  1.72294969e-04]
 [  1.04793134e-04]
 [  1.98398253e-02]
 [  1.72294969e-06]
 [  1.27451183e-05]
 [  1.41281936e-02]
 [  1.33803117e-05]
 [  1.60365906e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.06449403e-02]
 [  1.54744175e-05]
 [  1.72294969e-04]
 [  2.96347189e-02]
 [  1.33803117e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  32 / Last logScore:  -30557108.5115 / New log score:  -30556907.7881 / Difference attained:  200.723391443
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708183e-06]
 [  1.20606483e-02]
 [  1.69554911e-02]
 [  1.72294969e-06]
 [  1.34390151e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.57154546e-02]
 [  2.30867435e-02]
 [  2.80793970e-02]
 [  1.72294969e-04]
 [  4.13503758e-02]
 [  3.25628908e-02]
 [  4.63480883e-02]
 [  5.16884907e-04]
 [  1.32681360e-02]
 [  2.01567530e-02]
 [  1.72294969e-06]
 [  1.49897522e-02]
 [  2.54987192e-02]
 [  1.72294969e-04]
 [  1.33803118e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803118e-05]
 [  1.72294969e-06]
 [  1.33803118e-05]
 [  9.01050408e-06]
 [  3.08413147e-02]
 [  1.72294980e-04]
 [  1.32666906e-02]
 [  3.48044771e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.01590247e-02]
 [  2.56716311e-02]
 [  2.27405826e-02]
 [  1.84390947e-02]
 [  1.33803118e-05]
 [  1.41279491e-02]
 [  1.99033397e-05]
 [  1.33803118e-05]
 [  2.42927022e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527055e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.42935930e-02]
 [  3.13589309e-02]
 [  4.49673783e-02]
 [  1.72294969e-04]
 [  1.33803118e-05]
 [  3.56652770e-02]
 [  2.63601602e-02]
 [  2.27436539e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803118e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.70390827e-02]
 [  1.72294982e-04]
 [  1.33803118e-05]
 [  1.72294969e-04]
 [  1.33803118e-05]
 [  1.72294969e-06]
 [  1.94694911e-02]
 [  2.15362143e-02]
 [  1.60795214e-05]
 [  1.03376981e-03]
 [  2.32170972e-02]
 [  3.42877378e-02]
 [  2.18814719e-02]
 [  1.72294969e-04]
 [  1.04793133e-04]
 [  2.00116160e-02]
 [  1.72294969e-06]
 [  1.27451184e-05]
 [  1.39596981e-02]
 [  1.33803118e-05]
 [  1.60365905e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.05787318e-02]
 [  1.54744174e-05]
 [  1.72294969e-04]
 [  2.96347189e-02]
 [  1.33803118e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  33 / Last logScore:  -30556907.7881 / New log score:  -30556600.1162 / Difference attained:  307.671931278
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708193e-06]
 [  1.20606483e-02]
 [  1.72296011e-02]
 [  1.72294969e-06]
 [  1.34390151e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.56695521e-02]
 [  2.30865882e-02]
 [  2.80776215e-02]
 [  1.72294969e-04]
 [  4.13503662e-02]
 [  3.25628739e-02]
 [  4.63480044e-02]
 [  5.16884907e-04]
 [  1.32682919e-02]
 [  2.01567359e-02]
 [  1.72294969e-06]
 [  1.49897522e-02]
 [  2.54987112e-02]
 [  1.72294969e-04]
 [  1.33803122e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803122e-05]
 [  1.72294969e-06]
 [  1.33803122e-05]
 [  9.01050437e-06]
 [  3.08413144e-02]
 [  1.72294980e-04]
 [  1.32666906e-02]
 [  3.48044772e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.01590042e-02]
 [  2.56716311e-02]
 [  2.26640746e-02]
 [  1.84408667e-02]
 [  1.33803122e-05]
 [  1.41279388e-02]
 [  1.99033392e-05]
 [  1.33803122e-05]
 [  2.42927024e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527054e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.42935930e-02]
 [  3.13589374e-02]
 [  4.49673784e-02]
 [  1.72294969e-04]
 [  1.33803122e-05]
 [  3.56652953e-02]
 [  2.63449740e-02]
 [  2.27436538e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803122e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.70391180e-02]
 [  1.72294982e-04]
 [  1.33803122e-05]
 [  1.72294969e-04]
 [  1.33803122e-05]
 [  1.72294969e-06]
 [  1.94694913e-02]
 [  2.15362142e-02]
 [  1.60795210e-05]
 [  1.03376981e-03]
 [  2.32759127e-02]
 [  3.42877428e-02]
 [  2.18814715e-02]
 [  1.72294969e-04]
 [  1.04793130e-04]
 [  2.01651682e-02]
 [  1.72294969e-06]
 [  1.27451188e-05]
 [  1.39559807e-02]
 [  1.33803122e-05]
 [  1.60365901e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.02336728e-02]
 [  1.54744170e-05]
 [  1.72294969e-04]
 [  2.96347189e-02]
 [  1.33803122e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  34 / Last logScore:  -30556600.1162 / New log score:  -30556373.7423 / Difference attained:  226.373900313
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708226e-06]
 [  1.20606483e-02]
 [  1.73830499e-02]
 [  1.72294969e-06]
 [  1.34390151e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.56579492e-02]
 [  2.30864736e-02]
 [  2.80720571e-02]
 [  1.72294969e-04]
 [  4.13503639e-02]
 [  3.25628627e-02]
 [  4.63479762e-02]
 [  5.16884907e-04]
 [  1.32684066e-02]
 [  2.01567316e-02]
 [  1.72294969e-06]
 [  1.49897522e-02]
 [  2.54987101e-02]
 [  1.72294969e-04]
 [  1.33803135e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803135e-05]
 [  1.72294969e-06]
 [  1.33803135e-05]
 [  9.01050524e-06]
 [  3.08413144e-02]
 [  1.72294980e-04]
 [  1.32666882e-02]
 [  3.48046936e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.01590015e-02]
 [  2.56716308e-02]
 [  2.25712303e-02]
 [  1.84465373e-02]
 [  1.33803135e-05]
 [  1.41279354e-02]
 [  1.99033392e-05]
 [  1.33803135e-05]
 [  2.42927023e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527055e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.42935930e-02]
 [  3.13589408e-02]
 [  4.49673773e-02]
 [  1.72294969e-04]
 [  1.33803135e-05]
 [  3.56653516e-02]
 [  2.61891393e-02]
 [  2.27436538e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803135e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.70412747e-02]
 [  1.72294982e-04]
 [  1.33803135e-05]
 [  1.72294969e-04]
 [  1.33803135e-05]
 [  1.72294969e-06]
 [  1.94694915e-02]
 [  2.15341152e-02]
 [  1.60795210e-05]
 [  1.03376981e-03]
 [  2.34317326e-02]
 [  3.42877031e-02]
 [  2.18814714e-02]
 [  1.72294969e-04]
 [  1.04793131e-04]
 [  2.03558270e-02]
 [  1.72294969e-06]
 [  1.27451201e-05]
 [  1.39560067e-02]
 [  1.33803135e-05]
 [  1.60365901e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  1.99936577e-02]
 [  1.54744170e-05]
 [  1.72294969e-04]
 [  2.96347189e-02]
 [  1.33803135e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  35 / Last logScore:  -30556373.7423 / New log score:  -30556066.1094 / Difference attained:  307.632842518
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708208e-06]
 [  1.20606483e-02]
 [  1.75706956e-02]
 [  1.72294969e-06]
 [  1.34390151e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.54809821e-02]
 [  2.30863836e-02]
 [  2.80134460e-02]
 [  1.72294969e-04]
 [  4.13503604e-02]
 [  3.25628608e-02]
 [  4.63479490e-02]
 [  5.16884907e-04]
 [  1.32684963e-02]
 [  2.01567339e-02]
 [  1.72294969e-06]
 [  1.49897522e-02]
 [  2.54987003e-02]
 [  1.72294969e-04]
 [  1.33803128e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803128e-05]
 [  1.72294969e-06]
 [  1.33803128e-05]
 [  9.01050477e-06]
 [  3.08413144e-02]
 [  1.72294980e-04]
 [  1.32666455e-02]
 [  3.48084004e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.01589992e-02]
 [  2.56716297e-02]
 [  2.25711621e-02]
 [  1.85052422e-02]
 [  1.33803128e-05]
 [  1.41279341e-02]
 [  1.99033375e-05]
 [  1.33803128e-05]
 [  2.42927022e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527056e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.42935930e-02]
 [  3.13589438e-02]
 [  4.49673755e-02]
 [  1.72294969e-04]
 [  1.33803128e-05]
 [  3.56664345e-02]
 [  2.61903748e-02]
 [  2.27436538e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803128e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.72057388e-02]
 [  1.72294982e-04]
 [  1.33803128e-05]
 [  1.72294969e-04]
 [  1.33803128e-05]
 [  1.72294969e-06]
 [  1.94694915e-02]
 [  2.14684460e-02]
 [  1.60795196e-05]
 [  1.03376981e-03]
 [  2.34307206e-02]
 [  3.42864382e-02]
 [  2.18814714e-02]
 [  1.72294969e-04]
 [  1.04793122e-04]
 [  2.07673429e-02]
 [  1.72294969e-06]
 [  1.27451194e-05]
 [  1.39559868e-02]
 [  1.33803128e-05]
 [  1.60365887e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  1.94690010e-02]
 [  1.54744156e-05]
 [  1.72294969e-04]
 [  2.96347189e-02]
 [  1.33803128e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  36 / Last logScore:  -30556066.1094 / New log score:  -30555786.7034 / Difference attained:  279.406044222
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708219e-06]
 [  1.20606484e-02]
 [  1.77576539e-02]
 [  1.72294969e-06]
 [  1.34390151e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.53339033e-02]
 [  2.30863102e-02]
 [  2.79108697e-02]
 [  1.72294969e-04]
 [  4.13503653e-02]
 [  3.25628621e-02]
 [  4.63476874e-02]
 [  5.16884907e-04]
 [  1.32685700e-02]
 [  2.01570654e-02]
 [  1.72294969e-06]
 [  1.49897522e-02]
 [  2.54977902e-02]
 [  1.72294969e-04]
 [  1.33803133e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803133e-05]
 [  1.72294969e-06]
 [  1.33803133e-05]
 [  9.01050507e-06]
 [  3.08413144e-02]
 [  1.72294980e-04]
 [  1.32666419e-02]
 [  3.49629949e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.01589025e-02]
 [  2.56716297e-02]
 [  2.25716234e-02]
 [  1.86073566e-02]
 [  1.33803133e-05]
 [  1.41279649e-02]
 [  1.99033378e-05]
 [  1.33803133e-05]
 [  2.42927022e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527056e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.42935930e-02]
 [  3.13589655e-02]
 [  4.49673696e-02]
 [  1.72294969e-04]
 [  1.33803133e-05]
 [  3.56666442e-02]
 [  2.61914995e-02]
 [  2.27436539e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803133e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.72121041e-02]
 [  1.72294982e-04]
 [  1.33803133e-05]
 [  1.72294969e-04]
 [  1.33803133e-05]
 [  1.72294969e-06]
 [  1.94694924e-02]
 [  2.13641766e-02]
 [  1.60795199e-05]
 [  1.03376981e-03]
 [  2.34305343e-02]
 [  3.42853204e-02]
 [  2.18814726e-02]
 [  1.72294969e-04]
 [  1.04793123e-04]
 [  2.08429622e-02]
 [  1.72294969e-06]
 [  1.27451198e-05]
 [  1.39559933e-02]
 [  1.33803133e-05]
 [  1.60365890e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  1.92976609e-02]
 [  1.54744159e-05]
 [  1.72294969e-04]
 [  2.96347189e-02]
 [  1.33803133e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  37 / Last logScore:  -30555786.7034 / New log score:  -30555656.641 / Difference attained:  130.062337466
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708243e-06]
 [  1.20606485e-02]
 [  1.80738698e-02]
 [  1.72294969e-06]
 [  1.34390151e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.53253273e-02]
 [  2.30862704e-02]
 [  2.79083247e-02]
 [  1.72294969e-04]
 [  4.13503613e-02]
 [  3.25628642e-02]
 [  4.63470514e-02]
 [  5.16884907e-04]
 [  1.32686326e-02]
 [  2.01571642e-02]
 [  1.72294969e-06]
 [  1.49897522e-02]
 [  2.54974218e-02]
 [  1.72294969e-04]
 [  1.33803142e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803142e-05]
 [  1.72294969e-06]
 [  1.33803142e-05]
 [  9.01050570e-06]
 [  3.08413144e-02]
 [  1.72294980e-04]
 [  1.32666405e-02]
 [  3.49761981e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.01588954e-02]
 [  2.56716297e-02]
 [  2.25743382e-02]
 [  1.86071569e-02]
 [  1.33803142e-05]
 [  1.41281965e-02]
 [  1.99033374e-05]
 [  1.33803142e-05]
 [  2.42927022e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527055e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.42935930e-02]
 [  3.13595173e-02]
 [  4.49673639e-02]
 [  1.72294969e-04]
 [  1.33803142e-05]
 [  3.56666890e-02]
 [  2.61931656e-02]
 [  2.27436539e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803142e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.72123793e-02]
 [  1.72294982e-04]
 [  1.33803142e-05]
 [  1.72294969e-04]
 [  1.33803142e-05]
 [  1.72294969e-06]
 [  1.94694930e-02]
 [  2.13645922e-02]
 [  1.60795195e-05]
 [  1.03376981e-03]
 [  2.34304798e-02]
 [  3.42836605e-02]
 [  2.18814717e-02]
 [  1.72294969e-04]
 [  1.04793121e-04]
 [  2.06239033e-02]
 [  1.72294969e-06]
 [  1.27451207e-05]
 [  1.39559964e-02]
 [  1.33803142e-05]
 [  1.60365886e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  1.91953312e-02]
 [  1.54744156e-05]
 [  1.72294969e-04]
 [  2.96347195e-02]
 [  1.33803142e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  38 / Last logScore:  -30555656.641 / New log score:  -30555518.7404 / Difference attained:  137.900588814
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708246e-06]
 [  1.20606484e-02]
 [  1.84030270e-02]
 [  1.72294969e-06]
 [  1.34390151e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.53584019e-02]
 [  2.30862190e-02]
 [  2.79056495e-02]
 [  1.72294969e-04]
 [  4.13503615e-02]
 [  3.25628674e-02]
 [  4.63469597e-02]
 [  5.16884907e-04]
 [  1.32686877e-02]
 [  2.01571828e-02]
 [  1.72294969e-06]
 [  1.49897522e-02]
 [  2.54972755e-02]
 [  1.72294969e-04]
 [  1.33803143e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803143e-05]
 [  1.72294969e-06]
 [  1.33803143e-05]
 [  9.01050578e-06]
 [  3.08413144e-02]
 [  1.72294980e-04]
 [  1.32666386e-02]
 [  3.49761547e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.01588951e-02]
 [  2.56716297e-02]
 [  2.25770433e-02]
 [  1.86071214e-02]
 [  1.33803143e-05]
 [  1.41283414e-02]
 [  1.99033373e-05]
 [  1.33803143e-05]
 [  2.42927022e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527055e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.42935930e-02]
 [  3.13595561e-02]
 [  4.49673553e-02]
 [  1.72294969e-04]
 [  1.33803143e-05]
 [  3.56666987e-02]
 [  2.61977017e-02]
 [  2.27436538e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803143e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.72125070e-02]
 [  1.72294982e-04]
 [  1.33803143e-05]
 [  1.72294969e-04]
 [  1.33803143e-05]
 [  1.72294969e-06]
 [  1.94694932e-02]
 [  2.13645342e-02]
 [  1.60795195e-05]
 [  1.03376981e-03]
 [  2.34304564e-02]
 [  3.42791416e-02]
 [  2.18814716e-02]
 [  1.72294969e-04]
 [  1.04793120e-04]
 [  2.04044684e-02]
 [  1.72294969e-06]
 [  1.27451208e-05]
 [  1.39559964e-02]
 [  1.33803143e-05]
 [  1.60365885e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  1.90525474e-02]
 [  1.54744155e-05]
 [  1.72294969e-04]
 [  2.96347217e-02]
 [  1.33803143e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  39 / Last logScore:  -30555518.7404 / New log score:  -30555397.4201 / Difference attained:  121.320357114
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708248e-06]
 [  1.20606491e-02]
 [  1.86101602e-02]
 [  1.72294969e-06]
 [  1.34390151e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.54993697e-02]
 [  2.30861703e-02]
 [  2.79001684e-02]
 [  1.72294969e-04]
 [  4.13503636e-02]
 [  3.25628692e-02]
 [  4.63469363e-02]
 [  5.16884907e-04]
 [  1.32687372e-02]
 [  2.01571864e-02]
 [  1.72294969e-06]
 [  1.49897522e-02]
 [  2.54972151e-02]
 [  1.72294969e-04]
 [  1.33803144e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803144e-05]
 [  1.72294969e-06]
 [  1.33803144e-05]
 [  9.01050585e-06]
 [  3.08413144e-02]
 [  1.72294980e-04]
 [  1.32666334e-02]
 [  3.49761536e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.01588953e-02]
 [  2.56716297e-02]
 [  2.25825348e-02]
 [  1.86071038e-02]
 [  1.33803144e-05]
 [  1.41284439e-02]
 [  1.99033373e-05]
 [  1.33803144e-05]
 [  2.42927022e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527055e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.42935930e-02]
 [  3.13595547e-02]
 [  4.49673318e-02]
 [  1.72294969e-04]
 [  1.33803144e-05]
 [  3.56667008e-02]
 [  2.62387552e-02]
 [  2.27436538e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803144e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.72125637e-02]
 [  1.72294982e-04]
 [  1.33803144e-05]
 [  1.72294969e-04]
 [  1.33803144e-05]
 [  1.72294969e-06]
 [  1.94694937e-02]
 [  2.13644427e-02]
 [  1.60795194e-05]
 [  1.03376981e-03]
 [  2.34304633e-02]
 [  3.42381324e-02]
 [  2.18814712e-02]
 [  1.72294969e-04]
 [  1.04793120e-04]
 [  2.03287373e-02]
 [  1.72294969e-06]
 [  1.27451209e-05]
 [  1.39559964e-02]
 [  1.33803144e-05]
 [  1.60365885e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  1.87801590e-02]
 [  1.54744154e-05]
 [  1.72294969e-04]
 [  2.96347323e-02]
 [  1.33803144e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  40 / Last logScore:  -30555397.4201 / New log score:  -30555282.4567 / Difference attained:  114.963345651
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708246e-06]
 [  1.20606488e-02]
 [  1.87682919e-02]
 [  1.72294969e-06]
 [  1.34390151e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.55006941e-02]
 [  2.30861253e-02]
 [  2.78718489e-02]
 [  1.72294969e-04]
 [  4.13503898e-02]
 [  3.25628703e-02]
 [  4.63457442e-02]
 [  5.16884907e-04]
 [  1.32687828e-02]
 [  2.01571872e-02]
 [  1.72294969e-06]
 [  1.49897522e-02]
 [  2.54971898e-02]
 [  1.72294969e-04]
 [  1.33803143e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803143e-05]
 [  1.72294969e-06]
 [  1.33803143e-05]
 [  9.01050578e-06]
 [  3.08413143e-02]
 [  1.72294980e-04]
 [  1.32665692e-02]
 [  3.49761535e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.01588969e-02]
 [  2.56716291e-02]
 [  2.26108630e-02]
 [  1.86069949e-02]
 [  1.33803143e-05]
 [  1.41285208e-02]
 [  1.99033376e-05]
 [  1.33803143e-05]
 [  2.42927022e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527055e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.42935930e-02]
 [  3.13595534e-02]
 [  4.49670558e-02]
 [  1.72294969e-04]
 [  1.33803143e-05]
 [  3.56667013e-02]
 [  2.63612226e-02]
 [  2.27436538e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803143e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.72125882e-02]
 [  1.72294982e-04]
 [  1.33803143e-05]
 [  1.72294969e-04]
 [  1.33803143e-05]
 [  1.72294969e-06]
 [  1.94694984e-02]
 [  2.13643764e-02]
 [  1.60795197e-05]
 [  1.03376981e-03]
 [  2.34310376e-02]
 [  3.41161811e-02]
 [  2.18814708e-02]
 [  1.72294969e-04]
 [  1.04793122e-04]
 [  2.01695243e-02]
 [  1.72294969e-06]
 [  1.27451208e-05]
 [  1.39559964e-02]
 [  1.33803143e-05]
 [  1.60365888e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  1.87804195e-02]
 [  1.54744157e-05]
 [  1.72294969e-04]
 [  2.96347281e-02]
 [  1.33803143e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  41 / Last logScore:  -30555282.4567 / New log score:  -30555264.4655 / Difference attained:  17.9912048988
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708238e-06]
 [  1.20606542e-02]
 [  1.87964504e-02]
 [  1.72294969e-06]
 [  1.34390151e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.55010679e-02]
 [  2.30860881e-02]
 [  2.77387238e-02]
 [  1.72294969e-04]
 [  4.13503880e-02]
 [  3.25628710e-02]
 [  4.63449625e-02]
 [  5.16884907e-04]
 [  1.32688257e-02]
 [  2.01571875e-02]
 [  1.72294969e-06]
 [  1.49897522e-02]
 [  2.54971791e-02]
 [  1.72294969e-04]
 [  1.33803140e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803140e-05]
 [  1.72294969e-06]
 [  1.33803140e-05]
 [  9.01050558e-06]
 [  3.08413143e-02]
 [  1.72294980e-04]
 [  1.32659769e-02]
 [  3.49761535e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.01588968e-02]
 [  2.56716284e-02]
 [  2.27440187e-02]
 [  1.86056472e-02]
 [  1.33803140e-05]
 [  1.41285752e-02]
 [  1.99033372e-05]
 [  1.33803140e-05]
 [  2.42927022e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527055e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.42935930e-02]
 [  3.13595528e-02]
 [  4.49645389e-02]
 [  1.72294969e-04]
 [  1.33803140e-05]
 [  3.56667037e-02]
 [  2.63617532e-02]
 [  2.27436532e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803140e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.72125987e-02]
 [  1.72294982e-04]
 [  1.33803140e-05]
 [  1.72294969e-04]
 [  1.33803140e-05]
 [  1.72294969e-06]
 [  1.94694985e-02]
 [  2.13643810e-02]
 [  1.60795194e-05]
 [  1.03376981e-03]
 [  2.34389300e-02]
 [  3.41204375e-02]
 [  2.18814708e-02]
 [  1.72294969e-04]
 [  1.04793120e-04]
 [  2.01292046e-02]
 [  1.72294969e-06]
 [  1.27451205e-05]
 [  1.39559974e-02]
 [  1.33803140e-05]
 [  1.60365885e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  1.87846464e-02]
 [  1.54744154e-05]
 [  1.72294969e-04]
 [  2.96347467e-02]
 [  1.33803140e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  42 / Last logScore:  -30555264.4655 / New log score:  -30555207.8499 / Difference attained:  56.6156487428
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708239e-06]
 [  1.20606559e-02]
 [  1.89258387e-02]
 [  1.72294969e-06]
 [  1.34390151e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.55012099e-02]
 [  2.30861682e-02]
 [  2.77202114e-02]
 [  1.72294969e-04]
 [  4.13503880e-02]
 [  3.25628713e-02]
 [  4.63445822e-02]
 [  5.16884907e-04]
 [  1.32688669e-02]
 [  2.01571875e-02]
 [  1.72294969e-06]
 [  1.49897521e-02]
 [  2.54971745e-02]
 [  1.72294969e-04]
 [  1.33803141e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803141e-05]
 [  1.72294969e-06]
 [  1.33803141e-05]
 [  9.01050559e-06]
 [  3.08413144e-02]
 [  1.72294980e-04]
 [  1.32655608e-02]
 [  3.49761535e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.01588968e-02]
 [  2.56716303e-02]
 [  2.27629672e-02]
 [  1.86042557e-02]
 [  1.33803141e-05]
 [  1.41286182e-02]
 [  1.99033374e-05]
 [  1.33803141e-05]
 [  2.42927025e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527055e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.42935930e-02]
 [  3.13595524e-02]
 [  4.49624021e-02]
 [  1.72294969e-04]
 [  1.33803141e-05]
 [  3.56667362e-02]
 [  2.63621677e-02]
 [  2.27436485e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803141e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.72126031e-02]
 [  1.72294982e-04]
 [  1.33803141e-05]
 [  1.72294969e-04]
 [  1.33803141e-05]
 [  1.72294969e-06]
 [  1.94694984e-02]
 [  2.13643386e-02]
 [  1.60795195e-05]
 [  1.03376981e-03]
 [  2.34682139e-02]
 [  3.41236525e-02]
 [  2.18814708e-02]
 [  1.72294969e-04]
 [  1.04793121e-04]
 [  1.99238672e-02]
 [  1.72294969e-06]
 [  1.27451206e-05]
 [  1.39559976e-02]
 [  1.33803141e-05]
 [  1.60365886e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  1.88312683e-02]
 [  1.54744155e-05]
 [  1.72294969e-04]
 [  2.96347533e-02]
 [  1.33803141e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  43 / Last logScore:  -30555207.8499 / New log score:  -30555140.2048 / Difference attained:  67.6450590789
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708240e-06]
 [  1.20606563e-02]
 [  1.89529223e-02]
 [  1.72294969e-06]
 [  1.34390151e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.55012747e-02]
 [  2.30862661e-02]
 [  2.75975198e-02]
 [  1.72294969e-04]
 [  4.13503881e-02]
 [  3.25628713e-02]
 [  4.63444018e-02]
 [  5.16884907e-04]
 [  1.32689090e-02]
 [  2.01571876e-02]
 [  1.72294969e-06]
 [  1.49897520e-02]
 [  2.54971726e-02]
 [  1.72294969e-04]
 [  1.33803141e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803141e-05]
 [  1.72294969e-06]
 [  1.33803141e-05]
 [  9.01050562e-06]
 [  3.08413144e-02]
 [  1.72294980e-04]
 [  1.32651354e-02]
 [  3.49761535e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.01588968e-02]
 [  2.56716301e-02]
 [  2.28857454e-02]
 [  1.86029884e-02]
 [  1.33803141e-05]
 [  1.41286541e-02]
 [  1.99033372e-05]
 [  1.33803141e-05]
 [  2.42927025e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527055e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.42935930e-02]
 [  3.13595523e-02]
 [  4.49589668e-02]
 [  1.72294969e-04]
 [  1.33803141e-05]
 [  3.56668684e-02]
 [  2.63625931e-02]
 [  2.27436443e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803141e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.72126050e-02]
 [  1.72294982e-04]
 [  1.33803141e-05]
 [  1.72294969e-04]
 [  1.33803141e-05]
 [  1.72294969e-06]
 [  1.94694984e-02]
 [  2.13642994e-02]
 [  1.60795194e-05]
 [  1.03376981e-03]
 [  2.36001181e-02]
 [  3.41282587e-02]
 [  2.18814707e-02]
 [  1.72294969e-04]
 [  1.04793120e-04]
 [  1.96434946e-02]
 [  1.72294969e-06]
 [  1.27451206e-05]
 [  1.39559976e-02]
 [  1.33803141e-05]
 [  1.60365885e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  1.89524464e-02]
 [  1.54744154e-05]
 [  1.72294969e-04]
 [  2.96348211e-02]
 [  1.33803141e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  44 / Last logScore:  -30555140.2048 / New log score:  -30555085.1581 / Difference attained:  55.0467434414
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708244e-06]
 [  1.20606677e-02]
 [  1.89564164e-02]
 [  1.72294969e-06]
 [  1.34390151e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.55013004e-02]
 [  2.30864394e-02]
 [  2.73797329e-02]
 [  1.72294969e-04]
 [  4.13503881e-02]
 [  3.25628712e-02]
 [  4.63443117e-02]
 [  5.16884907e-04]
 [  1.32689530e-02]
 [  2.01571876e-02]
 [  1.72294969e-06]
 [  1.49897519e-02]
 [  2.54971719e-02]
 [  1.72294969e-04]
 [  1.33803143e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803143e-05]
 [  1.72294969e-06]
 [  1.33803143e-05]
 [  9.01050572e-06]
 [  3.08413143e-02]
 [  1.72294980e-04]
 [  1.32645392e-02]
 [  3.49761535e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.01588968e-02]
 [  2.56716247e-02]
 [  2.31031614e-02]
 [  1.86013590e-02]
 [  1.33803143e-05]
 [  1.41286852e-02]
 [  1.99033369e-05]
 [  1.33803143e-05]
 [  2.42927025e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527055e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.42935930e-02]
 [  3.13595522e-02]
 [  4.49482257e-02]
 [  1.72294969e-04]
 [  1.33803143e-05]
 [  3.56676057e-02]
 [  2.63631893e-02]
 [  2.27436381e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803143e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.72126056e-02]
 [  1.72294982e-04]
 [  1.33803143e-05]
 [  1.72294969e-04]
 [  1.33803143e-05]
 [  1.72294969e-06]
 [  1.94694983e-02]
 [  2.13642683e-02]
 [  1.60795191e-05]
 [  1.03376981e-03]
 [  2.36018299e-02]
 [  3.41408606e-02]
 [  2.18814703e-02]
 [  1.72294969e-04]
 [  1.04793118e-04]
 [  1.96368400e-02]
 [  1.72294969e-06]
 [  1.27451208e-05]
 [  1.39559976e-02]
 [  1.33803143e-05]
 [  1.60365882e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  1.89524466e-02]
 [  1.54744152e-05]
 [  1.72294969e-04]
 [  2.96355199e-02]
 [  1.33803143e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  45 / Last logScore:  -30555085.1581 / New log score:  -30554923.8148 / Difference attained:  161.343287211
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708242e-06]
 [  1.20606688e-02]
 [  1.89856833e-02]
 [  1.72294969e-06]
 [  1.34390151e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.55013111e-02]
 [  2.30869407e-02]
 [  2.72222809e-02]
 [  1.72294969e-04]
 [  4.13503881e-02]
 [  3.25628712e-02]
 [  4.63443539e-02]
 [  5.16884907e-04]
 [  1.32690016e-02]
 [  2.01571876e-02]
 [  1.72294969e-06]
 [  1.49897516e-02]
 [  2.54971716e-02]
 [  1.72294969e-04]
 [  1.33803142e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803142e-05]
 [  1.72294969e-06]
 [  1.33803142e-05]
 [  9.01050566e-06]
 [  3.08413141e-02]
 [  1.72294980e-04]
 [  1.32633136e-02]
 [  3.49761535e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.01588968e-02]
 [  2.56716258e-02]
 [  2.32654104e-02]
 [  1.85902646e-02]
 [  1.33803142e-05]
 [  1.41287121e-02]
 [  1.99033365e-05]
 [  1.33803142e-05]
 [  2.42927025e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527055e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.42935930e-02]
 [  3.13595522e-02]
 [  4.48518663e-02]
 [  1.72294969e-04]
 [  1.33803142e-05]
 [  3.56678783e-02]
 [  2.63644151e-02]
 [  2.27436201e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803142e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.72126060e-02]
 [  1.72294982e-04]
 [  1.33803142e-05]
 [  1.72294969e-04]
 [  1.33803142e-05]
 [  1.72294969e-06]
 [  1.94694980e-02]
 [  2.13642336e-02]
 [  1.60795188e-05]
 [  1.03376981e-03]
 [  2.36015571e-02]
 [  3.42429401e-02]
 [  2.18814704e-02]
 [  1.72294969e-04]
 [  1.04793116e-04]
 [  1.96074248e-02]
 [  1.72294969e-06]
 [  1.27451207e-05]
 [  1.39559976e-02]
 [  1.33803142e-05]
 [  1.60365879e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  1.89524466e-02]
 [  1.54744149e-05]
 [  1.72294969e-04]
 [  2.96356671e-02]
 [  1.33803142e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  46 / Last logScore:  -30554923.8148 / New log score:  -30554709.4495 / Difference attained:  214.365315218
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708238e-06]
 [  1.20606715e-02]
 [  1.91237563e-02]
 [  1.72294969e-06]
 [  1.34390151e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.55013152e-02]
 [  2.30899423e-02]
 [  2.69317084e-02]
 [  1.72294969e-04]
 [  4.13503881e-02]
 [  3.25628712e-02]
 [  4.63454887e-02]
 [  5.16884907e-04]
 [  1.32690610e-02]
 [  2.01571876e-02]
 [  1.72294969e-06]
 [  1.49897492e-02]
 [  2.54971714e-02]
 [  1.72294969e-04]
 [  1.33803140e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803140e-05]
 [  1.72294969e-06]
 [  1.33803140e-05]
 [  9.01050558e-06]
 [  3.08413089e-02]
 [  1.72294980e-04]
 [  1.32583094e-02]
 [  3.49761535e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.01588968e-02]
 [  2.56716424e-02]
 [  2.36316761e-02]
 [  1.84536943e-02]
 [  1.33803140e-05]
 [  1.41287359e-02]
 [  1.99033363e-05]
 [  1.33803140e-05]
 [  2.42927023e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527055e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.42935930e-02]
 [  3.13595521e-02]
 [  4.47955123e-02]
 [  1.72294969e-04]
 [  1.33803140e-05]
 [  3.56679810e-02]
 [  2.63694195e-02]
 [  2.27435050e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803140e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.72126061e-02]
 [  1.72294982e-04]
 [  1.33803140e-05]
 [  1.72294969e-04]
 [  1.33803140e-05]
 [  1.72294969e-06]
 [  1.94694972e-02]
 [  2.13642076e-02]
 [  1.60795187e-05]
 [  1.03376981e-03]
 [  2.36014540e-02]
 [  3.43560806e-02]
 [  2.18814704e-02]
 [  1.72294969e-04]
 [  1.04793115e-04]
 [  1.94693100e-02]
 [  1.72294969e-06]
 [  1.27451205e-05]
 [  1.39559976e-02]
 [  1.33803140e-05]
 [  1.60365878e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  1.89524469e-02]
 [  1.54744147e-05]
 [  1.72294969e-04]
 [  2.96357061e-02]
 [  1.33803140e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  47 / Last logScore:  -30554709.4495 / New log score:  -30554623.352 / Difference attained:  86.0974559188
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708241e-06]
 [  1.20606927e-02]
 [  1.91236210e-02]
 [  1.72294969e-06]
 [  1.34390151e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.55013104e-02]
 [  2.30854689e-02]
 [  2.68765755e-02]
 [  1.72294969e-04]
 [  4.13503880e-02]
 [  3.25628712e-02]
 [  4.63553798e-02]
 [  5.16884907e-04]
 [  1.32691777e-02]
 [  2.01571876e-02]
 [  1.72294969e-06]
 [  1.49897481e-02]
 [  2.54971713e-02]
 [  1.72294969e-04]
 [  1.33803142e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803142e-05]
 [  1.72294969e-06]
 [  1.33803142e-05]
 [  9.01050566e-06]
 [  3.08409850e-02]
 [  1.72294980e-04]
 [  1.31455828e-02]
 [  3.49761535e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.01588968e-02]
 [  2.56716633e-02]
 [  2.37679532e-02]
 [  1.82630579e-02]
 [  1.33803142e-05]
 [  1.41287591e-02]
 [  1.99033362e-05]
 [  1.33803142e-05]
 [  2.42927014e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527055e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.42935930e-02]
 [  3.13595521e-02]
 [  4.47955751e-02]
 [  1.72294969e-04]
 [  1.33803142e-05]
 [  3.56680207e-02]
 [  2.64821469e-02]
 [  2.27434588e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803142e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.72126061e-02]
 [  1.72294982e-04]
 [  1.33803142e-05]
 [  1.72294969e-04]
 [  1.33803142e-05]
 [  1.72294969e-06]
 [  1.94694986e-02]
 [  2.13641800e-02]
 [  1.60795185e-05]
 [  1.03376981e-03]
 [  2.36014140e-02]
 [  3.44603467e-02]
 [  2.18814707e-02]
 [  1.72294969e-04]
 [  1.04793115e-04]
 [  1.94692888e-02]
 [  1.72294969e-06]
 [  1.27451207e-05]
 [  1.39559980e-02]
 [  1.33803142e-05]
 [  1.60365876e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  1.89524354e-02]
 [  1.54744146e-05]
 [  1.72294969e-04]
 [  2.96358396e-02]
 [  1.33803142e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  48 / Last logScore:  -30554623.352 / New log score:  -30554613.5448 / Difference attained:  9.80720262975
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708246e-06]
 [  1.20606942e-02]
 [  1.91235844e-02]
 [  1.72294969e-06]
 [  1.34390151e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.55012476e-02]
 [  2.30853763e-02]
 [  2.68715165e-02]
 [  1.72294969e-04]
 [  4.13503866e-02]
 [  3.25628712e-02]
 [  4.63882952e-02]
 [  5.16884907e-04]
 [  1.32692305e-02]
 [  2.01571876e-02]
 [  1.72294969e-06]
 [  1.49897481e-02]
 [  2.54971713e-02]
 [  1.72294969e-04]
 [  1.33803143e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803143e-05]
 [  1.72294969e-06]
 [  1.33803143e-05]
 [  9.01050578e-06]
 [  3.08408471e-02]
 [  1.72294980e-04]
 [  1.30944051e-02]
 [  3.49761535e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.01588968e-02]
 [  2.56716652e-02]
 [  2.37408546e-02]
 [  1.82631434e-02]
 [  1.33803143e-05]
 [  1.41287979e-02]
 [  1.99033367e-05]
 [  1.33803143e-05]
 [  2.42927026e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527055e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.42935930e-02]
 [  3.13595521e-02]
 [  4.47951402e-02]
 [  1.72294969e-04]
 [  1.33803143e-05]
 [  3.56680362e-02]
 [  2.65333383e-02]
 [  2.27434562e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803143e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.72126061e-02]
 [  1.72294982e-04]
 [  1.33803143e-05]
 [  1.72294969e-04]
 [  1.33803143e-05]
 [  1.72294969e-06]
 [  1.94694984e-02]
 [  2.13641061e-02]
 [  1.60795190e-05]
 [  1.03376981e-03]
 [  2.36013985e-02]
 [  3.44603941e-02]
 [  2.18814707e-02]
 [  1.72294969e-04]
 [  1.04793117e-04]
 [  1.94692873e-02]
 [  1.72294969e-06]
 [  1.27451208e-05]
 [  1.39560008e-02]
 [  1.33803143e-05]
 [  1.60365880e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  1.89522399e-02]
 [  1.54744150e-05]
 [  1.72294969e-04]
 [  2.96358762e-02]
 [  1.33803143e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  49 / Last logScore:  -30554613.5448 / New log score:  -30554607.9097 / Difference attained:  5.6351586245
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708246e-06]
 [  1.20606943e-02]
 [  1.91235741e-02]
 [  1.72294969e-06]
 [  1.34390151e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.55010375e-02]
 [  2.30853168e-02]
 [  2.68590334e-02]
 [  1.72294969e-04]
 [  4.13503861e-02]
 [  3.25628712e-02]
 [  4.64987578e-02]
 [  5.16884907e-04]
 [  1.32692899e-02]
 [  2.01571876e-02]
 [  1.72294969e-06]
 [  1.49897481e-02]
 [  2.54971713e-02]
 [  1.72294969e-04]
 [  1.33803143e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803143e-05]
 [  1.72294969e-06]
 [  1.33803143e-05]
 [  9.01050578e-06]
 [  3.08407591e-02]
 [  1.72294980e-04]
 [  1.30940066e-02]
 [  3.49761535e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.01588968e-02]
 [  2.56716794e-02]
 [  2.36434322e-02]
 [  1.82631296e-02]
 [  1.33803143e-05]
 [  1.41288850e-02]
 [  1.99033370e-05]
 [  1.33803143e-05]
 [  2.42927026e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527055e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.42935930e-02]
 [  3.13595521e-02]
 [  4.47951207e-02]
 [  1.72294969e-04]
 [  1.33803143e-05]
 [  3.56680423e-02]
 [  2.65337404e-02]
 [  2.27434559e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803143e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.72126062e-02]
 [  1.72294982e-04]
 [  1.33803143e-05]
 [  1.72294969e-04]
 [  1.33803143e-05]
 [  1.72294969e-06]
 [  1.94694983e-02]
 [  2.13639489e-02]
 [  1.60795192e-05]
 [  1.03376981e-03]
 [  2.36013924e-02]
 [  3.44602055e-02]
 [  2.18814706e-02]
 [  1.72294969e-04]
 [  1.04793119e-04]
 [  1.94692872e-02]
 [  1.72294969e-06]
 [  1.27451208e-05]
 [  1.39560107e-02]
 [  1.33803143e-05]
 [  1.60365883e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  1.89522461e-02]
 [  1.54744153e-05]
 [  1.72294969e-04]
 [  2.96358865e-02]
 [  1.33803143e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  50 / Last logScore:  -30554607.9097 / New log score:  -30554597.3494 / Difference attained:  10.5603071302
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708246e-06]
 [  1.20606943e-02]
 [  1.91235713e-02]
 [  1.72294969e-06]
 [  1.34390151e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.55005194e-02]
 [  2.30852474e-02]
 [  2.67519664e-02]
 [  1.72294969e-04]
 [  4.13503860e-02]
 [  3.25628712e-02]
 [  4.65186934e-02]
 [  5.16884907e-04]
 [  1.32693595e-02]
 [  2.01571876e-02]
 [  1.72294969e-06]
 [  1.49897481e-02]
 [  2.54971713e-02]
 [  1.72294969e-04]
 [  1.33803143e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803143e-05]
 [  1.72294969e-06]
 [  1.33803143e-05]
 [  9.01050578e-06]
 [  3.08404627e-02]
 [  1.72294980e-04]
 [  1.30939377e-02]
 [  3.49761535e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.01588968e-02]
 [  2.56717108e-02]
 [  2.37316564e-02]
 [  1.82630592e-02]
 [  1.33803143e-05]
 [  1.41291184e-02]
 [  1.99033375e-05]
 [  1.33803143e-05]
 [  2.42927026e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527055e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.42935930e-02]
 [  3.13595521e-02]
 [  4.47951196e-02]
 [  1.72294969e-04]
 [  1.33803143e-05]
 [  3.56680446e-02]
 [  2.65338091e-02]
 [  2.27434558e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803143e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.72126062e-02]
 [  1.72294982e-04]
 [  1.33803143e-05]
 [  1.72294969e-04]
 [  1.33803143e-05]
 [  1.72294969e-06]
 [  1.94694983e-02]
 [  2.13635547e-02]
 [  1.60795196e-05]
 [  1.03376981e-03]
 [  2.36013901e-02]
 [  3.44600131e-02]
 [  2.18814706e-02]
 [  1.72294969e-04]
 [  1.04793121e-04]
 [  1.94692872e-02]
 [  1.72294969e-06]
 [  1.27451208e-05]
 [  1.39560520e-02]
 [  1.33803143e-05]
 [  1.60365887e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  1.89523198e-02]
 [  1.54744156e-05]
 [  1.72294969e-04]
 [  2.96358894e-02]
 [  1.33803143e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  51 / Last logScore:  -30554597.3494 / New log score:  -30554596.2382 / Difference attained:  1.11115978286
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708246e-06]
 [  1.20606943e-02]
 [  1.91235705e-02]
 [  1.72294969e-06]
 [  1.34390151e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.55003552e-02]
 [  2.30851638e-02]
 [  2.67051451e-02]
 [  1.72294969e-04]
 [  4.13503859e-02]
 [  3.25628712e-02]
 [  4.65188512e-02]
 [  5.16884907e-04]
 [  1.32694431e-02]
 [  2.01571876e-02]
 [  1.72294969e-06]
 [  1.49897481e-02]
 [  2.54971713e-02]
 [  1.72294969e-04]
 [  1.33803144e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803144e-05]
 [  1.72294969e-06]
 [  1.33803144e-05]
 [  9.01050579e-06]
 [  3.08404919e-02]
 [  1.72294980e-04]
 [  1.30939247e-02]
 [  3.49761535e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.01588968e-02]
 [  2.56716955e-02]
 [  2.37785059e-02]
 [  1.82629562e-02]
 [  1.33803144e-05]
 [  1.41292457e-02]
 [  1.99033376e-05]
 [  1.33803144e-05]
 [  2.42927025e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527056e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.42935930e-02]
 [  3.13595521e-02]
 [  4.47951193e-02]
 [  1.72294969e-04]
 [  1.33803144e-05]
 [  3.56680456e-02]
 [  2.65338222e-02]
 [  2.27434558e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803144e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.72126062e-02]
 [  1.72294982e-04]
 [  1.33803144e-05]
 [  1.72294969e-04]
 [  1.33803144e-05]
 [  1.72294969e-06]
 [  1.94694984e-02]
 [  2.13634428e-02]
 [  1.60795197e-05]
 [  1.03376981e-03]
 [  2.36013891e-02]
 [  3.44599878e-02]
 [  2.18814705e-02]
 [  1.72294969e-04]
 [  1.04793122e-04]
 [  1.94692872e-02]
 [  1.72294969e-06]
 [  1.27451208e-05]
 [  1.39560632e-02]
 [  1.33803144e-05]
 [  1.60365888e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  1.89523863e-02]
 [  1.54744157e-05]
 [  1.72294969e-04]
 [  2.96358902e-02]
 [  1.33803144e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
M-step...
Number of clusters:  100 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  52 / Last logScore:  -30554596.2382 / New log score:  -30554596.2305 / Difference attained:  0.00769013911486
Current pi parameter:  [[  1.72295089e-04]
 [  3.34708247e-06]
 [  1.20606943e-02]
 [  1.91235702e-02]
 [  1.72294969e-06]
 [  1.34390151e-02]
 [  1.48173677e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.55003246e-02]
 [  2.30850599e-02]
 [  2.67035136e-02]
 [  1.72294969e-04]
 [  4.13503859e-02]
 [  3.25628712e-02]
 [  4.65188574e-02]
 [  5.16884907e-04]
 [  1.32695471e-02]
 [  2.01571876e-02]
 [  1.72294969e-06]
 [  1.49897481e-02]
 [  2.54971713e-02]
 [  1.72294969e-04]
 [  1.33803144e-05]
 [  1.56788419e-04]
 [  1.72294969e-06]
 [  1.33803144e-05]
 [  1.72294969e-06]
 [  1.33803144e-05]
 [  9.01050580e-06]
 [  3.08405828e-02]
 [  1.72294980e-04]
 [  1.30939222e-02]
 [  3.49761535e-02]
 [  1.72294969e-04]
 [  8.61474845e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294976e-04]
 [  2.01588968e-02]
 [  2.56716842e-02]
 [  2.37800985e-02]
 [  1.82629011e-02]
 [  1.33803144e-05]
 [  1.41293020e-02]
 [  1.99033377e-05]
 [  1.33803144e-05]
 [  2.42927025e-02]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  2.20527056e-02]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  2.42935930e-02]
 [  3.13595521e-02]
 [  4.47951193e-02]
 [  1.72294969e-04]
 [  1.33803144e-05]
 [  3.56680459e-02]
 [  2.65338247e-02]
 [  2.27434558e-02]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  6.89179876e-04]
 [  1.33803144e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  4.72126062e-02]
 [  1.72294982e-04]
 [  1.33803144e-05]
 [  1.72294969e-04]
 [  1.33803144e-05]
 [  1.72294969e-06]
 [  1.94694984e-02]
 [  2.13634112e-02]
 [  1.60795198e-05]
 [  1.03376981e-03]
 [  2.36013888e-02]
 [  3.44599851e-02]
 [  2.18814705e-02]
 [  1.72294969e-04]
 [  1.04793122e-04]
 [  1.94692872e-02]
 [  1.72294969e-06]
 [  1.27451209e-05]
 [  1.39560639e-02]
 [  1.33803144e-05]
 [  1.60365888e-05]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-04]
 [  1.72294969e-06]
 [  1.72294969e-04]
 [  1.89524025e-02]
 [  1.54744158e-05]
 [  1.72294969e-04]
 [  2.96358904e-02]
 [  1.33803144e-05]]
E-step ...
Number of clusters:  100 / Number of bins:  755
SUCCESS! EM converged! 

Após rodar o método de reajuste nosso número final de clusters é reduzido para 73 clusters.

In [15]:
from EM import readjustEM

results = readjustEM(X.values, 
                     L, 
                     B, 
                     P,
                     Pi,
                     Rpost,
                     logScore,
                     logScores,
                     thresholdConvergence,
                     epsilon,
                     maxIterations = 200
                    )
new_K, new_P, new_Pi, new_R, new_logScore, new_logScores = results
Relative threshold under which the cluster is considered to disappear:  0.0001
Disappearing indexes :  [ 1  4 19 23 25 26 27 28 29 43 45 46 48 58 63 65 71 73 74 77 85 86 88 89 93
 96 99]
There exist disapearing mixture proportions! Running adjusted EM...
New adjusted number of clusters :  73
[ 0.00017234  0.01206377  0.01912845  0.01344245  0.01482115  0.00017234
  0.00017234  0.02550684  0.02309095  0.02671033  0.00017234  0.04136094
  0.03257119  0.04653074  0.00051702  0.01327294  0.02016233  0.01499358
  0.02550368  0.00017234  0.00015683  0.03084846  0.00017234  0.01309727
  0.03498508  0.00017234  0.00086169  0.00017234  0.00017234  0.00017234
  0.02016404  0.02567824  0.02378617  0.01826756  0.01413291  0.02429891
  0.00017234  0.02205834  0.00017234  0.00017234  0.00017234  0.0242998
  0.03136756  0.04480656  0.00017234  0.03567715  0.0265406   0.02274926
  0.00017234  0.00068936  0.00017234  0.00017234  0.00017234  0.04722466
  0.00017234  0.00017234  0.01947447  0.02136887  0.00103403  0.02360742
  0.03446878  0.02188706  0.00017234  0.00010482  0.01947426  0.01395963
  0.00017234  0.00017234  0.00017234  0.00017234  0.01895724  0.00017234
  0.02964346]
Current pi parameter:  [ 0.00017234  0.01206377  0.01912845  0.01344245  0.01482115  0.00017234
  0.00017234  0.02550684  0.02309095  0.02671033  0.00017234  0.04136094
  0.03257119  0.04653074  0.00051702  0.01327294  0.02016233  0.01499358
  0.02550368  0.00017234  0.00015683  0.03084846  0.00017234  0.01309727
  0.03498508  0.00017234  0.00086169  0.00017234  0.00017234  0.00017234
  0.02016404  0.02567824  0.02378617  0.01826756  0.01413291  0.02429891
  0.00017234  0.02205834  0.00017234  0.00017234  0.00017234  0.0242998
  0.03136756  0.04480656  0.00017234  0.03567715  0.0265406   0.02274926
  0.00017234  0.00068936  0.00017234  0.00017234  0.00017234  0.04722466
  0.00017234  0.00017234  0.01947447  0.02136887  0.00103403  0.02360742
  0.03446878  0.02188706  0.00017234  0.00010482  0.01947426  0.01395963
  0.00017234  0.00017234  0.00017234  0.00017234  0.01895724  0.00017234
  0.02964346]
Compute likelihood using current responsibility...
Number of bins:   755
Initial logScore:  -30554607.2445
E-step ...
Number of clusters:  73 / Number of bins:  755
M-step...
Number of clusters:  73 / Number of bins:  755
Compute likelihood using current responsibility...
Number of bins:   755
Itération number:  1 / Last logScore:  -30554607.2445 / New log score:  -30554607.1336 / Difference attained:  0.11088200286
Current pi parameter:  [[ 0.0001723 ]
 [ 0.01206336]
 [ 0.01912645]
 [ 0.01343904]
 [ 0.01482146]
 [ 0.00017229]
 [ 0.00017229]
 [ 0.02550129]
 [ 0.02309084]
 [ 0.026704  ]
 [ 0.00017229]
 [ 0.04135077]
 [ 0.03256301]
 [ 0.04652634]
 [ 0.00051688]
 [ 0.01328261]
 [ 0.02015719]
 [ 0.01499019]
 [ 0.02549719]
 [ 0.00017229]
 [ 0.00017229]
 [ 0.03084241]
 [ 0.00017229]
 [ 0.0130941 ]
 [ 0.03497707]
 [ 0.00017229]
 [ 0.00086147]
 [ 0.00017229]
 [ 0.0001723 ]
 [ 0.00017229]
 [ 0.020159  ]
 [ 0.02567891]
 [ 0.02378223]
 [ 0.01826348]
 [ 0.01413072]
 [ 0.02434867]
 [ 0.00017229]
 [ 0.02205277]
 [ 0.00017229]
 [ 0.00017229]
 [ 0.0001723 ]
 [ 0.02429367]
 [ 0.03135959]
 [ 0.04479751]
 [ 0.00017229]
 [ 0.03567279]
 [ 0.02653439]
 [ 0.02274705]
 [ 0.00017229]
 [ 0.00068918]
 [ 0.0001723 ]
 [ 0.00017229]
 [ 0.00017229]
 [ 0.04721272]
 [ 0.00017229]
 [ 0.00017229]
 [ 0.0194703 ]
 [ 0.02137017]
 [ 0.00103378]
 [ 0.02360184]
 [ 0.03446595]
 [ 0.02190093]
 [ 0.0001723 ]
 [ 0.00017228]
 [ 0.01947339]
 [ 0.01395657]
 [ 0.0001723 ]
 [ 0.0001723 ]
 [ 0.0001723 ]
 [ 0.00017229]
 [ 0.01895339]
 [ 0.00017229]
 [ 0.0296488 ]]
SUCCESS! EM converged! 
Disappearing indexes :  []

Com a nova escolha de um $K$, podemos visualizar alguns tópicos gerados via Word Cloud.

In [120]:
from wordcloud import WordCloud
selectedGroups = np.arange(1, new_K)   #defines which cluster to be represented
for g in selectedGroups:
    dicGroup = dict(zip(list(X.columns.values), list(new_P[g])))
    wordcloud = WordCloud( background_color='white')
    wordcloud.generate_from_frequencies(frequencies=dicGroup)
    plt.figure()
    plt.imshow(wordcloud, interpolation="bilinear")
    plt.axis("off")
    plt.show()

Dataset $[5804 x 300]$

Para o novo dataset, seguindo as conformidades explicitadas na literatura [4], realizamos os mesmos testes. Porém, sem tanta mudanças na magnitude dos valores.

In [125]:
from sklearn.mixture import GaussianMixture

def draw_aic_bic(n_components, dataset, cov='full'):
    models_gmm = [GaussianMixture(n_components=n, covariance_type=cov, max_iter=300).fit(dataset)
          for n in n_components]

    plt.plot(n_components, [m.bic(dataset) for m in models_gmm], label='BIC_GMM')
    plt.plot(n_components, [m.aic(dataset) for m in models_gmm], label='AIC_GMM')
    plt.legend(loc='best')
    plt.xlabel('n_components')
    plt.show()
    
    return models_gmm
In [49]:
# Each component has its own general covariance matrix
gmms = draw_aic_bic(np.arange(20, 40), X_300, title='Full cov.')
In [50]:
# All components share the same general covariance matrix
gmms = draw_aic_bic(np.arange(20, 40), X_300, title='Tied covariance', cov='tied')
In [51]:
# Each component has its own diagonal covariance matrix
gmms_diag = draw_aic_bic(np.arange(20, 40), X_300, title='Diag covariance', cov='diag')
In [52]:
gmms_sph = draw_aic_bic(np.arange(20, 40), X_300, title='Spherical covariance', cov='spherical')
In [55]:
gmms_diag = draw_aic_bic(np.arange(10, 300), X_300, title='Diag covariance', cov='diag')

Utilizando a biblioteca dispinibilizada pelo artigo estudado, encontramos um valor de 21 clusters para o dataset de 300 features.

In [38]:
from EM import expectationMaximisation2

thresholdConvergence = 1
epsilon = .01
deltaInit = 0
L = len(X_300)
B = 300
K = 35
In [39]:
P_300,Pi_300,Rpost_300,logScore_300,logScores_300 = expectationMaximisation2(X_300.values,
                                                         K,
                                                         L,
                                                         B,
                                                         thresholdConvergence,
                                                         200)
1 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   300
Initial logScore:  -64980880.2543
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
2 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   300
Initial logScore:  -59456243.3786
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
3 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   300
Initial logScore:  -69208282.0385
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
4 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   300
Initial logScore:  -60591792.374
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
5 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   300
Initial logScore:  -67083863.4447
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
6 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   300
Initial logScore:  -31360950.3207
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
7 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   300
Initial logScore:  -66325861.0096
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
8 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   300
Initial logScore:  -73746017.5831
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
9 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   300
Initial logScore:  -60817585.461
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
10 -th short run of EM
Compute likelihood using current responsibility...
Number of bins:   300
Initial logScore:  -66752833.1114
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
E-step ...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  16 / Last logScore:  -17031939.3814 / New log score:  -17031307.4212 / Difference attained:  631.960205343
Current pi parameter:  [[  3.77563776e-02]
 [  9.12335889e-06]
 [  3.12946199e-02]
 [  5.21447092e-02]
 [  6.95271279e-02]
 [  1.72294969e-06]
 [  6.42136451e-02]
 [  2.72016478e-05]
 [  5.88535831e-02]
 [  8.60511426e-06]
 [  1.08972606e-05]
 [  4.69932909e-06]
 [  5.34143657e-06]
 [  1.72324660e-04]
 [  6.76338986e-02]
 [  4.33845726e-02]
 [  5.09678986e-02]
 [  1.87380237e-05]
 [  4.13685120e-02]
 [  3.82067730e-02]
 [  1.72325600e-04]
 [  4.73397733e-02]
 [  6.45632198e-06]
 [  2.72573958e-02]
 [  1.57297163e-04]
 [  7.45851650e-02]
 [  3.76785551e-02]
 [  3.27080216e-02]
 [  6.56603610e-02]
 [  3.47340580e-02]
 [  4.37379100e-02]
 [  4.83643566e-02]
 [  7.69963112e-05]
 [  3.18992482e-02]
 [  1.17086483e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  17 / Last logScore:  -17031307.4212 / New log score:  -17030843.5067 / Difference attained:  463.914557159
Current pi parameter:  [[  3.77556823e-02]
 [  9.12333431e-06]
 [  3.12254188e-02]
 [  5.19803448e-02]
 [  6.91601359e-02]
 [  1.72294969e-06]
 [  6.38934368e-02]
 [  2.72015746e-05]
 [  5.88193366e-02]
 [  8.60511426e-06]
 [  1.08972313e-05]
 [  4.69932909e-06]
 [  5.34142218e-06]
 [  1.72324660e-04]
 [  6.75839651e-02]
 [  4.34308065e-02]
 [  5.10135404e-02]
 [  1.87379732e-05]
 [  4.13660839e-02]
 [  3.81515461e-02]
 [  1.72325600e-04]
 [  4.80597818e-02]
 [  6.45630459e-06]
 [  2.68829225e-02]
 [  1.57297163e-04]
 [  7.45788824e-02]
 [  3.77243175e-02]
 [  3.25081647e-02]
 [  6.57776521e-02]
 [  3.54945862e-02]
 [  4.38986814e-02]
 [  4.81969200e-02]
 [  7.69961039e-05]
 [  3.18143569e-02]
 [  1.17086168e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  18 / Last logScore:  -17030843.5067 / New log score:  -17030488.3383 / Difference attained:  355.168406352
Current pi parameter:  [[  3.77574170e-02]
 [  9.12448206e-06]
 [  3.11921472e-02]
 [  5.18684376e-02]
 [  6.89754714e-02]
 [  1.72294969e-06]
 [  6.40417664e-02]
 [  2.72049966e-05]
 [  5.86496090e-02]
 [  8.60511426e-06]
 [  1.08986022e-05]
 [  4.69932909e-06]
 [  5.34209415e-06]
 [  1.72324660e-04]
 [  6.80777737e-02]
 [  4.34858795e-02]
 [  5.11580950e-02]
 [  1.87403305e-05]
 [  4.13696560e-02]
 [  3.79865741e-02]
 [  1.72325600e-04]
 [  4.87543511e-02]
 [  6.45711682e-06]
 [  2.67329269e-02]
 [  1.57297163e-04]
 [  7.44537854e-02]
 [  3.73878474e-02]
 [  3.21052251e-02]
 [  6.61913975e-02]
 [  3.57882938e-02]
 [  4.34827255e-02]
 [  4.81812645e-02]
 [  7.70057903e-05]
 [  3.16758979e-02]
 [  1.17100898e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  19 / Last logScore:  -17030488.3383 / New log score:  -17030006.025 / Difference attained:  482.313286047
Current pi parameter:  [[  3.78576624e-02]
 [  9.12571819e-06]
 [  3.11400160e-02]
 [  5.18466629e-02]
 [  6.89304118e-02]
 [  1.72294969e-06]
 [  6.42100686e-02]
 [  2.72086822e-05]
 [  5.82127280e-02]
 [  8.60511426e-06]
 [  1.09000787e-05]
 [  4.69932909e-06]
 [  5.34281787e-06]
 [  1.72324660e-04]
 [  6.80002095e-02]
 [  4.35174046e-02]
 [  5.13256780e-02]
 [  1.87428694e-05]
 [  4.13952620e-02]
 [  3.78404254e-02]
 [  1.72325600e-04]
 [  4.91967277e-02]
 [  6.45799159e-06]
 [  2.65318816e-02]
 [  1.57297163e-04]
 [  7.49939413e-02]
 [  3.72733117e-02]
 [  3.14768308e-02]
 [  6.67538005e-02]
 [  3.58002363e-02]
 [  4.32487741e-02]
 [  4.81906276e-02]
 [  7.70162226e-05]
 [  3.15738582e-02]
 [  1.17116762e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  20 / Last logScore:  -17030006.025 / New log score:  -17029564.8411 / Difference attained:  441.183869369
Current pi parameter:  [[  3.79080610e-02]
 [  9.12610987e-06]
 [  3.10046059e-02]
 [  5.18165552e-02]
 [  6.87722801e-02]
 [  1.72294969e-06]
 [  6.42751970e-02]
 [  2.72098500e-05]
 [  5.82829563e-02]
 [  8.60511425e-06]
 [  1.09005465e-05]
 [  4.69932909e-06]
 [  5.34304718e-06]
 [  1.72324660e-04]
 [  6.80458671e-02]
 [  4.35292876e-02]
 [  5.13399114e-02]
 [  1.87436738e-05]
 [  4.15592742e-02]
 [  3.77083042e-02]
 [  1.72325600e-04]
 [  5.00403515e-02]
 [  6.45826876e-06]
 [  2.61699533e-02]
 [  1.57297163e-04]
 [  7.56759589e-02]
 [  3.75270706e-02]
 [  3.08765175e-02]
 [  6.70377920e-02]
 [  3.61470732e-02]
 [  4.19923025e-02]
 [  4.81185219e-02]
 [  7.70195281e-05]
 [  3.14886706e-02]
 [  1.17121788e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  21 / Last logScore:  -17029564.8411 / New log score:  -17029076.7809 / Difference attained:  488.060248595
Current pi parameter:  [[  3.79084998e-02]
 [  9.12540665e-06]
 [  3.08944256e-02]
 [  5.17277867e-02]
 [  6.85929672e-02]
 [  1.72294969e-06]
 [  6.46815905e-02]
 [  2.72077533e-05]
 [  5.84199900e-02]
 [  8.60511425e-06]
 [  1.08997066e-05]
 [  4.69932909e-06]
 [  5.34263547e-06]
 [  1.72324660e-04]
 [  6.79943145e-02]
 [  4.35000669e-02]
 [  5.13388338e-02]
 [  1.87422295e-05]
 [  4.16042134e-02]
 [  3.77414872e-02]
 [  1.72325600e-04]
 [  5.06294297e-02]
 [  6.45777112e-06]
 [  2.57496239e-02]
 [  1.57297163e-04]
 [  7.60839313e-02]
 [  3.78135532e-02]
 [  2.97183127e-02]
 [  6.74760719e-02]
 [  3.67025613e-02]
 [  4.12044197e-02]
 [  4.80922462e-02]
 [  7.70135933e-05]
 [  3.14421993e-02]
 [  1.17112764e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  22 / Last logScore:  -17029076.7809 / New log score:  -17028703.9453 / Difference attained:  372.835526582
Current pi parameter:  [[  3.79557585e-02]
 [  9.12551890e-06]
 [  3.08411746e-02]
 [  5.16148441e-02]
 [  6.79314704e-02]
 [  1.72294969e-06]
 [  6.47421524e-02]
 [  2.72080880e-05]
 [  5.85464010e-02]
 [  8.60511425e-06]
 [  1.08998406e-05]
 [  4.69932909e-06]
 [  5.34270119e-06]
 [  1.72324660e-04]
 [  6.80061251e-02]
 [  4.33723325e-02]
 [  5.13214404e-02]
 [  1.87424601e-05]
 [  4.16452481e-02]
 [  3.77352521e-02]
 [  1.72325600e-04]
 [  5.12724790e-02]
 [  6.45785055e-06]
 [  2.53112058e-02]
 [  1.57297163e-04]
 [  7.66649590e-02]
 [  3.79060589e-02]
 [  2.90620312e-02]
 [  6.78035423e-02]
 [  3.71221984e-02]
 [  4.08963371e-02]
 [  4.81606628e-02]
 [  7.70145406e-05]
 [  3.14048492e-02]
 [  1.17114204e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  23 / Last logScore:  -17028703.9453 / New log score:  -17028389.7988 / Difference attained:  314.146545723
Current pi parameter:  [[  3.79086654e-02]
 [  9.12638630e-06]
 [  3.08387594e-02]
 [  5.13866718e-02]
 [  6.76658573e-02]
 [  1.72294969e-06]
 [  6.46721075e-02]
 [  2.72106742e-05]
 [  5.86840618e-02]
 [  8.60511425e-06]
 [  1.09008767e-05]
 [  4.69932909e-06]
 [  5.34320902e-06]
 [  1.72324660e-04]
 [  6.78874914e-02]
 [  4.30850750e-02]
 [  5.11780368e-02]
 [  1.87442416e-05]
 [  4.17594013e-02]
 [  3.77377158e-02]
 [  1.72325600e-04]
 [  5.17639681e-02]
 [  6.45846438e-06]
 [  2.52278156e-02]
 [  1.57297163e-04]
 [  7.68279161e-02]
 [  3.79009949e-02]
 [  2.88287163e-02]
 [  6.80926507e-02]
 [  3.76622439e-02]
 [  4.07499907e-02]
 [  4.79399592e-02]
 [  7.70218610e-05]
 [  3.15184081e-02]
 [  1.17125336e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  24 / Last logScore:  -17028389.7988 / New log score:  -17028179.2447 / Difference attained:  210.554042388
Current pi parameter:  [[  3.79085388e-02]
 [  9.12717404e-06]
 [  3.09427847e-02]
 [  5.13599626e-02]
 [  6.74148030e-02]
 [  1.72294969e-06]
 [  6.46355046e-02]
 [  2.72130228e-05]
 [  5.86922626e-02]
 [  8.60511425e-06]
 [  1.09018176e-05]
 [  4.69932909e-06]
 [  5.34367022e-06]
 [  1.72324660e-04]
 [  6.78945685e-02]
 [  4.27116715e-02]
 [  5.11197469e-02]
 [  1.87458595e-05]
 [  4.19127598e-02]
 [  3.77540315e-02]
 [  1.72325600e-04]
 [  5.20011173e-02]
 [  6.45902184e-06]
 [  2.52788847e-02]
 [  1.57297163e-04]
 [  7.67286197e-02]
 [  3.78832842e-02]
 [  2.86591791e-02]
 [  6.83207889e-02]
 [  3.75526079e-02]
 [  4.10800636e-02]
 [  4.79234028e-02]
 [  7.70285091e-05]
 [  3.15419098e-02]
 [  1.17135446e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  25 / Last logScore:  -17028179.2447 / New log score:  -17027961.7835 / Difference attained:  217.461236585
Current pi parameter:  [[  3.79090785e-02]
 [  9.12720103e-06]
 [  3.09803458e-02]
 [  5.13610376e-02]
 [  6.70944239e-02]
 [  1.72294969e-06]
 [  6.46444954e-02]
 [  2.72131033e-05]
 [  5.85727997e-02]
 [  8.60511425e-06]
 [  1.09018498e-05]
 [  4.69932909e-06]
 [  5.34368602e-06]
 [  1.72324660e-04]
 [  6.78971649e-02]
 [  4.23161909e-02]
 [  5.09756062e-02]
 [  1.87459149e-05]
 [  4.20395229e-02]
 [  3.78225191e-02]
 [  1.72325600e-04]
 [  5.22757362e-02]
 [  6.45904095e-06]
 [  2.52636065e-02]
 [  1.57297163e-04]
 [  7.67730493e-02]
 [  3.77516461e-02]
 [  2.81807290e-02]
 [  6.87595411e-02]
 [  3.80336669e-02]
 [  4.12035399e-02]
 [  4.79180834e-02]
 [  7.70287369e-05]
 [  3.15437089e-02]
 [  1.17135792e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  26 / Last logScore:  -17027961.7835 / New log score:  -17027806.4127 / Difference attained:  155.370781776
Current pi parameter:  [[  3.79104540e-02]
 [  9.12793210e-06]
 [  3.08707074e-02]
 [  5.13588303e-02]
 [  6.66746790e-02]
 [  1.72294969e-06]
 [  6.46682991e-02]
 [  2.72152830e-05]
 [  5.84821163e-02]
 [  8.60511425e-06]
 [  1.09027230e-05]
 [  4.69932909e-06]
 [  5.34411404e-06]
 [  1.72324660e-04]
 [  6.78975551e-02]
 [  4.20375350e-02]
 [  5.09038522e-02]
 [  1.87474164e-05]
 [  4.20345717e-02]
 [  3.78929726e-02]
 [  1.72325600e-04]
 [  5.30277030e-02]
 [  6.45955830e-06]
 [  2.51522269e-02]
 [  1.57297163e-04]
 [  7.66716571e-02]
 [  3.77392738e-02]
 [  2.77696401e-02]
 [  6.93444838e-02]
 [  3.79999072e-02]
 [  4.14096184e-02]
 [  4.79221556e-02]
 [  7.70349067e-05]
 [  3.15482401e-02]
 [  1.17145174e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  27 / Last logScore:  -17027806.4127 / New log score:  -17027662.8228 / Difference attained:  143.589887943
Current pi parameter:  [[  3.79135133e-02]
 [  9.13016205e-06]
 [  3.05533140e-02]
 [  5.12934049e-02]
 [  6.68384666e-02]
 [  1.72294969e-06]
 [  6.47674513e-02]
 [  2.72219317e-05]
 [  5.85742652e-02]
 [  8.60511425e-06]
 [  1.09053866e-05]
 [  4.69932909e-06]
 [  5.34541960e-06]
 [  1.72324660e-04]
 [  6.78860529e-02]
 [  4.18627453e-02]
 [  5.08555308e-02]
 [  1.87519964e-05]
 [  4.20310773e-02]
 [  3.78676627e-02]
 [  1.72325600e-04]
 [  5.31502437e-02]
 [  6.46113637e-06]
 [  2.49569904e-02]
 [  1.57297163e-04]
 [  7.65147259e-02]
 [  3.77391284e-02]
 [  2.76330079e-02]
 [  6.95198202e-02]
 [  3.81871334e-02]
 [  4.16783638e-02]
 [  4.79396050e-02]
 [  7.70537263e-05]
 [  3.15539352e-02]
 [  1.17173793e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  28 / Last logScore:  -17027662.8228 / New log score:  -17027536.9047 / Difference attained:  125.918134101
Current pi parameter:  [[  3.79261283e-02]
 [  9.13114346e-06]
 [  3.03326602e-02]
 [  5.13015838e-02]
 [  6.67211146e-02]
 [  1.72294969e-06]
 [  6.49572469e-02]
 [  2.72248578e-05]
 [  5.86565183e-02]
 [  8.60511425e-06]
 [  1.09065588e-05]
 [  4.69932909e-06]
 [  5.34599419e-06]
 [  1.72324660e-04]
 [  6.79234340e-02]
 [  4.14395838e-02]
 [  5.08559608e-02]
 [  1.87540121e-05]
 [  4.20282950e-02]
 [  3.77784583e-02]
 [  1.72325600e-04]
 [  5.32568317e-02]
 [  6.46183089e-06]
 [  2.52016365e-02]
 [  1.57297163e-04]
 [  7.64556895e-02]
 [  3.77393520e-02]
 [  2.76773262e-02]
 [  6.96936342e-02]
 [  3.82061568e-02]
 [  4.16468276e-02]
 [  4.79578393e-02]
 [  7.70620090e-05]
 [  3.15601423e-02]
 [  1.17186388e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  29 / Last logScore:  -17027536.9047 / New log score:  -17027373.3061 / Difference attained:  163.598567653
Current pi parameter:  [[  3.80631039e-02]
 [  9.13156967e-06]
 [  3.02476115e-02]
 [  5.13646476e-02]
 [  6.65388042e-02]
 [  1.72294969e-06]
 [  6.49627869e-02]
 [  2.72261286e-05]
 [  5.87627373e-02]
 [  8.60511425e-06]
 [  1.09070679e-05]
 [  4.69932909e-06]
 [  5.34624372e-06]
 [  1.72324660e-04]
 [  6.80482037e-02]
 [  4.09772131e-02]
 [  5.08609866e-02]
 [  1.87548874e-05]
 [  4.20248434e-02]
 [  3.75329619e-02]
 [  1.72325600e-04]
 [  5.32826976e-02]
 [  6.46213250e-06]
 [  2.54969745e-02]
 [  1.57297163e-04]
 [  7.64756760e-02]
 [  3.77397877e-02]
 [  2.75739361e-02]
 [  7.01293436e-02]
 [  3.81048281e-02]
 [  4.15718783e-02]
 [  4.79913376e-02]
 [  7.70656059e-05]
 [  3.15660529e-02]
 [  1.17191858e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  30 / Last logScore:  -17027373.3061 / New log score:  -17027232.8656 / Difference attained:  140.440525308
Current pi parameter:  [[  3.80648054e-02]
 [  9.13220063e-06]
 [  3.00481859e-02]
 [  5.12428469e-02]
 [  6.64026202e-02]
 [  1.72294969e-06]
 [  6.49585427e-02]
 [  2.72280098e-05]
 [  5.87583977e-02]
 [  8.60511425e-06]
 [  1.09078215e-05]
 [  4.69932909e-06]
 [  5.34661313e-06]
 [  1.72324660e-04]
 [  6.84554648e-02]
 [  4.07381688e-02]
 [  5.08746558e-02]
 [  1.87561833e-05]
 [  4.20117855e-02]
 [  3.73035645e-02]
 [  1.72325600e-04]
 [  5.32983896e-02]
 [  6.46257901e-06]
 [  2.57372936e-02]
 [  1.57297163e-04]
 [  7.64851362e-02]
 [  3.77406634e-02]
 [  2.76424805e-02]
 [  7.06460056e-02]
 [  3.79054607e-02]
 [  4.13660147e-02]
 [  4.80413560e-02]
 [  7.70709309e-05]
 [  3.15945624e-02]
 [  1.17199955e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  31 / Last logScore:  -17027232.8656 / New log score:  -17027086.5726 / Difference attained:  146.292998813
Current pi parameter:  [[  3.79005624e-02]
 [  9.13223619e-06]
 [  3.00135968e-02]
 [  5.11731996e-02]
 [  6.60533233e-02]
 [  1.72294969e-06]
 [  6.49385816e-02]
 [  2.72281158e-05]
 [  5.87562259e-02]
 [  8.60511425e-06]
 [  1.09078640e-05]
 [  4.69932909e-06]
 [  5.34663395e-06]
 [  1.72324660e-04]
 [  6.84609370e-02]
 [  4.05607305e-02]
 [  5.09738572e-02]
 [  1.87562564e-05]
 [  4.19127704e-02]
 [  3.72412940e-02]
 [  1.72325600e-04]
 [  5.37545813e-02]
 [  6.46260417e-06]
 [  2.58053764e-02]
 [  1.57297163e-04]
 [  7.64732763e-02]
 [  3.77522583e-02]
 [  2.77381134e-02]
 [  7.09980158e-02]
 [  3.77609702e-02]
 [  4.12938271e-02]
 [  4.80908706e-02]
 [  7.70712310e-05]
 [  3.16640324e-02]
 [  1.17200412e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  32 / Last logScore:  -17027086.5726 / New log score:  -17026992.6329 / Difference attained:  93.9397528023
Current pi parameter:  [[  3.78817994e-02]
 [  9.13284463e-06]
 [  3.02088044e-02]
 [  5.11691147e-02]
 [  6.59046383e-02]
 [  1.72294969e-06]
 [  6.47892116e-02]
 [  2.72299299e-05]
 [  5.87467543e-02]
 [  8.60511425e-06]
 [  1.09085907e-05]
 [  4.69932909e-06]
 [  5.34699017e-06]
 [  1.72324660e-04]
 [  6.85205814e-02]
 [  4.03481849e-02]
 [  5.10486292e-02]
 [  1.87575060e-05]
 [  4.18382871e-02]
 [  3.72333535e-02]
 [  1.72325600e-04]
 [  5.39217711e-02]
 [  6.46303475e-06]
 [  2.56797673e-02]
 [  1.57297163e-04]
 [  7.64341539e-02]
 [  3.78135157e-02]
 [  2.77342010e-02]
 [  7.10967173e-02]
 [  3.79221367e-02]
 [  4.11680497e-02]
 [  4.81117429e-02]
 [  7.70763659e-05]
 [  3.17449746e-02]
 [  1.17208220e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  33 / Last logScore:  -17026992.6329 / New log score:  -17026892.0676 / Difference attained:  100.565226194
Current pi parameter:  [[  3.77888851e-02]
 [  9.13289376e-06]
 [  3.05907453e-02]
 [  5.11482852e-02]
 [  6.58602676e-02]
 [  1.72294969e-06]
 [  6.45295646e-02]
 [  2.72300764e-05]
 [  5.87396781e-02]
 [  8.60511425e-06]
 [  1.09086494e-05]
 [  4.69932908e-06]
 [  5.34701893e-06]
 [  1.72324660e-04]
 [  6.85522061e-02]
 [  4.01166636e-02]
 [  5.11091577e-02]
 [  1.87576069e-05]
 [  4.17765735e-02]
 [  3.72384579e-02]
 [  1.72325600e-04]
 [  5.39828266e-02]
 [  6.46306952e-06]
 [  2.59503431e-02]
 [  1.57297163e-04]
 [  7.63700964e-02]
 [  3.78133279e-02]
 [  2.77160017e-02]
 [  7.12484826e-02]
 [  3.78759274e-02]
 [  4.10066456e-02]
 [  4.81314770e-02]
 [  7.70767805e-05]
 [  3.17707754e-02]
 [  1.17208851e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  34 / Last logScore:  -17026892.0676 / New log score:  -17026809.9083 / Difference attained:  82.1593506895
Current pi parameter:  [[  3.77087163e-02]
 [  9.13297547e-06]
 [  3.08713716e-02]
 [  5.10738378e-02]
 [  6.57628527e-02]
 [  1.72294969e-06]
 [  6.43479502e-02]
 [  2.72303200e-05]
 [  5.87457636e-02]
 [  8.60511425e-06]
 [  1.09087470e-05]
 [  4.69932908e-06]
 [  5.34706678e-06]
 [  1.72324660e-04]
 [  6.84709604e-02]
 [  3.97172983e-02]
 [  5.12103610e-02]
 [  1.87577748e-05]
 [  4.16713316e-02]
 [  3.72441563e-02]
 [  1.72325600e-04]
 [  5.40758230e-02]
 [  6.46312734e-06]
 [  2.62846643e-02]
 [  1.57297163e-04]
 [  7.63334366e-02]
 [  3.77018659e-02]
 [  2.76141866e-02]
 [  7.13607597e-02]
 [  3.80548800e-02]
 [  4.09970786e-02]
 [  4.81632097e-02]
 [  7.70774702e-05]
 [  3.19058823e-02]
 [  1.17209900e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  35 / Last logScore:  -17026809.9083 / New log score:  -17026744.0943 / Difference attained:  65.813999217
Current pi parameter:  [[  3.77043279e-02]
 [  9.13314457e-06]
 [  3.09111667e-02]
 [  5.10006532e-02]
 [  6.56343936e-02]
 [  1.72294969e-06]
 [  6.43306095e-02]
 [  2.72308242e-05]
 [  5.88293195e-02]
 [  8.60511425e-06]
 [  1.09089490e-05]
 [  4.69932908e-06]
 [  5.34716577e-06]
 [  1.72324660e-04]
 [  6.82811818e-02]
 [  3.94016949e-02]
 [  5.13735837e-02]
 [  1.87581220e-05]
 [  4.15045118e-02]
 [  3.73039316e-02]
 [  1.72325600e-04]
 [  5.41901280e-02]
 [  6.46324700e-06]
 [  2.65621613e-02]
 [  1.57297163e-04]
 [  7.64504681e-02]
 [  3.75687338e-02]
 [  2.75178648e-02]
 [  7.13612605e-02]
 [  3.82927323e-02]
 [  4.09886235e-02]
 [  4.82126565e-02]
 [  7.70788972e-05]
 [  3.18963805e-02]
 [  1.17212070e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  36 / Last logScore:  -17026744.0943 / New log score:  -17026706.8788 / Difference attained:  37.2154388092
Current pi parameter:  [[  3.76959831e-02]
 [  9.13319336e-06]
 [  3.08421696e-02]
 [  5.10040287e-02]
 [  6.55419798e-02]
 [  1.72294969e-06]
 [  6.42887612e-02]
 [  2.72309697e-05]
 [  5.88738752e-02]
 [  8.60511425e-06]
 [  1.09090073e-05]
 [  4.69932908e-06]
 [  5.34719434e-06]
 [  1.72324660e-04]
 [  6.81071250e-02]
 [  3.91992766e-02]
 [  5.14927377e-02]
 [  1.87582223e-05]
 [  4.13828970e-02]
 [  3.74156859e-02]
 [  1.72325600e-04]
 [  5.42604013e-02]
 [  6.46328153e-06]
 [  2.67498892e-02]
 [  1.57297163e-04]
 [  7.65021961e-02]
 [  3.75688305e-02]
 [  2.74076768e-02]
 [  7.13561316e-02]
 [  3.84976873e-02]
 [  4.09645778e-02]
 [  4.82746924e-02]
 [  7.70793090e-05]
 [  3.18897800e-02]
 [  1.17212696e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  37 / Last logScore:  -17026706.8788 / New log score:  -17026615.6258 / Difference attained:  91.2530446015
Current pi parameter:  [[  3.76731302e-02]
 [  9.13310955e-06]
 [  3.08399725e-02]
 [  5.10068815e-02]
 [  6.53095413e-02]
 [  1.72294969e-06]
 [  6.42915827e-02]
 [  2.72307198e-05]
 [  5.88244757e-02]
 [  8.60511425e-06]
 [  1.09089072e-05]
 [  4.69932908e-06]
 [  5.34714527e-06]
 [  1.72324660e-04]
 [  6.78852929e-02]
 [  3.90526744e-02]
 [  5.16704337e-02]
 [  1.87580501e-05]
 [  4.12037224e-02]
 [  3.74064490e-02]
 [  1.72325600e-04]
 [  5.43802246e-02]
 [  6.46322223e-06]
 [  2.70739369e-02]
 [  1.57297163e-04]
 [  7.65045780e-02]
 [  3.75689862e-02]
 [  2.74000013e-02]
 [  7.13498178e-02]
 [  3.88560345e-02]
 [  4.08763677e-02]
 [  4.82531693e-02]
 [  7.70786017e-05]
 [  3.18891114e-02]
 [  1.17211620e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  38 / Last logScore:  -17026615.6258 / New log score:  -17026510.5976 / Difference attained:  105.028250653
Current pi parameter:  [[  3.77130854e-02]
 [  9.13316593e-06]
 [  3.08312863e-02]
 [  5.10149493e-02]
 [  6.51244688e-02]
 [  1.72294969e-06]
 [  6.42909381e-02]
 [  2.72308879e-05]
 [  5.87520677e-02]
 [  8.60511425e-06]
 [  1.09089745e-05]
 [  4.69932908e-06]
 [  5.34717828e-06]
 [  1.72324660e-04]
 [  6.77170683e-02]
 [  3.86349763e-02]
 [  5.16452987e-02]
 [  1.87581659e-05]
 [  4.11637668e-02]
 [  3.73981400e-02]
 [  1.72325600e-04]
 [  5.45980441e-02]
 [  6.46326212e-06]
 [  2.71588686e-02]
 [  1.57297163e-04]
 [  7.65069947e-02]
 [  3.75696731e-02]
 [  2.73855054e-02]
 [  7.13626476e-02]
 [  3.93219476e-02]
 [  4.08376551e-02]
 [  4.84004774e-02]
 [  7.70790775e-05]
 [  3.18885239e-02]
 [  1.17212344e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  39 / Last logScore:  -17026510.5976 / New log score:  -17026386.9313 / Difference attained:  123.666232977
Current pi parameter:  [[  3.77483268e-02]
 [  9.13347654e-06]
 [  3.07157571e-02]
 [  5.11259056e-02]
 [  6.48409892e-02]
 [  1.72294969e-06]
 [  6.42869737e-02]
 [  2.72318140e-05]
 [  5.87370275e-02]
 [  8.60511425e-06]
 [  1.09093455e-05]
 [  4.69932908e-06]
 [  5.34736013e-06]
 [  1.72324660e-04]
 [  6.77149589e-02]
 [  3.83543989e-02]
 [  5.16688730e-02]
 [  1.87588039e-05]
 [  4.10415809e-02]
 [  3.73950207e-02]
 [  1.72325600e-04]
 [  5.47512825e-02]
 [  6.46348193e-06]
 [  2.73811035e-02]
 [  1.57297163e-04]
 [  7.65074194e-02]
 [  3.75736114e-02]
 [  2.73698815e-02]
 [  7.13901770e-02]
 [  3.96275341e-02]
 [  4.08379870e-02]
 [  4.83537487e-02]
 [  7.70816988e-05]
 [  3.18938203e-02]
 [  1.17216330e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  40 / Last logScore:  -17026386.9313 / New log score:  -17026311.3894 / Difference attained:  75.5418760404
Current pi parameter:  [[  3.78526360e-02]
 [  9.13365115e-06]
 [  3.06750496e-02]
 [  5.11605543e-02]
 [  6.46549771e-02]
 [  1.72294969e-06]
 [  6.42805651e-02]
 [  2.72323346e-05]
 [  5.87375796e-02]
 [  8.60511425e-06]
 [  1.09095541e-05]
 [  4.69932908e-06]
 [  5.34746236e-06]
 [  1.72324660e-04]
 [  6.77151416e-02]
 [  3.81596759e-02]
 [  5.18834566e-02]
 [  1.87591625e-05]
 [  4.08293973e-02]
 [  3.73928845e-02]
 [  1.72325600e-04]
 [  5.48789303e-02]
 [  6.46360550e-06]
 [  2.74947509e-02]
 [  1.57297163e-04]
 [  7.65071506e-02]
 [  3.75977660e-02]
 [  2.73303044e-02]
 [  7.14571198e-02]
 [  3.95824783e-02]
 [  4.08379714e-02]
 [  4.83189187e-02]
 [  7.70831725e-05]
 [  3.19690665e-02]
 [  1.17218571e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  41 / Last logScore:  -17026311.3894 / New log score:  -17026244.6984 / Difference attained:  66.6910626292
Current pi parameter:  [[  3.77660793e-02]
 [  9.13356344e-06]
 [  3.06752374e-02]
 [  5.11470861e-02]
 [  6.45886299e-02]
 [  1.72294969e-06]
 [  6.42716178e-02]
 [  2.72320731e-05]
 [  5.87453750e-02]
 [  8.60511425e-06]
 [  1.09094493e-05]
 [  4.69932908e-06]
 [  5.34741101e-06]
 [  1.72324660e-04]
 [  6.77131621e-02]
 [  3.79832704e-02]
 [  5.20452344e-02]
 [  1.87589823e-05]
 [  4.06716658e-02]
 [  3.73918482e-02]
 [  1.72325600e-04]
 [  5.49145683e-02]
 [  6.46354343e-06]
 [  2.78601334e-02]
 [  1.57297163e-04]
 [  7.65068036e-02]
 [  3.77891739e-02]
 [  2.72180558e-02]
 [  7.16236451e-02]
 [  3.93252540e-02]
 [  4.08378262e-02]
 [  4.83497627e-02]
 [  7.70824322e-05]
 [  3.18919467e-02]
 [  1.17217445e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  42 / Last logScore:  -17026244.6984 / New log score:  -17026212.4917 / Difference attained:  32.2067275569
Current pi parameter:  [[  3.77379849e-02]
 [  9.13299432e-06]
 [  3.06752512e-02]
 [  5.11080635e-02]
 [  6.46092271e-02]
 [  1.72294969e-06]
 [  6.42690266e-02]
 [  2.72303762e-05]
 [  5.87532236e-02]
 [  8.60511425e-06]
 [  1.09087695e-05]
 [  4.69932908e-06]
 [  5.34707781e-06]
 [  1.72324660e-04]
 [  6.77163698e-02]
 [  3.78580570e-02]
 [  5.22095348e-02]
 [  1.87578135e-05]
 [  4.05067661e-02]
 [  3.73924519e-02]
 [  1.72325600e-04]
 [  5.49180295e-02]
 [  6.46314068e-06]
 [  2.79913149e-02]
 [  1.57297163e-04]
 [  7.65060045e-02]
 [  3.79128807e-02]
 [  2.72006417e-02]
 [  7.18141338e-02]
 [  3.90682685e-02]
 [  4.08360602e-02]
 [  4.83420844e-02]
 [  7.70776292e-05]
 [  3.18910117e-02]
 [  1.17210141e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  43 / Last logScore:  -17026212.4917 / New log score:  -17026141.3938 / Difference attained:  71.0978678763
Current pi parameter:  [[  3.77369844e-02]
 [  9.13237819e-06]
 [  3.06753085e-02]
 [  5.09103131e-02]
 [  6.46358661e-02]
 [  1.72294969e-06]
 [  6.42650893e-02]
 [  2.72285392e-05]
 [  5.87582119e-02]
 [  8.60511425e-06]
 [  1.09080336e-05]
 [  4.69932908e-06]
 [  5.34671708e-06]
 [  1.72324660e-04]
 [  6.77315790e-02]
 [  3.78298658e-02]
 [  5.22795364e-02]
 [  1.87565480e-05]
 [  4.04412013e-02]
 [  3.73928890e-02]
 [  1.72325600e-04]
 [  5.49991027e-02]
 [  6.46270466e-06]
 [  2.80141080e-02]
 [  1.57297163e-04]
 [  7.65042233e-02]
 [  3.79132190e-02]
 [  2.71192552e-02]
 [  7.20492388e-02]
 [  3.89998554e-02]
 [  4.08345559e-02]
 [  4.83337861e-02]
 [  7.70724294e-05]
 [  3.18922087e-02]
 [  1.17202234e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  44 / Last logScore:  -17026141.3938 / New log score:  -17026059.1763 / Difference attained:  82.2175155506
Current pi parameter:  [[  3.77368533e-02]
 [  9.13028948e-06]
 [  3.06754752e-02]
 [  5.04319296e-02]
 [  6.46911081e-02]
 [  1.72294969e-06]
 [  6.42590322e-02]
 [  2.72223116e-05]
 [  5.87616837e-02]
 [  8.60511425e-06]
 [  1.09055388e-05]
 [  4.69932908e-06]
 [  5.34549421e-06]
 [  1.72324660e-04]
 [  6.78724315e-02]
 [  3.78113678e-02]
 [  5.23868226e-02]
 [  1.87522581e-05]
 [  4.03411449e-02]
 [  3.73929015e-02]
 [  1.72325600e-04]
 [  5.52145938e-02]
 [  6.46122655e-06]
 [  2.78854032e-02]
 [  1.57297163e-04]
 [  7.65047812e-02]
 [  3.79142948e-02]
 [  2.70424750e-02]
 [  7.20642249e-02]
 [  3.92808031e-02]
 [  4.08305359e-02]
 [  4.83235206e-02]
 [  7.70548018e-05]
 [  3.18950531e-02]
 [  1.17175428e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  45 / Last logScore:  -17026059.1763 / New log score:  -17026039.2615 / Difference attained:  19.9147782773
Current pi parameter:  [[  3.77367705e-02]
 [  9.13004379e-06]
 [  3.06755940e-02]
 [  5.03038296e-02]
 [  6.47551093e-02]
 [  1.72294969e-06]
 [  6.42611751e-02]
 [  2.72215791e-05]
 [  5.87633278e-02]
 [  8.60511425e-06]
 [  1.09052453e-05]
 [  4.69932909e-06]
 [  5.34535037e-06]
 [  1.72324660e-04]
 [  6.78048077e-02]
 [  3.77666683e-02]
 [  5.23922937e-02]
 [  1.87517535e-05]
 [  4.03409672e-02]
 [  3.73926567e-02]
 [  1.72325600e-04]
 [  5.52401101e-02]
 [  6.46105268e-06]
 [  2.78918432e-02]
 [  1.57297163e-04]
 [  7.65049467e-02]
 [  3.79149006e-02]
 [  2.70411933e-02]
 [  7.20583163e-02]
 [  3.94362752e-02]
 [  4.08282708e-02]
 [  4.83036842e-02]
 [  7.70527283e-05]
 [  3.19036997e-02]
 [  1.17172275e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  46 / Last logScore:  -17026039.2615 / New log score:  -17026022.5329 / Difference attained:  16.7285765447
Current pi parameter:  [[  3.77367908e-02]
 [  9.12998658e-06]
 [  3.06753175e-02]
 [  5.02254085e-02]
 [  6.47520393e-02]
 [  1.72294969e-06]
 [  6.42613441e-02]
 [  2.72214085e-05]
 [  5.87635718e-02]
 [  8.60511425e-06]
 [  1.09051770e-05]
 [  4.69932909e-06]
 [  5.34531687e-06]
 [  1.72324660e-04]
 [  6.78517204e-02]
 [  3.77619158e-02]
 [  5.23943129e-02]
 [  1.87516360e-05]
 [  4.03408529e-02]
 [  3.73925905e-02]
 [  1.72325600e-04]
 [  5.52586651e-02]
 [  6.46101219e-06]
 [  2.78425305e-02]
 [  1.57297163e-04]
 [  7.65044065e-02]
 [  3.79148847e-02]
 [  2.70474119e-02]
 [  7.19827666e-02]
 [  3.95888344e-02]
 [  4.08254120e-02]
 [  4.82708254e-02]
 [  7.70522455e-05]
 [  3.19248397e-02]
 [  1.17171541e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  47 / Last logScore:  -17026022.5329 / New log score:  -17025996.6671 / Difference attained:  25.8658373579
Current pi parameter:  [[  3.77368395e-02]
 [  9.12968779e-06]
 [  3.06750032e-02]
 [  5.01311151e-02]
 [  6.47467907e-02]
 [  1.72294969e-06]
 [  6.42609128e-02]
 [  2.72205177e-05]
 [  5.87629432e-02]
 [  8.60511425e-06]
 [  1.09048201e-05]
 [  4.69932909e-06]
 [  5.34514194e-06]
 [  1.72324660e-04]
 [  6.78857265e-02]
 [  3.77589451e-02]
 [  5.23954318e-02]
 [  1.87510223e-05]
 [  4.03400375e-02]
 [  3.73926016e-02]
 [  1.72325600e-04]
 [  5.52648755e-02]
 [  6.46080075e-06]
 [  2.76495308e-02]
 [  1.57297163e-04]
 [  7.65047226e-02]
 [  3.79147630e-02]
 [  2.70770982e-02]
 [  7.20025303e-02]
 [  3.97454283e-02]
 [  4.08110311e-02]
 [  4.82316345e-02]
 [  7.70497239e-05]
 [  3.20284853e-02]
 [  1.17167706e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  48 / Last logScore:  -17025996.6671 / New log score:  -17025962.046 / Difference attained:  34.6210723743
Current pi parameter:  [[  3.77369750e-02]
 [  9.12966459e-06]
 [  3.06748639e-02]
 [  5.00412689e-02]
 [  6.47412090e-02]
 [  1.72294969e-06]
 [  6.42616433e-02]
 [  2.72204485e-05]
 [  5.87633322e-02]
 [  8.60511425e-06]
 [  1.09047924e-05]
 [  4.69932909e-06]
 [  5.34512836e-06]
 [  1.72324660e-04]
 [  6.78866160e-02]
 [  3.77558404e-02]
 [  5.23960507e-02]
 [  1.87509747e-05]
 [  4.03386755e-02]
 [  3.73926566e-02]
 [  1.72325600e-04]
 [  5.52570757e-02]
 [  6.46078433e-06]
 [  2.74078449e-02]
 [  1.57297163e-04]
 [  7.65049788e-02]
 [  3.79147977e-02]
 [  2.72064657e-02]
 [  7.20355317e-02]
 [  3.98247085e-02]
 [  4.07274408e-02]
 [  4.82089625e-02]
 [  7.70495280e-05]
 [  3.22395095e-02]
 [  1.17167409e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  49 / Last logScore:  -17025962.046 / New log score:  -17025938.7016 / Difference attained:  23.3444077782
Current pi parameter:  [[  3.77368117e-02]
 [  9.12952589e-06]
 [  3.06749631e-02]
 [  4.98764081e-02]
 [  6.47342296e-02]
 [  1.72294969e-06]
 [  6.42630715e-02]
 [  2.72200350e-05]
 [  5.87639532e-02]
 [  8.60511425e-06]
 [  1.09046267e-05]
 [  4.69932909e-06]
 [  5.34504715e-06]
 [  1.72324660e-04]
 [  6.78846902e-02]
 [  3.77537588e-02]
 [  5.23965607e-02]
 [  1.87506898e-05]
 [  4.03368883e-02]
 [  3.73929121e-02]
 [  1.72325600e-04]
 [  5.52750404e-02]
 [  6.46068618e-06]
 [  2.73923439e-02]
 [  1.57297163e-04]
 [  7.65051742e-02]
 [  3.79147852e-02]
 [  2.72161456e-02]
 [  7.20415232e-02]
 [  3.99720282e-02]
 [  4.06662161e-02]
 [  4.81959747e-02]
 [  7.70483575e-05]
 [  3.23229706e-02]
 [  1.17165629e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  50 / Last logScore:  -17025938.7016 / New log score:  -17025886.0874 / Difference attained:  52.6142003089
Current pi parameter:  [[  3.77366086e-02]
 [  9.12931747e-06]
 [  3.06750147e-02]
 [  4.95924518e-02]
 [  6.47308209e-02]
 [  1.72294969e-06]
 [  6.42646268e-02]
 [  2.72194136e-05]
 [  5.87642207e-02]
 [  8.60511425e-06]
 [  1.09043778e-05]
 [  4.69932909e-06]
 [  5.34492513e-06]
 [  1.72324660e-04]
 [  6.78836320e-02]
 [  3.77513235e-02]
 [  5.23970608e-02]
 [  1.87502618e-05]
 [  4.03351294e-02]
 [  3.73933915e-02]
 [  1.72325600e-04]
 [  5.53715183e-02]
 [  6.46053868e-06]
 [  2.73248131e-02]
 [  1.57297163e-04]
 [  7.65055147e-02]
 [  3.79147642e-02]
 [  2.72484322e-02]
 [  7.20424047e-02]
 [  4.00134386e-02]
 [  4.06660927e-02]
 [  4.81774017e-02]
 [  7.70465985e-05]
 [  3.25277924e-02]
 [  1.17162954e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  51 / Last logScore:  -17025886.0874 / New log score:  -17025846.1608 / Difference attained:  39.9266333692
Current pi parameter:  [[  3.77364643e-02]
 [  9.12925570e-06]
 [  3.06750109e-02]
 [  4.94082916e-02]
 [  6.47387699e-02]
 [  1.72294969e-06]
 [  6.42658308e-02]
 [  2.72192294e-05]
 [  5.87644830e-02]
 [  8.60511425e-06]
 [  1.09043040e-05]
 [  4.69932909e-06]
 [  5.34488897e-06]
 [  1.72324660e-04]
 [  6.78817275e-02]
 [  3.77484242e-02]
 [  5.23981081e-02]
 [  1.87501349e-05]
 [  4.03338323e-02]
 [  3.73942818e-02]
 [  1.72325600e-04]
 [  5.55283521e-02]
 [  6.46049498e-06]
 [  2.72271012e-02]
 [  1.57297163e-04]
 [  7.65055642e-02]
 [  3.79147644e-02]
 [  2.73730068e-02]
 [  7.20574713e-02]
 [  3.99934820e-02]
 [  4.06651954e-02]
 [  4.81221131e-02]
 [  7.70460773e-05]
 [  3.25841797e-02]
 [  1.17162161e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  52 / Last logScore:  -17025846.1608 / New log score:  -17025818.2033 / Difference attained:  27.9575077072
Current pi parameter:  [[  3.77364529e-02]
 [  9.12934964e-06]
 [  3.06751926e-02]
 [  4.91368770e-02]
 [  6.48154912e-02]
 [  1.72294969e-06]
 [  6.42665348e-02]
 [  2.72195095e-05]
 [  5.87648053e-02]
 [  8.60511425e-06]
 [  1.09044162e-05]
 [  4.69932909e-06]
 [  5.34494397e-06]
 [  1.72324660e-04]
 [  6.78830078e-02]
 [  3.77443160e-02]
 [  5.24024670e-02]
 [  1.87503278e-05]
 [  4.03330488e-02]
 [  3.74313518e-02]
 [  1.72325600e-04]
 [  5.55837616e-02]
 [  6.46056145e-06]
 [  2.72270369e-02]
 [  1.57297163e-04]
 [  7.65056094e-02]
 [  3.79148106e-02]
 [  2.73758867e-02]
 [  7.21053800e-02]
 [  4.00934552e-02]
 [  4.06656343e-02]
 [  4.80670619e-02]
 [  7.70468701e-05]
 [  3.25882711e-02]
 [  1.17163367e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  53 / Last logScore:  -17025818.2033 / New log score:  -17025790.4248 / Difference attained:  27.7784725279
Current pi parameter:  [[  3.77354657e-02]
 [  9.12910040e-06]
 [  3.06750805e-02]
 [  4.88527196e-02]
 [  6.49475013e-02]
 [  1.72294969e-06]
 [  6.42669086e-02]
 [  2.72187663e-05]
 [  5.87652045e-02]
 [  8.60511425e-06]
 [  1.09041185e-05]
 [  4.69932909e-06]
 [  5.34479804e-06]
 [  1.72324660e-04]
 [  6.78687347e-02]
 [  3.77350485e-02]
 [  5.24063132e-02]
 [  1.87498159e-05]
 [  4.03326083e-02]
 [  3.75648198e-02]
 [  1.72325600e-04]
 [  5.55989673e-02]
 [  6.46038507e-06]
 [  2.72269841e-02]
 [  1.57297163e-04]
 [  7.65057161e-02]
 [  3.79149752e-02]
 [  2.73717141e-02]
 [  7.22802498e-02]
 [  3.99398240e-02]
 [  4.06662849e-02]
 [  4.80718433e-02]
 [  7.70447665e-05]
 [  3.25894939e-02]
 [  1.17160168e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  54 / Last logScore:  -17025790.4248 / New log score:  -17025772.1854 / Difference attained:  18.2393400446
Current pi parameter:  [[  3.77340646e-02]
 [  9.12892972e-06]
 [  3.06751019e-02]
 [  4.85928735e-02]
 [  6.51652560e-02]
 [  1.72294969e-06]
 [  6.42670925e-02]
 [  2.72182575e-05]
 [  5.87658360e-02]
 [  8.60511425e-06]
 [  1.09039146e-05]
 [  4.69932909e-06]
 [  5.34469811e-06]
 [  1.72324660e-04]
 [  6.78286292e-02]
 [  3.77118020e-02]
 [  5.24103987e-02]
 [  1.87494654e-05]
 [  4.03296509e-02]
 [  3.75648584e-02]
 [  1.72325600e-04]
 [  5.56254950e-02]
 [  6.46026428e-06]
 [  2.72270119e-02]
 [  1.57297163e-04]
 [  7.65064223e-02]
 [  3.79153624e-02]
 [  2.73675220e-02]
 [  7.23788001e-02]
 [  3.99000643e-02]
 [  4.06662769e-02]
 [  4.80943368e-02]
 [  7.70433261e-05]
 [  3.25896050e-02]
 [  1.17157978e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  55 / Last logScore:  -17025772.1854 / New log score:  -17025722.8579 / Difference attained:  49.3275764212
Current pi parameter:  [[  3.77344047e-02]
 [  9.12921015e-06]
 [  3.06750609e-02]
 [  4.83082920e-02]
 [  6.52126476e-02]
 [  1.72294969e-06]
 [  6.42670443e-02]
 [  2.72190936e-05]
 [  5.87672747e-02]
 [  8.60511425e-06]
 [  1.09042496e-05]
 [  4.69932909e-06]
 [  5.34486230e-06]
 [  1.72324660e-04]
 [  6.77697438e-02]
 [  3.76601521e-02]
 [  5.24163233e-02]
 [  1.87500413e-05]
 [  4.03156322e-02]
 [  3.75637743e-02]
 [  1.72325600e-04]
 [  5.56957841e-02]
 [  6.46046274e-06]
 [  2.72270749e-02]
 [  1.57297163e-04]
 [  7.65071600e-02]
 [  3.79157042e-02]
 [  2.73630238e-02]
 [  7.23915431e-02]
 [  4.01231324e-02]
 [  4.06663224e-02]
 [  4.81467652e-02]
 [  7.70456928e-05]
 [  3.25895954e-02]
 [  1.17161577e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  56 / Last logScore:  -17025722.8579 / New log score:  -17025660.6419 / Difference attained:  62.2159395628
Current pi parameter:  [[  3.77341450e-02]
 [  9.12907082e-06]
 [  3.06750670e-02]
 [  4.77273606e-02]
 [  6.53196596e-02]
 [  1.72294969e-06]
 [  6.42674419e-02]
 [  2.72186782e-05]
 [  5.87678052e-02]
 [  8.60511425e-06]
 [  1.09040832e-05]
 [  4.69932909e-06]
 [  5.34478073e-06]
 [  1.72324660e-04]
 [  6.78701670e-02]
 [  3.76124511e-02]
 [  5.24216607e-02]
 [  1.87497552e-05]
 [  4.02687223e-02]
 [  3.75632739e-02]
 [  1.72325600e-04]
 [  5.58350344e-02]
 [  6.46036414e-06]
 [  2.72270847e-02]
 [  1.57297163e-04]
 [  7.65072182e-02]
 [  3.79164168e-02]
 [  2.73575453e-02]
 [  7.24391455e-02]
 [  4.03571755e-02]
 [  4.06667633e-02]
 [  4.81921868e-02]
 [  7.70445170e-05]
 [  3.25901333e-02]
 [  1.17159788e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  57 / Last logScore:  -17025660.6419 / New log score:  -17025619.853 / Difference attained:  40.7889449559
Current pi parameter:  [[  3.77268896e-02]
 [  9.12911947e-06]
 [  3.06752042e-02]
 [  4.73739778e-02]
 [  6.49349257e-02]
 [  1.72294969e-06]
 [  6.42723362e-02]
 [  2.72188232e-05]
 [  5.87685478e-02]
 [  8.60511425e-06]
 [  1.09041413e-05]
 [  4.69932909e-06]
 [  5.34480921e-06]
 [  1.72324660e-04]
 [  6.80618803e-02]
 [  3.76096963e-02]
 [  5.24276508e-02]
 [  1.87498551e-05]
 [  4.01602303e-02]
 [  3.75616360e-02]
 [  1.72325600e-04]
 [  5.62354403e-02]
 [  6.46039857e-06]
 [  2.72270089e-02]
 [  1.57297163e-04]
 [  7.65072285e-02]
 [  3.79252768e-02]
 [  2.73502180e-02]
 [  7.25478638e-02]
 [  4.04982042e-02]
 [  4.06669909e-02]
 [  4.81934859e-02]
 [  7.70449276e-05]
 [  3.25917649e-02]
 [  1.17160413e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  58 / Last logScore:  -17025619.853 / New log score:  -17025589.7769 / Difference attained:  30.0761209428
Current pi parameter:  [[  3.76669833e-02]
 [  9.12930934e-06]
 [  3.06753220e-02]
 [  4.73637145e-02]
 [  6.45907008e-02]
 [  1.72294969e-06]
 [  6.42836111e-02]
 [  2.72193893e-05]
 [  5.87708143e-02]
 [  8.60511425e-06]
 [  1.09043681e-05]
 [  4.69932909e-06]
 [  5.34492037e-06]
 [  1.72324660e-04]
 [  6.80536620e-02]
 [  3.76126092e-02]
 [  5.24381825e-02]
 [  1.87502451e-05]
 [  4.01561071e-02]
 [  3.75598607e-02]
 [  1.72325600e-04]
 [  5.65719201e-02]
 [  6.46053293e-06]
 [  2.72270127e-02]
 [  1.57297163e-04]
 [  7.65065374e-02]
 [  3.79944911e-02]
 [  2.73399411e-02]
 [  7.25542249e-02]
 [  4.04998655e-02]
 [  4.06670330e-02]
 [  4.81865696e-02]
 [  7.70465299e-05]
 [  3.25972905e-02]
 [  1.17162850e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  59 / Last logScore:  -17025589.7769 / New log score:  -17025560.9079 / Difference attained:  28.8689173907
Current pi parameter:  [[  3.75632965e-02]
 [  9.12935057e-06]
 [  3.06753295e-02]
 [  4.75565715e-02]
 [  6.43296411e-02]
 [  1.72294969e-06]
 [  6.42914219e-02]
 [  2.72195122e-05]
 [  5.87771542e-02]
 [  8.60511425e-06]
 [  1.09044173e-05]
 [  4.69932909e-06]
 [  5.34494451e-06]
 [  1.72324660e-04]
 [  6.80452822e-02]
 [  3.76167555e-02]
 [  5.24570622e-02]
 [  1.87503297e-05]
 [  4.01558071e-02]
 [  3.75560675e-02]
 [  1.72325600e-04]
 [  5.68313991e-02]
 [  6.46056211e-06]
 [  2.72270285e-02]
 [  1.57297163e-04]
 [  7.65064211e-02]
 [  3.80881345e-02]
 [  2.73243204e-02]
 [  7.25667823e-02]
 [  4.03026421e-02]
 [  4.06669503e-02]
 [  4.81794573e-02]
 [  7.70468779e-05]
 [  3.25989283e-02]
 [  1.17163379e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  60 / Last logScore:  -17025560.9079 / New log score:  -17025548.0915 / Difference attained:  12.8164163828
Current pi parameter:  [[  3.75609559e-02]
 [  9.12938641e-06]
 [  3.06752816e-02]
 [  4.75525010e-02]
 [  6.41994524e-02]
 [  1.72294969e-06]
 [  6.43038422e-02]
 [  2.72196191e-05]
 [  5.87900919e-02]
 [  8.60511425e-06]
 [  1.09044601e-05]
 [  4.69932909e-06]
 [  5.34496549e-06]
 [  1.72324660e-04]
 [  6.80318035e-02]
 [  3.76181993e-02]
 [  5.24847492e-02]
 [  1.87504033e-05]
 [  4.01558598e-02]
 [  3.75430665e-02]
 [  1.72325600e-04]
 [  5.69751835e-02]
 [  6.46058747e-06]
 [  2.72270426e-02]
 [  1.57297163e-04]
 [  7.65063592e-02]
 [  3.80894339e-02]
 [  2.72989939e-02]
 [  7.26925747e-02]
 [  4.01689679e-02]
 [  4.06667765e-02]
 [  4.81725437e-02]
 [  7.70471803e-05]
 [  3.26027729e-02]
 [  1.17163839e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  61 / Last logScore:  -17025548.0915 / New log score:  -17025538.4458 / Difference attained:  9.6456997022
Current pi parameter:  [[  3.75583741e-02]
 [  9.12596019e-06]
 [  3.06753134e-02]
 [  4.75139890e-02]
 [  6.41989698e-02]
 [  1.72294969e-06]
 [  6.43393775e-02]
 [  2.72094037e-05]
 [  5.88067215e-02]
 [  8.60511425e-06]
 [  1.09003677e-05]
 [  4.69932909e-06]
 [  5.34295955e-06]
 [  1.72324660e-04]
 [  6.79954252e-02]
 [  3.76185397e-02]
 [  5.25237374e-02]
 [  1.87433664e-05]
 [  4.01560071e-02]
 [  3.75234942e-02]
 [  1.72325600e-04]
 [  5.70133534e-02]
 [  6.45816284e-06]
 [  2.72270598e-02]
 [  1.57297163e-04]
 [  7.65052184e-02]
 [  3.80903055e-02]
 [  2.72616660e-02]
 [  7.27266902e-02]
 [  4.01575492e-02]
 [  4.06666767e-02]
 [  4.81506328e-02]
 [  7.70182649e-05]
 [  3.26074139e-02]
 [  1.17119868e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  62 / Last logScore:  -17025538.4458 / New log score:  -17025509.1392 / Difference attained:  29.3066090718
Current pi parameter:  [[  3.75539423e-02]
 [  9.12497262e-06]
 [  3.06754322e-02]
 [  4.73880186e-02]
 [  6.40914782e-02]
 [  1.72294969e-06]
 [  6.44477884e-02]
 [  2.72064592e-05]
 [  5.88468245e-02]
 [  8.60511425e-06]
 [  1.08991881e-05]
 [  4.69932909e-06]
 [  5.34238136e-06]
 [  1.72324660e-04]
 [  6.78865196e-02]
 [  3.76193932e-02]
 [  5.25503974e-02]
 [  1.87413381e-05]
 [  4.01564262e-02]
 [  3.75282295e-02]
 [  1.72325600e-04]
 [  5.71454755e-02]
 [  6.45746397e-06]
 [  2.72270701e-02]
 [  1.57297163e-04]
 [  7.65045289e-02]
 [  3.80906785e-02]
 [  2.72383122e-02]
 [  7.27301937e-02]
 [  4.02408247e-02]
 [  4.06664382e-02]
 [  4.81178840e-02]
 [  7.70099303e-05]
 [  3.26106766e-02]
 [  1.17107193e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  63 / Last logScore:  -17025509.1392 / New log score:  -17025473.098 / Difference attained:  36.0412015095
Current pi parameter:  [[  3.75420106e-02]
 [  9.12501497e-06]
 [  3.06757768e-02]
 [  4.72124530e-02]
 [  6.39112219e-02]
 [  1.72294969e-06]
 [  6.45469157e-02]
 [  2.72065855e-05]
 [  5.89286118e-02]
 [  8.60511426e-06]
 [  1.08992387e-05]
 [  4.69932909e-06]
 [  5.34240615e-06]
 [  1.72324660e-04]
 [  6.77869419e-02]
 [  3.76213140e-02]
 [  5.25566775e-02]
 [  1.87414251e-05]
 [  4.01578342e-02]
 [  3.75608845e-02]
 [  1.72325600e-04]
 [  5.73240926e-02]
 [  6.45749394e-06]
 [  2.72270862e-02]
 [  1.57297163e-04]
 [  7.65045440e-02]
 [  3.80911764e-02]
 [  2.72446203e-02]
 [  7.27316639e-02]
 [  4.03341607e-02]
 [  4.06644245e-02]
 [  4.80784415e-02]
 [  7.70102877e-05]
 [  3.26156800e-02]
 [  1.17107737e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  64 / Last logScore:  -17025473.098 / New log score:  -17025454.8 / Difference attained:  18.297969453
Current pi parameter:  [[  3.74745583e-02]
 [  9.12492954e-06]
 [  3.06759676e-02]
 [  4.70350037e-02]
 [  6.38711235e-02]
 [  1.72294969e-06]
 [  6.46133500e-02]
 [  2.72063308e-05]
 [  5.89397738e-02]
 [  8.60511426e-06]
 [  1.08991367e-05]
 [  4.69932909e-06]
 [  5.34235614e-06]
 [  1.72324660e-04]
 [  6.77284103e-02]
 [  3.76215134e-02]
 [  5.25576063e-02]
 [  1.87412496e-05]
 [  4.01589050e-02]
 [  3.75585154e-02]
 [  1.72325600e-04]
 [  5.73786925e-02]
 [  6.45743348e-06]
 [  2.72271244e-02]
 [  1.57297163e-04]
 [  7.65039870e-02]
 [  3.80911622e-02]
 [  2.73103199e-02]
 [  7.27363133e-02]
 [  4.04986406e-02]
 [  4.06541342e-02]
 [  4.80579357e-02]
 [  7.70095667e-05]
 [  3.26234965e-02]
 [  1.17106640e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  65 / Last logScore:  -17025454.8 / New log score:  -17025427.9859 / Difference attained:  26.8141109049
Current pi parameter:  [[  3.73935854e-02]
 [  9.12493005e-06]
 [  3.06761254e-02]
 [  4.68425077e-02]
 [  6.38993935e-02]
 [  1.72294969e-06]
 [  6.46140124e-02]
 [  2.72063323e-05]
 [  5.89399189e-02]
 [  8.60511426e-06]
 [  1.08991373e-05]
 [  4.69932909e-06]
 [  5.34235643e-06]
 [  1.72324660e-04]
 [  6.78515564e-02]
 [  3.76201749e-02]
 [  5.25582512e-02]
 [  1.87412506e-05]
 [  4.01596819e-02]
 [  3.75493795e-02]
 [  1.72325600e-04]
 [  5.73534316e-02]
 [  6.45743384e-06]
 [  2.72270853e-02]
 [  1.57297163e-04]
 [  7.65034017e-02]
 [  3.80925261e-02]
 [  2.73957834e-02]
 [  7.27419789e-02]
 [  4.06140452e-02]
 [  4.06000556e-02]
 [  4.80526309e-02]
 [  7.70095710e-05]
 [  3.26310076e-02]
 [  1.17106647e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  66 / Last logScore:  -17025427.9859 / New log score:  -17025391.7513 / Difference attained:  36.2346628606
Current pi parameter:  [[  3.73930959e-02]
 [  9.12492474e-06]
 [  3.06760694e-02]
 [  4.67111972e-02]
 [  6.40265336e-02]
 [  1.72294969e-06]
 [  6.46166747e-02]
 [  2.72063165e-05]
 [  5.89402820e-02]
 [  8.60511426e-06]
 [  1.08991310e-05]
 [  4.69932909e-06]
 [  5.34235333e-06]
 [  1.72324660e-04]
 [  6.78819080e-02]
 [  3.76185006e-02]
 [  5.25591047e-02]
 [  1.87412397e-05]
 [  4.01598503e-02]
 [  3.75045629e-02]
 [  1.72325600e-04]
 [  5.72077189e-02]
 [  6.45743009e-06]
 [  2.72269517e-02]
 [  1.57297163e-04]
 [  7.65023962e-02]
 [  3.80924315e-02]
 [  2.74567695e-02]
 [  7.27540903e-02]
 [  4.07970832e-02]
 [  4.05031481e-02]
 [  4.80511635e-02]
 [  7.70095263e-05]
 [  3.26370014e-02]
 [  1.17106579e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  67 / Last logScore:  -17025391.7513 / New log score:  -17025375.856 / Difference attained:  15.8952868208
Current pi parameter:  [[  3.73940526e-02]
 [  9.12500268e-06]
 [  3.06760273e-02]
 [  4.67373174e-02]
 [  6.41919024e-02]
 [  1.72294969e-06]
 [  6.46198284e-02]
 [  2.72065488e-05]
 [  5.89422696e-02]
 [  8.60511426e-06]
 [  1.08992240e-05]
 [  4.69932909e-06]
 [  5.34239895e-06]
 [  1.72324660e-04]
 [  6.78646838e-02]
 [  3.76166908e-02]
 [  5.25579908e-02]
 [  1.87413998e-05]
 [  4.01599335e-02]
 [  3.73773224e-02]
 [  1.72325600e-04]
 [  5.72130715e-02]
 [  6.45748524e-06]
 [  2.72259082e-02]
 [  1.57297163e-04]
 [  7.65028395e-02]
 [  3.80913411e-02]
 [  2.74065212e-02]
 [  7.27806692e-02]
 [  4.07721657e-02]
 [  4.04888891e-02]
 [  4.80496719e-02]
 [  7.70101840e-05]
 [  3.26474359e-02]
 [  1.17107579e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  68 / Last logScore:  -17025375.856 / New log score:  -17025348.4512 / Difference attained:  27.4048346542
Current pi parameter:  [[  3.74021672e-02]
 [  9.12494347e-06]
 [  3.06760392e-02]
 [  4.68628342e-02]
 [  6.43535702e-02]
 [  1.72294969e-06]
 [  6.46226920e-02]
 [  2.72063723e-05]
 [  5.89441441e-02]
 [  8.60511426e-06]
 [  1.08991533e-05]
 [  4.69932909e-06]
 [  5.34236429e-06]
 [  1.72324660e-04]
 [  6.78082979e-02]
 [  3.76156634e-02]
 [  5.25578347e-02]
 [  1.87412782e-05]
 [  4.01599966e-02]
 [  3.71956306e-02]
 [  1.72325600e-04]
 [  5.72163445e-02]
 [  6.45744334e-06]
 [  2.72244582e-02]
 [  1.57297163e-04]
 [  7.65033223e-02]
 [  3.80915838e-02]
 [  2.74078815e-02]
 [  7.28548681e-02]
 [  4.06257701e-02]
 [  4.04864378e-02]
 [  4.80490579e-02]
 [  7.70096843e-05]
 [  3.26579388e-02]
 [  1.17106819e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  69 / Last logScore:  -17025348.4512 / New log score:  -17025306.462 / Difference attained:  41.9891374633
Current pi parameter:  [[  3.75064720e-02]
 [  9.12488985e-06]
 [  3.06760938e-02]
 [  4.68732511e-02]
 [  6.43989579e-02]
 [  1.72294969e-06]
 [  6.46268898e-02]
 [  2.72062125e-05]
 [  5.89462085e-02]
 [  8.60511426e-06]
 [  1.08990893e-05]
 [  4.69932909e-06]
 [  5.34233290e-06]
 [  1.72324660e-04]
 [  6.75518799e-02]
 [  3.76154994e-02]
 [  5.25577994e-02]
 [  1.87411681e-05]
 [  4.01600515e-02]
 [  3.70389358e-02]
 [  1.72325600e-04]
 [  5.72152106e-02]
 [  6.45740540e-06]
 [  2.72228381e-02]
 [  1.57297163e-04]
 [  7.65037479e-02]
 [  3.80970966e-02]
 [  2.74094322e-02]
 [  7.31589320e-02]
 [  4.05573165e-02]
 [  4.04844923e-02]
 [  4.80486482e-02]
 [  7.70092318e-05]
 [  3.26667807e-02]
 [  1.17106131e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  70 / Last logScore:  -17025306.462 / New log score:  -17025273.4575 / Difference attained:  33.0045015626
Current pi parameter:  [[  3.75661557e-02]
 [  9.12473821e-06]
 [  3.06759971e-02]
 [  4.68772399e-02]
 [  6.44967338e-02]
 [  1.72294969e-06]
 [  6.46417771e-02]
 [  2.72057603e-05]
 [  5.89502404e-02]
 [  8.60511426e-06]
 [  1.08989081e-05]
 [  4.69932909e-06]
 [  5.34224412e-06]
 [  1.72324660e-04]
 [  6.71637900e-02]
 [  3.76151586e-02]
 [  5.25562837e-02]
 [  1.87408566e-05]
 [  4.01601248e-02]
 [  3.68796105e-02]
 [  1.72325600e-04]
 [  5.72119475e-02]
 [  6.45729808e-06]
 [  2.72200155e-02]
 [  1.57297163e-04]
 [  7.65039734e-02]
 [  3.81279789e-02]
 [  2.74130424e-02]
 [  7.35705032e-02]
 [  4.04817386e-02]
 [  4.04815632e-02]
 [  4.80487673e-02]
 [  7.70079520e-05]
 [  3.26738955e-02]
 [  1.17104185e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  71 / Last logScore:  -17025273.4575 / New log score:  -17025254.6651 / Difference attained:  18.7924407944
Current pi parameter:  [[  3.75673051e-02]
 [  9.12435086e-06]
 [  3.06756012e-02]
 [  4.68892809e-02]
 [  6.44976251e-02]
 [  1.72294969e-06]
 [  6.47303353e-02]
 [  2.72046054e-05]
 [  5.89627185e-02]
 [  8.60511426e-06]
 [  1.08984455e-05]
 [  4.69932909e-06]
 [  5.34201734e-06]
 [  1.72324660e-04]
 [  6.67990468e-02]
 [  3.76150642e-02]
 [  5.25554101e-02]
 [  1.87400611e-05]
 [  4.01603561e-02]
 [  3.68753545e-02]
 [  1.72325600e-04]
 [  5.72088794e-02]
 [  6.45702397e-06]
 [  2.72099175e-02]
 [  1.57297163e-04]
 [  7.64962499e-02]
 [  3.83103994e-02]
 [  2.74244709e-02]
 [  7.37139763e-02]
 [  4.04212566e-02]
 [  4.04747809e-02]
 [  4.80491207e-02]
 [  7.70046830e-05]
 [  3.26793947e-02]
 [  1.17099214e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  72 / Last logScore:  -17025254.6651 / New log score:  -17025217.6443 / Difference attained:  37.0207995623
Current pi parameter:  [[  3.75674748e-02]
 [  9.12425226e-06]
 [  3.06759863e-02]
 [  4.68796612e-02]
 [  6.44959118e-02]
 [  1.72294969e-06]
 [  6.47889245e-02]
 [  2.72043114e-05]
 [  5.89988965e-02]
 [  8.60511426e-06]
 [  1.08983277e-05]
 [  4.69932909e-06]
 [  5.34195961e-06]
 [  1.72324660e-04]
 [  6.65235258e-02]
 [  3.76155404e-02]
 [  5.25552151e-02]
 [  1.87398586e-05]
 [  4.01619165e-02]
 [  3.68752238e-02]
 [  1.72325600e-04]
 [  5.72057250e-02]
 [  6.45695419e-06]
 [  2.70958158e-02]
 [  1.57297163e-04]
 [  7.64948747e-02]
 [  3.84349092e-02]
 [  2.75399239e-02]
 [  7.39138497e-02]
 [  4.03191343e-02]
 [  4.04413372e-02]
 [  4.80492318e-02]
 [  7.70038508e-05]
 [  3.26834677e-02]
 [  1.17097948e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  73 / Last logScore:  -17025217.6443 / New log score:  -17025187.4198 / Difference attained:  30.2244919129
Current pi parameter:  [[  3.75676317e-02]
 [  9.12447978e-06]
 [  3.06762880e-02]
 [  4.68811114e-02]
 [  6.44948101e-02]
 [  1.72294969e-06]
 [  6.48754483e-02]
 [  2.72049898e-05]
 [  5.91223646e-02]
 [  8.60511426e-06]
 [  1.08985995e-05]
 [  4.69932909e-06]
 [  5.34209281e-06]
 [  1.72324660e-04]
 [  6.63713456e-02]
 [  3.76159720e-02]
 [  5.25539880e-02]
 [  1.87403259e-05]
 [  4.01639155e-02]
 [  3.68752142e-02]
 [  1.72325600e-04]
 [  5.72029032e-02]
 [  6.45711520e-06]
 [  2.70546714e-02]
 [  1.57297163e-04]
 [  7.64955277e-02]
 [  3.84387337e-02]
 [  2.76206205e-02]
 [  7.39440194e-02]
 [  4.03057838e-02]
 [  4.03204988e-02]
 [  4.80492875e-02]
 [  7.70057710e-05]
 [  3.26864063e-02]
 [  1.17100868e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  74 / Last logScore:  -17025187.4198 / New log score:  -17025135.1638 / Difference attained:  52.2559917495
Current pi parameter:  [[  3.75675394e-02]
 [  9.12460947e-06]
 [  3.06759586e-02]
 [  4.69219136e-02]
 [  6.44940175e-02]
 [  1.72294969e-06]
 [  6.50797602e-02]
 [  2.72053765e-05]
 [  5.91242197e-02]
 [  8.60511426e-06]
 [  1.08987544e-05]
 [  4.69932909e-06]
 [  5.34216874e-06]
 [  1.72324660e-04]
 [  6.60389756e-02]
 [  3.76163739e-02]
 [  5.25516205e-02]
 [  1.87405922e-05]
 [  4.01731532e-02]
 [  3.68752604e-02]
 [  1.72325600e-04]
 [  5.72010377e-02]
 [  6.45720698e-06]
 [  2.70545858e-02]
 [  1.57297163e-04]
 [  7.64903068e-02]
 [  3.84395067e-02]
 [  2.77410938e-02]
 [  7.39975135e-02]
 [  4.02139506e-02]
 [  4.03219099e-02]
 [  4.80493272e-02]
 [  7.70068655e-05]
 [  3.26885147e-02]
 [  1.17102533e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  75 / Last logScore:  -17025135.1638 / New log score:  -17025100.1477 / Difference attained:  35.016124513
Current pi parameter:  [[  3.75611213e-02]
 [  9.12313047e-06]
 [  3.06761157e-02]
 [  4.70248627e-02]
 [  6.44934219e-02]
 [  1.72294969e-06]
 [  6.52422817e-02]
 [  2.72009668e-05]
 [  5.91243014e-02]
 [  8.60511426e-06]
 [  1.08969878e-05]
 [  4.69932909e-06]
 [  5.34130284e-06]
 [  1.72324660e-04]
 [  6.56172193e-02]
 [  3.76167434e-02]
 [  5.25415977e-02]
 [  1.87375546e-05]
 [  4.02165952e-02]
 [  3.68755000e-02]
 [  1.72325600e-04]
 [  5.71997878e-02]
 [  6.45616033e-06]
 [  2.70546092e-02]
 [  1.57297163e-04]
 [  7.64714901e-02]
 [  3.84514691e-02]
 [  2.77758179e-02]
 [  7.41571556e-02]
 [  4.01549724e-02]
 [  4.03220837e-02]
 [  4.80493576e-02]
 [  7.69943835e-05]
 [  3.26900627e-02]
 [  1.17083552e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  76 / Last logScore:  -17025100.1477 / New log score:  -17025035.2687 / Difference attained:  64.8789825961
Current pi parameter:  [[  3.75412090e-02]
 [  9.12123811e-06]
 [  3.06804710e-02]
 [  4.69581595e-02]
 [  6.44929701e-02]
 [  1.72294969e-06]
 [  6.53600286e-02]
 [  2.71953247e-05]
 [  5.90360127e-02]
 [  8.60511426e-06]
 [  1.08947275e-05]
 [  4.69932909e-06]
 [  5.34019492e-06]
 [  1.72324660e-04]
 [  6.53335309e-02]
 [  3.76170509e-02]
 [  5.25319366e-02]
 [  1.87336680e-05]
 [  4.03665231e-02]
 [  3.68759970e-02]
 [  1.72325600e-04]
 [  5.71988977e-02]
 [  6.45482117e-06]
 [  2.70546368e-02]
 [  1.57297163e-04]
 [  7.64138682e-02]
 [  3.85681991e-02]
 [  2.78110645e-02]
 [  7.42566248e-02]
 [  4.01568566e-02]
 [  4.03220878e-02]
 [  4.80493811e-02]
 [  7.69784131e-05]
 [  3.26910947e-02]
 [  1.17059266e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  77 / Last logScore:  -17025035.2687 / New log score:  -17024926.7598 / Difference attained:  108.508835774
Current pi parameter:  [[  3.74224626e-02]
 [  9.12031982e-06]
 [  3.06807629e-02]
 [  4.68526078e-02]
 [  6.44925715e-02]
 [  1.72294969e-06]
 [  6.52765598e-02]
 [  2.71925867e-05]
 [  5.89529506e-02]
 [  8.60511426e-06]
 [  1.08936307e-05]
 [  4.69932909e-06]
 [  5.33965729e-06]
 [  1.72324660e-04]
 [  6.51083113e-02]
 [  3.76172828e-02]
 [  5.25210743e-02]
 [  1.87317819e-05]
 [  4.07885883e-02]
 [  3.68762047e-02]
 [  1.72325600e-04]
 [  5.71983804e-02]
 [  6.45417132e-06]
 [  2.70546394e-02]
 [  1.57297163e-04]
 [  7.62354681e-02]
 [  3.86390134e-02]
 [  2.79471302e-02]
 [  7.44259519e-02]
 [  4.01633706e-02]
 [  4.03220950e-02]
 [  4.80494007e-02]
 [  7.69706631e-05]
 [  3.26917914e-02]
 [  1.17047481e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  78 / Last logScore:  -17024926.7598 / New log score:  -17024828.6412 / Difference attained:  98.1186757535
Current pi parameter:  [[  3.73926647e-02]
 [  9.11862049e-06]
 [  3.07753571e-02]
 [  4.66634951e-02]
 [  6.44922270e-02]
 [  1.72294969e-06]
 [  6.53183376e-02]
 [  2.71875201e-05]
 [  5.89498471e-02]
 [  8.60511426e-06]
 [  1.08916009e-05]
 [  4.69932909e-06]
 [  5.33866239e-06]
 [  1.72324660e-04]
 [  6.50884963e-02]
 [  3.76171576e-02]
 [  5.25021719e-02]
 [  1.87282917e-05]
 [  4.10062800e-02]
 [  3.68763597e-02]
 [  1.72325600e-04]
 [  5.71983065e-02]
 [  6.45296876e-06]
 [  2.70546457e-02]
 [  1.57297163e-04]
 [  7.59320147e-02]
 [  3.86594687e-02]
 [  2.80190133e-02]
 [  7.45158180e-02]
 [  4.01908023e-02]
 [  4.03224711e-02]
 [  4.80494176e-02]
 [  7.69563217e-05]
 [  3.26922967e-02]
 [  1.17025672e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  79 / Last logScore:  -17024828.6412 / New log score:  -17024757.8808 / Difference attained:  70.7603894845
Current pi parameter:  [[  3.73848941e-02]
 [  9.11818602e-06]
 [  3.09550423e-02]
 [  4.66039512e-02]
 [  6.44924358e-02]
 [  1.72294969e-06]
 [  6.56383850e-02]
 [  2.71862247e-05]
 [  5.89485991e-02]
 [  8.60511426e-06]
 [  1.08910820e-05]
 [  4.69932909e-06]
 [  5.33840802e-06]
 [  1.72324660e-04]
 [  6.46134320e-02]
 [  3.76172189e-02]
 [  5.24669460e-02]
 [  1.87273994e-05]
 [  4.11646777e-02]
 [  3.68767936e-02]
 [  1.72325600e-04]
 [  5.71981948e-02]
 [  6.45266130e-06]
 [  2.70546858e-02]
 [  1.57297163e-04]
 [  7.57282956e-02]
 [  3.87425505e-02]
 [  2.81020415e-02]
 [  7.44065711e-02]
 [  4.02476877e-02]
 [  4.03321932e-02]
 [  4.80494337e-02]
 [  7.69526550e-05]
 [  3.26926269e-02]
 [  1.17020096e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  80 / Last logScore:  -17024757.8808 / New log score:  -17024692.2903 / Difference attained:  65.5904652588
Current pi parameter:  [[  3.73540971e-02]
 [  9.11771499e-06]
 [  3.08712698e-02]
 [  4.65310335e-02]
 [  6.44922605e-02]
 [  1.72294969e-06]
 [  6.58211323e-02]
 [  2.71848203e-05]
 [  5.89427181e-02]
 [  8.60511426e-06]
 [  1.08905194e-05]
 [  4.69932909e-06]
 [  5.33813225e-06]
 [  1.72324660e-04]
 [  6.45615538e-02]
 [  3.76174699e-02]
 [  5.24374292e-02]
 [  1.87264320e-05]
 [  4.11465513e-02]
 [  3.68846579e-02]
 [  1.72325600e-04]
 [  5.71981326e-02]
 [  6.45232796e-06]
 [  2.70547019e-02]
 [  1.57297163e-04]
 [  7.55488856e-02]
 [  3.89580621e-02]
 [  2.82531565e-02]
 [  7.41254928e-02]
 [  4.03203136e-02]
 [  4.04554526e-02]
 [  4.80494529e-02]
 [  7.69486797e-05]
 [  3.26928411e-02]
 [  1.17014051e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  81 / Last logScore:  -17024692.2903 / New log score:  -17024611.0206 / Difference attained:  81.2696680874
Current pi parameter:  [[  3.72264846e-02]
 [  9.11672871e-06]
 [  3.08531251e-02]
 [  4.65268336e-02]
 [  6.44920121e-02]
 [  1.72294969e-06]
 [  6.57743070e-02]
 [  2.71818797e-05]
 [  5.89210871e-02]
 [  8.60511426e-06]
 [  1.08893413e-05]
 [  4.69932909e-06]
 [  5.33755481e-06]
 [  1.72324660e-04]
 [  6.47492703e-02]
 [  3.76178897e-02]
 [  5.24478261e-02]
 [  1.87244063e-05]
 [  4.11244186e-02]
 [  3.70421717e-02]
 [  1.72325600e-04]
 [  5.71980351e-02]
 [  6.45163000e-06]
 [  2.70547203e-02]
 [  1.57297163e-04]
 [  7.52229097e-02]
 [  3.92834516e-02]
 [  2.85361671e-02]
 [  7.36832783e-02]
 [  4.03245272e-02]
 [  4.04956895e-02]
 [  4.80494674e-02]
 [  7.69403561e-05]
 [  3.26930112e-02]
 [  1.17001393e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  82 / Last logScore:  -17024611.0206 / New log score:  -17024587.3113 / Difference attained:  23.7093904875
Current pi parameter:  [[  3.72256640e-02]
 [  9.11538679e-06]
 [  3.08559933e-02]
 [  4.65272272e-02]
 [  6.44916832e-02]
 [  1.72294969e-06]
 [  6.56590737e-02]
 [  2.71778787e-05]
 [  5.88195979e-02]
 [  8.60511426e-06]
 [  1.08877385e-05]
 [  4.69932909e-06]
 [  5.33676916e-06]
 [  1.72324660e-04]
 [  6.52246108e-02]
 [  3.76187553e-02]
 [  5.24762562e-02]
 [  1.87216502e-05]
 [  4.10912693e-02]
 [  3.70525122e-02]
 [  1.72325600e-04]
 [  5.71983242e-02]
 [  6.45068037e-06]
 [  2.70547325e-02]
 [  1.57297163e-04]
 [  7.47918590e-02]
 [  3.92872664e-02]
 [  2.85767098e-02]
 [  7.38023493e-02]
 [  4.03264546e-02]
 [  4.04936960e-02]
 [  4.80494772e-02]
 [  7.69290310e-05]
 [  3.26931956e-02]
 [  1.16984172e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  83 / Last logScore:  -17024587.3113 / New log score:  -17024566.5505 / Difference attained:  20.7608036064
Current pi parameter:  [[  3.72284400e-02]
 [  9.11524846e-06]
 [  3.08586288e-02]
 [  4.65273300e-02]
 [  6.44914619e-02]
 [  1.72294969e-06]
 [  6.56356373e-02]
 [  2.71774663e-05]
 [  5.87846413e-02]
 [  8.60511426e-06]
 [  1.08875733e-05]
 [  4.69932909e-06]
 [  5.33668817e-06]
 [  1.72324660e-04]
 [  6.52662665e-02]
 [  3.76190393e-02]
 [  5.25172166e-02]
 [  1.87213661e-05]
 [  4.10476143e-02]
 [  3.70555409e-02]
 [  1.72325600e-04]
 [  5.71979598e-02]
 [  6.45058248e-06]
 [  2.70547289e-02]
 [  1.57297163e-04]
 [  7.45061740e-02]
 [  3.92841915e-02]
 [  2.85906345e-02]
 [  7.41137009e-02]
 [  4.03315279e-02]
 [  4.04631809e-02]
 [  4.80494800e-02]
 [  7.69278636e-05]
 [  3.26933150e-02]
 [  1.16982396e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  84 / Last logScore:  -17024566.5505 / New log score:  -17024530.2757 / Difference attained:  36.2747117504
Current pi parameter:  [[  3.72338190e-02]
 [  9.11522969e-06]
 [  3.08714097e-02]
 [  4.65273515e-02]
 [  6.44912451e-02]
 [  1.72294969e-06]
 [  6.56179620e-02]
 [  2.71774103e-05]
 [  5.87806611e-02]
 [  8.60511426e-06]
 [  1.08875508e-05]
 [  4.69932909e-06]
 [  5.33667718e-06]
 [  1.72324660e-04]
 [  6.53008137e-02]
 [  3.76192056e-02]
 [  5.25426264e-02]
 [  1.87213275e-05]
 [  4.10209202e-02]
 [  3.70586718e-02]
 [  1.72325600e-04]
 [  5.71908763e-02]
 [  6.45056919e-06]
 [  2.70547239e-02]
 [  1.57297163e-04]
 [  7.40719186e-02]
 [  3.92788284e-02]
 [  2.85904660e-02]
 [  7.46076586e-02]
 [  4.03416515e-02]
 [  4.03730294e-02]
 [  4.80494854e-02]
 [  7.69277051e-05]
 [  3.26933862e-02]
 [  1.16982155e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  85 / Last logScore:  -17024530.2757 / New log score:  -17024509.1942 / Difference attained:  21.0815823711
Current pi parameter:  [[  3.72547153e-02]
 [  9.11459709e-06]
 [  3.09431889e-02]
 [  4.65273685e-02]
 [  6.44908526e-02]
 [  1.72294969e-06]
 [  6.55473474e-02]
 [  2.71755242e-05]
 [  5.87783933e-02]
 [  8.60511426e-06]
 [  1.08867952e-05]
 [  4.69932909e-06]
 [  5.33630681e-06]
 [  1.72324660e-04]
 [  6.53156729e-02]
 [  3.76192803e-02]
 [  5.25635135e-02]
 [  1.87200283e-05]
 [  4.10153129e-02]
 [  3.70622297e-02]
 [  1.72325600e-04]
 [  5.70745770e-02]
 [  6.45012152e-06]
 [  2.70547150e-02]
 [  1.57297163e-04]
 [  7.39048359e-02]
 [  3.92582016e-02]
 [  2.85754510e-02]
 [  7.48964685e-02]
 [  4.03646412e-02]
 [  4.03267937e-02]
 [  4.80494069e-02]
 [  7.69223663e-05]
 [  3.26937559e-02]
 [  1.16974037e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  86 / Last logScore:  -17024509.1942 / New log score:  -17024468.3922 / Difference attained:  40.8020073809
Current pi parameter:  [[  3.73862346e-02]
 [  9.11442267e-06]
 [  3.10153235e-02]
 [  4.65274035e-02]
 [  6.44875425e-02]
 [  1.72294969e-06]
 [  6.54685754e-02]
 [  2.71750041e-05]
 [  5.87806840e-02]
 [  8.60511426e-06]
 [  1.08865869e-05]
 [  4.69932909e-06]
 [  5.33620470e-06]
 [  1.72324660e-04]
 [  6.53138309e-02]
 [  3.76187519e-02]
 [  5.26672220e-02]
 [  1.87196700e-05]
 [  4.10146251e-02]
 [  3.70649058e-02]
 [  1.72325600e-04]
 [  5.70239557e-02]
 [  6.44999809e-06]
 [  2.70546851e-02]
 [  1.57297163e-04]
 [  7.37247560e-02]
 [  3.91271942e-02]
 [  2.85209625e-02]
 [  7.50272185e-02]
 [  4.04262755e-02]
 [  4.03180151e-02]
 [  4.80480783e-02]
 [  7.69208943e-05]
 [  3.27004853e-02]
 [  1.16971798e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  87 / Last logScore:  -17024468.3922 / New log score:  -17024437.8963 / Difference attained:  30.4958643243
Current pi parameter:  [[  3.74131077e-02]
 [  9.11360962e-06]
 [  3.10184105e-02]
 [  4.65275053e-02]
 [  6.44850539e-02]
 [  1.72294969e-06]
 [  6.54017983e-02]
 [  2.71725800e-05]
 [  5.88248045e-02]
 [  8.60511426e-06]
 [  1.08856158e-05]
 [  4.69932909e-06]
 [  5.33572868e-06]
 [  1.72324660e-04]
 [  6.53116501e-02]
 [  3.75984176e-02]
 [  5.27168115e-02]
 [  1.87180002e-05]
 [  4.10147788e-02]
 [  3.70604878e-02]
 [  1.72325600e-04]
 [  5.70203074e-02]
 [  6.44942272e-06]
 [  2.70545291e-02]
 [  1.57297163e-04]
 [  7.35287781e-02]
 [  3.91185932e-02]
 [  2.86009539e-02]
 [  7.53591859e-02]
 [  4.01907123e-02]
 [  4.03163322e-02]
 [  4.80475042e-02]
 [  7.69140326e-05]
 [  3.27070177e-02]
 [  1.16961364e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  88 / Last logScore:  -17024437.8963 / New log score:  -17024408.1584 / Difference attained:  29.7378889211
Current pi parameter:  [[  3.74951335e-02]
 [  9.11374750e-06]
 [  3.10196751e-02]
 [  4.65274716e-02]
 [  6.44839411e-02]
 [  1.72294969e-06]
 [  6.53141345e-02]
 [  2.71729911e-05]
 [  5.89481409e-02]
 [  8.60511426e-06]
 [  1.08857805e-05]
 [  4.69932909e-06]
 [  5.33580941e-06]
 [  1.72324660e-04]
 [  6.53049608e-02]
 [  3.75084254e-02]
 [  5.27248857e-02]
 [  1.87182834e-05]
 [  4.10150108e-02]
 [  3.70548286e-02]
 [  1.72325600e-04]
 [  5.70179318e-02]
 [  6.44952029e-06]
 [  2.70543472e-02]
 [  1.57297163e-04]
 [  7.32405385e-02]
 [  3.91186326e-02]
 [  2.85903005e-02]
 [  7.56813280e-02]
 [  4.01382271e-02]
 [  4.03222927e-02]
 [  4.80477546e-02]
 [  7.69151963e-05]
 [  3.27087767e-02]
 [  1.16963133e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  89 / Last logScore:  -17024408.1584 / New log score:  -17024320.1085 / Difference attained:  88.0499445312
Current pi parameter:  [[  3.75408735e-02]
 [  9.11473566e-06]
 [  3.10200412e-02]
 [  4.65274348e-02]
 [  6.44821413e-02]
 [  1.72294969e-06]
 [  6.53143828e-02]
 [  2.71759373e-05]
 [  5.89498800e-02]
 [  8.60511426e-06]
 [  1.08869608e-05]
 [  4.69932909e-06]
 [  5.33638794e-06]
 [  1.72324660e-04]
 [  6.52302337e-02]
 [  3.74476343e-02]
 [  5.27263948e-02]
 [  1.87203129e-05]
 [  4.10150444e-02]
 [  3.70519629e-02]
 [  1.72325600e-04]
 [  5.70168912e-02]
 [  6.45021958e-06]
 [  2.70543329e-02]
 [  1.57297163e-04]
 [  7.30235071e-02]
 [  3.91187734e-02]
 [  2.84537895e-02]
 [  7.61340077e-02]
 [  4.01167032e-02]
 [  4.03335523e-02]
 [  4.80503858e-02]
 [  7.69235358e-05]
 [  3.27087526e-02]
 [  1.16975815e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  90 / Last logScore:  -17024320.1085 / New log score:  -17024261.502 / Difference attained:  58.6064051241
Current pi parameter:  [[  3.74362316e-02]
 [  9.11619669e-06]
 [  3.10198081e-02]
 [  4.65274376e-02]
 [  6.44739909e-02]
 [  1.72294969e-06]
 [  6.53191168e-02]
 [  2.71802935e-05]
 [  5.89502055e-02]
 [  8.60511426e-06]
 [  1.08887059e-05]
 [  4.69932909e-06]
 [  5.33724333e-06]
 [  1.72324660e-04]
 [  6.53099450e-02]
 [  3.74483550e-02]
 [  5.27259162e-02]
 [  1.87233136e-05]
 [  4.10150942e-02]
 [  3.70508881e-02]
 [  1.72325600e-04]
 [  5.70152443e-02]
 [  6.45125351e-06]
 [  2.70543205e-02]
 [  1.57297163e-04]
 [  7.28576470e-02]
 [  3.91188483e-02]
 [  2.83582968e-02]
 [  7.63998552e-02]
 [  4.00354403e-02]
 [  4.04022753e-02]
 [  4.80574752e-02]
 [  7.69358661e-05]
 [  3.27403011e-02]
 [  1.16994566e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  91 / Last logScore:  -17024261.502 / New log score:  -17024217.6665 / Difference attained:  43.8355272561
Current pi parameter:  [[  3.73149898e-02]
 [  9.11655160e-06]
 [  3.10187928e-02]
 [  4.65274806e-02]
 [  6.44377923e-02]
 [  1.72294969e-06]
 [  6.53550688e-02]
 [  2.71813516e-05]
 [  5.89485605e-02]
 [  8.60511426e-06]
 [  1.08891298e-05]
 [  4.69932909e-06]
 [  5.33745112e-06]
 [  1.72324660e-04]
 [  6.50498704e-02]
 [  3.74751350e-02]
 [  5.27269881e-02]
 [  1.87240426e-05]
 [  4.10151087e-02]
 [  3.70505426e-02]
 [  1.72325600e-04]
 [  5.70161176e-02]
 [  6.45150467e-06]
 [  2.70542687e-02]
 [  1.57297163e-04]
 [  7.28029078e-02]
 [  3.91188829e-02]
 [  2.83510129e-02]
 [  7.67353734e-02]
 [  3.99704157e-02]
 [  4.04133223e-02]
 [  4.80665497e-02]
 [  7.69388614e-05]
 [  3.28675056e-02]
 [  1.16999121e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  92 / Last logScore:  -17024217.6665 / New log score:  -17024192.2761 / Difference attained:  25.3904032037
Current pi parameter:  [[  3.72162736e-02]
 [  9.11700474e-06]
 [  3.10165462e-02]
 [  4.65274304e-02]
 [  6.43124548e-02]
 [  1.72294969e-06]
 [  6.54927254e-02]
 [  2.71827027e-05]
 [  5.89608987e-02]
 [  8.60511426e-06]
 [  1.08896710e-05]
 [  4.69932909e-06]
 [  5.33771642e-06]
 [  1.72324660e-04]
 [  6.49459065e-02]
 [  3.75777110e-02]
 [  5.27284974e-02]
 [  1.87249732e-05]
 [  4.10151224e-02]
 [  3.70503566e-02]
 [  1.72325600e-04]
 [  5.70168646e-02]
 [  6.45182534e-06]
 [  2.70542253e-02]
 [  1.57297163e-04]
 [  7.26951732e-02]
 [  3.91188197e-02]
 [  2.84347051e-02]
 [  7.68884460e-02]
 [  3.99717782e-02]
 [  4.03216007e-02]
 [  4.80888469e-02]
 [  7.69426856e-05]
 [  3.28822954e-02]
 [  1.17004936e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  93 / Last logScore:  -17024192.2761 / New log score:  -17024174.7727 / Difference attained:  17.5034335256
Current pi parameter:  [[  3.72146200e-02]
 [  9.11731495e-06]
 [  3.10116460e-02]
 [  4.65268576e-02]
 [  6.41769894e-02]
 [  1.72294969e-06]
 [  6.55805548e-02]
 [  2.71836276e-05]
 [  5.89777291e-02]
 [  8.60511426e-06]
 [  1.08900415e-05]
 [  4.69932909e-06]
 [  5.33789803e-06]
 [  1.72324660e-04]
 [  6.48356422e-02]
 [  3.76241601e-02]
 [  5.27300210e-02]
 [  1.87256104e-05]
 [  4.10151297e-02]
 [  3.70501869e-02]
 [  1.72325600e-04]
 [  5.70187488e-02]
 [  6.45204487e-06]
 [  2.70542596e-02]
 [  1.57297163e-04]
 [  7.26329894e-02]
 [  3.91186709e-02]
 [  2.84347931e-02]
 [  7.69677955e-02]
 [  3.99714352e-02]
 [  4.03144270e-02]
 [  4.81765244e-02]
 [  7.69453036e-05]
 [  3.28834917e-02]
 [  1.17008917e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  94 / Last logScore:  -17024174.7727 / New log score:  -17024165.1601 / Difference attained:  9.61258294806
Current pi parameter:  [[  3.72138525e-02]
 [  9.11742070e-06]
 [  3.09987655e-02]
 [  4.65257951e-02]
 [  6.41585298e-02]
 [  1.72294969e-06]
 [  6.56599462e-02]
 [  2.71839429e-05]
 [  5.89943837e-02]
 [  8.60511426e-06]
 [  1.08901679e-05]
 [  4.69932909e-06]
 [  5.33795995e-06]
 [  1.72324660e-04]
 [  6.47006914e-02]
 [  3.76004976e-02]
 [  5.27306830e-02]
 [  1.87258276e-05]
 [  4.10151314e-02]
 [  3.70501400e-02]
 [  1.72325600e-04]
 [  5.70205729e-02]
 [  6.45211971e-06]
 [  2.70542511e-02]
 [  1.57297163e-04]
 [  7.25341381e-02]
 [  3.91186844e-02]
 [  2.84346665e-02]
 [  7.71250059e-02]
 [  3.99715730e-02]
 [  4.03079833e-02]
 [  4.82178435e-02]
 [  7.69461961e-05]
 [  3.28835357e-02]
 [  1.17010274e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  95 / Last logScore:  -17024165.1601 / New log score:  -17024148.983 / Difference attained:  16.1771118529
Current pi parameter:  [[  3.72134141e-02]
 [  9.11763820e-06]
 [  3.09227153e-02]
 [  4.65249744e-02]
 [  6.41590403e-02]
 [  1.72294969e-06]
 [  6.56635566e-02]
 [  2.71845914e-05]
 [  5.90108559e-02]
 [  8.60511426e-06]
 [  1.08904277e-05]
 [  4.69932909e-06]
 [  5.33808729e-06]
 [  1.72324660e-04]
 [  6.46251436e-02]
 [  3.76000893e-02]
 [  5.27310030e-02]
 [  1.87262743e-05]
 [  4.10151349e-02]
 [  3.70501304e-02]
 [  1.72325600e-04]
 [  5.70213053e-02]
 [  6.45227362e-06]
 [  2.70542437e-02]
 [  1.57297163e-04]
 [  7.24650077e-02]
 [  3.91187333e-02]
 [  2.84337822e-02]
 [  7.73067085e-02]
 [  3.99721380e-02]
 [  4.03283237e-02]
 [  4.82177468e-02]
 [  7.69480317e-05]
 [  3.28826197e-02]
 [  1.17013066e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  96 / Last logScore:  -17024148.983 / New log score:  -17024119.7474 / Difference attained:  29.2356372662
Current pi parameter:  [[  3.72131469e-02]
 [  9.11789921e-06]
 [  3.08459223e-02]
 [  4.65243403e-02]
 [  6.41594518e-02]
 [  1.72294969e-06]
 [  6.57551332e-02]
 [  2.71853696e-05]
 [  5.90264043e-02]
 [  8.60511426e-06]
 [  1.08907394e-05]
 [  4.69932909e-06]
 [  5.33824010e-06]
 [  1.72324660e-04]
 [  6.45627555e-02]
 [  3.76001157e-02]
 [  5.27305917e-02]
 [  1.87268103e-05]
 [  4.10151217e-02]
 [  3.70501285e-02]
 [  1.72325600e-04]
 [  5.70214989e-02]
 [  6.45245833e-06]
 [  2.70542407e-02]
 [  1.57297163e-04]
 [  7.23910373e-02]
 [  3.91187794e-02]
 [  2.84311041e-02]
 [  7.74322109e-02]
 [  3.99736910e-02]
 [  4.03137081e-02]
 [  4.82177131e-02]
 [  7.69502345e-05]
 [  3.28795663e-02]
 [  1.17016415e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  97 / Last logScore:  -17024119.7474 / New log score:  -17024073.0004 / Difference attained:  46.746946197
Current pi parameter:  [[  3.72129634e-02]
 [  9.11818255e-06]
 [  3.07675998e-02]
 [  4.65237706e-02]
 [  6.41598604e-02]
 [  1.72294969e-06]
 [  6.58361230e-02]
 [  2.71862144e-05]
 [  5.90364959e-02]
 [  8.60511426e-06]
 [  1.08910778e-05]
 [  4.69932909e-06]
 [  5.33840599e-06]
 [  1.72324660e-04]
 [  6.43948253e-02]
 [  3.76001250e-02]
 [  5.27295436e-02]
 [  1.87273923e-05]
 [  4.10151353e-02]
 [  3.70501303e-02]
 [  1.72325600e-04]
 [  5.70218265e-02]
 [  6.45265885e-06]
 [  2.70542366e-02]
 [  1.57297163e-04]
 [  7.23881368e-02]
 [  3.91187526e-02]
 [  2.84250082e-02]
 [  7.76861435e-02]
 [  3.99771607e-02]
 [  4.02312736e-02]
 [  4.82177098e-02]
 [  7.69526257e-05]
 [  3.28698357e-02]
 [  1.17020052e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  98 / Last logScore:  -17024073.0004 / New log score:  -17024035.7481 / Difference attained:  37.252278436
Current pi parameter:  [[  3.72128037e-02]
 [  9.11846671e-06]
 [  3.06803017e-02]
 [  4.65231912e-02]
 [  6.41603577e-02]
 [  1.72294969e-06]
 [  6.58463811e-02]
 [  2.71870616e-05]
 [  5.90081950e-02]
 [  8.60511426e-06]
 [  1.08914172e-05]
 [  4.69932909e-06]
 [  5.33857235e-06]
 [  1.72324660e-04]
 [  6.43161493e-02]
 [  3.76001267e-02]
 [  5.27271297e-02]
 [  1.87279759e-05]
 [  4.10151644e-02]
 [  3.70501356e-02]
 [  1.72325600e-04]
 [  5.70227778e-02]
 [  6.45285993e-06]
 [  2.70542285e-02]
 [  1.57297163e-04]
 [  7.24017267e-02]
 [  3.91181075e-02]
 [  2.83888771e-02]
 [  7.80918318e-02]
 [  3.99734594e-02]
 [  4.00872343e-02]
 [  4.82177090e-02]
 [  7.69550239e-05]
 [  3.28207632e-02]
 [  1.17023698e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  99 / Last logScore:  -17024035.7481 / New log score:  -17024001.1059 / Difference attained:  34.6422509365
Current pi parameter:  [[  3.72125132e-02]
 [  9.11862181e-06]
 [  3.06149818e-02]
 [  4.65225329e-02]
 [  6.41609737e-02]
 [  1.72294969e-06]
 [  6.58479857e-02]
 [  2.71875240e-05]
 [  5.89251362e-02]
 [  8.60511426e-06]
 [  1.08916025e-05]
 [  4.69932909e-06]
 [  5.33866316e-06]
 [  1.72324660e-04]
 [  6.42861175e-02]
 [  3.76001244e-02]
 [  5.27203255e-02]
 [  1.87282945e-05]
 [  4.10151746e-02]
 [  3.70501548e-02]
 [  1.72325600e-04]
 [  5.70277106e-02]
 [  6.45296969e-06]
 [  2.70542136e-02]
 [  1.57297163e-04]
 [  7.24700814e-02]
 [  3.91145613e-02]
 [  2.82640669e-02]
 [  7.85323188e-02]
 [  3.99441271e-02]
 [  4.00279555e-02]
 [  4.82177054e-02]
 [  7.69563328e-05]
 [  3.27078876e-02]
 [  1.17025689e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
M-step...
Number of clusters:  35 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  100 / Last logScore:  -17024001.1059 / New log score:  -17023974.259 / Difference attained:  26.8468308747
Current pi parameter:  [[  3.72117307e-02]
 [  9.11940040e-06]
 [  3.05322285e-02]
 [  4.65216915e-02]
 [  6.41618805e-02]
 [  1.72294969e-06]
 [  6.58534054e-02]
 [  2.71898454e-05]
 [  5.87882277e-02]
 [  8.60511426e-06]
 [  1.08925325e-05]
 [  4.69932909e-06]
 [  5.33911900e-06]
 [  1.72324660e-04]
 [  6.42754622e-02]
 [  3.76001160e-02]
 [  5.26878645e-02]
 [  1.87298936e-05]
 [  4.10151974e-02]
 [  3.70501986e-02]
 [  1.72325600e-04]
 [  5.70433194e-02]
 [  6.45352068e-06]
 [  2.70541917e-02]
 [  1.57297163e-04]
 [  7.23692315e-02]
 [  3.91076994e-02]
 [  2.82629908e-02]
 [  7.88760462e-02]
 [  3.98972138e-02]
 [  4.00983247e-02]
 [  4.82176864e-02]
 [  7.69629037e-05]
 [  3.26919273e-02]
 [  1.17035681e-05]]
E-step ...
Number of clusters:  35 / Number of bins:  300
WARNING! The EM did not converge! 
In [40]:
results_300 = readjustEM(X_300.values, 
                     L, 
                     B, 
                     P_300,
                     Pi_300,
                     Rpost_300,
                     logScore_300,
                     logScores_300,
                     1,
                     0.01,
                     maxIterations = 300
                    )
Relative threshold under which the cluster is considered to disappear:  0.00028571428571428574
Disappearing indexes :  [ 1  5  7  9 10 11 12 13 17 20 22 24 32 34]
There exist disapearing mixture proportions! Running adjusted EM...
New adjusted number of clusters :  21
[ 0.03723718  0.03055311  0.0465535   0.06420576  0.06589844  0.05882843
  0.06431942  0.03762583  0.05272389  0.04104324  0.03707553  0.05708233
  0.02707269  0.07241872  0.03913444  0.02828232  0.07892998  0.0399245
  0.04012575  0.04825066  0.03271428]
Current pi parameter:  [ 0.03723718  0.03055311  0.0465535   0.06420576  0.06589844  0.05882843
  0.06431942  0.03762583  0.05272389  0.04104324  0.03707553  0.05708233
  0.02707269  0.07241872  0.03913444  0.02828232  0.07892998  0.0399245
  0.04012575  0.04825066  0.03271428]
Compute likelihood using current responsibility...
Number of bins:   300
Initial logScore:  -17025766.3798
E-step ...
Number of clusters:  21 / Number of bins:  300
M-step...
Number of clusters:  21 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  1 / Last logScore:  -17025766.3798 / New log score:  -17025719.2652 / Difference attained:  47.1145917736
Current pi parameter:  [[ 0.03721917]
 [ 0.03048881]
 [ 0.04669699]
 [ 0.06416429]
 [ 0.06586566]
 [ 0.05877902]
 [ 0.0642698 ]
 [ 0.03760028]
 [ 0.05273771]
 [ 0.04101664]
 [ 0.037058  ]
 [ 0.0570539 ]
 [ 0.02705435]
 [ 0.07234352]
 [ 0.03911091]
 [ 0.02826615]
 [ 0.07916594]
 [ 0.04002793]
 [ 0.04017573]
 [ 0.04821771]
 [ 0.03268747]]
E-step ...
Number of clusters:  21 / Number of bins:  300
M-step...
Number of clusters:  21 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  2 / Last logScore:  -17025719.2652 / New log score:  -17025701.6962 / Difference attained:  17.5689461455
Current pi parameter:  [[ 0.0372203 ]
 [ 0.03041127]
 [ 0.04668699]
 [ 0.06417492]
 [ 0.06583346]
 [ 0.05877876]
 [ 0.06426823]
 [ 0.03760027]
 [ 0.05272832]
 [ 0.0410201 ]
 [ 0.0370602 ]
 [ 0.05706219]
 [ 0.02705427]
 [ 0.07233782]
 [ 0.03898269]
 [ 0.0282667 ]
 [ 0.07916584]
 [ 0.04013   ]
 [ 0.04032129]
 [ 0.04821766]
 [ 0.03267871]]
E-step ...
Number of clusters:  21 / Number of bins:  300
M-step...
Number of clusters:  21 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  3 / Last logScore:  -17025701.6962 / New log score:  -17025686.0186 / Difference attained:  15.6775996909
Current pi parameter:  [[ 0.037221  ]
 [ 0.03050992]
 [ 0.0466146 ]
 [ 0.06424699]
 [ 0.06571201]
 [ 0.05877838]
 [ 0.06426499]
 [ 0.03760028]
 [ 0.05272542]
 [ 0.04102071]
 [ 0.03706158]
 [ 0.05706964]
 [ 0.02705437]
 [ 0.07233421]
 [ 0.03897954]
 [ 0.02826689]
 [ 0.07916445]
 [ 0.04016062]
 [ 0.04032503]
 [ 0.04821764]
 [ 0.03267175]]
E-step ...
Number of clusters:  21 / Number of bins:  300
M-step...
Number of clusters:  21 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  4 / Last logScore:  -17025686.0186 / New log score:  -17025679.074 / Difference attained:  6.94462605938
Current pi parameter:  [[ 0.03722141]
 [ 0.03054146]
 [ 0.04653297]
 [ 0.0643221 ]
 [ 0.06569419]
 [ 0.0587783 ]
 [ 0.06425662]
 [ 0.03760032]
 [ 0.05272404]
 [ 0.04102086]
 [ 0.03706261]
 [ 0.05708143]
 [ 0.0270544 ]
 [ 0.07232865]
 [ 0.03897949]
 [ 0.02826698]
 [ 0.07916364]
 [ 0.04016143]
 [ 0.04032524]
 [ 0.04821774]
 [ 0.03266613]]
E-step ...
Number of clusters:  21 / Number of bins:  300
M-step...
Number of clusters:  21 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  5 / Last logScore:  -17025679.074 / New log score:  -17025666.729 / Difference attained:  12.3450129442
Current pi parameter:  [[ 0.03722164]
 [ 0.03067452]
 [ 0.04653272]
 [ 0.06431259]
 [ 0.06557873]
 [ 0.05877828]
 [ 0.06424269]
 [ 0.03760038]
 [ 0.05272327]
 [ 0.04102086]
 [ 0.03706339]
 [ 0.05709494]
 [ 0.0270544 ]
 [ 0.07232501]
 [ 0.03897948]
 [ 0.02826704]
 [ 0.07916345]
 [ 0.04016165]
 [ 0.04032532]
 [ 0.04821791]
 [ 0.03266175]]
E-step ...
Number of clusters:  21 / Number of bins:  300
M-step...
Number of clusters:  21 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  6 / Last logScore:  -17025666.729 / New log score:  -17025659.4728 / Difference attained:  7.25621429458
Current pi parameter:  [[ 0.03722177]
 [ 0.03080602]
 [ 0.0465327 ]
 [ 0.06431026]
 [ 0.0656082 ]
 [ 0.05877827]
 [ 0.06420449]
 [ 0.03760038]
 [ 0.05272262]
 [ 0.04102078]
 [ 0.03706389]
 [ 0.05710074]
 [ 0.0270544 ]
 [ 0.07220179]
 [ 0.0389798 ]
 [ 0.02826708]
 [ 0.07916341]
 [ 0.04016171]
 [ 0.04032536]
 [ 0.0482179 ]
 [ 0.03265845]]
E-step ...
Number of clusters:  21 / Number of bins:  300
M-step...
Number of clusters:  21 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  7 / Last logScore:  -17025659.4728 / New log score:  -17025657.5258 / Difference attained:  1.94700316712
Current pi parameter:  [[ 0.03722184]
 [ 0.03084745]
 [ 0.0465327 ]
 [ 0.06430965]
 [ 0.06568726]
 [ 0.05877826]
 [ 0.064125  ]
 [ 0.03760037]
 [ 0.05272214]
 [ 0.04102079]
 [ 0.03706427]
 [ 0.05710406]
 [ 0.0270544 ]
 [ 0.07216003]
 [ 0.03898015]
 [ 0.02826711]
 [ 0.07916342]
 [ 0.04016172]
 [ 0.04032562]
 [ 0.04821789]
 [ 0.03265586]]
E-step ...
Number of clusters:  21 / Number of bins:  300
M-step...
Number of clusters:  21 / Number of bins:  300
Compute likelihood using current responsibility...
Number of bins:   300
Itération number:  8 / Last logScore:  -17025657.5258 / New log score:  -17025657.3931 / Difference attained:  0.132684484124
Current pi parameter:  [[ 0.03722188]
 [ 0.03084745]
 [ 0.0465327 ]
 [ 0.06430952]
 [ 0.06571261]
 [ 0.05877825]
 [ 0.064105  ]
 [ 0.03760037]
 [ 0.05272179]
 [ 0.04102081]
 [ 0.03706456]
 [ 0.0571063 ]
 [ 0.0270544 ]
 [ 0.07215292]
 [ 0.03898102]
 [ 0.02826714]
 [ 0.0791635 ]
 [ 0.04016172]
 [ 0.04032636]
 [ 0.04821788]
 [ 0.03265381]]
SUCCESS! EM converged! 
Disappearing indexes :  []

Visualização da clusterização

Dado o tamanho da dimensionalidade do conjunto de dados, se torna inviável a visualização dos resultados por meio de gráficos comuns, dessa forma buscou-se visualizar os clusters via Word Cloud. Já que o cerne do problema é texto, podemos criar um gráfico Word Cloud para representar a probabilidade de cada palavra. Dessa forma podemos deduzir qual cluster se refere a qual assunto.

Outra visualização possível é a visualização através do tempo, já que também temos o timestamp de cada artigo. Dessa forma, podemos visualizar qual é a distribuição temporal de cada cluster dentro do conjunto de dados no NIPS.

In [24]:
from wordcloud import WordCloud

def wordcloud_from_pred(groups_to_plot, predictions, dataset, titles=[], verbose=1):
    n_groups = np.max(predictions) + 1
    counts = [len([i for i in predictions if i == j]) for j in range(n_groups)]    

    if len(groups_to_plot) < 1:
        raise Exception('Need to select at least 1 group to plot')
    elif np.max(groups_to_plot) > n_groups or len(groups_to_plot) > n_groups + 1:
        raise Exception('Groups to plot exceeded the prediction groups: {} > {}'
                            .format(len(groups_to_plot), n_groups))
    
    for index, group in enumerate(groups_to_plot):
        rows_wth_sg = [i for i, x in enumerate(predictions) if x == group]
        dictionary = dataset.iloc[rows_wth_sg].sum(axis=0)
        legend = dictionary.nlargest(12).index.values
        dict_sg = dict(zip(dictionary.index.values, dictionary.values))

        wordcloud = WordCloud( background_color='white')
        wordcloud.generate_from_frequencies(frequencies=dict_sg)
        plt.figure()
        plt.imshow(wordcloud, interpolation="bilinear")
        plt.axis("off")
        
        group_cadidates_count = ('group {} with {} candidates'
                                     .format(group, counts[group]))
        try:
            title = titles[index]
            if title == '':
                raise Exception('Empty title')
        except Exception as e:
            title = group_cadidates_count
        
        plt.title(title)
        plt.show()
        
        if verbose > 0:
            print(group_cadidates_count)
            print(legend)
In [8]:
import re

def get_indexes_group(prediction, group):
    return [i for i, p in enumerate(prediction) if p == group]

def get_group_years(prediction, y):
    groups_years = []
    for group in set(sorted(prediction)):
        g_ind = get_indexes_group(prediction, group)
        g_years = y[g_ind]
        g_years = [int(re.search('\d+', year).group(0)) for year in g_years] 
        groups_years.append(g_years)
    
    return groups_years

def create_column(legend, start_index, end_index):
    column = ''
    for i in range(start_index, end_index):
        column += legend[i]
        if i < end_index - 1:
            column += '\n'
            
    return column

def plot_timeline(years, legend, title='Articles'):
    fig = plt.figure()
    ax = fig.add_subplot(111)
    props = dict(boxstyle='square', facecolor='white', alpha=0)

    first_column = create_column(legend, 0, int(len(legend)/2))
    second_column = create_column(legend, int(len(legend)/2), len(legend))

    ax.text(0.6, 0.95, first_column, transform=ax.transAxes, fontsize=12,
             multialignment = 'left' , verticalalignment='top', bbox=props)
    ax.text(0.8, 0.95, second_column, transform=ax.transAxes, fontsize=12,
             multialignment = 'left' , verticalalignment='top', bbox=props)

    x = np.arange(1987, 2016)
    count_articles_at_year = [years.count(year) for year in x]
    ax.plot(x, count_articles_at_year, color='red')

    plt.title('{} through the years'.format(title))
    plt.xlabel('Year')
    plt.xticks(x, rotation=60) 
    plt.ylabel('Articles')
    ax.grid(axis='x', linestyle='--', linewidth=0.3)
    plt.show()
    
    return fig
In [9]:
def get_sorted_clusters_count(prediction, n_clusters):
    counts = [(index, len([i for i in prediction if i == j])) for index, j in enumerate(np.arange(0, n_clusters))]
    sorted_counts = sorted(counts, key=lambda tup: tup[1], reverse=True)

    return sorted_counts

Visualização de 73 clusters

Dataset (5804, 300)

In [131]:
gmm_o = GaussianMixture(n_components=73, covariance_type='diag', max_iter=300).fit(X_300)
In [133]:
gmm_pred = gmm_o.predict(X_300)
In [238]:
sorted_counts = get_sorted_clusters_count(gmm_pred, 73)
print(sorted_counts)
[(28, 326), (56, 226), (16, 220), (70, 198), (0, 170), (23, 160), (18, 142), (46, 127), (11, 126), (38, 122), (72, 119), (6, 115), (32, 113), (5, 109), (7, 109), (9, 109), (47, 109), (62, 109), (19, 106), (55, 106), (14, 104), (50, 98), (13, 97), (51, 95), (64, 92), (49, 90), (25, 84), (59, 74), (8, 73), (43, 71), (61, 71), (63, 69), (22, 67), (65, 67), (48, 66), (26, 63), (10, 62), (31, 62), (53, 62), (37, 61), (12, 60), (44, 60), (24, 58), (54, 58), (30, 57), (52, 55), (66, 55), (3, 53), (45, 53), (69, 53), (2, 51), (17, 51), (41, 51), (60, 51), (71, 51), (21, 50), (33, 50), (34, 50), (29, 49), (35, 46), (68, 46), (15, 43), (27, 41), (42, 40), (58, 35), (39, 31), (1, 13), (57, 13), (36, 10), (20, 8), (40, 6), (4, 4), (67, 3)]

Aqui temos os 5 maiores clusters criados pelo GMM com 73 componentes. Podemos distinguir 2 temas de artigos apenas olhando as palavras mais frequentes nesse cluster.

  • Neural Network: Discriminado principalmente pelas palavras
    • 'neuron', 'cell', 'network', 'activate', 'connect', 'map'
  • Reinforcement Learning: Discriminado principalmente pelas palavra
    • 'policies', 'state', 'action', 'reward'
In [155]:
selected_groups = [i for i, n in sorted_counts]
wordcloud_from_pred(selected_groups[:5],
                    gmm_pred,
                    X_300,
                    titles=['Neural Network', '', 'Reinforcement Learning'])
group 28 with 326 candidates
['neuron' 'cell' 'network' 'activate' 'response' 'spike' 'pattern' 'output'
 'visual' 'connect' 'unit' 'map']
group 56 with 226 candidates
['bound' 'norm' 'matrix' 'optim' 'estimate' 'kernel' 'sample' 'theorem'
 'convex' 'regular' 'converge' 'rate']
group 16 with 220 candidates
['policies' 'state' 'action' 'optim' 'bound' 'reward' 'sample' 'estimate'
 'iter' 'gradient' 'converge' 'theorem']
group 70 with 198 candidates
['network' 'train' 'output' 'unit' 'dynam' 'estimate' 'hidden' 'optim'
 'state' 'predict' 'gradient' 'converge']
group 0 with 170 candidates
['network' 'train' 'recognition' 'unit' 'output' 'feature' 'image' 'speech'
 'word' 'layer' 'hidden' 'task']

Nesse momento podemos visualizar os clusters através do tempo, como cada assunto/cluster se comportou através dos anos.

Para essa visualização colocamos as 12 palavras mais frequentes em cada cluster e a contagem de artigos por ano.

Pode-se notar 3 grupos muito parecidos em suas palavras caracteristicas, onde todas podem remeter à "Reinforcement Learning", isso pode nos mostrar que nossos clusters não estão perfeitos e que alguns grupos podem ser somados em apenas um.

In [235]:
groups_years = get_group_years(gmm_pred, y)
reinforcement_learning = [10, 14, 16]
selected_groups = [(i, groups_years[i]) for i in reinforcement_learning]

for group, years_group in selected_groups:
    group_indexes = get_indexes_group(gmm_pred, group)
    dictionary = X_300.iloc[group_indexes].sum(axis=0)
    legend = dictionary.nlargest(12).index.values
    
    plot_timeline(years_group, legend, title='Group {}'.format(group))

Visualização de 21 clusters

Dataset (5804, 300)

In [13]:
from sklearn.mixture import GaussianMixture
gmm_21 = GaussianMixture(n_components=21, covariance_type='diag', max_iter=300).fit(X_300)
In [14]:
gmm_21_pred = gmm_21.predict(X_300)
In [25]:
sorted_counts = get_sorted_clusters_count(gmm_21_pred, 21)
print(sorted_counts)
[(20, 578), (18, 508), (6, 455), (2, 382), (3, 352), (12, 332), (11, 329), (9, 311), (7, 309), (8, 306), (13, 230), (4, 226), (17, 204), (19, 196), (16, 188), (0, 184), (15, 160), (1, 158), (5, 152), (10, 136), (14, 108)]
In [40]:
selected_groups = [i for i, n in sorted_counts]
titles = ['Neural Networks', 'Deep Learning', 'kernel methods', 'Reinforcement Learning', '']
wordcloud_from_pred(selected_groups[:5],
                    gmm_21_pred,
                    X_300,
                   titles = titles)
group 20 with 578 candidates
['network' 'neuron' 'cell' 'activate' 'response' 'output' 'unit' 'pattern'
 'visual' 'spike' 'connect' 'signal']
group 18 with 508 candidates
['network' 'train' 'unit' 'output' 'hidden' 'state' 'pattern' 'layer'
 'recognition' 'net' 'feature' 'estimate']
group 6 with 455 candidates
['kernel' 'estimate' 'train' 'optim' 'matrix' 'feature' 'class' 'sample'
 'bound' 'regular' 'theorem' 'classification']
group 2 with 382 candidates
['state' 'policies' 'action' 'optim' 'reward' 'sample' 'estimate' 'bound'
 'control' 'iter' 'converge' 'dynam']
group 3 with 352 candidates
['bound' 'loss' 'optim' 'theorem' 'sample' 'rate' 'convex' 'estimate'
 'class' 'train' 'online' 'predict']
In [42]:
groups_years = get_group_years(gmm_21_pred, y_300)
selected_groups = selected_groups
selected_groups_21 = [(i, groups_years[i]) for i in selected_groups]

j=0
for group, years_group in selected_groups_21[:5]:
    group_indexes = get_indexes_group(gmm_21_pred, group)
    dictionary = X_300.iloc[group_indexes].sum(axis=0)
    legend = dictionary.nlargest(12).index.values
    
    plot_timeline(years_group, legend, title='{}'.format(titles[j]))
    j+=1

Conclusão

Dessa forma podemos dizer que o melhor resultado e $K$ escolhido, dentro do escopo realizado foi $K = 21$ para um dataset de 300 palavras. Dito isso, tal resultado diferiu do que foi lido na literatura, porém acreditamos que bons resultados foram alcançados e o objetivo sobre o aprendizado para esse problema foi aprendido. Foi adquirido um conhecimento sobre como atacar problemas não supervisionados, como lidar com situações onde não existem labels para os dados e há pouca explicação para o conjunto de dados. Porém, existem pontos onde poderiamos melhorar nossa solução, em um cenário onde o recurso tempo não fosse um atrapalhador, poderiamos gerar mais análises mesmo com baixo recurso computacional, levando assim a possíveis descobertas que não foram possíveis por falta de análise. Outro ponto que poderíamos melhorar é na pesquisa e leitura de mais material da literatura, já que existem muitas fontes e muitos pontos inexplorados como Self Organizing Maps, DBSCAN e demais modelos para aprendizado não supervisionado. Portanto, cremos que foi atingido um bom patamar com o resultado entregue, porém há o que melhorar.


Segmentation Fault - GitHub
UnB - Universidade de Brasília - 2017