import numpy as np
import pandas as pd
import matplotlib.pyplot as plt
from time import time
%matplotlib notebook
dataset = pd.read_csv('NIPS_1987-2015_transpose.csv')
dataset = dataset.drop('Unnamed: 0', axis=1)
X = pd.read_csv('NIPS_1987-2015_remodeled_755.csv')
y = X.loc[:, 'y']
X = X.drop('y', axis=1)
X_300 = pd.read_csv('NIPS_1987-2015_remodeled_300.csv')
y_300 = X_300.loc[:, 'y']
X_300 = X_300.drop('y', axis=1)
Modelo de mistura gaussiana são modelos probabilísticos para representar populações distribuidas de forma normalizada. Em geral, gaussian mixtures não necessitam de conhecimento prévio sobre qual subpopulação do conjunto de dados um certo ponto pertence, dessa forma se caracteriza como um modelo não-supervisionado, podendo aprender as subpopulações automaticamente.
Por ser um modelo probabilístico, podemos dizer que esse método é um K-Means mais ameno, onde a classificação de um ponto não é deterministico e sim é calculada uma probabilidade de tal ponto pertencer a um subconjunto.
Um exemplo disso é a imagem abaixo, onde podemos notar a pobabilidade de um ponto pertencer a um ou outro cluster
Para um modelo uni-dimensional temos a seguinte fórmula:
$$ p(x) = \sum_{i=1}^K\phi_i \mathcal{N}(x \;|\; \mu_i, \sigma_i) $$
$$ \mathcal{N}(x \;|\; \mu_i, \sigma_i) = \frac{1}{\sigma_i\sqrt{2\pi}} \exp\left(-\frac{(x-\mu_i)^2}{2\sigma_i^2}\right) $$
$$ \sum_{i=1}^K\phi_i = 1 $$
Onde, uma mistura de modelos gaussianos (GMM) é parametrizada por dois tipos de valores, os pesos dos componentes de mistura ($\phi_k$) e o componente de médias ($\mu_k$) e variâncias/covariâncias ($\sigma_k$), para cada componente $k_i$ no conjunto de $K$ componentes.
O algoritmo de EM é um procedimento eficiente e iterativo de calcular o Maximum Likelihood (máxima verossimilhança) na presença de dados faltantes. Com a utilização desse algoritmo temos o objetivo de estimar parâmetros do modelo para qual os dados são mais prováveis de apresentar.
Cada iteração do algoritmo de EM consiste me dois passos:
O processo se repete até o ponto de convergência do algoritmo, gerando um maximum likelihood.
Para essa etapa do problema encontramos diversos desafios, entre eles:
K Means, também chamado de médias móveis, realiza agrupamentos de pontos no conjunto de dados com base na distância de cada ponto para os centróides de cada cluster. Dessa forma esse método se torna dependente de uma boa inicialização de seus centróides e a criação de seus clusters são de forma deterministica.
Para o KMeans, foi utilizada o método do cotovelo (Elbow) juntamente com a métrica de silhueta e Calinski.
O método de Elbow análise o valor do erro quadrático entre os clusters (Within-Clusters Sum of Squares, WCSS) , no caso do sklearn a inertia.
A silhueta é definida pela formula
$$ S = \frac{(b-a)}{max(a,b)} $$
Sendo:
Esse coeficiente esta no intervalo $]-1,1 [$ sendo que quanto mais próximo de 1 o coeficiente é ótimo e quanto mais perto de -1 o pior, valores perto de 0 podem demonstrar overlapping entre os clusters.
Calinski analisa a dispersão média entre os clusters e quanto maior o seu valor melhor.
# importa o dataset
data = pd.read_csv('data_remake.csv')
# Descrição
print(data.head())
data.shape
Unnamed: 0 abalon abbeel abbot abbrevy abc abel abernethy abl \ 0 1987_1 0 0 0 0 0 0 0 2 1 1987_2 0 0 0 0 0 0 0 1 2 1987_3 0 0 0 0 0 0 0 2 3 1987_4 0 0 0 0 0 0 0 0 4 1987_5 0 0 0 0 0 0 0 1 abnorm ... zhou zhu zien zilberstein zon zoo zoom zou zoubin \ 0 0 ... 0 0 0 0 0 0 0 0 0 1 0 ... 0 0 0 0 0 0 0 0 0 2 0 ... 0 0 0 0 0 0 0 0 0 3 0 ... 0 0 0 0 0 0 0 0 0 4 0 ... 0 0 0 0 0 0 0 0 0 zurich 0 0 1 0 2 0 3 0 4 0 [5 rows x 5986 columns]
(5811, 5986)
import matplotlib.pyplot as plt
from sklearn.metrics import silhouette_score
from sklearn.metrics import calinski_harabaz_score
from sklearn.cluster import KMeans
def kmeans_analysis(input_data, tot_range=[1,20]):
"""
Método que realiza algumas análises no modelo KMeans.
As análises são plotadas e os vetores resultados são retornados ao final da função.
Métodos utilizados:
Elbow Method:
O método de Elbow análise o valor do erro quadrático entre os clusters, no caso do sklearn a inertia
Silhouette Score:
A silhueta é definida pela formula (b-a)/max(a,b) sendo:
- a: distância média entre um ponto e os outros da mesma classe.
- b: distância média entre um ponto e os outros da classe mais próxima.
Esse coeficiente esta no intervalo ]-1,1 [ sendo que quanto mais próximo de 1 o coeficiente é ótimo
e quanto mais perto de -1 o pior, valores perto de 0 podem demonstrar overlapping entre os clusters.
Calinski:
Calinski analisa a dispersão média entre os clusters e quanto maior o seu valor melhor.
Obs*: O método de calinski é um pouco mais complexo de explicar aqui, vou linkar referências ao
ao final do notebook.
"""
erro = []
silhueta = []
calinski = []
# Realiza para todos os k
for k in range(tot_range[0], tot_range[1]+1):
modelo = KMeans(n_clusters=k).fit(input_data)
# Inertia
erro.append(modelo.inertia_)
# Silhueta
silhueta.append( silhouette_score(input_data, modelo.labels_) )
# Calinski
calinski.append( calinski_harabaz_score(input_data, modelo.labels_) )
# Plot do Elbow Method
plt.figure(1)
plt.xlabel('Clusters')
plt.ylabel('Inertia')
plt.grid(True)
plt.xticks(range(tot_range[0], tot_range[1]+1))
plt.plot( range(tot_range[0], tot_range[1]+1), erro, c='blue')
plt.scatter(range(tot_range[0], tot_range[1]+1), erro, c='red')
# Plot Silhueta
plt.figure(2)
plt.xticks(range(tot_range[0], tot_range[1]+1))
plt.title('Silhueta')
plt.xlabel('Clusters')
plt.ylabel('Silhueta')
plt.grid(True)
plt.plot(range(tot_range[0], tot_range[1]+1), silhueta )
plt.scatter(range(tot_range[0], tot_range[1]+1), silhueta, c='red')
# Plot Calinski
plt.figure(3)
plt.xlabel('Clusters')
plt.ylabel('Y')
plt.xticks(range(tot_range[0], tot_range[1]+1))
plt.grid(True)
plt.plot(range(tot_range[0], tot_range[1]+1), calinski)
plt.scatter(range(tot_range[0], tot_range[1]+1), calinski, c='red')
plt.show()
return [erro ,calinski, silhueta]
kmeans_analysis(data.iloc[:1000, 1:5000], [2,50])
--------------------------------------------------------------------------- NameError Traceback (most recent call last) <ipython-input-6-82670fe8e8d3> in <module>() ----> 1 kmeans_analysis(data.iloc[:1000, 1:5000], [2,50]) <ipython-input-4-009a98977167> in kmeans_analysis(input_data, tot_range) 86 plt.show() 87 ---> 88 return result[erro ,calinski, silhueta] NameError: name 'result' is not defined
Para a escolha de um K ótimo, utilizamos a métrica BIC, juntamente com a AIC, que quando minimizadas apontam a melhor escolha de um K.
Em estatística o BIC é um critério para seleção de modelos dentro de um conjunto finito de modelos, sendo que o modelo com menor BIC é o escolhido. Para contornar o caso de overfitting o BIC adiciona um termo de penalização para o numero de parâmetros em um modelo. Pode ser usado para escolher o número de clusters de acordo com a complexidade intrínseca presente em um conjunto de dados.
from sklearn.mixture import GaussianMixture
Com o uso de GMM e coletando as métricas BIC e AIC, conseguimos plotar os gráficos seguintes. Porém, nenhum deles nos mostrou resultados utilizáveis, tanto pelos valores altamente discrepantes, como pela alta variação das métricas conforme o número de componentes aumentava.
n_components = np.arange(1, 10)
models_gmm = [GaussianMixture(n_components=n, covariance_type='full', max_iter=300).fit(X)
for n in n_components]
plt.plot(n_components, [m.bic(X) for m in models_gmm], label='BIC_GMM')
plt.plot(n_components, [m.aic(X) for m in models_gmm], label='AIC_GMM')
plt.legend(loc='best')
plt.xlabel('n_components')
plt.show()
n_components = np.arange(10, 25)
models_gmm = [GaussianMixture(n_components=n, covariance_type='full', max_iter=300).fit(X)
for n in n_components]
plt.plot(n_components, [m.bic(X) for m in models_gmm], label='BIC_GMM')
plt.plot(n_components, [m.aic(X) for m in models_gmm], label='AIC_GMM')
plt.legend(loc='best')
plt.xlabel('n_components')
plt.show()
n_components = np.arange(25, 35)
models_gmm = [GaussianMixture(n_components=n, covariance_type='full', max_iter=300).fit(X)
for n in n_components]
plt.plot(n_components, [m.bic(X) for m in models_gmm], label='BIC_GMM')
plt.plot(n_components, [m.aic(X) for m in models_gmm], label='AIC_GMM')
plt.legend(loc='best')
plt.xlabel('n_components')
plt.show()
gmms_diag = draw_aic_bic(np.arange(10, 300), X, title='Diag covariance', cov='diag')
Após tais testes recorremos a literatura [4] e encontramos uma implementação do algoritmo EM, onde é feita a proposta de um algoritimo robusto para EM, com diferente tipo de penalização (Kullback-Leibler). Essa proposta é feita para encontrar um número ótimo de clusters a partir da calibração da penalização.
Seguindo a literatura, testamos a aplicação de 100 clusters no nosso dataset com tamanho igual a $[5804x755]$, o que difere das 300 features apresentadas na literatura. Essa decisão foi tomada, com o objetivo que depois esse número de clusters seja reduzido utilizando as técnicas apresentadas no artigo.
from EM import expectationMaximisation2
thresholdConvergence = 1
epsilon = .01
deltaInit = 0
L = len(X)
B = 755
K = 100
P,Pi,Rpost,logScore,logScores = expectationMaximisation2(X.values,
K,
L,
B,
thresholdConvergence,
200)
1 -th short run of EM Compute likelihood using current responsibility... Number of bins: 755 Initial logScore: -111593790.555 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 2 -th short run of EM Compute likelihood using current responsibility... Number of bins: 755 Initial logScore: -105857470.069 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 3 -th short run of EM Compute likelihood using current responsibility... Number of bins: 755 Initial logScore: -123214254.018 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 4 -th short run of EM Compute likelihood using current responsibility... Number of bins: 755 Initial logScore: -112637265.636 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 5 -th short run of EM Compute likelihood using current responsibility... Number of bins: 755 Initial logScore: -109217488.48 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 6 -th short run of EM Compute likelihood using current responsibility... Number of bins: 755 Initial logScore: -106335920.263 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 7 -th short run of EM Compute likelihood using current responsibility... Number of bins: 755 Initial logScore: -113944546.816 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 8 -th short run of EM Compute likelihood using current responsibility... Number of bins: 755 Initial logScore: -103879551.479 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 9 -th short run of EM Compute likelihood using current responsibility... Number of bins: 755 Initial logScore: -106227420.009 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 10 -th short run of EM Compute likelihood using current responsibility... Number of bins: 755 Initial logScore: -101085078.82 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 11 -th short run of EM Compute likelihood using current responsibility... Number of bins: 755 Initial logScore: -108642866.794 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 12 -th short run of EM Compute likelihood using current responsibility... Number of bins: 755 Initial logScore: -119726529.461 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 13 -th short run of EM Compute likelihood using current responsibility... Number of bins: 755 Initial logScore: -113895530.042 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 14 -th short run of EM Compute likelihood using current responsibility... Number of bins: 755 Initial logScore: -104551884.838 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 15 -th short run of EM Compute likelihood using current responsibility... Number of bins: 755 Initial logScore: -104319542.857 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 16 -th short run of EM Compute likelihood using current responsibility... Number of bins: 755 Initial logScore: -110616055.716 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 17 -th short run of EM Compute likelihood using current responsibility... Number of bins: 755 Initial logScore: -93221010.8575 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 18 -th short run of EM Compute likelihood using current responsibility... Number of bins: 755 Initial logScore: -109561259.026 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 19 -th short run of EM Compute likelihood using current responsibility... Number of bins: 755 Initial logScore: -79276184.2579 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 20 -th short run of EM Compute likelihood using current responsibility... Number of bins: 755 Initial logScore: -95571793.6208 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 21 -th short run of EM Compute likelihood using current responsibility... Number of bins: 755 Initial logScore: -111817903.603 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 22 -th short run of EM Compute likelihood using current responsibility... Number of bins: 755 Initial logScore: -106040561.171 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 23 -th short run of EM Compute likelihood using current responsibility... Number of bins: 755 Initial logScore: -75923491.6215 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 24 -th short run of EM Compute likelihood using current responsibility... Number of bins: 755 Initial logScore: -122944770.245 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 25 -th short run of EM Compute likelihood using current responsibility... Number of bins: 755 Initial logScore: -111259017.621 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 E-step ... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 16 / Last logScore: -30567128.3959 / New log score: -30565605.5469 / Difference attained: 1522.84897841 Current pi parameter: [[ 1.72295089e-04] [ 3.34707609e-06] [ 1.18888707e-02] [ 1.37834689e-02] [ 1.72294969e-06] [ 1.34390120e-02] [ 1.43024063e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.61873799e-02] [ 2.23981538e-02] [ 2.87730434e-02] [ 1.72294969e-04] [ 4.20281909e-02] [ 3.17841202e-02] [ 4.61096427e-02] [ 5.16884907e-04] [ 1.27467085e-02] [ 1.94875194e-02] [ 1.72294969e-06] [ 1.37839430e-02] [ 2.62999454e-02] [ 1.72294969e-04] [ 1.33802889e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33802889e-05] [ 1.72294969e-06] [ 1.33802889e-05] [ 9.01048864e-06] [ 3.24623547e-02] [ 1.72294980e-04] [ 1.34249872e-02] [ 3.49784478e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 1.98822586e-02] [ 2.54971390e-02] [ 2.31622226e-02] [ 1.91229843e-02] [ 1.33802889e-05] [ 1.39425353e-02] [ 1.99033406e-05] [ 1.33802889e-05] [ 2.44655240e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.26948809e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.48105697e-02] [ 3.11828904e-02] [ 4.53976299e-02] [ 1.72294969e-04] [ 1.33802889e-05] [ 3.54973344e-02] [ 2.63610631e-02] [ 2.21741603e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33802889e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.75576289e-02] [ 1.72294982e-04] [ 1.33802889e-05] [ 1.72294969e-04] [ 1.33802889e-05] [ 1.72294969e-06] [ 1.94022274e-02] [ 2.17066535e-02] [ 1.60795221e-05] [ 1.03376981e-03] [ 2.39250484e-02] [ 3.33883893e-02] [ 2.18750670e-02] [ 1.72294969e-04] [ 1.04793138e-04] [ 2.00028925e-02] [ 1.72294969e-06] [ 1.27450966e-05] [ 1.41376490e-02] [ 1.33802889e-05] [ 1.60365912e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.06550659e-02] [ 1.54744180e-05] [ 1.72294969e-04] [ 3.10098491e-02] [ 1.33802889e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 17 / Last logScore: -30565605.5469 / New log score: -30564292.3275 / Difference attained: 1313.21944768 Current pi parameter: [[ 1.72295089e-04] [ 3.34707892e-06] [ 1.19643598e-02] [ 1.37835996e-02] [ 1.72294969e-06] [ 1.34390120e-02] [ 1.49886551e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.61859187e-02] [ 2.25721770e-02] [ 2.87727834e-02] [ 1.72294969e-04] [ 4.17660284e-02] [ 3.21650737e-02] [ 4.59523376e-02] [ 5.16884907e-04] [ 1.27060446e-02] [ 1.94610640e-02] [ 1.72294969e-06] [ 1.38041276e-02] [ 2.61888030e-02] [ 1.72294969e-04] [ 1.33803002e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803002e-05] [ 1.72294969e-06] [ 1.33803002e-05] [ 9.01049626e-06] [ 3.22053906e-02] [ 1.72294980e-04] [ 1.32916608e-02] [ 3.49658716e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.01533827e-02] [ 2.54249412e-02] [ 2.32965149e-02] [ 1.88750774e-02] [ 1.33803002e-05] [ 1.37854059e-02] [ 1.99033412e-05] [ 1.33803002e-05] [ 2.44651851e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.24680733e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.48108326e-02] [ 3.11828396e-02] [ 4.49684639e-02] [ 1.72294969e-04] [ 1.33803002e-05] [ 3.54668535e-02] [ 2.63610644e-02] [ 2.22263037e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803002e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.76602731e-02] [ 1.72294982e-04] [ 1.33803002e-05] [ 1.72294969e-04] [ 1.33803002e-05] [ 1.72294969e-06] [ 1.92383639e-02] [ 2.17076966e-02] [ 1.60795226e-05] [ 1.03376981e-03] [ 2.34853038e-02] [ 3.37326057e-02] [ 2.17640241e-02] [ 1.72294969e-04] [ 1.04793141e-04] [ 2.01585391e-02] [ 1.72294969e-06] [ 1.27451074e-05] [ 1.43004697e-02] [ 1.33803002e-05] [ 1.60365917e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.10199856e-02] [ 1.54744185e-05] [ 1.72294969e-04] [ 3.09647507e-02] [ 1.33803002e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 18 / Last logScore: -30564292.3275 / New log score: -30563598.8718 / Difference attained: 693.455669954 Current pi parameter: [[ 1.72295089e-04] [ 3.34707891e-06] [ 1.20605756e-02] [ 1.37872853e-02] [ 1.72294969e-06] [ 1.34390145e-02] [ 1.51688894e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.61847143e-02] [ 2.27481844e-02] [ 2.87717437e-02] [ 1.72294969e-04] [ 4.16233095e-02] [ 3.23356820e-02] [ 4.58452218e-02] [ 5.16884907e-04] [ 1.27505033e-02] [ 1.96018276e-02] [ 1.72294969e-06] [ 1.39573837e-02] [ 2.61880383e-02] [ 1.72294969e-04] [ 1.33803002e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803002e-05] [ 1.72294969e-06] [ 1.33803002e-05] [ 9.01049623e-06] [ 3.17483841e-02] [ 1.72294980e-04] [ 1.32667077e-02] [ 3.48063969e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.02493966e-02] [ 2.54986257e-02] [ 2.36763847e-02] [ 1.86375860e-02] [ 1.33803002e-05] [ 1.38156883e-02] [ 1.99033355e-05] [ 1.33803002e-05] [ 2.44654903e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.24375567e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.48301999e-02] [ 3.11348218e-02] [ 4.51066972e-02] [ 1.72294969e-04] [ 1.33803002e-05] [ 3.54946352e-02] [ 2.63611632e-02] [ 2.22300008e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803002e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.77240387e-02] [ 1.72294982e-04] [ 1.33803002e-05] [ 1.72294969e-04] [ 1.33803002e-05] [ 1.72294969e-06] [ 1.93122459e-02] [ 2.16772755e-02] [ 1.60795180e-05] [ 1.03376981e-03] [ 2.34529770e-02] [ 3.37721301e-02] [ 2.15386543e-02] [ 1.72294969e-04] [ 1.04793111e-04] [ 2.01567377e-02] [ 1.72294969e-06] [ 1.27451073e-05] [ 1.42999317e-02] [ 1.33803002e-05] [ 1.60365871e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.10354256e-02] [ 1.54744141e-05] [ 1.72294969e-04] [ 3.05383335e-02] [ 1.33803002e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 19 / Last logScore: -30563598.8718 / New log score: -30562965.8496 / Difference attained: 633.022204313 Current pi parameter: [[ 1.72295089e-04] [ 3.34708181e-06] [ 1.20606483e-02] [ 1.38013236e-02] [ 1.72294969e-06] [ 1.34390147e-02] [ 1.50087397e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.61845144e-02] [ 2.28719832e-02] [ 2.87717342e-02] [ 1.72294969e-04] [ 4.15238499e-02] [ 3.25665775e-02] [ 4.60557886e-02] [ 5.16884907e-04] [ 1.28266348e-02] [ 1.96545911e-02] [ 1.72294969e-06] [ 1.41605493e-02] [ 2.61809138e-02] [ 1.72294969e-04] [ 1.33803118e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803118e-05] [ 1.72294969e-06] [ 1.33803118e-05] [ 9.01050404e-06] [ 3.15945694e-02] [ 1.72294980e-04] [ 1.32666910e-02] [ 3.48040765e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.05110730e-02] [ 2.54935505e-02] [ 2.36050294e-02] [ 1.84790837e-02] [ 1.33803118e-05] [ 1.39803098e-02] [ 1.99033375e-05] [ 1.33803118e-05] [ 2.44656318e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.22223414e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.48104814e-02] [ 3.10129374e-02] [ 4.49551885e-02] [ 1.72294969e-04] [ 1.33803118e-05] [ 3.55508254e-02] [ 2.63612933e-02] [ 2.22599841e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803118e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.77163747e-02] [ 1.72294982e-04] [ 1.33803118e-05] [ 1.72294969e-04] [ 1.33803118e-05] [ 1.72294969e-06] [ 1.96409023e-02] [ 2.15128442e-02] [ 1.60795196e-05] [ 1.03376981e-03] [ 2.33735386e-02] [ 3.38062944e-02] [ 2.14212508e-02] [ 1.72294969e-04] [ 1.04793122e-04] [ 2.01264817e-02] [ 1.72294969e-06] [ 1.27451184e-05] [ 1.42996509e-02] [ 1.33803118e-05] [ 1.60365887e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.11745468e-02] [ 1.54744157e-05] [ 1.72294969e-04] [ 3.01780440e-02] [ 1.33803118e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 20 / Last logScore: -30562965.8496 / New log score: -30562532.4305 / Difference attained: 433.419134632 Current pi parameter: [[ 1.72295089e-04] [ 3.34708256e-06] [ 1.20606483e-02] [ 1.39539838e-02] [ 1.72294969e-06] [ 1.34390135e-02] [ 1.48355300e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.61758103e-02] [ 2.29158663e-02] [ 2.87609274e-02] [ 1.72294969e-04] [ 4.14590214e-02] [ 3.25636977e-02] [ 4.60293946e-02] [ 5.16884907e-04] [ 1.30472786e-02] [ 1.96869090e-02] [ 1.72294969e-06] [ 1.43008479e-02] [ 2.60165193e-02] [ 1.72294969e-04] [ 1.33803148e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803148e-05] [ 1.72294969e-06] [ 1.33803148e-05] [ 9.01050606e-06] [ 3.13658407e-02] [ 1.72294980e-04] [ 1.32666908e-02] [ 3.48037459e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.07534231e-02] [ 2.54703519e-02] [ 2.35447747e-02] [ 1.84351246e-02] [ 1.33803148e-05] [ 1.41595884e-02] [ 1.99033432e-05] [ 1.33803148e-05] [ 2.44657040e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.21813362e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.48104747e-02] [ 3.10132299e-02] [ 4.48892115e-02] [ 1.72294969e-04] [ 1.33803148e-05] [ 3.56648440e-02] [ 2.63612113e-02] [ 2.24026134e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803148e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.77119938e-02] [ 1.72294982e-04] [ 1.33803148e-05] [ 1.72294969e-04] [ 1.33803148e-05] [ 1.72294969e-06] [ 1.96306188e-02] [ 2.13439019e-02] [ 1.60795242e-05] [ 1.03376981e-03] [ 2.32597036e-02] [ 3.39456846e-02] [ 2.15504748e-02] [ 1.72294969e-04] [ 1.04793151e-04] [ 1.99941350e-02] [ 1.72294969e-06] [ 1.27451212e-05] [ 1.42971962e-02] [ 1.33803148e-05] [ 1.60365933e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.10975799e-02] [ 1.54744200e-05] [ 1.72294969e-04] [ 3.00649567e-02] [ 1.33803148e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 21 / Last logScore: -30562532.4305 / New log score: -30562039.1497 / Difference attained: 493.280765451 Current pi parameter: [[ 1.72295089e-04] [ 3.34708276e-06] [ 1.20606470e-02] [ 1.39848708e-02] [ 1.72294969e-06] [ 1.34390126e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.60679848e-02] [ 2.29183115e-02] [ 2.86136235e-02] [ 1.72294969e-04] [ 4.13518549e-02] [ 3.25568005e-02] [ 4.63315510e-02] [ 5.16884907e-04] [ 1.27500572e-02] [ 1.98092419e-02] [ 1.72294969e-06] [ 1.43028186e-02] [ 2.60165568e-02] [ 1.72294969e-04] [ 1.33803155e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803155e-05] [ 1.72294969e-06] [ 1.33803155e-05] [ 9.01050658e-06] [ 3.13474514e-02] [ 1.72294980e-04] [ 1.32666908e-02] [ 3.48022646e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.10216300e-02] [ 2.53345804e-02] [ 2.35004723e-02] [ 1.84326484e-02] [ 1.33803155e-05] [ 1.43668278e-02] [ 1.99033421e-05] [ 1.33803155e-05] [ 2.44657253e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20537467e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.48104134e-02] [ 3.11068252e-02] [ 4.47249230e-02] [ 1.72294969e-04] [ 1.33803155e-05] [ 3.56651866e-02] [ 2.63607123e-02] [ 2.25683830e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803155e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.75579831e-02] [ 1.72294982e-04] [ 1.33803155e-05] [ 1.72294969e-04] [ 1.33803155e-05] [ 1.72294969e-06] [ 1.96004861e-02] [ 2.12214427e-02] [ 1.60795233e-05] [ 1.03376981e-03] [ 2.32585960e-02] [ 3.41634178e-02] [ 2.16218365e-02] [ 1.72294969e-04] [ 1.04793146e-04] [ 2.00908916e-02] [ 1.72294969e-06] [ 1.27451220e-05] [ 1.42087481e-02] [ 1.33803155e-05] [ 1.60365924e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.11785358e-02] [ 1.54744192e-05] [ 1.72294969e-04] [ 2.99787403e-02] [ 1.33803155e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 22 / Last logScore: -30562039.1497 / New log score: -30561462.0996 / Difference attained: 577.050159786 Current pi parameter: [[ 1.72295089e-04] [ 3.34708262e-06] [ 1.20606473e-02] [ 1.41559139e-02] [ 1.72294969e-06] [ 1.34390115e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.59665602e-02] [ 2.29263154e-02] [ 2.86008382e-02] [ 1.72294969e-04] [ 4.13540980e-02] [ 3.24664747e-02] [ 4.64182209e-02] [ 5.16884907e-04] [ 1.25771054e-02] [ 1.98364906e-02] [ 1.72294969e-06] [ 1.43056910e-02] [ 2.60165828e-02] [ 1.72294969e-04] [ 1.33803150e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803150e-05] [ 1.72294969e-06] [ 1.33803150e-05] [ 9.01050623e-06] [ 3.12892822e-02] [ 1.72294980e-04] [ 1.32666907e-02] [ 3.48013166e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.10207333e-02] [ 2.51862730e-02] [ 2.31120099e-02] [ 1.84246518e-02] [ 1.33803150e-05] [ 1.44722842e-02] [ 1.99033442e-05] [ 1.33803150e-05] [ 2.44657226e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20531261e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.48101637e-02] [ 3.11853788e-02] [ 4.46839959e-02] [ 1.72294969e-04] [ 1.33803150e-05] [ 3.56652283e-02] [ 2.63606562e-02] [ 2.25733087e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803150e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.75308029e-02] [ 1.72294982e-04] [ 1.33803150e-05] [ 1.72294969e-04] [ 1.33803150e-05] [ 1.72294969e-06] [ 1.94694520e-02] [ 2.12126135e-02] [ 1.60795250e-05] [ 1.03376981e-03] [ 2.32561544e-02] [ 3.42867419e-02] [ 2.19703134e-02] [ 1.72294969e-04] [ 1.04793157e-04] [ 2.01587003e-02] [ 1.72294969e-06] [ 1.27451215e-05] [ 1.41283289e-02] [ 1.33803150e-05] [ 1.60365941e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.14262484e-02] [ 1.54744208e-05] [ 1.72294969e-04] [ 2.99783630e-02] [ 1.33803150e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 23 / Last logScore: -30561462.0996 / New log score: -30560402.0369 / Difference attained: 1060.06263352 Current pi parameter: [[ 1.72295089e-04] [ 3.34708213e-06] [ 1.20606481e-02] [ 1.46587929e-02] [ 1.72294969e-06] [ 1.34390114e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.61826459e-02] [ 2.30610972e-02] [ 2.86000607e-02] [ 1.72294969e-04] [ 4.13520897e-02] [ 3.23975863e-02] [ 4.62416399e-02] [ 5.16884907e-04] [ 1.25807300e-02] [ 1.99818650e-02] [ 1.72294969e-06] [ 1.43240247e-02] [ 2.60028491e-02] [ 1.72294969e-04] [ 1.33803130e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803130e-05] [ 1.72294969e-06] [ 1.33803130e-05] [ 9.01050491e-06] [ 3.13210389e-02] [ 1.72294980e-04] [ 1.32666907e-02] [ 3.47998632e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.08702832e-02] [ 2.52842123e-02] [ 2.24086701e-02] [ 1.82896498e-02] [ 1.33803130e-05] [ 1.44691883e-02] [ 1.99033471e-05] [ 1.33803130e-05] [ 2.44656666e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20529179e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.48101673e-02] [ 3.13575118e-02] [ 4.48044324e-02] [ 1.72294969e-04] [ 1.33803130e-05] [ 3.56652283e-02] [ 2.63606485e-02] [ 2.25750444e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803130e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.73854162e-02] [ 1.72294982e-04] [ 1.33803130e-05] [ 1.72294969e-04] [ 1.33803130e-05] [ 1.72294969e-06] [ 1.94690554e-02] [ 2.15359263e-02] [ 1.60795273e-05] [ 1.03376981e-03] [ 2.32379967e-02] [ 3.42869076e-02] [ 2.20496180e-02] [ 1.72294969e-04] [ 1.04793172e-04] [ 2.03321229e-02] [ 1.72294969e-06] [ 1.27451196e-05] [ 1.43004495e-02] [ 1.33803130e-05] [ 1.60365964e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.06525460e-02] [ 1.54744231e-05] [ 1.72294969e-04] [ 2.99781972e-02] [ 1.33803130e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 24 / Last logScore: -30560402.0369 / New log score: -30560071.2482 / Difference attained: 330.788684193 Current pi parameter: [[ 1.72295089e-04] [ 3.34708185e-06] [ 1.20606485e-02] [ 1.48377967e-02] [ 1.72294969e-06] [ 1.34390116e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.61692847e-02] [ 2.30876698e-02] [ 2.84576196e-02] [ 1.72294969e-04] [ 4.13506240e-02] [ 3.24116311e-02] [ 4.61754846e-02] [ 5.16884907e-04] [ 1.25976408e-02] [ 1.99850268e-02] [ 1.72294969e-06] [ 1.44745395e-02] [ 2.58442730e-02] [ 1.72294969e-04] [ 1.33803119e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803119e-05] [ 1.72294969e-06] [ 1.33803119e-05] [ 9.01050415e-06] [ 3.11265889e-02] [ 1.72294980e-04] [ 1.32666907e-02] [ 3.47953105e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.06757397e-02] [ 2.55677860e-02] [ 2.25444360e-02] [ 1.82637335e-02] [ 1.33803119e-05] [ 1.43104050e-02] [ 1.99033465e-05] [ 1.33803119e-05] [ 2.44654286e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527810e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.48000012e-02] [ 3.13578539e-02] [ 4.48673884e-02] [ 1.72294969e-04] [ 1.33803119e-05] [ 3.56652320e-02] [ 2.63606189e-02] [ 2.25799835e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803119e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.73821694e-02] [ 1.72294982e-04] [ 1.33803119e-05] [ 1.72294969e-04] [ 1.33803119e-05] [ 1.72294969e-06] [ 1.94692631e-02] [ 2.15367475e-02] [ 1.60795269e-05] [ 1.03376981e-03] [ 2.30880468e-02] [ 3.42870068e-02] [ 2.20331402e-02] [ 1.72294969e-04] [ 1.04793169e-04] [ 2.03466553e-02] [ 1.72294969e-06] [ 1.27451185e-05] [ 1.43004875e-02] [ 1.33803119e-05] [ 1.60365960e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.09000869e-02] [ 1.54744227e-05] [ 1.72294969e-04] [ 2.99776585e-02] [ 1.33803119e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 25 / Last logScore: -30560071.2482 / New log score: -30559627.9702 / Difference attained: 443.277990025 Current pi parameter: [[ 1.72295089e-04] [ 3.34708170e-06] [ 1.20606485e-02] [ 1.51619611e-02] [ 1.72294969e-06] [ 1.34390117e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.61064280e-02] [ 2.30877040e-02] [ 2.83275183e-02] [ 1.72294969e-04] [ 4.13506730e-02] [ 3.24743014e-02] [ 4.61756342e-02] [ 5.16884907e-04] [ 1.27492202e-02] [ 1.99854993e-02] [ 1.72294969e-06] [ 1.44943666e-02] [ 2.56718983e-02] [ 1.72294969e-04] [ 1.33803113e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803113e-05] [ 1.72294969e-06] [ 1.33803113e-05] [ 9.01050373e-06] [ 3.09978410e-02] [ 1.72294980e-04] [ 1.32666907e-02] [ 3.47456276e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.06632433e-02] [ 2.56715589e-02] [ 2.26705486e-02] [ 1.82643333e-02] [ 1.33803113e-05] [ 1.41276686e-02] [ 1.99033456e-05] [ 1.33803113e-05] [ 2.44653618e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527466e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.47722218e-02] [ 3.13579933e-02] [ 4.49834142e-02] [ 1.72294969e-04] [ 1.33803113e-05] [ 3.56652878e-02] [ 2.63605153e-02] [ 2.26299368e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803113e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.73816410e-02] [ 1.72294982e-04] [ 1.33803113e-05] [ 1.72294969e-04] [ 1.33803113e-05] [ 1.72294969e-06] [ 1.94693499e-02] [ 2.15368301e-02] [ 1.60795262e-05] [ 1.03376981e-03] [ 2.30880929e-02] [ 3.42871172e-02] [ 2.18816605e-02] [ 1.72294969e-04] [ 1.04793164e-04] [ 2.04607131e-02] [ 1.72294969e-06] [ 1.27451179e-05] [ 1.43004874e-02] [ 1.33803113e-05] [ 1.60365952e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.07687101e-02] [ 1.54744219e-05] [ 1.72294969e-04] [ 2.99580341e-02] [ 1.33803113e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 26 / Last logScore: -30559627.9702 / New log score: -30559160.7169 / Difference attained: 467.253318399 Current pi parameter: [[ 1.72295089e-04] [ 3.34708161e-06] [ 1.20606485e-02] [ 1.55074010e-02] [ 1.72294969e-06] [ 1.34390125e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.60186813e-02] [ 2.30877055e-02] [ 2.82390132e-02] [ 1.72294969e-04] [ 4.13506568e-02] [ 3.25637662e-02] [ 4.61765224e-02] [ 5.16884907e-04] [ 1.29195396e-02] [ 1.99855775e-02] [ 1.72294969e-06] [ 1.46505935e-02] [ 2.54992986e-02] [ 1.72294969e-04] [ 1.33803110e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803110e-05] [ 1.72294969e-06] [ 1.33803110e-05] [ 9.01050350e-06] [ 3.08481558e-02] [ 1.72294980e-04] [ 1.32666907e-02] [ 3.46320139e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.05035694e-02] [ 2.56712859e-02] [ 2.27429247e-02] [ 1.82804072e-02] [ 1.33803110e-05] [ 1.41271429e-02] [ 1.99033456e-05] [ 1.33803110e-05] [ 2.44656297e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527446e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.46490296e-02] [ 3.13581762e-02] [ 4.51322331e-02] [ 1.72294969e-04] [ 1.33803110e-05] [ 3.56652861e-02] [ 2.63604612e-02] [ 2.27442209e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803110e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.73685211e-02] [ 1.72294982e-04] [ 1.33803110e-05] [ 1.72294969e-04] [ 1.33803110e-05] [ 1.72294969e-06] [ 1.94694898e-02] [ 2.15365464e-02] [ 1.60795262e-05] [ 1.03376981e-03] [ 2.30881450e-02] [ 3.42870767e-02] [ 2.18814872e-02] [ 1.72294969e-04] [ 1.04793164e-04] [ 2.03367954e-02] [ 1.72294969e-06] [ 1.27451176e-05] [ 1.43004874e-02] [ 1.33803110e-05] [ 1.60365953e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.08435912e-02] [ 1.54744220e-05] [ 1.72294969e-04] [ 2.98019618e-02] [ 1.33803110e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 27 / Last logScore: -30559160.7169 / New log score: -30558475.6705 / Difference attained: 685.046415627 Current pi parameter: [[ 1.72295089e-04] [ 3.34708130e-06] [ 1.20606483e-02] [ 1.61420385e-02] [ 1.72294969e-06] [ 1.34390153e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.60884400e-02] [ 2.30877134e-02] [ 2.80839995e-02] [ 1.72294969e-04] [ 4.13891475e-02] [ 3.25632940e-02] [ 4.61785665e-02] [ 5.16884907e-04] [ 1.30216735e-02] [ 1.99873910e-02] [ 1.72294969e-06] [ 1.48419212e-02] [ 2.54991304e-02] [ 1.72294969e-04] [ 1.33803097e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803097e-05] [ 1.72294969e-06] [ 1.33803097e-05] [ 9.01050266e-06] [ 3.08412980e-02] [ 1.72294980e-04] [ 1.32666907e-02] [ 3.46321767e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.03801524e-02] [ 2.56715563e-02] [ 2.27430111e-02] [ 1.84352740e-02] [ 1.33803097e-05] [ 1.41268147e-02] [ 1.99033472e-05] [ 1.33803097e-05] [ 2.44631576e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527439e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.44668872e-02] [ 3.13585242e-02] [ 4.51145048e-02] [ 1.72294969e-04] [ 1.33803097e-05] [ 3.56652763e-02] [ 2.63604314e-02] [ 2.27443557e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803097e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.72284553e-02] [ 1.72294982e-04] [ 1.33803097e-05] [ 1.72294969e-04] [ 1.33803097e-05] [ 1.72294969e-06] [ 1.94695033e-02] [ 2.15364073e-02] [ 1.60795275e-05] [ 1.03376981e-03] [ 2.30881741e-02] [ 3.42871593e-02] [ 2.18823343e-02] [ 1.72294969e-04] [ 1.04793173e-04] [ 2.00202717e-02] [ 1.72294969e-06] [ 1.27451164e-05] [ 1.43004758e-02] [ 1.33803097e-05] [ 1.60365965e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.07588118e-02] [ 1.54744232e-05] [ 1.72294969e-04] [ 2.96350632e-02] [ 1.33803097e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 28 / Last logScore: -30558475.6705 / New log score: -30557625.5875 / Difference attained: 850.083014995 Current pi parameter: [[ 1.72295089e-04] [ 3.34708138e-06] [ 1.20606487e-02] [ 1.67141032e-02] [ 1.72294969e-06] [ 1.34390154e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.60503341e-02] [ 2.30878955e-02] [ 2.80823721e-02] [ 1.72294969e-04] [ 4.13508325e-02] [ 3.25630647e-02] [ 4.61189262e-02] [ 5.16884907e-04] [ 1.31531282e-02] [ 2.00221056e-02] [ 1.72294969e-06] [ 1.49897421e-02] [ 2.54991659e-02] [ 1.72294969e-04] [ 1.33803100e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803100e-05] [ 1.72294969e-06] [ 1.33803100e-05] [ 9.01050287e-06] [ 3.08414283e-02] [ 1.72294980e-04] [ 1.32666906e-02] [ 3.48027694e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.02940324e-02] [ 2.56716146e-02] [ 2.27434457e-02] [ 1.84362386e-02] [ 1.33803100e-05] [ 1.41265513e-02] [ 1.99033468e-05] [ 1.33803100e-05] [ 2.42928986e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527385e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.44658872e-02] [ 3.13587281e-02] [ 4.49669783e-02] [ 1.72294969e-04] [ 1.33803100e-05] [ 3.56652764e-02] [ 2.63604171e-02] [ 2.27442982e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803100e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.72106637e-02] [ 1.72294982e-04] [ 1.33803100e-05] [ 1.72294969e-04] [ 1.33803100e-05] [ 1.72294969e-06] [ 1.94694998e-02] [ 2.15363351e-02] [ 1.60795271e-05] [ 1.03376981e-03] [ 2.30881906e-02] [ 3.42872427e-02] [ 2.18814694e-02] [ 1.72294969e-04] [ 1.04793170e-04] [ 1.96081406e-02] [ 1.72294969e-06] [ 1.27451167e-05] [ 1.43002787e-02] [ 1.33803100e-05] [ 1.60365962e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.06746101e-02] [ 1.54744229e-05] [ 1.72294969e-04] [ 2.96347326e-02] [ 1.33803100e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 29 / Last logScore: -30557625.5875 / New log score: -30557313.4556 / Difference attained: 312.131922752 Current pi parameter: [[ 1.72295089e-04] [ 3.34708152e-06] [ 1.20606487e-02] [ 1.67126171e-02] [ 1.72294969e-06] [ 1.34390153e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.59270947e-02] [ 2.30881609e-02] [ 2.80816111e-02] [ 1.72294969e-04] [ 4.13505314e-02] [ 3.25629480e-02] [ 4.61896389e-02] [ 5.16884907e-04] [ 1.32692947e-02] [ 2.01557122e-02] [ 1.72294969e-06] [ 1.49897524e-02] [ 2.54991708e-02] [ 1.72294969e-04] [ 1.33803106e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803106e-05] [ 1.72294969e-06] [ 1.33803106e-05] [ 9.01050324e-06] [ 3.08413419e-02] [ 1.72294980e-04] [ 1.32666906e-02] [ 3.48044778e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.01603475e-02] [ 2.56716307e-02] [ 2.27433840e-02] [ 1.84369109e-02] [ 1.33803106e-05] [ 1.41265399e-02] [ 1.99033420e-05] [ 1.33803106e-05] [ 2.42926799e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527452e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.44656172e-02] [ 3.13588400e-02] [ 4.49673226e-02] [ 1.72294969e-04] [ 1.33803106e-05] [ 3.56652765e-02] [ 2.63604056e-02] [ 2.27437284e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803106e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.71715757e-02] [ 1.72294982e-04] [ 1.33803106e-05] [ 1.72294969e-04] [ 1.33803106e-05] [ 1.72294969e-06] [ 1.94694922e-02] [ 2.15362873e-02] [ 1.60795232e-05] [ 1.03376981e-03] [ 2.30883599e-02] [ 3.42874662e-02] [ 2.18814791e-02] [ 1.72294969e-04] [ 1.04793145e-04] [ 1.97378708e-02] [ 1.72294969e-06] [ 1.27451172e-05] [ 1.42997222e-02] [ 1.33803106e-05] [ 1.60365923e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.05213830e-02] [ 1.54744191e-05] [ 1.72294969e-04] [ 2.96347190e-02] [ 1.33803106e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 30 / Last logScore: -30557313.4556 / New log score: -30557151.8383 / Difference attained: 161.617293447 Current pi parameter: [[ 1.72295089e-04] [ 3.34708179e-06] [ 1.20606485e-02] [ 1.68802409e-02] [ 1.72294969e-06] [ 1.34390151e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.58425803e-02] [ 2.30873617e-02] [ 2.80809979e-02] [ 1.72294969e-04] [ 4.13503984e-02] [ 3.25629104e-02] [ 4.63444455e-02] [ 5.16884907e-04] [ 1.32675145e-02] [ 2.01572317e-02] [ 1.72294969e-06] [ 1.49897522e-02] [ 2.54990933e-02] [ 1.72294969e-04] [ 1.33803117e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803117e-05] [ 1.72294969e-06] [ 1.33803117e-05] [ 9.01050397e-06] [ 3.08413209e-02] [ 1.72294980e-04] [ 1.32666906e-02] [ 3.48044768e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.01594603e-02] [ 2.56716313e-02] [ 2.27434756e-02] [ 1.84375085e-02] [ 1.33803117e-05] [ 1.41279994e-02] [ 1.99033435e-05] [ 1.33803117e-05] [ 2.42926966e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527066e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.43843160e-02] [ 3.13588921e-02] [ 4.49673718e-02] [ 1.72294969e-04] [ 1.33803117e-05] [ 3.56652766e-02] [ 2.63603968e-02] [ 2.27436620e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803117e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.70377947e-02] [ 1.72294982e-04] [ 1.33803117e-05] [ 1.72294969e-04] [ 1.33803117e-05] [ 1.72294969e-06] [ 1.94694908e-02] [ 2.15361815e-02] [ 1.60795244e-05] [ 1.03376981e-03] [ 2.30897952e-02] [ 3.42875257e-02] [ 2.18814723e-02] [ 1.72294969e-04] [ 1.04793153e-04] [ 1.97325916e-02] [ 1.72294969e-06] [ 1.27451183e-05] [ 1.42334562e-02] [ 1.33803117e-05] [ 1.60365935e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.05693913e-02] [ 1.54744203e-05] [ 1.72294969e-04] [ 2.96347189e-02] [ 1.33803117e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 31 / Last logScore: -30557151.8383 / New log score: -30557108.5115 / Difference attained: 43.3268024996 Current pi parameter: [[ 1.72295089e-04] [ 3.34708180e-06] [ 1.20606485e-02] [ 1.68897436e-02] [ 1.72294969e-06] [ 1.34390151e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.58357587e-02] [ 2.30869728e-02] [ 2.80803309e-02] [ 1.72294969e-04] [ 4.13503761e-02] [ 3.25628895e-02] [ 4.63481216e-02] [ 5.16884907e-04] [ 1.32679056e-02] [ 2.01568240e-02] [ 1.72294969e-06] [ 1.49897522e-02] [ 2.54987704e-02] [ 1.72294969e-04] [ 1.33803117e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803117e-05] [ 1.72294969e-06] [ 1.33803117e-05] [ 9.01050399e-06] [ 3.08413159e-02] [ 1.72294980e-04] [ 1.32666906e-02] [ 3.48044770e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.01590924e-02] [ 2.56716313e-02] [ 2.27433925e-02] [ 1.84381674e-02] [ 1.33803117e-05] [ 1.41279745e-02] [ 1.99033399e-05] [ 1.33803117e-05] [ 2.42927012e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527056e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.42935927e-02] [ 3.13589179e-02] [ 4.49673777e-02] [ 1.72294969e-04] [ 1.33803117e-05] [ 3.56652767e-02] [ 2.63603586e-02] [ 2.27436547e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803117e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.70388948e-02] [ 1.72294982e-04] [ 1.33803117e-05] [ 1.72294969e-04] [ 1.33803117e-05] [ 1.72294969e-06] [ 1.94694911e-02] [ 2.15362209e-02] [ 1.60795216e-05] [ 1.03376981e-03] [ 2.30965947e-02] [ 3.42877031e-02] [ 2.18814720e-02] [ 1.72294969e-04] [ 1.04793134e-04] [ 1.98398253e-02] [ 1.72294969e-06] [ 1.27451183e-05] [ 1.41281936e-02] [ 1.33803117e-05] [ 1.60365906e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.06449403e-02] [ 1.54744175e-05] [ 1.72294969e-04] [ 2.96347189e-02] [ 1.33803117e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 32 / Last logScore: -30557108.5115 / New log score: -30556907.7881 / Difference attained: 200.723391443 Current pi parameter: [[ 1.72295089e-04] [ 3.34708183e-06] [ 1.20606483e-02] [ 1.69554911e-02] [ 1.72294969e-06] [ 1.34390151e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.57154546e-02] [ 2.30867435e-02] [ 2.80793970e-02] [ 1.72294969e-04] [ 4.13503758e-02] [ 3.25628908e-02] [ 4.63480883e-02] [ 5.16884907e-04] [ 1.32681360e-02] [ 2.01567530e-02] [ 1.72294969e-06] [ 1.49897522e-02] [ 2.54987192e-02] [ 1.72294969e-04] [ 1.33803118e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803118e-05] [ 1.72294969e-06] [ 1.33803118e-05] [ 9.01050408e-06] [ 3.08413147e-02] [ 1.72294980e-04] [ 1.32666906e-02] [ 3.48044771e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.01590247e-02] [ 2.56716311e-02] [ 2.27405826e-02] [ 1.84390947e-02] [ 1.33803118e-05] [ 1.41279491e-02] [ 1.99033397e-05] [ 1.33803118e-05] [ 2.42927022e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527055e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.42935930e-02] [ 3.13589309e-02] [ 4.49673783e-02] [ 1.72294969e-04] [ 1.33803118e-05] [ 3.56652770e-02] [ 2.63601602e-02] [ 2.27436539e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803118e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.70390827e-02] [ 1.72294982e-04] [ 1.33803118e-05] [ 1.72294969e-04] [ 1.33803118e-05] [ 1.72294969e-06] [ 1.94694911e-02] [ 2.15362143e-02] [ 1.60795214e-05] [ 1.03376981e-03] [ 2.32170972e-02] [ 3.42877378e-02] [ 2.18814719e-02] [ 1.72294969e-04] [ 1.04793133e-04] [ 2.00116160e-02] [ 1.72294969e-06] [ 1.27451184e-05] [ 1.39596981e-02] [ 1.33803118e-05] [ 1.60365905e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.05787318e-02] [ 1.54744174e-05] [ 1.72294969e-04] [ 2.96347189e-02] [ 1.33803118e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 33 / Last logScore: -30556907.7881 / New log score: -30556600.1162 / Difference attained: 307.671931278 Current pi parameter: [[ 1.72295089e-04] [ 3.34708193e-06] [ 1.20606483e-02] [ 1.72296011e-02] [ 1.72294969e-06] [ 1.34390151e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.56695521e-02] [ 2.30865882e-02] [ 2.80776215e-02] [ 1.72294969e-04] [ 4.13503662e-02] [ 3.25628739e-02] [ 4.63480044e-02] [ 5.16884907e-04] [ 1.32682919e-02] [ 2.01567359e-02] [ 1.72294969e-06] [ 1.49897522e-02] [ 2.54987112e-02] [ 1.72294969e-04] [ 1.33803122e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803122e-05] [ 1.72294969e-06] [ 1.33803122e-05] [ 9.01050437e-06] [ 3.08413144e-02] [ 1.72294980e-04] [ 1.32666906e-02] [ 3.48044772e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.01590042e-02] [ 2.56716311e-02] [ 2.26640746e-02] [ 1.84408667e-02] [ 1.33803122e-05] [ 1.41279388e-02] [ 1.99033392e-05] [ 1.33803122e-05] [ 2.42927024e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527054e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.42935930e-02] [ 3.13589374e-02] [ 4.49673784e-02] [ 1.72294969e-04] [ 1.33803122e-05] [ 3.56652953e-02] [ 2.63449740e-02] [ 2.27436538e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803122e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.70391180e-02] [ 1.72294982e-04] [ 1.33803122e-05] [ 1.72294969e-04] [ 1.33803122e-05] [ 1.72294969e-06] [ 1.94694913e-02] [ 2.15362142e-02] [ 1.60795210e-05] [ 1.03376981e-03] [ 2.32759127e-02] [ 3.42877428e-02] [ 2.18814715e-02] [ 1.72294969e-04] [ 1.04793130e-04] [ 2.01651682e-02] [ 1.72294969e-06] [ 1.27451188e-05] [ 1.39559807e-02] [ 1.33803122e-05] [ 1.60365901e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.02336728e-02] [ 1.54744170e-05] [ 1.72294969e-04] [ 2.96347189e-02] [ 1.33803122e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 34 / Last logScore: -30556600.1162 / New log score: -30556373.7423 / Difference attained: 226.373900313 Current pi parameter: [[ 1.72295089e-04] [ 3.34708226e-06] [ 1.20606483e-02] [ 1.73830499e-02] [ 1.72294969e-06] [ 1.34390151e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.56579492e-02] [ 2.30864736e-02] [ 2.80720571e-02] [ 1.72294969e-04] [ 4.13503639e-02] [ 3.25628627e-02] [ 4.63479762e-02] [ 5.16884907e-04] [ 1.32684066e-02] [ 2.01567316e-02] [ 1.72294969e-06] [ 1.49897522e-02] [ 2.54987101e-02] [ 1.72294969e-04] [ 1.33803135e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803135e-05] [ 1.72294969e-06] [ 1.33803135e-05] [ 9.01050524e-06] [ 3.08413144e-02] [ 1.72294980e-04] [ 1.32666882e-02] [ 3.48046936e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.01590015e-02] [ 2.56716308e-02] [ 2.25712303e-02] [ 1.84465373e-02] [ 1.33803135e-05] [ 1.41279354e-02] [ 1.99033392e-05] [ 1.33803135e-05] [ 2.42927023e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527055e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.42935930e-02] [ 3.13589408e-02] [ 4.49673773e-02] [ 1.72294969e-04] [ 1.33803135e-05] [ 3.56653516e-02] [ 2.61891393e-02] [ 2.27436538e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803135e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.70412747e-02] [ 1.72294982e-04] [ 1.33803135e-05] [ 1.72294969e-04] [ 1.33803135e-05] [ 1.72294969e-06] [ 1.94694915e-02] [ 2.15341152e-02] [ 1.60795210e-05] [ 1.03376981e-03] [ 2.34317326e-02] [ 3.42877031e-02] [ 2.18814714e-02] [ 1.72294969e-04] [ 1.04793131e-04] [ 2.03558270e-02] [ 1.72294969e-06] [ 1.27451201e-05] [ 1.39560067e-02] [ 1.33803135e-05] [ 1.60365901e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 1.99936577e-02] [ 1.54744170e-05] [ 1.72294969e-04] [ 2.96347189e-02] [ 1.33803135e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 35 / Last logScore: -30556373.7423 / New log score: -30556066.1094 / Difference attained: 307.632842518 Current pi parameter: [[ 1.72295089e-04] [ 3.34708208e-06] [ 1.20606483e-02] [ 1.75706956e-02] [ 1.72294969e-06] [ 1.34390151e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.54809821e-02] [ 2.30863836e-02] [ 2.80134460e-02] [ 1.72294969e-04] [ 4.13503604e-02] [ 3.25628608e-02] [ 4.63479490e-02] [ 5.16884907e-04] [ 1.32684963e-02] [ 2.01567339e-02] [ 1.72294969e-06] [ 1.49897522e-02] [ 2.54987003e-02] [ 1.72294969e-04] [ 1.33803128e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803128e-05] [ 1.72294969e-06] [ 1.33803128e-05] [ 9.01050477e-06] [ 3.08413144e-02] [ 1.72294980e-04] [ 1.32666455e-02] [ 3.48084004e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.01589992e-02] [ 2.56716297e-02] [ 2.25711621e-02] [ 1.85052422e-02] [ 1.33803128e-05] [ 1.41279341e-02] [ 1.99033375e-05] [ 1.33803128e-05] [ 2.42927022e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527056e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.42935930e-02] [ 3.13589438e-02] [ 4.49673755e-02] [ 1.72294969e-04] [ 1.33803128e-05] [ 3.56664345e-02] [ 2.61903748e-02] [ 2.27436538e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803128e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.72057388e-02] [ 1.72294982e-04] [ 1.33803128e-05] [ 1.72294969e-04] [ 1.33803128e-05] [ 1.72294969e-06] [ 1.94694915e-02] [ 2.14684460e-02] [ 1.60795196e-05] [ 1.03376981e-03] [ 2.34307206e-02] [ 3.42864382e-02] [ 2.18814714e-02] [ 1.72294969e-04] [ 1.04793122e-04] [ 2.07673429e-02] [ 1.72294969e-06] [ 1.27451194e-05] [ 1.39559868e-02] [ 1.33803128e-05] [ 1.60365887e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 1.94690010e-02] [ 1.54744156e-05] [ 1.72294969e-04] [ 2.96347189e-02] [ 1.33803128e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 36 / Last logScore: -30556066.1094 / New log score: -30555786.7034 / Difference attained: 279.406044222 Current pi parameter: [[ 1.72295089e-04] [ 3.34708219e-06] [ 1.20606484e-02] [ 1.77576539e-02] [ 1.72294969e-06] [ 1.34390151e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.53339033e-02] [ 2.30863102e-02] [ 2.79108697e-02] [ 1.72294969e-04] [ 4.13503653e-02] [ 3.25628621e-02] [ 4.63476874e-02] [ 5.16884907e-04] [ 1.32685700e-02] [ 2.01570654e-02] [ 1.72294969e-06] [ 1.49897522e-02] [ 2.54977902e-02] [ 1.72294969e-04] [ 1.33803133e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803133e-05] [ 1.72294969e-06] [ 1.33803133e-05] [ 9.01050507e-06] [ 3.08413144e-02] [ 1.72294980e-04] [ 1.32666419e-02] [ 3.49629949e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.01589025e-02] [ 2.56716297e-02] [ 2.25716234e-02] [ 1.86073566e-02] [ 1.33803133e-05] [ 1.41279649e-02] [ 1.99033378e-05] [ 1.33803133e-05] [ 2.42927022e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527056e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.42935930e-02] [ 3.13589655e-02] [ 4.49673696e-02] [ 1.72294969e-04] [ 1.33803133e-05] [ 3.56666442e-02] [ 2.61914995e-02] [ 2.27436539e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803133e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.72121041e-02] [ 1.72294982e-04] [ 1.33803133e-05] [ 1.72294969e-04] [ 1.33803133e-05] [ 1.72294969e-06] [ 1.94694924e-02] [ 2.13641766e-02] [ 1.60795199e-05] [ 1.03376981e-03] [ 2.34305343e-02] [ 3.42853204e-02] [ 2.18814726e-02] [ 1.72294969e-04] [ 1.04793123e-04] [ 2.08429622e-02] [ 1.72294969e-06] [ 1.27451198e-05] [ 1.39559933e-02] [ 1.33803133e-05] [ 1.60365890e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 1.92976609e-02] [ 1.54744159e-05] [ 1.72294969e-04] [ 2.96347189e-02] [ 1.33803133e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 37 / Last logScore: -30555786.7034 / New log score: -30555656.641 / Difference attained: 130.062337466 Current pi parameter: [[ 1.72295089e-04] [ 3.34708243e-06] [ 1.20606485e-02] [ 1.80738698e-02] [ 1.72294969e-06] [ 1.34390151e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.53253273e-02] [ 2.30862704e-02] [ 2.79083247e-02] [ 1.72294969e-04] [ 4.13503613e-02] [ 3.25628642e-02] [ 4.63470514e-02] [ 5.16884907e-04] [ 1.32686326e-02] [ 2.01571642e-02] [ 1.72294969e-06] [ 1.49897522e-02] [ 2.54974218e-02] [ 1.72294969e-04] [ 1.33803142e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803142e-05] [ 1.72294969e-06] [ 1.33803142e-05] [ 9.01050570e-06] [ 3.08413144e-02] [ 1.72294980e-04] [ 1.32666405e-02] [ 3.49761981e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.01588954e-02] [ 2.56716297e-02] [ 2.25743382e-02] [ 1.86071569e-02] [ 1.33803142e-05] [ 1.41281965e-02] [ 1.99033374e-05] [ 1.33803142e-05] [ 2.42927022e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527055e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.42935930e-02] [ 3.13595173e-02] [ 4.49673639e-02] [ 1.72294969e-04] [ 1.33803142e-05] [ 3.56666890e-02] [ 2.61931656e-02] [ 2.27436539e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803142e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.72123793e-02] [ 1.72294982e-04] [ 1.33803142e-05] [ 1.72294969e-04] [ 1.33803142e-05] [ 1.72294969e-06] [ 1.94694930e-02] [ 2.13645922e-02] [ 1.60795195e-05] [ 1.03376981e-03] [ 2.34304798e-02] [ 3.42836605e-02] [ 2.18814717e-02] [ 1.72294969e-04] [ 1.04793121e-04] [ 2.06239033e-02] [ 1.72294969e-06] [ 1.27451207e-05] [ 1.39559964e-02] [ 1.33803142e-05] [ 1.60365886e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 1.91953312e-02] [ 1.54744156e-05] [ 1.72294969e-04] [ 2.96347195e-02] [ 1.33803142e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 38 / Last logScore: -30555656.641 / New log score: -30555518.7404 / Difference attained: 137.900588814 Current pi parameter: [[ 1.72295089e-04] [ 3.34708246e-06] [ 1.20606484e-02] [ 1.84030270e-02] [ 1.72294969e-06] [ 1.34390151e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.53584019e-02] [ 2.30862190e-02] [ 2.79056495e-02] [ 1.72294969e-04] [ 4.13503615e-02] [ 3.25628674e-02] [ 4.63469597e-02] [ 5.16884907e-04] [ 1.32686877e-02] [ 2.01571828e-02] [ 1.72294969e-06] [ 1.49897522e-02] [ 2.54972755e-02] [ 1.72294969e-04] [ 1.33803143e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803143e-05] [ 1.72294969e-06] [ 1.33803143e-05] [ 9.01050578e-06] [ 3.08413144e-02] [ 1.72294980e-04] [ 1.32666386e-02] [ 3.49761547e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.01588951e-02] [ 2.56716297e-02] [ 2.25770433e-02] [ 1.86071214e-02] [ 1.33803143e-05] [ 1.41283414e-02] [ 1.99033373e-05] [ 1.33803143e-05] [ 2.42927022e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527055e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.42935930e-02] [ 3.13595561e-02] [ 4.49673553e-02] [ 1.72294969e-04] [ 1.33803143e-05] [ 3.56666987e-02] [ 2.61977017e-02] [ 2.27436538e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803143e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.72125070e-02] [ 1.72294982e-04] [ 1.33803143e-05] [ 1.72294969e-04] [ 1.33803143e-05] [ 1.72294969e-06] [ 1.94694932e-02] [ 2.13645342e-02] [ 1.60795195e-05] [ 1.03376981e-03] [ 2.34304564e-02] [ 3.42791416e-02] [ 2.18814716e-02] [ 1.72294969e-04] [ 1.04793120e-04] [ 2.04044684e-02] [ 1.72294969e-06] [ 1.27451208e-05] [ 1.39559964e-02] [ 1.33803143e-05] [ 1.60365885e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 1.90525474e-02] [ 1.54744155e-05] [ 1.72294969e-04] [ 2.96347217e-02] [ 1.33803143e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 39 / Last logScore: -30555518.7404 / New log score: -30555397.4201 / Difference attained: 121.320357114 Current pi parameter: [[ 1.72295089e-04] [ 3.34708248e-06] [ 1.20606491e-02] [ 1.86101602e-02] [ 1.72294969e-06] [ 1.34390151e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.54993697e-02] [ 2.30861703e-02] [ 2.79001684e-02] [ 1.72294969e-04] [ 4.13503636e-02] [ 3.25628692e-02] [ 4.63469363e-02] [ 5.16884907e-04] [ 1.32687372e-02] [ 2.01571864e-02] [ 1.72294969e-06] [ 1.49897522e-02] [ 2.54972151e-02] [ 1.72294969e-04] [ 1.33803144e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803144e-05] [ 1.72294969e-06] [ 1.33803144e-05] [ 9.01050585e-06] [ 3.08413144e-02] [ 1.72294980e-04] [ 1.32666334e-02] [ 3.49761536e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.01588953e-02] [ 2.56716297e-02] [ 2.25825348e-02] [ 1.86071038e-02] [ 1.33803144e-05] [ 1.41284439e-02] [ 1.99033373e-05] [ 1.33803144e-05] [ 2.42927022e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527055e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.42935930e-02] [ 3.13595547e-02] [ 4.49673318e-02] [ 1.72294969e-04] [ 1.33803144e-05] [ 3.56667008e-02] [ 2.62387552e-02] [ 2.27436538e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803144e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.72125637e-02] [ 1.72294982e-04] [ 1.33803144e-05] [ 1.72294969e-04] [ 1.33803144e-05] [ 1.72294969e-06] [ 1.94694937e-02] [ 2.13644427e-02] [ 1.60795194e-05] [ 1.03376981e-03] [ 2.34304633e-02] [ 3.42381324e-02] [ 2.18814712e-02] [ 1.72294969e-04] [ 1.04793120e-04] [ 2.03287373e-02] [ 1.72294969e-06] [ 1.27451209e-05] [ 1.39559964e-02] [ 1.33803144e-05] [ 1.60365885e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 1.87801590e-02] [ 1.54744154e-05] [ 1.72294969e-04] [ 2.96347323e-02] [ 1.33803144e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 40 / Last logScore: -30555397.4201 / New log score: -30555282.4567 / Difference attained: 114.963345651 Current pi parameter: [[ 1.72295089e-04] [ 3.34708246e-06] [ 1.20606488e-02] [ 1.87682919e-02] [ 1.72294969e-06] [ 1.34390151e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.55006941e-02] [ 2.30861253e-02] [ 2.78718489e-02] [ 1.72294969e-04] [ 4.13503898e-02] [ 3.25628703e-02] [ 4.63457442e-02] [ 5.16884907e-04] [ 1.32687828e-02] [ 2.01571872e-02] [ 1.72294969e-06] [ 1.49897522e-02] [ 2.54971898e-02] [ 1.72294969e-04] [ 1.33803143e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803143e-05] [ 1.72294969e-06] [ 1.33803143e-05] [ 9.01050578e-06] [ 3.08413143e-02] [ 1.72294980e-04] [ 1.32665692e-02] [ 3.49761535e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.01588969e-02] [ 2.56716291e-02] [ 2.26108630e-02] [ 1.86069949e-02] [ 1.33803143e-05] [ 1.41285208e-02] [ 1.99033376e-05] [ 1.33803143e-05] [ 2.42927022e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527055e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.42935930e-02] [ 3.13595534e-02] [ 4.49670558e-02] [ 1.72294969e-04] [ 1.33803143e-05] [ 3.56667013e-02] [ 2.63612226e-02] [ 2.27436538e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803143e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.72125882e-02] [ 1.72294982e-04] [ 1.33803143e-05] [ 1.72294969e-04] [ 1.33803143e-05] [ 1.72294969e-06] [ 1.94694984e-02] [ 2.13643764e-02] [ 1.60795197e-05] [ 1.03376981e-03] [ 2.34310376e-02] [ 3.41161811e-02] [ 2.18814708e-02] [ 1.72294969e-04] [ 1.04793122e-04] [ 2.01695243e-02] [ 1.72294969e-06] [ 1.27451208e-05] [ 1.39559964e-02] [ 1.33803143e-05] [ 1.60365888e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 1.87804195e-02] [ 1.54744157e-05] [ 1.72294969e-04] [ 2.96347281e-02] [ 1.33803143e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 41 / Last logScore: -30555282.4567 / New log score: -30555264.4655 / Difference attained: 17.9912048988 Current pi parameter: [[ 1.72295089e-04] [ 3.34708238e-06] [ 1.20606542e-02] [ 1.87964504e-02] [ 1.72294969e-06] [ 1.34390151e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.55010679e-02] [ 2.30860881e-02] [ 2.77387238e-02] [ 1.72294969e-04] [ 4.13503880e-02] [ 3.25628710e-02] [ 4.63449625e-02] [ 5.16884907e-04] [ 1.32688257e-02] [ 2.01571875e-02] [ 1.72294969e-06] [ 1.49897522e-02] [ 2.54971791e-02] [ 1.72294969e-04] [ 1.33803140e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803140e-05] [ 1.72294969e-06] [ 1.33803140e-05] [ 9.01050558e-06] [ 3.08413143e-02] [ 1.72294980e-04] [ 1.32659769e-02] [ 3.49761535e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.01588968e-02] [ 2.56716284e-02] [ 2.27440187e-02] [ 1.86056472e-02] [ 1.33803140e-05] [ 1.41285752e-02] [ 1.99033372e-05] [ 1.33803140e-05] [ 2.42927022e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527055e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.42935930e-02] [ 3.13595528e-02] [ 4.49645389e-02] [ 1.72294969e-04] [ 1.33803140e-05] [ 3.56667037e-02] [ 2.63617532e-02] [ 2.27436532e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803140e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.72125987e-02] [ 1.72294982e-04] [ 1.33803140e-05] [ 1.72294969e-04] [ 1.33803140e-05] [ 1.72294969e-06] [ 1.94694985e-02] [ 2.13643810e-02] [ 1.60795194e-05] [ 1.03376981e-03] [ 2.34389300e-02] [ 3.41204375e-02] [ 2.18814708e-02] [ 1.72294969e-04] [ 1.04793120e-04] [ 2.01292046e-02] [ 1.72294969e-06] [ 1.27451205e-05] [ 1.39559974e-02] [ 1.33803140e-05] [ 1.60365885e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 1.87846464e-02] [ 1.54744154e-05] [ 1.72294969e-04] [ 2.96347467e-02] [ 1.33803140e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 42 / Last logScore: -30555264.4655 / New log score: -30555207.8499 / Difference attained: 56.6156487428 Current pi parameter: [[ 1.72295089e-04] [ 3.34708239e-06] [ 1.20606559e-02] [ 1.89258387e-02] [ 1.72294969e-06] [ 1.34390151e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.55012099e-02] [ 2.30861682e-02] [ 2.77202114e-02] [ 1.72294969e-04] [ 4.13503880e-02] [ 3.25628713e-02] [ 4.63445822e-02] [ 5.16884907e-04] [ 1.32688669e-02] [ 2.01571875e-02] [ 1.72294969e-06] [ 1.49897521e-02] [ 2.54971745e-02] [ 1.72294969e-04] [ 1.33803141e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803141e-05] [ 1.72294969e-06] [ 1.33803141e-05] [ 9.01050559e-06] [ 3.08413144e-02] [ 1.72294980e-04] [ 1.32655608e-02] [ 3.49761535e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.01588968e-02] [ 2.56716303e-02] [ 2.27629672e-02] [ 1.86042557e-02] [ 1.33803141e-05] [ 1.41286182e-02] [ 1.99033374e-05] [ 1.33803141e-05] [ 2.42927025e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527055e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.42935930e-02] [ 3.13595524e-02] [ 4.49624021e-02] [ 1.72294969e-04] [ 1.33803141e-05] [ 3.56667362e-02] [ 2.63621677e-02] [ 2.27436485e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803141e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.72126031e-02] [ 1.72294982e-04] [ 1.33803141e-05] [ 1.72294969e-04] [ 1.33803141e-05] [ 1.72294969e-06] [ 1.94694984e-02] [ 2.13643386e-02] [ 1.60795195e-05] [ 1.03376981e-03] [ 2.34682139e-02] [ 3.41236525e-02] [ 2.18814708e-02] [ 1.72294969e-04] [ 1.04793121e-04] [ 1.99238672e-02] [ 1.72294969e-06] [ 1.27451206e-05] [ 1.39559976e-02] [ 1.33803141e-05] [ 1.60365886e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 1.88312683e-02] [ 1.54744155e-05] [ 1.72294969e-04] [ 2.96347533e-02] [ 1.33803141e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 43 / Last logScore: -30555207.8499 / New log score: -30555140.2048 / Difference attained: 67.6450590789 Current pi parameter: [[ 1.72295089e-04] [ 3.34708240e-06] [ 1.20606563e-02] [ 1.89529223e-02] [ 1.72294969e-06] [ 1.34390151e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.55012747e-02] [ 2.30862661e-02] [ 2.75975198e-02] [ 1.72294969e-04] [ 4.13503881e-02] [ 3.25628713e-02] [ 4.63444018e-02] [ 5.16884907e-04] [ 1.32689090e-02] [ 2.01571876e-02] [ 1.72294969e-06] [ 1.49897520e-02] [ 2.54971726e-02] [ 1.72294969e-04] [ 1.33803141e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803141e-05] [ 1.72294969e-06] [ 1.33803141e-05] [ 9.01050562e-06] [ 3.08413144e-02] [ 1.72294980e-04] [ 1.32651354e-02] [ 3.49761535e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.01588968e-02] [ 2.56716301e-02] [ 2.28857454e-02] [ 1.86029884e-02] [ 1.33803141e-05] [ 1.41286541e-02] [ 1.99033372e-05] [ 1.33803141e-05] [ 2.42927025e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527055e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.42935930e-02] [ 3.13595523e-02] [ 4.49589668e-02] [ 1.72294969e-04] [ 1.33803141e-05] [ 3.56668684e-02] [ 2.63625931e-02] [ 2.27436443e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803141e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.72126050e-02] [ 1.72294982e-04] [ 1.33803141e-05] [ 1.72294969e-04] [ 1.33803141e-05] [ 1.72294969e-06] [ 1.94694984e-02] [ 2.13642994e-02] [ 1.60795194e-05] [ 1.03376981e-03] [ 2.36001181e-02] [ 3.41282587e-02] [ 2.18814707e-02] [ 1.72294969e-04] [ 1.04793120e-04] [ 1.96434946e-02] [ 1.72294969e-06] [ 1.27451206e-05] [ 1.39559976e-02] [ 1.33803141e-05] [ 1.60365885e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 1.89524464e-02] [ 1.54744154e-05] [ 1.72294969e-04] [ 2.96348211e-02] [ 1.33803141e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 44 / Last logScore: -30555140.2048 / New log score: -30555085.1581 / Difference attained: 55.0467434414 Current pi parameter: [[ 1.72295089e-04] [ 3.34708244e-06] [ 1.20606677e-02] [ 1.89564164e-02] [ 1.72294969e-06] [ 1.34390151e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.55013004e-02] [ 2.30864394e-02] [ 2.73797329e-02] [ 1.72294969e-04] [ 4.13503881e-02] [ 3.25628712e-02] [ 4.63443117e-02] [ 5.16884907e-04] [ 1.32689530e-02] [ 2.01571876e-02] [ 1.72294969e-06] [ 1.49897519e-02] [ 2.54971719e-02] [ 1.72294969e-04] [ 1.33803143e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803143e-05] [ 1.72294969e-06] [ 1.33803143e-05] [ 9.01050572e-06] [ 3.08413143e-02] [ 1.72294980e-04] [ 1.32645392e-02] [ 3.49761535e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.01588968e-02] [ 2.56716247e-02] [ 2.31031614e-02] [ 1.86013590e-02] [ 1.33803143e-05] [ 1.41286852e-02] [ 1.99033369e-05] [ 1.33803143e-05] [ 2.42927025e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527055e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.42935930e-02] [ 3.13595522e-02] [ 4.49482257e-02] [ 1.72294969e-04] [ 1.33803143e-05] [ 3.56676057e-02] [ 2.63631893e-02] [ 2.27436381e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803143e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.72126056e-02] [ 1.72294982e-04] [ 1.33803143e-05] [ 1.72294969e-04] [ 1.33803143e-05] [ 1.72294969e-06] [ 1.94694983e-02] [ 2.13642683e-02] [ 1.60795191e-05] [ 1.03376981e-03] [ 2.36018299e-02] [ 3.41408606e-02] [ 2.18814703e-02] [ 1.72294969e-04] [ 1.04793118e-04] [ 1.96368400e-02] [ 1.72294969e-06] [ 1.27451208e-05] [ 1.39559976e-02] [ 1.33803143e-05] [ 1.60365882e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 1.89524466e-02] [ 1.54744152e-05] [ 1.72294969e-04] [ 2.96355199e-02] [ 1.33803143e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 45 / Last logScore: -30555085.1581 / New log score: -30554923.8148 / Difference attained: 161.343287211 Current pi parameter: [[ 1.72295089e-04] [ 3.34708242e-06] [ 1.20606688e-02] [ 1.89856833e-02] [ 1.72294969e-06] [ 1.34390151e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.55013111e-02] [ 2.30869407e-02] [ 2.72222809e-02] [ 1.72294969e-04] [ 4.13503881e-02] [ 3.25628712e-02] [ 4.63443539e-02] [ 5.16884907e-04] [ 1.32690016e-02] [ 2.01571876e-02] [ 1.72294969e-06] [ 1.49897516e-02] [ 2.54971716e-02] [ 1.72294969e-04] [ 1.33803142e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803142e-05] [ 1.72294969e-06] [ 1.33803142e-05] [ 9.01050566e-06] [ 3.08413141e-02] [ 1.72294980e-04] [ 1.32633136e-02] [ 3.49761535e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.01588968e-02] [ 2.56716258e-02] [ 2.32654104e-02] [ 1.85902646e-02] [ 1.33803142e-05] [ 1.41287121e-02] [ 1.99033365e-05] [ 1.33803142e-05] [ 2.42927025e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527055e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.42935930e-02] [ 3.13595522e-02] [ 4.48518663e-02] [ 1.72294969e-04] [ 1.33803142e-05] [ 3.56678783e-02] [ 2.63644151e-02] [ 2.27436201e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803142e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.72126060e-02] [ 1.72294982e-04] [ 1.33803142e-05] [ 1.72294969e-04] [ 1.33803142e-05] [ 1.72294969e-06] [ 1.94694980e-02] [ 2.13642336e-02] [ 1.60795188e-05] [ 1.03376981e-03] [ 2.36015571e-02] [ 3.42429401e-02] [ 2.18814704e-02] [ 1.72294969e-04] [ 1.04793116e-04] [ 1.96074248e-02] [ 1.72294969e-06] [ 1.27451207e-05] [ 1.39559976e-02] [ 1.33803142e-05] [ 1.60365879e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 1.89524466e-02] [ 1.54744149e-05] [ 1.72294969e-04] [ 2.96356671e-02] [ 1.33803142e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 46 / Last logScore: -30554923.8148 / New log score: -30554709.4495 / Difference attained: 214.365315218 Current pi parameter: [[ 1.72295089e-04] [ 3.34708238e-06] [ 1.20606715e-02] [ 1.91237563e-02] [ 1.72294969e-06] [ 1.34390151e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.55013152e-02] [ 2.30899423e-02] [ 2.69317084e-02] [ 1.72294969e-04] [ 4.13503881e-02] [ 3.25628712e-02] [ 4.63454887e-02] [ 5.16884907e-04] [ 1.32690610e-02] [ 2.01571876e-02] [ 1.72294969e-06] [ 1.49897492e-02] [ 2.54971714e-02] [ 1.72294969e-04] [ 1.33803140e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803140e-05] [ 1.72294969e-06] [ 1.33803140e-05] [ 9.01050558e-06] [ 3.08413089e-02] [ 1.72294980e-04] [ 1.32583094e-02] [ 3.49761535e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.01588968e-02] [ 2.56716424e-02] [ 2.36316761e-02] [ 1.84536943e-02] [ 1.33803140e-05] [ 1.41287359e-02] [ 1.99033363e-05] [ 1.33803140e-05] [ 2.42927023e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527055e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.42935930e-02] [ 3.13595521e-02] [ 4.47955123e-02] [ 1.72294969e-04] [ 1.33803140e-05] [ 3.56679810e-02] [ 2.63694195e-02] [ 2.27435050e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803140e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.72126061e-02] [ 1.72294982e-04] [ 1.33803140e-05] [ 1.72294969e-04] [ 1.33803140e-05] [ 1.72294969e-06] [ 1.94694972e-02] [ 2.13642076e-02] [ 1.60795187e-05] [ 1.03376981e-03] [ 2.36014540e-02] [ 3.43560806e-02] [ 2.18814704e-02] [ 1.72294969e-04] [ 1.04793115e-04] [ 1.94693100e-02] [ 1.72294969e-06] [ 1.27451205e-05] [ 1.39559976e-02] [ 1.33803140e-05] [ 1.60365878e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 1.89524469e-02] [ 1.54744147e-05] [ 1.72294969e-04] [ 2.96357061e-02] [ 1.33803140e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 47 / Last logScore: -30554709.4495 / New log score: -30554623.352 / Difference attained: 86.0974559188 Current pi parameter: [[ 1.72295089e-04] [ 3.34708241e-06] [ 1.20606927e-02] [ 1.91236210e-02] [ 1.72294969e-06] [ 1.34390151e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.55013104e-02] [ 2.30854689e-02] [ 2.68765755e-02] [ 1.72294969e-04] [ 4.13503880e-02] [ 3.25628712e-02] [ 4.63553798e-02] [ 5.16884907e-04] [ 1.32691777e-02] [ 2.01571876e-02] [ 1.72294969e-06] [ 1.49897481e-02] [ 2.54971713e-02] [ 1.72294969e-04] [ 1.33803142e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803142e-05] [ 1.72294969e-06] [ 1.33803142e-05] [ 9.01050566e-06] [ 3.08409850e-02] [ 1.72294980e-04] [ 1.31455828e-02] [ 3.49761535e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.01588968e-02] [ 2.56716633e-02] [ 2.37679532e-02] [ 1.82630579e-02] [ 1.33803142e-05] [ 1.41287591e-02] [ 1.99033362e-05] [ 1.33803142e-05] [ 2.42927014e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527055e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.42935930e-02] [ 3.13595521e-02] [ 4.47955751e-02] [ 1.72294969e-04] [ 1.33803142e-05] [ 3.56680207e-02] [ 2.64821469e-02] [ 2.27434588e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803142e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.72126061e-02] [ 1.72294982e-04] [ 1.33803142e-05] [ 1.72294969e-04] [ 1.33803142e-05] [ 1.72294969e-06] [ 1.94694986e-02] [ 2.13641800e-02] [ 1.60795185e-05] [ 1.03376981e-03] [ 2.36014140e-02] [ 3.44603467e-02] [ 2.18814707e-02] [ 1.72294969e-04] [ 1.04793115e-04] [ 1.94692888e-02] [ 1.72294969e-06] [ 1.27451207e-05] [ 1.39559980e-02] [ 1.33803142e-05] [ 1.60365876e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 1.89524354e-02] [ 1.54744146e-05] [ 1.72294969e-04] [ 2.96358396e-02] [ 1.33803142e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 48 / Last logScore: -30554623.352 / New log score: -30554613.5448 / Difference attained: 9.80720262975 Current pi parameter: [[ 1.72295089e-04] [ 3.34708246e-06] [ 1.20606942e-02] [ 1.91235844e-02] [ 1.72294969e-06] [ 1.34390151e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.55012476e-02] [ 2.30853763e-02] [ 2.68715165e-02] [ 1.72294969e-04] [ 4.13503866e-02] [ 3.25628712e-02] [ 4.63882952e-02] [ 5.16884907e-04] [ 1.32692305e-02] [ 2.01571876e-02] [ 1.72294969e-06] [ 1.49897481e-02] [ 2.54971713e-02] [ 1.72294969e-04] [ 1.33803143e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803143e-05] [ 1.72294969e-06] [ 1.33803143e-05] [ 9.01050578e-06] [ 3.08408471e-02] [ 1.72294980e-04] [ 1.30944051e-02] [ 3.49761535e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.01588968e-02] [ 2.56716652e-02] [ 2.37408546e-02] [ 1.82631434e-02] [ 1.33803143e-05] [ 1.41287979e-02] [ 1.99033367e-05] [ 1.33803143e-05] [ 2.42927026e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527055e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.42935930e-02] [ 3.13595521e-02] [ 4.47951402e-02] [ 1.72294969e-04] [ 1.33803143e-05] [ 3.56680362e-02] [ 2.65333383e-02] [ 2.27434562e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803143e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.72126061e-02] [ 1.72294982e-04] [ 1.33803143e-05] [ 1.72294969e-04] [ 1.33803143e-05] [ 1.72294969e-06] [ 1.94694984e-02] [ 2.13641061e-02] [ 1.60795190e-05] [ 1.03376981e-03] [ 2.36013985e-02] [ 3.44603941e-02] [ 2.18814707e-02] [ 1.72294969e-04] [ 1.04793117e-04] [ 1.94692873e-02] [ 1.72294969e-06] [ 1.27451208e-05] [ 1.39560008e-02] [ 1.33803143e-05] [ 1.60365880e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 1.89522399e-02] [ 1.54744150e-05] [ 1.72294969e-04] [ 2.96358762e-02] [ 1.33803143e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 49 / Last logScore: -30554613.5448 / New log score: -30554607.9097 / Difference attained: 5.6351586245 Current pi parameter: [[ 1.72295089e-04] [ 3.34708246e-06] [ 1.20606943e-02] [ 1.91235741e-02] [ 1.72294969e-06] [ 1.34390151e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.55010375e-02] [ 2.30853168e-02] [ 2.68590334e-02] [ 1.72294969e-04] [ 4.13503861e-02] [ 3.25628712e-02] [ 4.64987578e-02] [ 5.16884907e-04] [ 1.32692899e-02] [ 2.01571876e-02] [ 1.72294969e-06] [ 1.49897481e-02] [ 2.54971713e-02] [ 1.72294969e-04] [ 1.33803143e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803143e-05] [ 1.72294969e-06] [ 1.33803143e-05] [ 9.01050578e-06] [ 3.08407591e-02] [ 1.72294980e-04] [ 1.30940066e-02] [ 3.49761535e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.01588968e-02] [ 2.56716794e-02] [ 2.36434322e-02] [ 1.82631296e-02] [ 1.33803143e-05] [ 1.41288850e-02] [ 1.99033370e-05] [ 1.33803143e-05] [ 2.42927026e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527055e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.42935930e-02] [ 3.13595521e-02] [ 4.47951207e-02] [ 1.72294969e-04] [ 1.33803143e-05] [ 3.56680423e-02] [ 2.65337404e-02] [ 2.27434559e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803143e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.72126062e-02] [ 1.72294982e-04] [ 1.33803143e-05] [ 1.72294969e-04] [ 1.33803143e-05] [ 1.72294969e-06] [ 1.94694983e-02] [ 2.13639489e-02] [ 1.60795192e-05] [ 1.03376981e-03] [ 2.36013924e-02] [ 3.44602055e-02] [ 2.18814706e-02] [ 1.72294969e-04] [ 1.04793119e-04] [ 1.94692872e-02] [ 1.72294969e-06] [ 1.27451208e-05] [ 1.39560107e-02] [ 1.33803143e-05] [ 1.60365883e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 1.89522461e-02] [ 1.54744153e-05] [ 1.72294969e-04] [ 2.96358865e-02] [ 1.33803143e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 50 / Last logScore: -30554607.9097 / New log score: -30554597.3494 / Difference attained: 10.5603071302 Current pi parameter: [[ 1.72295089e-04] [ 3.34708246e-06] [ 1.20606943e-02] [ 1.91235713e-02] [ 1.72294969e-06] [ 1.34390151e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.55005194e-02] [ 2.30852474e-02] [ 2.67519664e-02] [ 1.72294969e-04] [ 4.13503860e-02] [ 3.25628712e-02] [ 4.65186934e-02] [ 5.16884907e-04] [ 1.32693595e-02] [ 2.01571876e-02] [ 1.72294969e-06] [ 1.49897481e-02] [ 2.54971713e-02] [ 1.72294969e-04] [ 1.33803143e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803143e-05] [ 1.72294969e-06] [ 1.33803143e-05] [ 9.01050578e-06] [ 3.08404627e-02] [ 1.72294980e-04] [ 1.30939377e-02] [ 3.49761535e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.01588968e-02] [ 2.56717108e-02] [ 2.37316564e-02] [ 1.82630592e-02] [ 1.33803143e-05] [ 1.41291184e-02] [ 1.99033375e-05] [ 1.33803143e-05] [ 2.42927026e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527055e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.42935930e-02] [ 3.13595521e-02] [ 4.47951196e-02] [ 1.72294969e-04] [ 1.33803143e-05] [ 3.56680446e-02] [ 2.65338091e-02] [ 2.27434558e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803143e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.72126062e-02] [ 1.72294982e-04] [ 1.33803143e-05] [ 1.72294969e-04] [ 1.33803143e-05] [ 1.72294969e-06] [ 1.94694983e-02] [ 2.13635547e-02] [ 1.60795196e-05] [ 1.03376981e-03] [ 2.36013901e-02] [ 3.44600131e-02] [ 2.18814706e-02] [ 1.72294969e-04] [ 1.04793121e-04] [ 1.94692872e-02] [ 1.72294969e-06] [ 1.27451208e-05] [ 1.39560520e-02] [ 1.33803143e-05] [ 1.60365887e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 1.89523198e-02] [ 1.54744156e-05] [ 1.72294969e-04] [ 2.96358894e-02] [ 1.33803143e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 51 / Last logScore: -30554597.3494 / New log score: -30554596.2382 / Difference attained: 1.11115978286 Current pi parameter: [[ 1.72295089e-04] [ 3.34708246e-06] [ 1.20606943e-02] [ 1.91235705e-02] [ 1.72294969e-06] [ 1.34390151e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.55003552e-02] [ 2.30851638e-02] [ 2.67051451e-02] [ 1.72294969e-04] [ 4.13503859e-02] [ 3.25628712e-02] [ 4.65188512e-02] [ 5.16884907e-04] [ 1.32694431e-02] [ 2.01571876e-02] [ 1.72294969e-06] [ 1.49897481e-02] [ 2.54971713e-02] [ 1.72294969e-04] [ 1.33803144e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803144e-05] [ 1.72294969e-06] [ 1.33803144e-05] [ 9.01050579e-06] [ 3.08404919e-02] [ 1.72294980e-04] [ 1.30939247e-02] [ 3.49761535e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.01588968e-02] [ 2.56716955e-02] [ 2.37785059e-02] [ 1.82629562e-02] [ 1.33803144e-05] [ 1.41292457e-02] [ 1.99033376e-05] [ 1.33803144e-05] [ 2.42927025e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527056e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.42935930e-02] [ 3.13595521e-02] [ 4.47951193e-02] [ 1.72294969e-04] [ 1.33803144e-05] [ 3.56680456e-02] [ 2.65338222e-02] [ 2.27434558e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803144e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.72126062e-02] [ 1.72294982e-04] [ 1.33803144e-05] [ 1.72294969e-04] [ 1.33803144e-05] [ 1.72294969e-06] [ 1.94694984e-02] [ 2.13634428e-02] [ 1.60795197e-05] [ 1.03376981e-03] [ 2.36013891e-02] [ 3.44599878e-02] [ 2.18814705e-02] [ 1.72294969e-04] [ 1.04793122e-04] [ 1.94692872e-02] [ 1.72294969e-06] [ 1.27451208e-05] [ 1.39560632e-02] [ 1.33803144e-05] [ 1.60365888e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 1.89523863e-02] [ 1.54744157e-05] [ 1.72294969e-04] [ 2.96358902e-02] [ 1.33803144e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 M-step... Number of clusters: 100 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 52 / Last logScore: -30554596.2382 / New log score: -30554596.2305 / Difference attained: 0.00769013911486 Current pi parameter: [[ 1.72295089e-04] [ 3.34708247e-06] [ 1.20606943e-02] [ 1.91235702e-02] [ 1.72294969e-06] [ 1.34390151e-02] [ 1.48173677e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.55003246e-02] [ 2.30850599e-02] [ 2.67035136e-02] [ 1.72294969e-04] [ 4.13503859e-02] [ 3.25628712e-02] [ 4.65188574e-02] [ 5.16884907e-04] [ 1.32695471e-02] [ 2.01571876e-02] [ 1.72294969e-06] [ 1.49897481e-02] [ 2.54971713e-02] [ 1.72294969e-04] [ 1.33803144e-05] [ 1.56788419e-04] [ 1.72294969e-06] [ 1.33803144e-05] [ 1.72294969e-06] [ 1.33803144e-05] [ 9.01050580e-06] [ 3.08405828e-02] [ 1.72294980e-04] [ 1.30939222e-02] [ 3.49761535e-02] [ 1.72294969e-04] [ 8.61474845e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294976e-04] [ 2.01588968e-02] [ 2.56716842e-02] [ 2.37800985e-02] [ 1.82629011e-02] [ 1.33803144e-05] [ 1.41293020e-02] [ 1.99033377e-05] [ 1.33803144e-05] [ 2.42927025e-02] [ 1.72294969e-06] [ 1.72294969e-04] [ 2.20527056e-02] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 2.42935930e-02] [ 3.13595521e-02] [ 4.47951193e-02] [ 1.72294969e-04] [ 1.33803144e-05] [ 3.56680459e-02] [ 2.65338247e-02] [ 2.27434558e-02] [ 1.72294969e-04] [ 1.72294969e-06] [ 6.89179876e-04] [ 1.33803144e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 4.72126062e-02] [ 1.72294982e-04] [ 1.33803144e-05] [ 1.72294969e-04] [ 1.33803144e-05] [ 1.72294969e-06] [ 1.94694984e-02] [ 2.13634112e-02] [ 1.60795198e-05] [ 1.03376981e-03] [ 2.36013888e-02] [ 3.44599851e-02] [ 2.18814705e-02] [ 1.72294969e-04] [ 1.04793122e-04] [ 1.94692872e-02] [ 1.72294969e-06] [ 1.27451209e-05] [ 1.39560639e-02] [ 1.33803144e-05] [ 1.60365888e-05] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-04] [ 1.72294969e-06] [ 1.72294969e-04] [ 1.89524025e-02] [ 1.54744158e-05] [ 1.72294969e-04] [ 2.96358904e-02] [ 1.33803144e-05]] E-step ... Number of clusters: 100 / Number of bins: 755 SUCCESS! EM converged!
Após rodar o método de reajuste nosso número final de clusters é reduzido para 73 clusters.
from EM import readjustEM
results = readjustEM(X.values,
L,
B,
P,
Pi,
Rpost,
logScore,
logScores,
thresholdConvergence,
epsilon,
maxIterations = 200
)
new_K, new_P, new_Pi, new_R, new_logScore, new_logScores = results
Relative threshold under which the cluster is considered to disappear: 0.0001 Disappearing indexes : [ 1 4 19 23 25 26 27 28 29 43 45 46 48 58 63 65 71 73 74 77 85 86 88 89 93 96 99] There exist disapearing mixture proportions! Running adjusted EM... New adjusted number of clusters : 73 [ 0.00017234 0.01206377 0.01912845 0.01344245 0.01482115 0.00017234 0.00017234 0.02550684 0.02309095 0.02671033 0.00017234 0.04136094 0.03257119 0.04653074 0.00051702 0.01327294 0.02016233 0.01499358 0.02550368 0.00017234 0.00015683 0.03084846 0.00017234 0.01309727 0.03498508 0.00017234 0.00086169 0.00017234 0.00017234 0.00017234 0.02016404 0.02567824 0.02378617 0.01826756 0.01413291 0.02429891 0.00017234 0.02205834 0.00017234 0.00017234 0.00017234 0.0242998 0.03136756 0.04480656 0.00017234 0.03567715 0.0265406 0.02274926 0.00017234 0.00068936 0.00017234 0.00017234 0.00017234 0.04722466 0.00017234 0.00017234 0.01947447 0.02136887 0.00103403 0.02360742 0.03446878 0.02188706 0.00017234 0.00010482 0.01947426 0.01395963 0.00017234 0.00017234 0.00017234 0.00017234 0.01895724 0.00017234 0.02964346] Current pi parameter: [ 0.00017234 0.01206377 0.01912845 0.01344245 0.01482115 0.00017234 0.00017234 0.02550684 0.02309095 0.02671033 0.00017234 0.04136094 0.03257119 0.04653074 0.00051702 0.01327294 0.02016233 0.01499358 0.02550368 0.00017234 0.00015683 0.03084846 0.00017234 0.01309727 0.03498508 0.00017234 0.00086169 0.00017234 0.00017234 0.00017234 0.02016404 0.02567824 0.02378617 0.01826756 0.01413291 0.02429891 0.00017234 0.02205834 0.00017234 0.00017234 0.00017234 0.0242998 0.03136756 0.04480656 0.00017234 0.03567715 0.0265406 0.02274926 0.00017234 0.00068936 0.00017234 0.00017234 0.00017234 0.04722466 0.00017234 0.00017234 0.01947447 0.02136887 0.00103403 0.02360742 0.03446878 0.02188706 0.00017234 0.00010482 0.01947426 0.01395963 0.00017234 0.00017234 0.00017234 0.00017234 0.01895724 0.00017234 0.02964346] Compute likelihood using current responsibility... Number of bins: 755 Initial logScore: -30554607.2445 E-step ... Number of clusters: 73 / Number of bins: 755 M-step... Number of clusters: 73 / Number of bins: 755 Compute likelihood using current responsibility... Number of bins: 755 Itération number: 1 / Last logScore: -30554607.2445 / New log score: -30554607.1336 / Difference attained: 0.11088200286 Current pi parameter: [[ 0.0001723 ] [ 0.01206336] [ 0.01912645] [ 0.01343904] [ 0.01482146] [ 0.00017229] [ 0.00017229] [ 0.02550129] [ 0.02309084] [ 0.026704 ] [ 0.00017229] [ 0.04135077] [ 0.03256301] [ 0.04652634] [ 0.00051688] [ 0.01328261] [ 0.02015719] [ 0.01499019] [ 0.02549719] [ 0.00017229] [ 0.00017229] [ 0.03084241] [ 0.00017229] [ 0.0130941 ] [ 0.03497707] [ 0.00017229] [ 0.00086147] [ 0.00017229] [ 0.0001723 ] [ 0.00017229] [ 0.020159 ] [ 0.02567891] [ 0.02378223] [ 0.01826348] [ 0.01413072] [ 0.02434867] [ 0.00017229] [ 0.02205277] [ 0.00017229] [ 0.00017229] [ 0.0001723 ] [ 0.02429367] [ 0.03135959] [ 0.04479751] [ 0.00017229] [ 0.03567279] [ 0.02653439] [ 0.02274705] [ 0.00017229] [ 0.00068918] [ 0.0001723 ] [ 0.00017229] [ 0.00017229] [ 0.04721272] [ 0.00017229] [ 0.00017229] [ 0.0194703 ] [ 0.02137017] [ 0.00103378] [ 0.02360184] [ 0.03446595] [ 0.02190093] [ 0.0001723 ] [ 0.00017228] [ 0.01947339] [ 0.01395657] [ 0.0001723 ] [ 0.0001723 ] [ 0.0001723 ] [ 0.00017229] [ 0.01895339] [ 0.00017229] [ 0.0296488 ]] SUCCESS! EM converged! Disappearing indexes : []
Com a nova escolha de um $K$, podemos visualizar alguns tópicos gerados via Word Cloud.
from wordcloud import WordCloud
selectedGroups = np.arange(1, new_K) #defines which cluster to be represented
for g in selectedGroups:
dicGroup = dict(zip(list(X.columns.values), list(new_P[g])))
wordcloud = WordCloud( background_color='white')
wordcloud.generate_from_frequencies(frequencies=dicGroup)
plt.figure()
plt.imshow(wordcloud, interpolation="bilinear")
plt.axis("off")
plt.show()
from sklearn.mixture import GaussianMixture
def draw_aic_bic(n_components, dataset, cov='full'):
models_gmm = [GaussianMixture(n_components=n, covariance_type=cov, max_iter=300).fit(dataset)
for n in n_components]
plt.plot(n_components, [m.bic(dataset) for m in models_gmm], label='BIC_GMM')
plt.plot(n_components, [m.aic(dataset) for m in models_gmm], label='AIC_GMM')
plt.legend(loc='best')
plt.xlabel('n_components')
plt.show()
return models_gmm
# Each component has its own general covariance matrix
gmms = draw_aic_bic(np.arange(20, 40), X_300, title='Full cov.')
# All components share the same general covariance matrix
gmms = draw_aic_bic(np.arange(20, 40), X_300, title='Tied covariance', cov='tied')
# Each component has its own diagonal covariance matrix
gmms_diag = draw_aic_bic(np.arange(20, 40), X_300, title='Diag covariance', cov='diag')
gmms_sph = draw_aic_bic(np.arange(20, 40), X_300, title='Spherical covariance', cov='spherical')
gmms_diag = draw_aic_bic(np.arange(10, 300), X_300, title='Diag covariance', cov='diag')
Utilizando a biblioteca dispinibilizada pelo artigo estudado, encontramos um valor de 21 clusters para o dataset de 300 features.
from EM import expectationMaximisation2
thresholdConvergence = 1
epsilon = .01
deltaInit = 0
L = len(X_300)
B = 300
K = 35
P_300,Pi_300,Rpost_300,logScore_300,logScores_300 = expectationMaximisation2(X_300.values,
K,
L,
B,
thresholdConvergence,
200)
1 -th short run of EM Compute likelihood using current responsibility... Number of bins: 300 Initial logScore: -64980880.2543 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 2 -th short run of EM Compute likelihood using current responsibility... Number of bins: 300 Initial logScore: -59456243.3786 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 3 -th short run of EM Compute likelihood using current responsibility... Number of bins: 300 Initial logScore: -69208282.0385 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 4 -th short run of EM Compute likelihood using current responsibility... Number of bins: 300 Initial logScore: -60591792.374 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 5 -th short run of EM Compute likelihood using current responsibility... Number of bins: 300 Initial logScore: -67083863.4447 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 6 -th short run of EM Compute likelihood using current responsibility... Number of bins: 300 Initial logScore: -31360950.3207 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 7 -th short run of EM Compute likelihood using current responsibility... Number of bins: 300 Initial logScore: -66325861.0096 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 8 -th short run of EM Compute likelihood using current responsibility... Number of bins: 300 Initial logScore: -73746017.5831 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 9 -th short run of EM Compute likelihood using current responsibility... Number of bins: 300 Initial logScore: -60817585.461 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 10 -th short run of EM Compute likelihood using current responsibility... Number of bins: 300 Initial logScore: -66752833.1114 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 E-step ... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 16 / Last logScore: -17031939.3814 / New log score: -17031307.4212 / Difference attained: 631.960205343 Current pi parameter: [[ 3.77563776e-02] [ 9.12335889e-06] [ 3.12946199e-02] [ 5.21447092e-02] [ 6.95271279e-02] [ 1.72294969e-06] [ 6.42136451e-02] [ 2.72016478e-05] [ 5.88535831e-02] [ 8.60511426e-06] [ 1.08972606e-05] [ 4.69932909e-06] [ 5.34143657e-06] [ 1.72324660e-04] [ 6.76338986e-02] [ 4.33845726e-02] [ 5.09678986e-02] [ 1.87380237e-05] [ 4.13685120e-02] [ 3.82067730e-02] [ 1.72325600e-04] [ 4.73397733e-02] [ 6.45632198e-06] [ 2.72573958e-02] [ 1.57297163e-04] [ 7.45851650e-02] [ 3.76785551e-02] [ 3.27080216e-02] [ 6.56603610e-02] [ 3.47340580e-02] [ 4.37379100e-02] [ 4.83643566e-02] [ 7.69963112e-05] [ 3.18992482e-02] [ 1.17086483e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 17 / Last logScore: -17031307.4212 / New log score: -17030843.5067 / Difference attained: 463.914557159 Current pi parameter: [[ 3.77556823e-02] [ 9.12333431e-06] [ 3.12254188e-02] [ 5.19803448e-02] [ 6.91601359e-02] [ 1.72294969e-06] [ 6.38934368e-02] [ 2.72015746e-05] [ 5.88193366e-02] [ 8.60511426e-06] [ 1.08972313e-05] [ 4.69932909e-06] [ 5.34142218e-06] [ 1.72324660e-04] [ 6.75839651e-02] [ 4.34308065e-02] [ 5.10135404e-02] [ 1.87379732e-05] [ 4.13660839e-02] [ 3.81515461e-02] [ 1.72325600e-04] [ 4.80597818e-02] [ 6.45630459e-06] [ 2.68829225e-02] [ 1.57297163e-04] [ 7.45788824e-02] [ 3.77243175e-02] [ 3.25081647e-02] [ 6.57776521e-02] [ 3.54945862e-02] [ 4.38986814e-02] [ 4.81969200e-02] [ 7.69961039e-05] [ 3.18143569e-02] [ 1.17086168e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 18 / Last logScore: -17030843.5067 / New log score: -17030488.3383 / Difference attained: 355.168406352 Current pi parameter: [[ 3.77574170e-02] [ 9.12448206e-06] [ 3.11921472e-02] [ 5.18684376e-02] [ 6.89754714e-02] [ 1.72294969e-06] [ 6.40417664e-02] [ 2.72049966e-05] [ 5.86496090e-02] [ 8.60511426e-06] [ 1.08986022e-05] [ 4.69932909e-06] [ 5.34209415e-06] [ 1.72324660e-04] [ 6.80777737e-02] [ 4.34858795e-02] [ 5.11580950e-02] [ 1.87403305e-05] [ 4.13696560e-02] [ 3.79865741e-02] [ 1.72325600e-04] [ 4.87543511e-02] [ 6.45711682e-06] [ 2.67329269e-02] [ 1.57297163e-04] [ 7.44537854e-02] [ 3.73878474e-02] [ 3.21052251e-02] [ 6.61913975e-02] [ 3.57882938e-02] [ 4.34827255e-02] [ 4.81812645e-02] [ 7.70057903e-05] [ 3.16758979e-02] [ 1.17100898e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 19 / Last logScore: -17030488.3383 / New log score: -17030006.025 / Difference attained: 482.313286047 Current pi parameter: [[ 3.78576624e-02] [ 9.12571819e-06] [ 3.11400160e-02] [ 5.18466629e-02] [ 6.89304118e-02] [ 1.72294969e-06] [ 6.42100686e-02] [ 2.72086822e-05] [ 5.82127280e-02] [ 8.60511426e-06] [ 1.09000787e-05] [ 4.69932909e-06] [ 5.34281787e-06] [ 1.72324660e-04] [ 6.80002095e-02] [ 4.35174046e-02] [ 5.13256780e-02] [ 1.87428694e-05] [ 4.13952620e-02] [ 3.78404254e-02] [ 1.72325600e-04] [ 4.91967277e-02] [ 6.45799159e-06] [ 2.65318816e-02] [ 1.57297163e-04] [ 7.49939413e-02] [ 3.72733117e-02] [ 3.14768308e-02] [ 6.67538005e-02] [ 3.58002363e-02] [ 4.32487741e-02] [ 4.81906276e-02] [ 7.70162226e-05] [ 3.15738582e-02] [ 1.17116762e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 20 / Last logScore: -17030006.025 / New log score: -17029564.8411 / Difference attained: 441.183869369 Current pi parameter: [[ 3.79080610e-02] [ 9.12610987e-06] [ 3.10046059e-02] [ 5.18165552e-02] [ 6.87722801e-02] [ 1.72294969e-06] [ 6.42751970e-02] [ 2.72098500e-05] [ 5.82829563e-02] [ 8.60511425e-06] [ 1.09005465e-05] [ 4.69932909e-06] [ 5.34304718e-06] [ 1.72324660e-04] [ 6.80458671e-02] [ 4.35292876e-02] [ 5.13399114e-02] [ 1.87436738e-05] [ 4.15592742e-02] [ 3.77083042e-02] [ 1.72325600e-04] [ 5.00403515e-02] [ 6.45826876e-06] [ 2.61699533e-02] [ 1.57297163e-04] [ 7.56759589e-02] [ 3.75270706e-02] [ 3.08765175e-02] [ 6.70377920e-02] [ 3.61470732e-02] [ 4.19923025e-02] [ 4.81185219e-02] [ 7.70195281e-05] [ 3.14886706e-02] [ 1.17121788e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 21 / Last logScore: -17029564.8411 / New log score: -17029076.7809 / Difference attained: 488.060248595 Current pi parameter: [[ 3.79084998e-02] [ 9.12540665e-06] [ 3.08944256e-02] [ 5.17277867e-02] [ 6.85929672e-02] [ 1.72294969e-06] [ 6.46815905e-02] [ 2.72077533e-05] [ 5.84199900e-02] [ 8.60511425e-06] [ 1.08997066e-05] [ 4.69932909e-06] [ 5.34263547e-06] [ 1.72324660e-04] [ 6.79943145e-02] [ 4.35000669e-02] [ 5.13388338e-02] [ 1.87422295e-05] [ 4.16042134e-02] [ 3.77414872e-02] [ 1.72325600e-04] [ 5.06294297e-02] [ 6.45777112e-06] [ 2.57496239e-02] [ 1.57297163e-04] [ 7.60839313e-02] [ 3.78135532e-02] [ 2.97183127e-02] [ 6.74760719e-02] [ 3.67025613e-02] [ 4.12044197e-02] [ 4.80922462e-02] [ 7.70135933e-05] [ 3.14421993e-02] [ 1.17112764e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 22 / Last logScore: -17029076.7809 / New log score: -17028703.9453 / Difference attained: 372.835526582 Current pi parameter: [[ 3.79557585e-02] [ 9.12551890e-06] [ 3.08411746e-02] [ 5.16148441e-02] [ 6.79314704e-02] [ 1.72294969e-06] [ 6.47421524e-02] [ 2.72080880e-05] [ 5.85464010e-02] [ 8.60511425e-06] [ 1.08998406e-05] [ 4.69932909e-06] [ 5.34270119e-06] [ 1.72324660e-04] [ 6.80061251e-02] [ 4.33723325e-02] [ 5.13214404e-02] [ 1.87424601e-05] [ 4.16452481e-02] [ 3.77352521e-02] [ 1.72325600e-04] [ 5.12724790e-02] [ 6.45785055e-06] [ 2.53112058e-02] [ 1.57297163e-04] [ 7.66649590e-02] [ 3.79060589e-02] [ 2.90620312e-02] [ 6.78035423e-02] [ 3.71221984e-02] [ 4.08963371e-02] [ 4.81606628e-02] [ 7.70145406e-05] [ 3.14048492e-02] [ 1.17114204e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 23 / Last logScore: -17028703.9453 / New log score: -17028389.7988 / Difference attained: 314.146545723 Current pi parameter: [[ 3.79086654e-02] [ 9.12638630e-06] [ 3.08387594e-02] [ 5.13866718e-02] [ 6.76658573e-02] [ 1.72294969e-06] [ 6.46721075e-02] [ 2.72106742e-05] [ 5.86840618e-02] [ 8.60511425e-06] [ 1.09008767e-05] [ 4.69932909e-06] [ 5.34320902e-06] [ 1.72324660e-04] [ 6.78874914e-02] [ 4.30850750e-02] [ 5.11780368e-02] [ 1.87442416e-05] [ 4.17594013e-02] [ 3.77377158e-02] [ 1.72325600e-04] [ 5.17639681e-02] [ 6.45846438e-06] [ 2.52278156e-02] [ 1.57297163e-04] [ 7.68279161e-02] [ 3.79009949e-02] [ 2.88287163e-02] [ 6.80926507e-02] [ 3.76622439e-02] [ 4.07499907e-02] [ 4.79399592e-02] [ 7.70218610e-05] [ 3.15184081e-02] [ 1.17125336e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 24 / Last logScore: -17028389.7988 / New log score: -17028179.2447 / Difference attained: 210.554042388 Current pi parameter: [[ 3.79085388e-02] [ 9.12717404e-06] [ 3.09427847e-02] [ 5.13599626e-02] [ 6.74148030e-02] [ 1.72294969e-06] [ 6.46355046e-02] [ 2.72130228e-05] [ 5.86922626e-02] [ 8.60511425e-06] [ 1.09018176e-05] [ 4.69932909e-06] [ 5.34367022e-06] [ 1.72324660e-04] [ 6.78945685e-02] [ 4.27116715e-02] [ 5.11197469e-02] [ 1.87458595e-05] [ 4.19127598e-02] [ 3.77540315e-02] [ 1.72325600e-04] [ 5.20011173e-02] [ 6.45902184e-06] [ 2.52788847e-02] [ 1.57297163e-04] [ 7.67286197e-02] [ 3.78832842e-02] [ 2.86591791e-02] [ 6.83207889e-02] [ 3.75526079e-02] [ 4.10800636e-02] [ 4.79234028e-02] [ 7.70285091e-05] [ 3.15419098e-02] [ 1.17135446e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 25 / Last logScore: -17028179.2447 / New log score: -17027961.7835 / Difference attained: 217.461236585 Current pi parameter: [[ 3.79090785e-02] [ 9.12720103e-06] [ 3.09803458e-02] [ 5.13610376e-02] [ 6.70944239e-02] [ 1.72294969e-06] [ 6.46444954e-02] [ 2.72131033e-05] [ 5.85727997e-02] [ 8.60511425e-06] [ 1.09018498e-05] [ 4.69932909e-06] [ 5.34368602e-06] [ 1.72324660e-04] [ 6.78971649e-02] [ 4.23161909e-02] [ 5.09756062e-02] [ 1.87459149e-05] [ 4.20395229e-02] [ 3.78225191e-02] [ 1.72325600e-04] [ 5.22757362e-02] [ 6.45904095e-06] [ 2.52636065e-02] [ 1.57297163e-04] [ 7.67730493e-02] [ 3.77516461e-02] [ 2.81807290e-02] [ 6.87595411e-02] [ 3.80336669e-02] [ 4.12035399e-02] [ 4.79180834e-02] [ 7.70287369e-05] [ 3.15437089e-02] [ 1.17135792e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 26 / Last logScore: -17027961.7835 / New log score: -17027806.4127 / Difference attained: 155.370781776 Current pi parameter: [[ 3.79104540e-02] [ 9.12793210e-06] [ 3.08707074e-02] [ 5.13588303e-02] [ 6.66746790e-02] [ 1.72294969e-06] [ 6.46682991e-02] [ 2.72152830e-05] [ 5.84821163e-02] [ 8.60511425e-06] [ 1.09027230e-05] [ 4.69932909e-06] [ 5.34411404e-06] [ 1.72324660e-04] [ 6.78975551e-02] [ 4.20375350e-02] [ 5.09038522e-02] [ 1.87474164e-05] [ 4.20345717e-02] [ 3.78929726e-02] [ 1.72325600e-04] [ 5.30277030e-02] [ 6.45955830e-06] [ 2.51522269e-02] [ 1.57297163e-04] [ 7.66716571e-02] [ 3.77392738e-02] [ 2.77696401e-02] [ 6.93444838e-02] [ 3.79999072e-02] [ 4.14096184e-02] [ 4.79221556e-02] [ 7.70349067e-05] [ 3.15482401e-02] [ 1.17145174e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 27 / Last logScore: -17027806.4127 / New log score: -17027662.8228 / Difference attained: 143.589887943 Current pi parameter: [[ 3.79135133e-02] [ 9.13016205e-06] [ 3.05533140e-02] [ 5.12934049e-02] [ 6.68384666e-02] [ 1.72294969e-06] [ 6.47674513e-02] [ 2.72219317e-05] [ 5.85742652e-02] [ 8.60511425e-06] [ 1.09053866e-05] [ 4.69932909e-06] [ 5.34541960e-06] [ 1.72324660e-04] [ 6.78860529e-02] [ 4.18627453e-02] [ 5.08555308e-02] [ 1.87519964e-05] [ 4.20310773e-02] [ 3.78676627e-02] [ 1.72325600e-04] [ 5.31502437e-02] [ 6.46113637e-06] [ 2.49569904e-02] [ 1.57297163e-04] [ 7.65147259e-02] [ 3.77391284e-02] [ 2.76330079e-02] [ 6.95198202e-02] [ 3.81871334e-02] [ 4.16783638e-02] [ 4.79396050e-02] [ 7.70537263e-05] [ 3.15539352e-02] [ 1.17173793e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 28 / Last logScore: -17027662.8228 / New log score: -17027536.9047 / Difference attained: 125.918134101 Current pi parameter: [[ 3.79261283e-02] [ 9.13114346e-06] [ 3.03326602e-02] [ 5.13015838e-02] [ 6.67211146e-02] [ 1.72294969e-06] [ 6.49572469e-02] [ 2.72248578e-05] [ 5.86565183e-02] [ 8.60511425e-06] [ 1.09065588e-05] [ 4.69932909e-06] [ 5.34599419e-06] [ 1.72324660e-04] [ 6.79234340e-02] [ 4.14395838e-02] [ 5.08559608e-02] [ 1.87540121e-05] [ 4.20282950e-02] [ 3.77784583e-02] [ 1.72325600e-04] [ 5.32568317e-02] [ 6.46183089e-06] [ 2.52016365e-02] [ 1.57297163e-04] [ 7.64556895e-02] [ 3.77393520e-02] [ 2.76773262e-02] [ 6.96936342e-02] [ 3.82061568e-02] [ 4.16468276e-02] [ 4.79578393e-02] [ 7.70620090e-05] [ 3.15601423e-02] [ 1.17186388e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 29 / Last logScore: -17027536.9047 / New log score: -17027373.3061 / Difference attained: 163.598567653 Current pi parameter: [[ 3.80631039e-02] [ 9.13156967e-06] [ 3.02476115e-02] [ 5.13646476e-02] [ 6.65388042e-02] [ 1.72294969e-06] [ 6.49627869e-02] [ 2.72261286e-05] [ 5.87627373e-02] [ 8.60511425e-06] [ 1.09070679e-05] [ 4.69932909e-06] [ 5.34624372e-06] [ 1.72324660e-04] [ 6.80482037e-02] [ 4.09772131e-02] [ 5.08609866e-02] [ 1.87548874e-05] [ 4.20248434e-02] [ 3.75329619e-02] [ 1.72325600e-04] [ 5.32826976e-02] [ 6.46213250e-06] [ 2.54969745e-02] [ 1.57297163e-04] [ 7.64756760e-02] [ 3.77397877e-02] [ 2.75739361e-02] [ 7.01293436e-02] [ 3.81048281e-02] [ 4.15718783e-02] [ 4.79913376e-02] [ 7.70656059e-05] [ 3.15660529e-02] [ 1.17191858e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 30 / Last logScore: -17027373.3061 / New log score: -17027232.8656 / Difference attained: 140.440525308 Current pi parameter: [[ 3.80648054e-02] [ 9.13220063e-06] [ 3.00481859e-02] [ 5.12428469e-02] [ 6.64026202e-02] [ 1.72294969e-06] [ 6.49585427e-02] [ 2.72280098e-05] [ 5.87583977e-02] [ 8.60511425e-06] [ 1.09078215e-05] [ 4.69932909e-06] [ 5.34661313e-06] [ 1.72324660e-04] [ 6.84554648e-02] [ 4.07381688e-02] [ 5.08746558e-02] [ 1.87561833e-05] [ 4.20117855e-02] [ 3.73035645e-02] [ 1.72325600e-04] [ 5.32983896e-02] [ 6.46257901e-06] [ 2.57372936e-02] [ 1.57297163e-04] [ 7.64851362e-02] [ 3.77406634e-02] [ 2.76424805e-02] [ 7.06460056e-02] [ 3.79054607e-02] [ 4.13660147e-02] [ 4.80413560e-02] [ 7.70709309e-05] [ 3.15945624e-02] [ 1.17199955e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 31 / Last logScore: -17027232.8656 / New log score: -17027086.5726 / Difference attained: 146.292998813 Current pi parameter: [[ 3.79005624e-02] [ 9.13223619e-06] [ 3.00135968e-02] [ 5.11731996e-02] [ 6.60533233e-02] [ 1.72294969e-06] [ 6.49385816e-02] [ 2.72281158e-05] [ 5.87562259e-02] [ 8.60511425e-06] [ 1.09078640e-05] [ 4.69932909e-06] [ 5.34663395e-06] [ 1.72324660e-04] [ 6.84609370e-02] [ 4.05607305e-02] [ 5.09738572e-02] [ 1.87562564e-05] [ 4.19127704e-02] [ 3.72412940e-02] [ 1.72325600e-04] [ 5.37545813e-02] [ 6.46260417e-06] [ 2.58053764e-02] [ 1.57297163e-04] [ 7.64732763e-02] [ 3.77522583e-02] [ 2.77381134e-02] [ 7.09980158e-02] [ 3.77609702e-02] [ 4.12938271e-02] [ 4.80908706e-02] [ 7.70712310e-05] [ 3.16640324e-02] [ 1.17200412e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 32 / Last logScore: -17027086.5726 / New log score: -17026992.6329 / Difference attained: 93.9397528023 Current pi parameter: [[ 3.78817994e-02] [ 9.13284463e-06] [ 3.02088044e-02] [ 5.11691147e-02] [ 6.59046383e-02] [ 1.72294969e-06] [ 6.47892116e-02] [ 2.72299299e-05] [ 5.87467543e-02] [ 8.60511425e-06] [ 1.09085907e-05] [ 4.69932909e-06] [ 5.34699017e-06] [ 1.72324660e-04] [ 6.85205814e-02] [ 4.03481849e-02] [ 5.10486292e-02] [ 1.87575060e-05] [ 4.18382871e-02] [ 3.72333535e-02] [ 1.72325600e-04] [ 5.39217711e-02] [ 6.46303475e-06] [ 2.56797673e-02] [ 1.57297163e-04] [ 7.64341539e-02] [ 3.78135157e-02] [ 2.77342010e-02] [ 7.10967173e-02] [ 3.79221367e-02] [ 4.11680497e-02] [ 4.81117429e-02] [ 7.70763659e-05] [ 3.17449746e-02] [ 1.17208220e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 33 / Last logScore: -17026992.6329 / New log score: -17026892.0676 / Difference attained: 100.565226194 Current pi parameter: [[ 3.77888851e-02] [ 9.13289376e-06] [ 3.05907453e-02] [ 5.11482852e-02] [ 6.58602676e-02] [ 1.72294969e-06] [ 6.45295646e-02] [ 2.72300764e-05] [ 5.87396781e-02] [ 8.60511425e-06] [ 1.09086494e-05] [ 4.69932908e-06] [ 5.34701893e-06] [ 1.72324660e-04] [ 6.85522061e-02] [ 4.01166636e-02] [ 5.11091577e-02] [ 1.87576069e-05] [ 4.17765735e-02] [ 3.72384579e-02] [ 1.72325600e-04] [ 5.39828266e-02] [ 6.46306952e-06] [ 2.59503431e-02] [ 1.57297163e-04] [ 7.63700964e-02] [ 3.78133279e-02] [ 2.77160017e-02] [ 7.12484826e-02] [ 3.78759274e-02] [ 4.10066456e-02] [ 4.81314770e-02] [ 7.70767805e-05] [ 3.17707754e-02] [ 1.17208851e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 34 / Last logScore: -17026892.0676 / New log score: -17026809.9083 / Difference attained: 82.1593506895 Current pi parameter: [[ 3.77087163e-02] [ 9.13297547e-06] [ 3.08713716e-02] [ 5.10738378e-02] [ 6.57628527e-02] [ 1.72294969e-06] [ 6.43479502e-02] [ 2.72303200e-05] [ 5.87457636e-02] [ 8.60511425e-06] [ 1.09087470e-05] [ 4.69932908e-06] [ 5.34706678e-06] [ 1.72324660e-04] [ 6.84709604e-02] [ 3.97172983e-02] [ 5.12103610e-02] [ 1.87577748e-05] [ 4.16713316e-02] [ 3.72441563e-02] [ 1.72325600e-04] [ 5.40758230e-02] [ 6.46312734e-06] [ 2.62846643e-02] [ 1.57297163e-04] [ 7.63334366e-02] [ 3.77018659e-02] [ 2.76141866e-02] [ 7.13607597e-02] [ 3.80548800e-02] [ 4.09970786e-02] [ 4.81632097e-02] [ 7.70774702e-05] [ 3.19058823e-02] [ 1.17209900e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 35 / Last logScore: -17026809.9083 / New log score: -17026744.0943 / Difference attained: 65.813999217 Current pi parameter: [[ 3.77043279e-02] [ 9.13314457e-06] [ 3.09111667e-02] [ 5.10006532e-02] [ 6.56343936e-02] [ 1.72294969e-06] [ 6.43306095e-02] [ 2.72308242e-05] [ 5.88293195e-02] [ 8.60511425e-06] [ 1.09089490e-05] [ 4.69932908e-06] [ 5.34716577e-06] [ 1.72324660e-04] [ 6.82811818e-02] [ 3.94016949e-02] [ 5.13735837e-02] [ 1.87581220e-05] [ 4.15045118e-02] [ 3.73039316e-02] [ 1.72325600e-04] [ 5.41901280e-02] [ 6.46324700e-06] [ 2.65621613e-02] [ 1.57297163e-04] [ 7.64504681e-02] [ 3.75687338e-02] [ 2.75178648e-02] [ 7.13612605e-02] [ 3.82927323e-02] [ 4.09886235e-02] [ 4.82126565e-02] [ 7.70788972e-05] [ 3.18963805e-02] [ 1.17212070e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 36 / Last logScore: -17026744.0943 / New log score: -17026706.8788 / Difference attained: 37.2154388092 Current pi parameter: [[ 3.76959831e-02] [ 9.13319336e-06] [ 3.08421696e-02] [ 5.10040287e-02] [ 6.55419798e-02] [ 1.72294969e-06] [ 6.42887612e-02] [ 2.72309697e-05] [ 5.88738752e-02] [ 8.60511425e-06] [ 1.09090073e-05] [ 4.69932908e-06] [ 5.34719434e-06] [ 1.72324660e-04] [ 6.81071250e-02] [ 3.91992766e-02] [ 5.14927377e-02] [ 1.87582223e-05] [ 4.13828970e-02] [ 3.74156859e-02] [ 1.72325600e-04] [ 5.42604013e-02] [ 6.46328153e-06] [ 2.67498892e-02] [ 1.57297163e-04] [ 7.65021961e-02] [ 3.75688305e-02] [ 2.74076768e-02] [ 7.13561316e-02] [ 3.84976873e-02] [ 4.09645778e-02] [ 4.82746924e-02] [ 7.70793090e-05] [ 3.18897800e-02] [ 1.17212696e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 37 / Last logScore: -17026706.8788 / New log score: -17026615.6258 / Difference attained: 91.2530446015 Current pi parameter: [[ 3.76731302e-02] [ 9.13310955e-06] [ 3.08399725e-02] [ 5.10068815e-02] [ 6.53095413e-02] [ 1.72294969e-06] [ 6.42915827e-02] [ 2.72307198e-05] [ 5.88244757e-02] [ 8.60511425e-06] [ 1.09089072e-05] [ 4.69932908e-06] [ 5.34714527e-06] [ 1.72324660e-04] [ 6.78852929e-02] [ 3.90526744e-02] [ 5.16704337e-02] [ 1.87580501e-05] [ 4.12037224e-02] [ 3.74064490e-02] [ 1.72325600e-04] [ 5.43802246e-02] [ 6.46322223e-06] [ 2.70739369e-02] [ 1.57297163e-04] [ 7.65045780e-02] [ 3.75689862e-02] [ 2.74000013e-02] [ 7.13498178e-02] [ 3.88560345e-02] [ 4.08763677e-02] [ 4.82531693e-02] [ 7.70786017e-05] [ 3.18891114e-02] [ 1.17211620e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 38 / Last logScore: -17026615.6258 / New log score: -17026510.5976 / Difference attained: 105.028250653 Current pi parameter: [[ 3.77130854e-02] [ 9.13316593e-06] [ 3.08312863e-02] [ 5.10149493e-02] [ 6.51244688e-02] [ 1.72294969e-06] [ 6.42909381e-02] [ 2.72308879e-05] [ 5.87520677e-02] [ 8.60511425e-06] [ 1.09089745e-05] [ 4.69932908e-06] [ 5.34717828e-06] [ 1.72324660e-04] [ 6.77170683e-02] [ 3.86349763e-02] [ 5.16452987e-02] [ 1.87581659e-05] [ 4.11637668e-02] [ 3.73981400e-02] [ 1.72325600e-04] [ 5.45980441e-02] [ 6.46326212e-06] [ 2.71588686e-02] [ 1.57297163e-04] [ 7.65069947e-02] [ 3.75696731e-02] [ 2.73855054e-02] [ 7.13626476e-02] [ 3.93219476e-02] [ 4.08376551e-02] [ 4.84004774e-02] [ 7.70790775e-05] [ 3.18885239e-02] [ 1.17212344e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 39 / Last logScore: -17026510.5976 / New log score: -17026386.9313 / Difference attained: 123.666232977 Current pi parameter: [[ 3.77483268e-02] [ 9.13347654e-06] [ 3.07157571e-02] [ 5.11259056e-02] [ 6.48409892e-02] [ 1.72294969e-06] [ 6.42869737e-02] [ 2.72318140e-05] [ 5.87370275e-02] [ 8.60511425e-06] [ 1.09093455e-05] [ 4.69932908e-06] [ 5.34736013e-06] [ 1.72324660e-04] [ 6.77149589e-02] [ 3.83543989e-02] [ 5.16688730e-02] [ 1.87588039e-05] [ 4.10415809e-02] [ 3.73950207e-02] [ 1.72325600e-04] [ 5.47512825e-02] [ 6.46348193e-06] [ 2.73811035e-02] [ 1.57297163e-04] [ 7.65074194e-02] [ 3.75736114e-02] [ 2.73698815e-02] [ 7.13901770e-02] [ 3.96275341e-02] [ 4.08379870e-02] [ 4.83537487e-02] [ 7.70816988e-05] [ 3.18938203e-02] [ 1.17216330e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 40 / Last logScore: -17026386.9313 / New log score: -17026311.3894 / Difference attained: 75.5418760404 Current pi parameter: [[ 3.78526360e-02] [ 9.13365115e-06] [ 3.06750496e-02] [ 5.11605543e-02] [ 6.46549771e-02] [ 1.72294969e-06] [ 6.42805651e-02] [ 2.72323346e-05] [ 5.87375796e-02] [ 8.60511425e-06] [ 1.09095541e-05] [ 4.69932908e-06] [ 5.34746236e-06] [ 1.72324660e-04] [ 6.77151416e-02] [ 3.81596759e-02] [ 5.18834566e-02] [ 1.87591625e-05] [ 4.08293973e-02] [ 3.73928845e-02] [ 1.72325600e-04] [ 5.48789303e-02] [ 6.46360550e-06] [ 2.74947509e-02] [ 1.57297163e-04] [ 7.65071506e-02] [ 3.75977660e-02] [ 2.73303044e-02] [ 7.14571198e-02] [ 3.95824783e-02] [ 4.08379714e-02] [ 4.83189187e-02] [ 7.70831725e-05] [ 3.19690665e-02] [ 1.17218571e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 41 / Last logScore: -17026311.3894 / New log score: -17026244.6984 / Difference attained: 66.6910626292 Current pi parameter: [[ 3.77660793e-02] [ 9.13356344e-06] [ 3.06752374e-02] [ 5.11470861e-02] [ 6.45886299e-02] [ 1.72294969e-06] [ 6.42716178e-02] [ 2.72320731e-05] [ 5.87453750e-02] [ 8.60511425e-06] [ 1.09094493e-05] [ 4.69932908e-06] [ 5.34741101e-06] [ 1.72324660e-04] [ 6.77131621e-02] [ 3.79832704e-02] [ 5.20452344e-02] [ 1.87589823e-05] [ 4.06716658e-02] [ 3.73918482e-02] [ 1.72325600e-04] [ 5.49145683e-02] [ 6.46354343e-06] [ 2.78601334e-02] [ 1.57297163e-04] [ 7.65068036e-02] [ 3.77891739e-02] [ 2.72180558e-02] [ 7.16236451e-02] [ 3.93252540e-02] [ 4.08378262e-02] [ 4.83497627e-02] [ 7.70824322e-05] [ 3.18919467e-02] [ 1.17217445e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 42 / Last logScore: -17026244.6984 / New log score: -17026212.4917 / Difference attained: 32.2067275569 Current pi parameter: [[ 3.77379849e-02] [ 9.13299432e-06] [ 3.06752512e-02] [ 5.11080635e-02] [ 6.46092271e-02] [ 1.72294969e-06] [ 6.42690266e-02] [ 2.72303762e-05] [ 5.87532236e-02] [ 8.60511425e-06] [ 1.09087695e-05] [ 4.69932908e-06] [ 5.34707781e-06] [ 1.72324660e-04] [ 6.77163698e-02] [ 3.78580570e-02] [ 5.22095348e-02] [ 1.87578135e-05] [ 4.05067661e-02] [ 3.73924519e-02] [ 1.72325600e-04] [ 5.49180295e-02] [ 6.46314068e-06] [ 2.79913149e-02] [ 1.57297163e-04] [ 7.65060045e-02] [ 3.79128807e-02] [ 2.72006417e-02] [ 7.18141338e-02] [ 3.90682685e-02] [ 4.08360602e-02] [ 4.83420844e-02] [ 7.70776292e-05] [ 3.18910117e-02] [ 1.17210141e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 43 / Last logScore: -17026212.4917 / New log score: -17026141.3938 / Difference attained: 71.0978678763 Current pi parameter: [[ 3.77369844e-02] [ 9.13237819e-06] [ 3.06753085e-02] [ 5.09103131e-02] [ 6.46358661e-02] [ 1.72294969e-06] [ 6.42650893e-02] [ 2.72285392e-05] [ 5.87582119e-02] [ 8.60511425e-06] [ 1.09080336e-05] [ 4.69932908e-06] [ 5.34671708e-06] [ 1.72324660e-04] [ 6.77315790e-02] [ 3.78298658e-02] [ 5.22795364e-02] [ 1.87565480e-05] [ 4.04412013e-02] [ 3.73928890e-02] [ 1.72325600e-04] [ 5.49991027e-02] [ 6.46270466e-06] [ 2.80141080e-02] [ 1.57297163e-04] [ 7.65042233e-02] [ 3.79132190e-02] [ 2.71192552e-02] [ 7.20492388e-02] [ 3.89998554e-02] [ 4.08345559e-02] [ 4.83337861e-02] [ 7.70724294e-05] [ 3.18922087e-02] [ 1.17202234e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 44 / Last logScore: -17026141.3938 / New log score: -17026059.1763 / Difference attained: 82.2175155506 Current pi parameter: [[ 3.77368533e-02] [ 9.13028948e-06] [ 3.06754752e-02] [ 5.04319296e-02] [ 6.46911081e-02] [ 1.72294969e-06] [ 6.42590322e-02] [ 2.72223116e-05] [ 5.87616837e-02] [ 8.60511425e-06] [ 1.09055388e-05] [ 4.69932908e-06] [ 5.34549421e-06] [ 1.72324660e-04] [ 6.78724315e-02] [ 3.78113678e-02] [ 5.23868226e-02] [ 1.87522581e-05] [ 4.03411449e-02] [ 3.73929015e-02] [ 1.72325600e-04] [ 5.52145938e-02] [ 6.46122655e-06] [ 2.78854032e-02] [ 1.57297163e-04] [ 7.65047812e-02] [ 3.79142948e-02] [ 2.70424750e-02] [ 7.20642249e-02] [ 3.92808031e-02] [ 4.08305359e-02] [ 4.83235206e-02] [ 7.70548018e-05] [ 3.18950531e-02] [ 1.17175428e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 45 / Last logScore: -17026059.1763 / New log score: -17026039.2615 / Difference attained: 19.9147782773 Current pi parameter: [[ 3.77367705e-02] [ 9.13004379e-06] [ 3.06755940e-02] [ 5.03038296e-02] [ 6.47551093e-02] [ 1.72294969e-06] [ 6.42611751e-02] [ 2.72215791e-05] [ 5.87633278e-02] [ 8.60511425e-06] [ 1.09052453e-05] [ 4.69932909e-06] [ 5.34535037e-06] [ 1.72324660e-04] [ 6.78048077e-02] [ 3.77666683e-02] [ 5.23922937e-02] [ 1.87517535e-05] [ 4.03409672e-02] [ 3.73926567e-02] [ 1.72325600e-04] [ 5.52401101e-02] [ 6.46105268e-06] [ 2.78918432e-02] [ 1.57297163e-04] [ 7.65049467e-02] [ 3.79149006e-02] [ 2.70411933e-02] [ 7.20583163e-02] [ 3.94362752e-02] [ 4.08282708e-02] [ 4.83036842e-02] [ 7.70527283e-05] [ 3.19036997e-02] [ 1.17172275e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 46 / Last logScore: -17026039.2615 / New log score: -17026022.5329 / Difference attained: 16.7285765447 Current pi parameter: [[ 3.77367908e-02] [ 9.12998658e-06] [ 3.06753175e-02] [ 5.02254085e-02] [ 6.47520393e-02] [ 1.72294969e-06] [ 6.42613441e-02] [ 2.72214085e-05] [ 5.87635718e-02] [ 8.60511425e-06] [ 1.09051770e-05] [ 4.69932909e-06] [ 5.34531687e-06] [ 1.72324660e-04] [ 6.78517204e-02] [ 3.77619158e-02] [ 5.23943129e-02] [ 1.87516360e-05] [ 4.03408529e-02] [ 3.73925905e-02] [ 1.72325600e-04] [ 5.52586651e-02] [ 6.46101219e-06] [ 2.78425305e-02] [ 1.57297163e-04] [ 7.65044065e-02] [ 3.79148847e-02] [ 2.70474119e-02] [ 7.19827666e-02] [ 3.95888344e-02] [ 4.08254120e-02] [ 4.82708254e-02] [ 7.70522455e-05] [ 3.19248397e-02] [ 1.17171541e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 47 / Last logScore: -17026022.5329 / New log score: -17025996.6671 / Difference attained: 25.8658373579 Current pi parameter: [[ 3.77368395e-02] [ 9.12968779e-06] [ 3.06750032e-02] [ 5.01311151e-02] [ 6.47467907e-02] [ 1.72294969e-06] [ 6.42609128e-02] [ 2.72205177e-05] [ 5.87629432e-02] [ 8.60511425e-06] [ 1.09048201e-05] [ 4.69932909e-06] [ 5.34514194e-06] [ 1.72324660e-04] [ 6.78857265e-02] [ 3.77589451e-02] [ 5.23954318e-02] [ 1.87510223e-05] [ 4.03400375e-02] [ 3.73926016e-02] [ 1.72325600e-04] [ 5.52648755e-02] [ 6.46080075e-06] [ 2.76495308e-02] [ 1.57297163e-04] [ 7.65047226e-02] [ 3.79147630e-02] [ 2.70770982e-02] [ 7.20025303e-02] [ 3.97454283e-02] [ 4.08110311e-02] [ 4.82316345e-02] [ 7.70497239e-05] [ 3.20284853e-02] [ 1.17167706e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 48 / Last logScore: -17025996.6671 / New log score: -17025962.046 / Difference attained: 34.6210723743 Current pi parameter: [[ 3.77369750e-02] [ 9.12966459e-06] [ 3.06748639e-02] [ 5.00412689e-02] [ 6.47412090e-02] [ 1.72294969e-06] [ 6.42616433e-02] [ 2.72204485e-05] [ 5.87633322e-02] [ 8.60511425e-06] [ 1.09047924e-05] [ 4.69932909e-06] [ 5.34512836e-06] [ 1.72324660e-04] [ 6.78866160e-02] [ 3.77558404e-02] [ 5.23960507e-02] [ 1.87509747e-05] [ 4.03386755e-02] [ 3.73926566e-02] [ 1.72325600e-04] [ 5.52570757e-02] [ 6.46078433e-06] [ 2.74078449e-02] [ 1.57297163e-04] [ 7.65049788e-02] [ 3.79147977e-02] [ 2.72064657e-02] [ 7.20355317e-02] [ 3.98247085e-02] [ 4.07274408e-02] [ 4.82089625e-02] [ 7.70495280e-05] [ 3.22395095e-02] [ 1.17167409e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 49 / Last logScore: -17025962.046 / New log score: -17025938.7016 / Difference attained: 23.3444077782 Current pi parameter: [[ 3.77368117e-02] [ 9.12952589e-06] [ 3.06749631e-02] [ 4.98764081e-02] [ 6.47342296e-02] [ 1.72294969e-06] [ 6.42630715e-02] [ 2.72200350e-05] [ 5.87639532e-02] [ 8.60511425e-06] [ 1.09046267e-05] [ 4.69932909e-06] [ 5.34504715e-06] [ 1.72324660e-04] [ 6.78846902e-02] [ 3.77537588e-02] [ 5.23965607e-02] [ 1.87506898e-05] [ 4.03368883e-02] [ 3.73929121e-02] [ 1.72325600e-04] [ 5.52750404e-02] [ 6.46068618e-06] [ 2.73923439e-02] [ 1.57297163e-04] [ 7.65051742e-02] [ 3.79147852e-02] [ 2.72161456e-02] [ 7.20415232e-02] [ 3.99720282e-02] [ 4.06662161e-02] [ 4.81959747e-02] [ 7.70483575e-05] [ 3.23229706e-02] [ 1.17165629e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 50 / Last logScore: -17025938.7016 / New log score: -17025886.0874 / Difference attained: 52.6142003089 Current pi parameter: [[ 3.77366086e-02] [ 9.12931747e-06] [ 3.06750147e-02] [ 4.95924518e-02] [ 6.47308209e-02] [ 1.72294969e-06] [ 6.42646268e-02] [ 2.72194136e-05] [ 5.87642207e-02] [ 8.60511425e-06] [ 1.09043778e-05] [ 4.69932909e-06] [ 5.34492513e-06] [ 1.72324660e-04] [ 6.78836320e-02] [ 3.77513235e-02] [ 5.23970608e-02] [ 1.87502618e-05] [ 4.03351294e-02] [ 3.73933915e-02] [ 1.72325600e-04] [ 5.53715183e-02] [ 6.46053868e-06] [ 2.73248131e-02] [ 1.57297163e-04] [ 7.65055147e-02] [ 3.79147642e-02] [ 2.72484322e-02] [ 7.20424047e-02] [ 4.00134386e-02] [ 4.06660927e-02] [ 4.81774017e-02] [ 7.70465985e-05] [ 3.25277924e-02] [ 1.17162954e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 51 / Last logScore: -17025886.0874 / New log score: -17025846.1608 / Difference attained: 39.9266333692 Current pi parameter: [[ 3.77364643e-02] [ 9.12925570e-06] [ 3.06750109e-02] [ 4.94082916e-02] [ 6.47387699e-02] [ 1.72294969e-06] [ 6.42658308e-02] [ 2.72192294e-05] [ 5.87644830e-02] [ 8.60511425e-06] [ 1.09043040e-05] [ 4.69932909e-06] [ 5.34488897e-06] [ 1.72324660e-04] [ 6.78817275e-02] [ 3.77484242e-02] [ 5.23981081e-02] [ 1.87501349e-05] [ 4.03338323e-02] [ 3.73942818e-02] [ 1.72325600e-04] [ 5.55283521e-02] [ 6.46049498e-06] [ 2.72271012e-02] [ 1.57297163e-04] [ 7.65055642e-02] [ 3.79147644e-02] [ 2.73730068e-02] [ 7.20574713e-02] [ 3.99934820e-02] [ 4.06651954e-02] [ 4.81221131e-02] [ 7.70460773e-05] [ 3.25841797e-02] [ 1.17162161e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 52 / Last logScore: -17025846.1608 / New log score: -17025818.2033 / Difference attained: 27.9575077072 Current pi parameter: [[ 3.77364529e-02] [ 9.12934964e-06] [ 3.06751926e-02] [ 4.91368770e-02] [ 6.48154912e-02] [ 1.72294969e-06] [ 6.42665348e-02] [ 2.72195095e-05] [ 5.87648053e-02] [ 8.60511425e-06] [ 1.09044162e-05] [ 4.69932909e-06] [ 5.34494397e-06] [ 1.72324660e-04] [ 6.78830078e-02] [ 3.77443160e-02] [ 5.24024670e-02] [ 1.87503278e-05] [ 4.03330488e-02] [ 3.74313518e-02] [ 1.72325600e-04] [ 5.55837616e-02] [ 6.46056145e-06] [ 2.72270369e-02] [ 1.57297163e-04] [ 7.65056094e-02] [ 3.79148106e-02] [ 2.73758867e-02] [ 7.21053800e-02] [ 4.00934552e-02] [ 4.06656343e-02] [ 4.80670619e-02] [ 7.70468701e-05] [ 3.25882711e-02] [ 1.17163367e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 53 / Last logScore: -17025818.2033 / New log score: -17025790.4248 / Difference attained: 27.7784725279 Current pi parameter: [[ 3.77354657e-02] [ 9.12910040e-06] [ 3.06750805e-02] [ 4.88527196e-02] [ 6.49475013e-02] [ 1.72294969e-06] [ 6.42669086e-02] [ 2.72187663e-05] [ 5.87652045e-02] [ 8.60511425e-06] [ 1.09041185e-05] [ 4.69932909e-06] [ 5.34479804e-06] [ 1.72324660e-04] [ 6.78687347e-02] [ 3.77350485e-02] [ 5.24063132e-02] [ 1.87498159e-05] [ 4.03326083e-02] [ 3.75648198e-02] [ 1.72325600e-04] [ 5.55989673e-02] [ 6.46038507e-06] [ 2.72269841e-02] [ 1.57297163e-04] [ 7.65057161e-02] [ 3.79149752e-02] [ 2.73717141e-02] [ 7.22802498e-02] [ 3.99398240e-02] [ 4.06662849e-02] [ 4.80718433e-02] [ 7.70447665e-05] [ 3.25894939e-02] [ 1.17160168e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 54 / Last logScore: -17025790.4248 / New log score: -17025772.1854 / Difference attained: 18.2393400446 Current pi parameter: [[ 3.77340646e-02] [ 9.12892972e-06] [ 3.06751019e-02] [ 4.85928735e-02] [ 6.51652560e-02] [ 1.72294969e-06] [ 6.42670925e-02] [ 2.72182575e-05] [ 5.87658360e-02] [ 8.60511425e-06] [ 1.09039146e-05] [ 4.69932909e-06] [ 5.34469811e-06] [ 1.72324660e-04] [ 6.78286292e-02] [ 3.77118020e-02] [ 5.24103987e-02] [ 1.87494654e-05] [ 4.03296509e-02] [ 3.75648584e-02] [ 1.72325600e-04] [ 5.56254950e-02] [ 6.46026428e-06] [ 2.72270119e-02] [ 1.57297163e-04] [ 7.65064223e-02] [ 3.79153624e-02] [ 2.73675220e-02] [ 7.23788001e-02] [ 3.99000643e-02] [ 4.06662769e-02] [ 4.80943368e-02] [ 7.70433261e-05] [ 3.25896050e-02] [ 1.17157978e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 55 / Last logScore: -17025772.1854 / New log score: -17025722.8579 / Difference attained: 49.3275764212 Current pi parameter: [[ 3.77344047e-02] [ 9.12921015e-06] [ 3.06750609e-02] [ 4.83082920e-02] [ 6.52126476e-02] [ 1.72294969e-06] [ 6.42670443e-02] [ 2.72190936e-05] [ 5.87672747e-02] [ 8.60511425e-06] [ 1.09042496e-05] [ 4.69932909e-06] [ 5.34486230e-06] [ 1.72324660e-04] [ 6.77697438e-02] [ 3.76601521e-02] [ 5.24163233e-02] [ 1.87500413e-05] [ 4.03156322e-02] [ 3.75637743e-02] [ 1.72325600e-04] [ 5.56957841e-02] [ 6.46046274e-06] [ 2.72270749e-02] [ 1.57297163e-04] [ 7.65071600e-02] [ 3.79157042e-02] [ 2.73630238e-02] [ 7.23915431e-02] [ 4.01231324e-02] [ 4.06663224e-02] [ 4.81467652e-02] [ 7.70456928e-05] [ 3.25895954e-02] [ 1.17161577e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 56 / Last logScore: -17025722.8579 / New log score: -17025660.6419 / Difference attained: 62.2159395628 Current pi parameter: [[ 3.77341450e-02] [ 9.12907082e-06] [ 3.06750670e-02] [ 4.77273606e-02] [ 6.53196596e-02] [ 1.72294969e-06] [ 6.42674419e-02] [ 2.72186782e-05] [ 5.87678052e-02] [ 8.60511425e-06] [ 1.09040832e-05] [ 4.69932909e-06] [ 5.34478073e-06] [ 1.72324660e-04] [ 6.78701670e-02] [ 3.76124511e-02] [ 5.24216607e-02] [ 1.87497552e-05] [ 4.02687223e-02] [ 3.75632739e-02] [ 1.72325600e-04] [ 5.58350344e-02] [ 6.46036414e-06] [ 2.72270847e-02] [ 1.57297163e-04] [ 7.65072182e-02] [ 3.79164168e-02] [ 2.73575453e-02] [ 7.24391455e-02] [ 4.03571755e-02] [ 4.06667633e-02] [ 4.81921868e-02] [ 7.70445170e-05] [ 3.25901333e-02] [ 1.17159788e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 57 / Last logScore: -17025660.6419 / New log score: -17025619.853 / Difference attained: 40.7889449559 Current pi parameter: [[ 3.77268896e-02] [ 9.12911947e-06] [ 3.06752042e-02] [ 4.73739778e-02] [ 6.49349257e-02] [ 1.72294969e-06] [ 6.42723362e-02] [ 2.72188232e-05] [ 5.87685478e-02] [ 8.60511425e-06] [ 1.09041413e-05] [ 4.69932909e-06] [ 5.34480921e-06] [ 1.72324660e-04] [ 6.80618803e-02] [ 3.76096963e-02] [ 5.24276508e-02] [ 1.87498551e-05] [ 4.01602303e-02] [ 3.75616360e-02] [ 1.72325600e-04] [ 5.62354403e-02] [ 6.46039857e-06] [ 2.72270089e-02] [ 1.57297163e-04] [ 7.65072285e-02] [ 3.79252768e-02] [ 2.73502180e-02] [ 7.25478638e-02] [ 4.04982042e-02] [ 4.06669909e-02] [ 4.81934859e-02] [ 7.70449276e-05] [ 3.25917649e-02] [ 1.17160413e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 58 / Last logScore: -17025619.853 / New log score: -17025589.7769 / Difference attained: 30.0761209428 Current pi parameter: [[ 3.76669833e-02] [ 9.12930934e-06] [ 3.06753220e-02] [ 4.73637145e-02] [ 6.45907008e-02] [ 1.72294969e-06] [ 6.42836111e-02] [ 2.72193893e-05] [ 5.87708143e-02] [ 8.60511425e-06] [ 1.09043681e-05] [ 4.69932909e-06] [ 5.34492037e-06] [ 1.72324660e-04] [ 6.80536620e-02] [ 3.76126092e-02] [ 5.24381825e-02] [ 1.87502451e-05] [ 4.01561071e-02] [ 3.75598607e-02] [ 1.72325600e-04] [ 5.65719201e-02] [ 6.46053293e-06] [ 2.72270127e-02] [ 1.57297163e-04] [ 7.65065374e-02] [ 3.79944911e-02] [ 2.73399411e-02] [ 7.25542249e-02] [ 4.04998655e-02] [ 4.06670330e-02] [ 4.81865696e-02] [ 7.70465299e-05] [ 3.25972905e-02] [ 1.17162850e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 59 / Last logScore: -17025589.7769 / New log score: -17025560.9079 / Difference attained: 28.8689173907 Current pi parameter: [[ 3.75632965e-02] [ 9.12935057e-06] [ 3.06753295e-02] [ 4.75565715e-02] [ 6.43296411e-02] [ 1.72294969e-06] [ 6.42914219e-02] [ 2.72195122e-05] [ 5.87771542e-02] [ 8.60511425e-06] [ 1.09044173e-05] [ 4.69932909e-06] [ 5.34494451e-06] [ 1.72324660e-04] [ 6.80452822e-02] [ 3.76167555e-02] [ 5.24570622e-02] [ 1.87503297e-05] [ 4.01558071e-02] [ 3.75560675e-02] [ 1.72325600e-04] [ 5.68313991e-02] [ 6.46056211e-06] [ 2.72270285e-02] [ 1.57297163e-04] [ 7.65064211e-02] [ 3.80881345e-02] [ 2.73243204e-02] [ 7.25667823e-02] [ 4.03026421e-02] [ 4.06669503e-02] [ 4.81794573e-02] [ 7.70468779e-05] [ 3.25989283e-02] [ 1.17163379e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 60 / Last logScore: -17025560.9079 / New log score: -17025548.0915 / Difference attained: 12.8164163828 Current pi parameter: [[ 3.75609559e-02] [ 9.12938641e-06] [ 3.06752816e-02] [ 4.75525010e-02] [ 6.41994524e-02] [ 1.72294969e-06] [ 6.43038422e-02] [ 2.72196191e-05] [ 5.87900919e-02] [ 8.60511425e-06] [ 1.09044601e-05] [ 4.69932909e-06] [ 5.34496549e-06] [ 1.72324660e-04] [ 6.80318035e-02] [ 3.76181993e-02] [ 5.24847492e-02] [ 1.87504033e-05] [ 4.01558598e-02] [ 3.75430665e-02] [ 1.72325600e-04] [ 5.69751835e-02] [ 6.46058747e-06] [ 2.72270426e-02] [ 1.57297163e-04] [ 7.65063592e-02] [ 3.80894339e-02] [ 2.72989939e-02] [ 7.26925747e-02] [ 4.01689679e-02] [ 4.06667765e-02] [ 4.81725437e-02] [ 7.70471803e-05] [ 3.26027729e-02] [ 1.17163839e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 61 / Last logScore: -17025548.0915 / New log score: -17025538.4458 / Difference attained: 9.6456997022 Current pi parameter: [[ 3.75583741e-02] [ 9.12596019e-06] [ 3.06753134e-02] [ 4.75139890e-02] [ 6.41989698e-02] [ 1.72294969e-06] [ 6.43393775e-02] [ 2.72094037e-05] [ 5.88067215e-02] [ 8.60511425e-06] [ 1.09003677e-05] [ 4.69932909e-06] [ 5.34295955e-06] [ 1.72324660e-04] [ 6.79954252e-02] [ 3.76185397e-02] [ 5.25237374e-02] [ 1.87433664e-05] [ 4.01560071e-02] [ 3.75234942e-02] [ 1.72325600e-04] [ 5.70133534e-02] [ 6.45816284e-06] [ 2.72270598e-02] [ 1.57297163e-04] [ 7.65052184e-02] [ 3.80903055e-02] [ 2.72616660e-02] [ 7.27266902e-02] [ 4.01575492e-02] [ 4.06666767e-02] [ 4.81506328e-02] [ 7.70182649e-05] [ 3.26074139e-02] [ 1.17119868e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 62 / Last logScore: -17025538.4458 / New log score: -17025509.1392 / Difference attained: 29.3066090718 Current pi parameter: [[ 3.75539423e-02] [ 9.12497262e-06] [ 3.06754322e-02] [ 4.73880186e-02] [ 6.40914782e-02] [ 1.72294969e-06] [ 6.44477884e-02] [ 2.72064592e-05] [ 5.88468245e-02] [ 8.60511425e-06] [ 1.08991881e-05] [ 4.69932909e-06] [ 5.34238136e-06] [ 1.72324660e-04] [ 6.78865196e-02] [ 3.76193932e-02] [ 5.25503974e-02] [ 1.87413381e-05] [ 4.01564262e-02] [ 3.75282295e-02] [ 1.72325600e-04] [ 5.71454755e-02] [ 6.45746397e-06] [ 2.72270701e-02] [ 1.57297163e-04] [ 7.65045289e-02] [ 3.80906785e-02] [ 2.72383122e-02] [ 7.27301937e-02] [ 4.02408247e-02] [ 4.06664382e-02] [ 4.81178840e-02] [ 7.70099303e-05] [ 3.26106766e-02] [ 1.17107193e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 63 / Last logScore: -17025509.1392 / New log score: -17025473.098 / Difference attained: 36.0412015095 Current pi parameter: [[ 3.75420106e-02] [ 9.12501497e-06] [ 3.06757768e-02] [ 4.72124530e-02] [ 6.39112219e-02] [ 1.72294969e-06] [ 6.45469157e-02] [ 2.72065855e-05] [ 5.89286118e-02] [ 8.60511426e-06] [ 1.08992387e-05] [ 4.69932909e-06] [ 5.34240615e-06] [ 1.72324660e-04] [ 6.77869419e-02] [ 3.76213140e-02] [ 5.25566775e-02] [ 1.87414251e-05] [ 4.01578342e-02] [ 3.75608845e-02] [ 1.72325600e-04] [ 5.73240926e-02] [ 6.45749394e-06] [ 2.72270862e-02] [ 1.57297163e-04] [ 7.65045440e-02] [ 3.80911764e-02] [ 2.72446203e-02] [ 7.27316639e-02] [ 4.03341607e-02] [ 4.06644245e-02] [ 4.80784415e-02] [ 7.70102877e-05] [ 3.26156800e-02] [ 1.17107737e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 64 / Last logScore: -17025473.098 / New log score: -17025454.8 / Difference attained: 18.297969453 Current pi parameter: [[ 3.74745583e-02] [ 9.12492954e-06] [ 3.06759676e-02] [ 4.70350037e-02] [ 6.38711235e-02] [ 1.72294969e-06] [ 6.46133500e-02] [ 2.72063308e-05] [ 5.89397738e-02] [ 8.60511426e-06] [ 1.08991367e-05] [ 4.69932909e-06] [ 5.34235614e-06] [ 1.72324660e-04] [ 6.77284103e-02] [ 3.76215134e-02] [ 5.25576063e-02] [ 1.87412496e-05] [ 4.01589050e-02] [ 3.75585154e-02] [ 1.72325600e-04] [ 5.73786925e-02] [ 6.45743348e-06] [ 2.72271244e-02] [ 1.57297163e-04] [ 7.65039870e-02] [ 3.80911622e-02] [ 2.73103199e-02] [ 7.27363133e-02] [ 4.04986406e-02] [ 4.06541342e-02] [ 4.80579357e-02] [ 7.70095667e-05] [ 3.26234965e-02] [ 1.17106640e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 65 / Last logScore: -17025454.8 / New log score: -17025427.9859 / Difference attained: 26.8141109049 Current pi parameter: [[ 3.73935854e-02] [ 9.12493005e-06] [ 3.06761254e-02] [ 4.68425077e-02] [ 6.38993935e-02] [ 1.72294969e-06] [ 6.46140124e-02] [ 2.72063323e-05] [ 5.89399189e-02] [ 8.60511426e-06] [ 1.08991373e-05] [ 4.69932909e-06] [ 5.34235643e-06] [ 1.72324660e-04] [ 6.78515564e-02] [ 3.76201749e-02] [ 5.25582512e-02] [ 1.87412506e-05] [ 4.01596819e-02] [ 3.75493795e-02] [ 1.72325600e-04] [ 5.73534316e-02] [ 6.45743384e-06] [ 2.72270853e-02] [ 1.57297163e-04] [ 7.65034017e-02] [ 3.80925261e-02] [ 2.73957834e-02] [ 7.27419789e-02] [ 4.06140452e-02] [ 4.06000556e-02] [ 4.80526309e-02] [ 7.70095710e-05] [ 3.26310076e-02] [ 1.17106647e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 66 / Last logScore: -17025427.9859 / New log score: -17025391.7513 / Difference attained: 36.2346628606 Current pi parameter: [[ 3.73930959e-02] [ 9.12492474e-06] [ 3.06760694e-02] [ 4.67111972e-02] [ 6.40265336e-02] [ 1.72294969e-06] [ 6.46166747e-02] [ 2.72063165e-05] [ 5.89402820e-02] [ 8.60511426e-06] [ 1.08991310e-05] [ 4.69932909e-06] [ 5.34235333e-06] [ 1.72324660e-04] [ 6.78819080e-02] [ 3.76185006e-02] [ 5.25591047e-02] [ 1.87412397e-05] [ 4.01598503e-02] [ 3.75045629e-02] [ 1.72325600e-04] [ 5.72077189e-02] [ 6.45743009e-06] [ 2.72269517e-02] [ 1.57297163e-04] [ 7.65023962e-02] [ 3.80924315e-02] [ 2.74567695e-02] [ 7.27540903e-02] [ 4.07970832e-02] [ 4.05031481e-02] [ 4.80511635e-02] [ 7.70095263e-05] [ 3.26370014e-02] [ 1.17106579e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 67 / Last logScore: -17025391.7513 / New log score: -17025375.856 / Difference attained: 15.8952868208 Current pi parameter: [[ 3.73940526e-02] [ 9.12500268e-06] [ 3.06760273e-02] [ 4.67373174e-02] [ 6.41919024e-02] [ 1.72294969e-06] [ 6.46198284e-02] [ 2.72065488e-05] [ 5.89422696e-02] [ 8.60511426e-06] [ 1.08992240e-05] [ 4.69932909e-06] [ 5.34239895e-06] [ 1.72324660e-04] [ 6.78646838e-02] [ 3.76166908e-02] [ 5.25579908e-02] [ 1.87413998e-05] [ 4.01599335e-02] [ 3.73773224e-02] [ 1.72325600e-04] [ 5.72130715e-02] [ 6.45748524e-06] [ 2.72259082e-02] [ 1.57297163e-04] [ 7.65028395e-02] [ 3.80913411e-02] [ 2.74065212e-02] [ 7.27806692e-02] [ 4.07721657e-02] [ 4.04888891e-02] [ 4.80496719e-02] [ 7.70101840e-05] [ 3.26474359e-02] [ 1.17107579e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 68 / Last logScore: -17025375.856 / New log score: -17025348.4512 / Difference attained: 27.4048346542 Current pi parameter: [[ 3.74021672e-02] [ 9.12494347e-06] [ 3.06760392e-02] [ 4.68628342e-02] [ 6.43535702e-02] [ 1.72294969e-06] [ 6.46226920e-02] [ 2.72063723e-05] [ 5.89441441e-02] [ 8.60511426e-06] [ 1.08991533e-05] [ 4.69932909e-06] [ 5.34236429e-06] [ 1.72324660e-04] [ 6.78082979e-02] [ 3.76156634e-02] [ 5.25578347e-02] [ 1.87412782e-05] [ 4.01599966e-02] [ 3.71956306e-02] [ 1.72325600e-04] [ 5.72163445e-02] [ 6.45744334e-06] [ 2.72244582e-02] [ 1.57297163e-04] [ 7.65033223e-02] [ 3.80915838e-02] [ 2.74078815e-02] [ 7.28548681e-02] [ 4.06257701e-02] [ 4.04864378e-02] [ 4.80490579e-02] [ 7.70096843e-05] [ 3.26579388e-02] [ 1.17106819e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 69 / Last logScore: -17025348.4512 / New log score: -17025306.462 / Difference attained: 41.9891374633 Current pi parameter: [[ 3.75064720e-02] [ 9.12488985e-06] [ 3.06760938e-02] [ 4.68732511e-02] [ 6.43989579e-02] [ 1.72294969e-06] [ 6.46268898e-02] [ 2.72062125e-05] [ 5.89462085e-02] [ 8.60511426e-06] [ 1.08990893e-05] [ 4.69932909e-06] [ 5.34233290e-06] [ 1.72324660e-04] [ 6.75518799e-02] [ 3.76154994e-02] [ 5.25577994e-02] [ 1.87411681e-05] [ 4.01600515e-02] [ 3.70389358e-02] [ 1.72325600e-04] [ 5.72152106e-02] [ 6.45740540e-06] [ 2.72228381e-02] [ 1.57297163e-04] [ 7.65037479e-02] [ 3.80970966e-02] [ 2.74094322e-02] [ 7.31589320e-02] [ 4.05573165e-02] [ 4.04844923e-02] [ 4.80486482e-02] [ 7.70092318e-05] [ 3.26667807e-02] [ 1.17106131e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 70 / Last logScore: -17025306.462 / New log score: -17025273.4575 / Difference attained: 33.0045015626 Current pi parameter: [[ 3.75661557e-02] [ 9.12473821e-06] [ 3.06759971e-02] [ 4.68772399e-02] [ 6.44967338e-02] [ 1.72294969e-06] [ 6.46417771e-02] [ 2.72057603e-05] [ 5.89502404e-02] [ 8.60511426e-06] [ 1.08989081e-05] [ 4.69932909e-06] [ 5.34224412e-06] [ 1.72324660e-04] [ 6.71637900e-02] [ 3.76151586e-02] [ 5.25562837e-02] [ 1.87408566e-05] [ 4.01601248e-02] [ 3.68796105e-02] [ 1.72325600e-04] [ 5.72119475e-02] [ 6.45729808e-06] [ 2.72200155e-02] [ 1.57297163e-04] [ 7.65039734e-02] [ 3.81279789e-02] [ 2.74130424e-02] [ 7.35705032e-02] [ 4.04817386e-02] [ 4.04815632e-02] [ 4.80487673e-02] [ 7.70079520e-05] [ 3.26738955e-02] [ 1.17104185e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 71 / Last logScore: -17025273.4575 / New log score: -17025254.6651 / Difference attained: 18.7924407944 Current pi parameter: [[ 3.75673051e-02] [ 9.12435086e-06] [ 3.06756012e-02] [ 4.68892809e-02] [ 6.44976251e-02] [ 1.72294969e-06] [ 6.47303353e-02] [ 2.72046054e-05] [ 5.89627185e-02] [ 8.60511426e-06] [ 1.08984455e-05] [ 4.69932909e-06] [ 5.34201734e-06] [ 1.72324660e-04] [ 6.67990468e-02] [ 3.76150642e-02] [ 5.25554101e-02] [ 1.87400611e-05] [ 4.01603561e-02] [ 3.68753545e-02] [ 1.72325600e-04] [ 5.72088794e-02] [ 6.45702397e-06] [ 2.72099175e-02] [ 1.57297163e-04] [ 7.64962499e-02] [ 3.83103994e-02] [ 2.74244709e-02] [ 7.37139763e-02] [ 4.04212566e-02] [ 4.04747809e-02] [ 4.80491207e-02] [ 7.70046830e-05] [ 3.26793947e-02] [ 1.17099214e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 72 / Last logScore: -17025254.6651 / New log score: -17025217.6443 / Difference attained: 37.0207995623 Current pi parameter: [[ 3.75674748e-02] [ 9.12425226e-06] [ 3.06759863e-02] [ 4.68796612e-02] [ 6.44959118e-02] [ 1.72294969e-06] [ 6.47889245e-02] [ 2.72043114e-05] [ 5.89988965e-02] [ 8.60511426e-06] [ 1.08983277e-05] [ 4.69932909e-06] [ 5.34195961e-06] [ 1.72324660e-04] [ 6.65235258e-02] [ 3.76155404e-02] [ 5.25552151e-02] [ 1.87398586e-05] [ 4.01619165e-02] [ 3.68752238e-02] [ 1.72325600e-04] [ 5.72057250e-02] [ 6.45695419e-06] [ 2.70958158e-02] [ 1.57297163e-04] [ 7.64948747e-02] [ 3.84349092e-02] [ 2.75399239e-02] [ 7.39138497e-02] [ 4.03191343e-02] [ 4.04413372e-02] [ 4.80492318e-02] [ 7.70038508e-05] [ 3.26834677e-02] [ 1.17097948e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 73 / Last logScore: -17025217.6443 / New log score: -17025187.4198 / Difference attained: 30.2244919129 Current pi parameter: [[ 3.75676317e-02] [ 9.12447978e-06] [ 3.06762880e-02] [ 4.68811114e-02] [ 6.44948101e-02] [ 1.72294969e-06] [ 6.48754483e-02] [ 2.72049898e-05] [ 5.91223646e-02] [ 8.60511426e-06] [ 1.08985995e-05] [ 4.69932909e-06] [ 5.34209281e-06] [ 1.72324660e-04] [ 6.63713456e-02] [ 3.76159720e-02] [ 5.25539880e-02] [ 1.87403259e-05] [ 4.01639155e-02] [ 3.68752142e-02] [ 1.72325600e-04] [ 5.72029032e-02] [ 6.45711520e-06] [ 2.70546714e-02] [ 1.57297163e-04] [ 7.64955277e-02] [ 3.84387337e-02] [ 2.76206205e-02] [ 7.39440194e-02] [ 4.03057838e-02] [ 4.03204988e-02] [ 4.80492875e-02] [ 7.70057710e-05] [ 3.26864063e-02] [ 1.17100868e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 74 / Last logScore: -17025187.4198 / New log score: -17025135.1638 / Difference attained: 52.2559917495 Current pi parameter: [[ 3.75675394e-02] [ 9.12460947e-06] [ 3.06759586e-02] [ 4.69219136e-02] [ 6.44940175e-02] [ 1.72294969e-06] [ 6.50797602e-02] [ 2.72053765e-05] [ 5.91242197e-02] [ 8.60511426e-06] [ 1.08987544e-05] [ 4.69932909e-06] [ 5.34216874e-06] [ 1.72324660e-04] [ 6.60389756e-02] [ 3.76163739e-02] [ 5.25516205e-02] [ 1.87405922e-05] [ 4.01731532e-02] [ 3.68752604e-02] [ 1.72325600e-04] [ 5.72010377e-02] [ 6.45720698e-06] [ 2.70545858e-02] [ 1.57297163e-04] [ 7.64903068e-02] [ 3.84395067e-02] [ 2.77410938e-02] [ 7.39975135e-02] [ 4.02139506e-02] [ 4.03219099e-02] [ 4.80493272e-02] [ 7.70068655e-05] [ 3.26885147e-02] [ 1.17102533e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 75 / Last logScore: -17025135.1638 / New log score: -17025100.1477 / Difference attained: 35.016124513 Current pi parameter: [[ 3.75611213e-02] [ 9.12313047e-06] [ 3.06761157e-02] [ 4.70248627e-02] [ 6.44934219e-02] [ 1.72294969e-06] [ 6.52422817e-02] [ 2.72009668e-05] [ 5.91243014e-02] [ 8.60511426e-06] [ 1.08969878e-05] [ 4.69932909e-06] [ 5.34130284e-06] [ 1.72324660e-04] [ 6.56172193e-02] [ 3.76167434e-02] [ 5.25415977e-02] [ 1.87375546e-05] [ 4.02165952e-02] [ 3.68755000e-02] [ 1.72325600e-04] [ 5.71997878e-02] [ 6.45616033e-06] [ 2.70546092e-02] [ 1.57297163e-04] [ 7.64714901e-02] [ 3.84514691e-02] [ 2.77758179e-02] [ 7.41571556e-02] [ 4.01549724e-02] [ 4.03220837e-02] [ 4.80493576e-02] [ 7.69943835e-05] [ 3.26900627e-02] [ 1.17083552e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 76 / Last logScore: -17025100.1477 / New log score: -17025035.2687 / Difference attained: 64.8789825961 Current pi parameter: [[ 3.75412090e-02] [ 9.12123811e-06] [ 3.06804710e-02] [ 4.69581595e-02] [ 6.44929701e-02] [ 1.72294969e-06] [ 6.53600286e-02] [ 2.71953247e-05] [ 5.90360127e-02] [ 8.60511426e-06] [ 1.08947275e-05] [ 4.69932909e-06] [ 5.34019492e-06] [ 1.72324660e-04] [ 6.53335309e-02] [ 3.76170509e-02] [ 5.25319366e-02] [ 1.87336680e-05] [ 4.03665231e-02] [ 3.68759970e-02] [ 1.72325600e-04] [ 5.71988977e-02] [ 6.45482117e-06] [ 2.70546368e-02] [ 1.57297163e-04] [ 7.64138682e-02] [ 3.85681991e-02] [ 2.78110645e-02] [ 7.42566248e-02] [ 4.01568566e-02] [ 4.03220878e-02] [ 4.80493811e-02] [ 7.69784131e-05] [ 3.26910947e-02] [ 1.17059266e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 77 / Last logScore: -17025035.2687 / New log score: -17024926.7598 / Difference attained: 108.508835774 Current pi parameter: [[ 3.74224626e-02] [ 9.12031982e-06] [ 3.06807629e-02] [ 4.68526078e-02] [ 6.44925715e-02] [ 1.72294969e-06] [ 6.52765598e-02] [ 2.71925867e-05] [ 5.89529506e-02] [ 8.60511426e-06] [ 1.08936307e-05] [ 4.69932909e-06] [ 5.33965729e-06] [ 1.72324660e-04] [ 6.51083113e-02] [ 3.76172828e-02] [ 5.25210743e-02] [ 1.87317819e-05] [ 4.07885883e-02] [ 3.68762047e-02] [ 1.72325600e-04] [ 5.71983804e-02] [ 6.45417132e-06] [ 2.70546394e-02] [ 1.57297163e-04] [ 7.62354681e-02] [ 3.86390134e-02] [ 2.79471302e-02] [ 7.44259519e-02] [ 4.01633706e-02] [ 4.03220950e-02] [ 4.80494007e-02] [ 7.69706631e-05] [ 3.26917914e-02] [ 1.17047481e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 78 / Last logScore: -17024926.7598 / New log score: -17024828.6412 / Difference attained: 98.1186757535 Current pi parameter: [[ 3.73926647e-02] [ 9.11862049e-06] [ 3.07753571e-02] [ 4.66634951e-02] [ 6.44922270e-02] [ 1.72294969e-06] [ 6.53183376e-02] [ 2.71875201e-05] [ 5.89498471e-02] [ 8.60511426e-06] [ 1.08916009e-05] [ 4.69932909e-06] [ 5.33866239e-06] [ 1.72324660e-04] [ 6.50884963e-02] [ 3.76171576e-02] [ 5.25021719e-02] [ 1.87282917e-05] [ 4.10062800e-02] [ 3.68763597e-02] [ 1.72325600e-04] [ 5.71983065e-02] [ 6.45296876e-06] [ 2.70546457e-02] [ 1.57297163e-04] [ 7.59320147e-02] [ 3.86594687e-02] [ 2.80190133e-02] [ 7.45158180e-02] [ 4.01908023e-02] [ 4.03224711e-02] [ 4.80494176e-02] [ 7.69563217e-05] [ 3.26922967e-02] [ 1.17025672e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 79 / Last logScore: -17024828.6412 / New log score: -17024757.8808 / Difference attained: 70.7603894845 Current pi parameter: [[ 3.73848941e-02] [ 9.11818602e-06] [ 3.09550423e-02] [ 4.66039512e-02] [ 6.44924358e-02] [ 1.72294969e-06] [ 6.56383850e-02] [ 2.71862247e-05] [ 5.89485991e-02] [ 8.60511426e-06] [ 1.08910820e-05] [ 4.69932909e-06] [ 5.33840802e-06] [ 1.72324660e-04] [ 6.46134320e-02] [ 3.76172189e-02] [ 5.24669460e-02] [ 1.87273994e-05] [ 4.11646777e-02] [ 3.68767936e-02] [ 1.72325600e-04] [ 5.71981948e-02] [ 6.45266130e-06] [ 2.70546858e-02] [ 1.57297163e-04] [ 7.57282956e-02] [ 3.87425505e-02] [ 2.81020415e-02] [ 7.44065711e-02] [ 4.02476877e-02] [ 4.03321932e-02] [ 4.80494337e-02] [ 7.69526550e-05] [ 3.26926269e-02] [ 1.17020096e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 80 / Last logScore: -17024757.8808 / New log score: -17024692.2903 / Difference attained: 65.5904652588 Current pi parameter: [[ 3.73540971e-02] [ 9.11771499e-06] [ 3.08712698e-02] [ 4.65310335e-02] [ 6.44922605e-02] [ 1.72294969e-06] [ 6.58211323e-02] [ 2.71848203e-05] [ 5.89427181e-02] [ 8.60511426e-06] [ 1.08905194e-05] [ 4.69932909e-06] [ 5.33813225e-06] [ 1.72324660e-04] [ 6.45615538e-02] [ 3.76174699e-02] [ 5.24374292e-02] [ 1.87264320e-05] [ 4.11465513e-02] [ 3.68846579e-02] [ 1.72325600e-04] [ 5.71981326e-02] [ 6.45232796e-06] [ 2.70547019e-02] [ 1.57297163e-04] [ 7.55488856e-02] [ 3.89580621e-02] [ 2.82531565e-02] [ 7.41254928e-02] [ 4.03203136e-02] [ 4.04554526e-02] [ 4.80494529e-02] [ 7.69486797e-05] [ 3.26928411e-02] [ 1.17014051e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 81 / Last logScore: -17024692.2903 / New log score: -17024611.0206 / Difference attained: 81.2696680874 Current pi parameter: [[ 3.72264846e-02] [ 9.11672871e-06] [ 3.08531251e-02] [ 4.65268336e-02] [ 6.44920121e-02] [ 1.72294969e-06] [ 6.57743070e-02] [ 2.71818797e-05] [ 5.89210871e-02] [ 8.60511426e-06] [ 1.08893413e-05] [ 4.69932909e-06] [ 5.33755481e-06] [ 1.72324660e-04] [ 6.47492703e-02] [ 3.76178897e-02] [ 5.24478261e-02] [ 1.87244063e-05] [ 4.11244186e-02] [ 3.70421717e-02] [ 1.72325600e-04] [ 5.71980351e-02] [ 6.45163000e-06] [ 2.70547203e-02] [ 1.57297163e-04] [ 7.52229097e-02] [ 3.92834516e-02] [ 2.85361671e-02] [ 7.36832783e-02] [ 4.03245272e-02] [ 4.04956895e-02] [ 4.80494674e-02] [ 7.69403561e-05] [ 3.26930112e-02] [ 1.17001393e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 82 / Last logScore: -17024611.0206 / New log score: -17024587.3113 / Difference attained: 23.7093904875 Current pi parameter: [[ 3.72256640e-02] [ 9.11538679e-06] [ 3.08559933e-02] [ 4.65272272e-02] [ 6.44916832e-02] [ 1.72294969e-06] [ 6.56590737e-02] [ 2.71778787e-05] [ 5.88195979e-02] [ 8.60511426e-06] [ 1.08877385e-05] [ 4.69932909e-06] [ 5.33676916e-06] [ 1.72324660e-04] [ 6.52246108e-02] [ 3.76187553e-02] [ 5.24762562e-02] [ 1.87216502e-05] [ 4.10912693e-02] [ 3.70525122e-02] [ 1.72325600e-04] [ 5.71983242e-02] [ 6.45068037e-06] [ 2.70547325e-02] [ 1.57297163e-04] [ 7.47918590e-02] [ 3.92872664e-02] [ 2.85767098e-02] [ 7.38023493e-02] [ 4.03264546e-02] [ 4.04936960e-02] [ 4.80494772e-02] [ 7.69290310e-05] [ 3.26931956e-02] [ 1.16984172e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 83 / Last logScore: -17024587.3113 / New log score: -17024566.5505 / Difference attained: 20.7608036064 Current pi parameter: [[ 3.72284400e-02] [ 9.11524846e-06] [ 3.08586288e-02] [ 4.65273300e-02] [ 6.44914619e-02] [ 1.72294969e-06] [ 6.56356373e-02] [ 2.71774663e-05] [ 5.87846413e-02] [ 8.60511426e-06] [ 1.08875733e-05] [ 4.69932909e-06] [ 5.33668817e-06] [ 1.72324660e-04] [ 6.52662665e-02] [ 3.76190393e-02] [ 5.25172166e-02] [ 1.87213661e-05] [ 4.10476143e-02] [ 3.70555409e-02] [ 1.72325600e-04] [ 5.71979598e-02] [ 6.45058248e-06] [ 2.70547289e-02] [ 1.57297163e-04] [ 7.45061740e-02] [ 3.92841915e-02] [ 2.85906345e-02] [ 7.41137009e-02] [ 4.03315279e-02] [ 4.04631809e-02] [ 4.80494800e-02] [ 7.69278636e-05] [ 3.26933150e-02] [ 1.16982396e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 84 / Last logScore: -17024566.5505 / New log score: -17024530.2757 / Difference attained: 36.2747117504 Current pi parameter: [[ 3.72338190e-02] [ 9.11522969e-06] [ 3.08714097e-02] [ 4.65273515e-02] [ 6.44912451e-02] [ 1.72294969e-06] [ 6.56179620e-02] [ 2.71774103e-05] [ 5.87806611e-02] [ 8.60511426e-06] [ 1.08875508e-05] [ 4.69932909e-06] [ 5.33667718e-06] [ 1.72324660e-04] [ 6.53008137e-02] [ 3.76192056e-02] [ 5.25426264e-02] [ 1.87213275e-05] [ 4.10209202e-02] [ 3.70586718e-02] [ 1.72325600e-04] [ 5.71908763e-02] [ 6.45056919e-06] [ 2.70547239e-02] [ 1.57297163e-04] [ 7.40719186e-02] [ 3.92788284e-02] [ 2.85904660e-02] [ 7.46076586e-02] [ 4.03416515e-02] [ 4.03730294e-02] [ 4.80494854e-02] [ 7.69277051e-05] [ 3.26933862e-02] [ 1.16982155e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 85 / Last logScore: -17024530.2757 / New log score: -17024509.1942 / Difference attained: 21.0815823711 Current pi parameter: [[ 3.72547153e-02] [ 9.11459709e-06] [ 3.09431889e-02] [ 4.65273685e-02] [ 6.44908526e-02] [ 1.72294969e-06] [ 6.55473474e-02] [ 2.71755242e-05] [ 5.87783933e-02] [ 8.60511426e-06] [ 1.08867952e-05] [ 4.69932909e-06] [ 5.33630681e-06] [ 1.72324660e-04] [ 6.53156729e-02] [ 3.76192803e-02] [ 5.25635135e-02] [ 1.87200283e-05] [ 4.10153129e-02] [ 3.70622297e-02] [ 1.72325600e-04] [ 5.70745770e-02] [ 6.45012152e-06] [ 2.70547150e-02] [ 1.57297163e-04] [ 7.39048359e-02] [ 3.92582016e-02] [ 2.85754510e-02] [ 7.48964685e-02] [ 4.03646412e-02] [ 4.03267937e-02] [ 4.80494069e-02] [ 7.69223663e-05] [ 3.26937559e-02] [ 1.16974037e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 86 / Last logScore: -17024509.1942 / New log score: -17024468.3922 / Difference attained: 40.8020073809 Current pi parameter: [[ 3.73862346e-02] [ 9.11442267e-06] [ 3.10153235e-02] [ 4.65274035e-02] [ 6.44875425e-02] [ 1.72294969e-06] [ 6.54685754e-02] [ 2.71750041e-05] [ 5.87806840e-02] [ 8.60511426e-06] [ 1.08865869e-05] [ 4.69932909e-06] [ 5.33620470e-06] [ 1.72324660e-04] [ 6.53138309e-02] [ 3.76187519e-02] [ 5.26672220e-02] [ 1.87196700e-05] [ 4.10146251e-02] [ 3.70649058e-02] [ 1.72325600e-04] [ 5.70239557e-02] [ 6.44999809e-06] [ 2.70546851e-02] [ 1.57297163e-04] [ 7.37247560e-02] [ 3.91271942e-02] [ 2.85209625e-02] [ 7.50272185e-02] [ 4.04262755e-02] [ 4.03180151e-02] [ 4.80480783e-02] [ 7.69208943e-05] [ 3.27004853e-02] [ 1.16971798e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 87 / Last logScore: -17024468.3922 / New log score: -17024437.8963 / Difference attained: 30.4958643243 Current pi parameter: [[ 3.74131077e-02] [ 9.11360962e-06] [ 3.10184105e-02] [ 4.65275053e-02] [ 6.44850539e-02] [ 1.72294969e-06] [ 6.54017983e-02] [ 2.71725800e-05] [ 5.88248045e-02] [ 8.60511426e-06] [ 1.08856158e-05] [ 4.69932909e-06] [ 5.33572868e-06] [ 1.72324660e-04] [ 6.53116501e-02] [ 3.75984176e-02] [ 5.27168115e-02] [ 1.87180002e-05] [ 4.10147788e-02] [ 3.70604878e-02] [ 1.72325600e-04] [ 5.70203074e-02] [ 6.44942272e-06] [ 2.70545291e-02] [ 1.57297163e-04] [ 7.35287781e-02] [ 3.91185932e-02] [ 2.86009539e-02] [ 7.53591859e-02] [ 4.01907123e-02] [ 4.03163322e-02] [ 4.80475042e-02] [ 7.69140326e-05] [ 3.27070177e-02] [ 1.16961364e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 88 / Last logScore: -17024437.8963 / New log score: -17024408.1584 / Difference attained: 29.7378889211 Current pi parameter: [[ 3.74951335e-02] [ 9.11374750e-06] [ 3.10196751e-02] [ 4.65274716e-02] [ 6.44839411e-02] [ 1.72294969e-06] [ 6.53141345e-02] [ 2.71729911e-05] [ 5.89481409e-02] [ 8.60511426e-06] [ 1.08857805e-05] [ 4.69932909e-06] [ 5.33580941e-06] [ 1.72324660e-04] [ 6.53049608e-02] [ 3.75084254e-02] [ 5.27248857e-02] [ 1.87182834e-05] [ 4.10150108e-02] [ 3.70548286e-02] [ 1.72325600e-04] [ 5.70179318e-02] [ 6.44952029e-06] [ 2.70543472e-02] [ 1.57297163e-04] [ 7.32405385e-02] [ 3.91186326e-02] [ 2.85903005e-02] [ 7.56813280e-02] [ 4.01382271e-02] [ 4.03222927e-02] [ 4.80477546e-02] [ 7.69151963e-05] [ 3.27087767e-02] [ 1.16963133e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 89 / Last logScore: -17024408.1584 / New log score: -17024320.1085 / Difference attained: 88.0499445312 Current pi parameter: [[ 3.75408735e-02] [ 9.11473566e-06] [ 3.10200412e-02] [ 4.65274348e-02] [ 6.44821413e-02] [ 1.72294969e-06] [ 6.53143828e-02] [ 2.71759373e-05] [ 5.89498800e-02] [ 8.60511426e-06] [ 1.08869608e-05] [ 4.69932909e-06] [ 5.33638794e-06] [ 1.72324660e-04] [ 6.52302337e-02] [ 3.74476343e-02] [ 5.27263948e-02] [ 1.87203129e-05] [ 4.10150444e-02] [ 3.70519629e-02] [ 1.72325600e-04] [ 5.70168912e-02] [ 6.45021958e-06] [ 2.70543329e-02] [ 1.57297163e-04] [ 7.30235071e-02] [ 3.91187734e-02] [ 2.84537895e-02] [ 7.61340077e-02] [ 4.01167032e-02] [ 4.03335523e-02] [ 4.80503858e-02] [ 7.69235358e-05] [ 3.27087526e-02] [ 1.16975815e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 90 / Last logScore: -17024320.1085 / New log score: -17024261.502 / Difference attained: 58.6064051241 Current pi parameter: [[ 3.74362316e-02] [ 9.11619669e-06] [ 3.10198081e-02] [ 4.65274376e-02] [ 6.44739909e-02] [ 1.72294969e-06] [ 6.53191168e-02] [ 2.71802935e-05] [ 5.89502055e-02] [ 8.60511426e-06] [ 1.08887059e-05] [ 4.69932909e-06] [ 5.33724333e-06] [ 1.72324660e-04] [ 6.53099450e-02] [ 3.74483550e-02] [ 5.27259162e-02] [ 1.87233136e-05] [ 4.10150942e-02] [ 3.70508881e-02] [ 1.72325600e-04] [ 5.70152443e-02] [ 6.45125351e-06] [ 2.70543205e-02] [ 1.57297163e-04] [ 7.28576470e-02] [ 3.91188483e-02] [ 2.83582968e-02] [ 7.63998552e-02] [ 4.00354403e-02] [ 4.04022753e-02] [ 4.80574752e-02] [ 7.69358661e-05] [ 3.27403011e-02] [ 1.16994566e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 91 / Last logScore: -17024261.502 / New log score: -17024217.6665 / Difference attained: 43.8355272561 Current pi parameter: [[ 3.73149898e-02] [ 9.11655160e-06] [ 3.10187928e-02] [ 4.65274806e-02] [ 6.44377923e-02] [ 1.72294969e-06] [ 6.53550688e-02] [ 2.71813516e-05] [ 5.89485605e-02] [ 8.60511426e-06] [ 1.08891298e-05] [ 4.69932909e-06] [ 5.33745112e-06] [ 1.72324660e-04] [ 6.50498704e-02] [ 3.74751350e-02] [ 5.27269881e-02] [ 1.87240426e-05] [ 4.10151087e-02] [ 3.70505426e-02] [ 1.72325600e-04] [ 5.70161176e-02] [ 6.45150467e-06] [ 2.70542687e-02] [ 1.57297163e-04] [ 7.28029078e-02] [ 3.91188829e-02] [ 2.83510129e-02] [ 7.67353734e-02] [ 3.99704157e-02] [ 4.04133223e-02] [ 4.80665497e-02] [ 7.69388614e-05] [ 3.28675056e-02] [ 1.16999121e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 92 / Last logScore: -17024217.6665 / New log score: -17024192.2761 / Difference attained: 25.3904032037 Current pi parameter: [[ 3.72162736e-02] [ 9.11700474e-06] [ 3.10165462e-02] [ 4.65274304e-02] [ 6.43124548e-02] [ 1.72294969e-06] [ 6.54927254e-02] [ 2.71827027e-05] [ 5.89608987e-02] [ 8.60511426e-06] [ 1.08896710e-05] [ 4.69932909e-06] [ 5.33771642e-06] [ 1.72324660e-04] [ 6.49459065e-02] [ 3.75777110e-02] [ 5.27284974e-02] [ 1.87249732e-05] [ 4.10151224e-02] [ 3.70503566e-02] [ 1.72325600e-04] [ 5.70168646e-02] [ 6.45182534e-06] [ 2.70542253e-02] [ 1.57297163e-04] [ 7.26951732e-02] [ 3.91188197e-02] [ 2.84347051e-02] [ 7.68884460e-02] [ 3.99717782e-02] [ 4.03216007e-02] [ 4.80888469e-02] [ 7.69426856e-05] [ 3.28822954e-02] [ 1.17004936e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 93 / Last logScore: -17024192.2761 / New log score: -17024174.7727 / Difference attained: 17.5034335256 Current pi parameter: [[ 3.72146200e-02] [ 9.11731495e-06] [ 3.10116460e-02] [ 4.65268576e-02] [ 6.41769894e-02] [ 1.72294969e-06] [ 6.55805548e-02] [ 2.71836276e-05] [ 5.89777291e-02] [ 8.60511426e-06] [ 1.08900415e-05] [ 4.69932909e-06] [ 5.33789803e-06] [ 1.72324660e-04] [ 6.48356422e-02] [ 3.76241601e-02] [ 5.27300210e-02] [ 1.87256104e-05] [ 4.10151297e-02] [ 3.70501869e-02] [ 1.72325600e-04] [ 5.70187488e-02] [ 6.45204487e-06] [ 2.70542596e-02] [ 1.57297163e-04] [ 7.26329894e-02] [ 3.91186709e-02] [ 2.84347931e-02] [ 7.69677955e-02] [ 3.99714352e-02] [ 4.03144270e-02] [ 4.81765244e-02] [ 7.69453036e-05] [ 3.28834917e-02] [ 1.17008917e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 94 / Last logScore: -17024174.7727 / New log score: -17024165.1601 / Difference attained: 9.61258294806 Current pi parameter: [[ 3.72138525e-02] [ 9.11742070e-06] [ 3.09987655e-02] [ 4.65257951e-02] [ 6.41585298e-02] [ 1.72294969e-06] [ 6.56599462e-02] [ 2.71839429e-05] [ 5.89943837e-02] [ 8.60511426e-06] [ 1.08901679e-05] [ 4.69932909e-06] [ 5.33795995e-06] [ 1.72324660e-04] [ 6.47006914e-02] [ 3.76004976e-02] [ 5.27306830e-02] [ 1.87258276e-05] [ 4.10151314e-02] [ 3.70501400e-02] [ 1.72325600e-04] [ 5.70205729e-02] [ 6.45211971e-06] [ 2.70542511e-02] [ 1.57297163e-04] [ 7.25341381e-02] [ 3.91186844e-02] [ 2.84346665e-02] [ 7.71250059e-02] [ 3.99715730e-02] [ 4.03079833e-02] [ 4.82178435e-02] [ 7.69461961e-05] [ 3.28835357e-02] [ 1.17010274e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 95 / Last logScore: -17024165.1601 / New log score: -17024148.983 / Difference attained: 16.1771118529 Current pi parameter: [[ 3.72134141e-02] [ 9.11763820e-06] [ 3.09227153e-02] [ 4.65249744e-02] [ 6.41590403e-02] [ 1.72294969e-06] [ 6.56635566e-02] [ 2.71845914e-05] [ 5.90108559e-02] [ 8.60511426e-06] [ 1.08904277e-05] [ 4.69932909e-06] [ 5.33808729e-06] [ 1.72324660e-04] [ 6.46251436e-02] [ 3.76000893e-02] [ 5.27310030e-02] [ 1.87262743e-05] [ 4.10151349e-02] [ 3.70501304e-02] [ 1.72325600e-04] [ 5.70213053e-02] [ 6.45227362e-06] [ 2.70542437e-02] [ 1.57297163e-04] [ 7.24650077e-02] [ 3.91187333e-02] [ 2.84337822e-02] [ 7.73067085e-02] [ 3.99721380e-02] [ 4.03283237e-02] [ 4.82177468e-02] [ 7.69480317e-05] [ 3.28826197e-02] [ 1.17013066e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 96 / Last logScore: -17024148.983 / New log score: -17024119.7474 / Difference attained: 29.2356372662 Current pi parameter: [[ 3.72131469e-02] [ 9.11789921e-06] [ 3.08459223e-02] [ 4.65243403e-02] [ 6.41594518e-02] [ 1.72294969e-06] [ 6.57551332e-02] [ 2.71853696e-05] [ 5.90264043e-02] [ 8.60511426e-06] [ 1.08907394e-05] [ 4.69932909e-06] [ 5.33824010e-06] [ 1.72324660e-04] [ 6.45627555e-02] [ 3.76001157e-02] [ 5.27305917e-02] [ 1.87268103e-05] [ 4.10151217e-02] [ 3.70501285e-02] [ 1.72325600e-04] [ 5.70214989e-02] [ 6.45245833e-06] [ 2.70542407e-02] [ 1.57297163e-04] [ 7.23910373e-02] [ 3.91187794e-02] [ 2.84311041e-02] [ 7.74322109e-02] [ 3.99736910e-02] [ 4.03137081e-02] [ 4.82177131e-02] [ 7.69502345e-05] [ 3.28795663e-02] [ 1.17016415e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 97 / Last logScore: -17024119.7474 / New log score: -17024073.0004 / Difference attained: 46.746946197 Current pi parameter: [[ 3.72129634e-02] [ 9.11818255e-06] [ 3.07675998e-02] [ 4.65237706e-02] [ 6.41598604e-02] [ 1.72294969e-06] [ 6.58361230e-02] [ 2.71862144e-05] [ 5.90364959e-02] [ 8.60511426e-06] [ 1.08910778e-05] [ 4.69932909e-06] [ 5.33840599e-06] [ 1.72324660e-04] [ 6.43948253e-02] [ 3.76001250e-02] [ 5.27295436e-02] [ 1.87273923e-05] [ 4.10151353e-02] [ 3.70501303e-02] [ 1.72325600e-04] [ 5.70218265e-02] [ 6.45265885e-06] [ 2.70542366e-02] [ 1.57297163e-04] [ 7.23881368e-02] [ 3.91187526e-02] [ 2.84250082e-02] [ 7.76861435e-02] [ 3.99771607e-02] [ 4.02312736e-02] [ 4.82177098e-02] [ 7.69526257e-05] [ 3.28698357e-02] [ 1.17020052e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 98 / Last logScore: -17024073.0004 / New log score: -17024035.7481 / Difference attained: 37.252278436 Current pi parameter: [[ 3.72128037e-02] [ 9.11846671e-06] [ 3.06803017e-02] [ 4.65231912e-02] [ 6.41603577e-02] [ 1.72294969e-06] [ 6.58463811e-02] [ 2.71870616e-05] [ 5.90081950e-02] [ 8.60511426e-06] [ 1.08914172e-05] [ 4.69932909e-06] [ 5.33857235e-06] [ 1.72324660e-04] [ 6.43161493e-02] [ 3.76001267e-02] [ 5.27271297e-02] [ 1.87279759e-05] [ 4.10151644e-02] [ 3.70501356e-02] [ 1.72325600e-04] [ 5.70227778e-02] [ 6.45285993e-06] [ 2.70542285e-02] [ 1.57297163e-04] [ 7.24017267e-02] [ 3.91181075e-02] [ 2.83888771e-02] [ 7.80918318e-02] [ 3.99734594e-02] [ 4.00872343e-02] [ 4.82177090e-02] [ 7.69550239e-05] [ 3.28207632e-02] [ 1.17023698e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 99 / Last logScore: -17024035.7481 / New log score: -17024001.1059 / Difference attained: 34.6422509365 Current pi parameter: [[ 3.72125132e-02] [ 9.11862181e-06] [ 3.06149818e-02] [ 4.65225329e-02] [ 6.41609737e-02] [ 1.72294969e-06] [ 6.58479857e-02] [ 2.71875240e-05] [ 5.89251362e-02] [ 8.60511426e-06] [ 1.08916025e-05] [ 4.69932909e-06] [ 5.33866316e-06] [ 1.72324660e-04] [ 6.42861175e-02] [ 3.76001244e-02] [ 5.27203255e-02] [ 1.87282945e-05] [ 4.10151746e-02] [ 3.70501548e-02] [ 1.72325600e-04] [ 5.70277106e-02] [ 6.45296969e-06] [ 2.70542136e-02] [ 1.57297163e-04] [ 7.24700814e-02] [ 3.91145613e-02] [ 2.82640669e-02] [ 7.85323188e-02] [ 3.99441271e-02] [ 4.00279555e-02] [ 4.82177054e-02] [ 7.69563328e-05] [ 3.27078876e-02] [ 1.17025689e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 M-step... Number of clusters: 35 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 100 / Last logScore: -17024001.1059 / New log score: -17023974.259 / Difference attained: 26.8468308747 Current pi parameter: [[ 3.72117307e-02] [ 9.11940040e-06] [ 3.05322285e-02] [ 4.65216915e-02] [ 6.41618805e-02] [ 1.72294969e-06] [ 6.58534054e-02] [ 2.71898454e-05] [ 5.87882277e-02] [ 8.60511426e-06] [ 1.08925325e-05] [ 4.69932909e-06] [ 5.33911900e-06] [ 1.72324660e-04] [ 6.42754622e-02] [ 3.76001160e-02] [ 5.26878645e-02] [ 1.87298936e-05] [ 4.10151974e-02] [ 3.70501986e-02] [ 1.72325600e-04] [ 5.70433194e-02] [ 6.45352068e-06] [ 2.70541917e-02] [ 1.57297163e-04] [ 7.23692315e-02] [ 3.91076994e-02] [ 2.82629908e-02] [ 7.88760462e-02] [ 3.98972138e-02] [ 4.00983247e-02] [ 4.82176864e-02] [ 7.69629037e-05] [ 3.26919273e-02] [ 1.17035681e-05]] E-step ... Number of clusters: 35 / Number of bins: 300 WARNING! The EM did not converge!
results_300 = readjustEM(X_300.values,
L,
B,
P_300,
Pi_300,
Rpost_300,
logScore_300,
logScores_300,
1,
0.01,
maxIterations = 300
)
Relative threshold under which the cluster is considered to disappear: 0.00028571428571428574 Disappearing indexes : [ 1 5 7 9 10 11 12 13 17 20 22 24 32 34] There exist disapearing mixture proportions! Running adjusted EM... New adjusted number of clusters : 21 [ 0.03723718 0.03055311 0.0465535 0.06420576 0.06589844 0.05882843 0.06431942 0.03762583 0.05272389 0.04104324 0.03707553 0.05708233 0.02707269 0.07241872 0.03913444 0.02828232 0.07892998 0.0399245 0.04012575 0.04825066 0.03271428] Current pi parameter: [ 0.03723718 0.03055311 0.0465535 0.06420576 0.06589844 0.05882843 0.06431942 0.03762583 0.05272389 0.04104324 0.03707553 0.05708233 0.02707269 0.07241872 0.03913444 0.02828232 0.07892998 0.0399245 0.04012575 0.04825066 0.03271428] Compute likelihood using current responsibility... Number of bins: 300 Initial logScore: -17025766.3798 E-step ... Number of clusters: 21 / Number of bins: 300 M-step... Number of clusters: 21 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 1 / Last logScore: -17025766.3798 / New log score: -17025719.2652 / Difference attained: 47.1145917736 Current pi parameter: [[ 0.03721917] [ 0.03048881] [ 0.04669699] [ 0.06416429] [ 0.06586566] [ 0.05877902] [ 0.0642698 ] [ 0.03760028] [ 0.05273771] [ 0.04101664] [ 0.037058 ] [ 0.0570539 ] [ 0.02705435] [ 0.07234352] [ 0.03911091] [ 0.02826615] [ 0.07916594] [ 0.04002793] [ 0.04017573] [ 0.04821771] [ 0.03268747]] E-step ... Number of clusters: 21 / Number of bins: 300 M-step... Number of clusters: 21 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 2 / Last logScore: -17025719.2652 / New log score: -17025701.6962 / Difference attained: 17.5689461455 Current pi parameter: [[ 0.0372203 ] [ 0.03041127] [ 0.04668699] [ 0.06417492] [ 0.06583346] [ 0.05877876] [ 0.06426823] [ 0.03760027] [ 0.05272832] [ 0.0410201 ] [ 0.0370602 ] [ 0.05706219] [ 0.02705427] [ 0.07233782] [ 0.03898269] [ 0.0282667 ] [ 0.07916584] [ 0.04013 ] [ 0.04032129] [ 0.04821766] [ 0.03267871]] E-step ... Number of clusters: 21 / Number of bins: 300 M-step... Number of clusters: 21 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 3 / Last logScore: -17025701.6962 / New log score: -17025686.0186 / Difference attained: 15.6775996909 Current pi parameter: [[ 0.037221 ] [ 0.03050992] [ 0.0466146 ] [ 0.06424699] [ 0.06571201] [ 0.05877838] [ 0.06426499] [ 0.03760028] [ 0.05272542] [ 0.04102071] [ 0.03706158] [ 0.05706964] [ 0.02705437] [ 0.07233421] [ 0.03897954] [ 0.02826689] [ 0.07916445] [ 0.04016062] [ 0.04032503] [ 0.04821764] [ 0.03267175]] E-step ... Number of clusters: 21 / Number of bins: 300 M-step... Number of clusters: 21 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 4 / Last logScore: -17025686.0186 / New log score: -17025679.074 / Difference attained: 6.94462605938 Current pi parameter: [[ 0.03722141] [ 0.03054146] [ 0.04653297] [ 0.0643221 ] [ 0.06569419] [ 0.0587783 ] [ 0.06425662] [ 0.03760032] [ 0.05272404] [ 0.04102086] [ 0.03706261] [ 0.05708143] [ 0.0270544 ] [ 0.07232865] [ 0.03897949] [ 0.02826698] [ 0.07916364] [ 0.04016143] [ 0.04032524] [ 0.04821774] [ 0.03266613]] E-step ... Number of clusters: 21 / Number of bins: 300 M-step... Number of clusters: 21 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 5 / Last logScore: -17025679.074 / New log score: -17025666.729 / Difference attained: 12.3450129442 Current pi parameter: [[ 0.03722164] [ 0.03067452] [ 0.04653272] [ 0.06431259] [ 0.06557873] [ 0.05877828] [ 0.06424269] [ 0.03760038] [ 0.05272327] [ 0.04102086] [ 0.03706339] [ 0.05709494] [ 0.0270544 ] [ 0.07232501] [ 0.03897948] [ 0.02826704] [ 0.07916345] [ 0.04016165] [ 0.04032532] [ 0.04821791] [ 0.03266175]] E-step ... Number of clusters: 21 / Number of bins: 300 M-step... Number of clusters: 21 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 6 / Last logScore: -17025666.729 / New log score: -17025659.4728 / Difference attained: 7.25621429458 Current pi parameter: [[ 0.03722177] [ 0.03080602] [ 0.0465327 ] [ 0.06431026] [ 0.0656082 ] [ 0.05877827] [ 0.06420449] [ 0.03760038] [ 0.05272262] [ 0.04102078] [ 0.03706389] [ 0.05710074] [ 0.0270544 ] [ 0.07220179] [ 0.0389798 ] [ 0.02826708] [ 0.07916341] [ 0.04016171] [ 0.04032536] [ 0.0482179 ] [ 0.03265845]] E-step ... Number of clusters: 21 / Number of bins: 300 M-step... Number of clusters: 21 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 7 / Last logScore: -17025659.4728 / New log score: -17025657.5258 / Difference attained: 1.94700316712 Current pi parameter: [[ 0.03722184] [ 0.03084745] [ 0.0465327 ] [ 0.06430965] [ 0.06568726] [ 0.05877826] [ 0.064125 ] [ 0.03760037] [ 0.05272214] [ 0.04102079] [ 0.03706427] [ 0.05710406] [ 0.0270544 ] [ 0.07216003] [ 0.03898015] [ 0.02826711] [ 0.07916342] [ 0.04016172] [ 0.04032562] [ 0.04821789] [ 0.03265586]] E-step ... Number of clusters: 21 / Number of bins: 300 M-step... Number of clusters: 21 / Number of bins: 300 Compute likelihood using current responsibility... Number of bins: 300 Itération number: 8 / Last logScore: -17025657.5258 / New log score: -17025657.3931 / Difference attained: 0.132684484124 Current pi parameter: [[ 0.03722188] [ 0.03084745] [ 0.0465327 ] [ 0.06430952] [ 0.06571261] [ 0.05877825] [ 0.064105 ] [ 0.03760037] [ 0.05272179] [ 0.04102081] [ 0.03706456] [ 0.0571063 ] [ 0.0270544 ] [ 0.07215292] [ 0.03898102] [ 0.02826714] [ 0.0791635 ] [ 0.04016172] [ 0.04032636] [ 0.04821788] [ 0.03265381]] SUCCESS! EM converged! Disappearing indexes : []
Dado o tamanho da dimensionalidade do conjunto de dados, se torna inviável a visualização dos resultados por meio de gráficos comuns, dessa forma buscou-se visualizar os clusters via Word Cloud. Já que o cerne do problema é texto, podemos criar um gráfico Word Cloud para representar a probabilidade de cada palavra. Dessa forma podemos deduzir qual cluster se refere a qual assunto.
Outra visualização possível é a visualização através do tempo, já que também temos o timestamp de cada artigo. Dessa forma, podemos visualizar qual é a distribuição temporal de cada cluster dentro do conjunto de dados no NIPS.
from wordcloud import WordCloud
def wordcloud_from_pred(groups_to_plot, predictions, dataset, titles=[], verbose=1):
n_groups = np.max(predictions) + 1
counts = [len([i for i in predictions if i == j]) for j in range(n_groups)]
if len(groups_to_plot) < 1:
raise Exception('Need to select at least 1 group to plot')
elif np.max(groups_to_plot) > n_groups or len(groups_to_plot) > n_groups + 1:
raise Exception('Groups to plot exceeded the prediction groups: {} > {}'
.format(len(groups_to_plot), n_groups))
for index, group in enumerate(groups_to_plot):
rows_wth_sg = [i for i, x in enumerate(predictions) if x == group]
dictionary = dataset.iloc[rows_wth_sg].sum(axis=0)
legend = dictionary.nlargest(12).index.values
dict_sg = dict(zip(dictionary.index.values, dictionary.values))
wordcloud = WordCloud( background_color='white')
wordcloud.generate_from_frequencies(frequencies=dict_sg)
plt.figure()
plt.imshow(wordcloud, interpolation="bilinear")
plt.axis("off")
group_cadidates_count = ('group {} with {} candidates'
.format(group, counts[group]))
try:
title = titles[index]
if title == '':
raise Exception('Empty title')
except Exception as e:
title = group_cadidates_count
plt.title(title)
plt.show()
if verbose > 0:
print(group_cadidates_count)
print(legend)
import re
def get_indexes_group(prediction, group):
return [i for i, p in enumerate(prediction) if p == group]
def get_group_years(prediction, y):
groups_years = []
for group in set(sorted(prediction)):
g_ind = get_indexes_group(prediction, group)
g_years = y[g_ind]
g_years = [int(re.search('\d+', year).group(0)) for year in g_years]
groups_years.append(g_years)
return groups_years
def create_column(legend, start_index, end_index):
column = ''
for i in range(start_index, end_index):
column += legend[i]
if i < end_index - 1:
column += '\n'
return column
def plot_timeline(years, legend, title='Articles'):
fig = plt.figure()
ax = fig.add_subplot(111)
props = dict(boxstyle='square', facecolor='white', alpha=0)
first_column = create_column(legend, 0, int(len(legend)/2))
second_column = create_column(legend, int(len(legend)/2), len(legend))
ax.text(0.6, 0.95, first_column, transform=ax.transAxes, fontsize=12,
multialignment = 'left' , verticalalignment='top', bbox=props)
ax.text(0.8, 0.95, second_column, transform=ax.transAxes, fontsize=12,
multialignment = 'left' , verticalalignment='top', bbox=props)
x = np.arange(1987, 2016)
count_articles_at_year = [years.count(year) for year in x]
ax.plot(x, count_articles_at_year, color='red')
plt.title('{} through the years'.format(title))
plt.xlabel('Year')
plt.xticks(x, rotation=60)
plt.ylabel('Articles')
ax.grid(axis='x', linestyle='--', linewidth=0.3)
plt.show()
return fig
def get_sorted_clusters_count(prediction, n_clusters):
counts = [(index, len([i for i in prediction if i == j])) for index, j in enumerate(np.arange(0, n_clusters))]
sorted_counts = sorted(counts, key=lambda tup: tup[1], reverse=True)
return sorted_counts
gmm_o = GaussianMixture(n_components=73, covariance_type='diag', max_iter=300).fit(X_300)
gmm_pred = gmm_o.predict(X_300)
sorted_counts = get_sorted_clusters_count(gmm_pred, 73)
print(sorted_counts)
[(28, 326), (56, 226), (16, 220), (70, 198), (0, 170), (23, 160), (18, 142), (46, 127), (11, 126), (38, 122), (72, 119), (6, 115), (32, 113), (5, 109), (7, 109), (9, 109), (47, 109), (62, 109), (19, 106), (55, 106), (14, 104), (50, 98), (13, 97), (51, 95), (64, 92), (49, 90), (25, 84), (59, 74), (8, 73), (43, 71), (61, 71), (63, 69), (22, 67), (65, 67), (48, 66), (26, 63), (10, 62), (31, 62), (53, 62), (37, 61), (12, 60), (44, 60), (24, 58), (54, 58), (30, 57), (52, 55), (66, 55), (3, 53), (45, 53), (69, 53), (2, 51), (17, 51), (41, 51), (60, 51), (71, 51), (21, 50), (33, 50), (34, 50), (29, 49), (35, 46), (68, 46), (15, 43), (27, 41), (42, 40), (58, 35), (39, 31), (1, 13), (57, 13), (36, 10), (20, 8), (40, 6), (4, 4), (67, 3)]
Aqui temos os 5 maiores clusters criados pelo GMM com 73 componentes. Podemos distinguir 2 temas de artigos apenas olhando as palavras mais frequentes nesse cluster.
selected_groups = [i for i, n in sorted_counts]
wordcloud_from_pred(selected_groups[:5],
gmm_pred,
X_300,
titles=['Neural Network', '', 'Reinforcement Learning'])
group 28 with 326 candidates ['neuron' 'cell' 'network' 'activate' 'response' 'spike' 'pattern' 'output' 'visual' 'connect' 'unit' 'map']
group 56 with 226 candidates ['bound' 'norm' 'matrix' 'optim' 'estimate' 'kernel' 'sample' 'theorem' 'convex' 'regular' 'converge' 'rate']
group 16 with 220 candidates ['policies' 'state' 'action' 'optim' 'bound' 'reward' 'sample' 'estimate' 'iter' 'gradient' 'converge' 'theorem']
group 70 with 198 candidates ['network' 'train' 'output' 'unit' 'dynam' 'estimate' 'hidden' 'optim' 'state' 'predict' 'gradient' 'converge']
group 0 with 170 candidates ['network' 'train' 'recognition' 'unit' 'output' 'feature' 'image' 'speech' 'word' 'layer' 'hidden' 'task']
Nesse momento podemos visualizar os clusters através do tempo, como cada assunto/cluster se comportou através dos anos.
Para essa visualização colocamos as 12 palavras mais frequentes em cada cluster e a contagem de artigos por ano.
Pode-se notar 3 grupos muito parecidos em suas palavras caracteristicas, onde todas podem remeter à "Reinforcement Learning", isso pode nos mostrar que nossos clusters não estão perfeitos e que alguns grupos podem ser somados em apenas um.
groups_years = get_group_years(gmm_pred, y)
reinforcement_learning = [10, 14, 16]
selected_groups = [(i, groups_years[i]) for i in reinforcement_learning]
for group, years_group in selected_groups:
group_indexes = get_indexes_group(gmm_pred, group)
dictionary = X_300.iloc[group_indexes].sum(axis=0)
legend = dictionary.nlargest(12).index.values
plot_timeline(years_group, legend, title='Group {}'.format(group))
from sklearn.mixture import GaussianMixture
gmm_21 = GaussianMixture(n_components=21, covariance_type='diag', max_iter=300).fit(X_300)
gmm_21_pred = gmm_21.predict(X_300)
sorted_counts = get_sorted_clusters_count(gmm_21_pred, 21)
print(sorted_counts)
[(20, 578), (18, 508), (6, 455), (2, 382), (3, 352), (12, 332), (11, 329), (9, 311), (7, 309), (8, 306), (13, 230), (4, 226), (17, 204), (19, 196), (16, 188), (0, 184), (15, 160), (1, 158), (5, 152), (10, 136), (14, 108)]
selected_groups = [i for i, n in sorted_counts]
titles = ['Neural Networks', 'Deep Learning', 'kernel methods', 'Reinforcement Learning', '']
wordcloud_from_pred(selected_groups[:5],
gmm_21_pred,
X_300,
titles = titles)
group 20 with 578 candidates ['network' 'neuron' 'cell' 'activate' 'response' 'output' 'unit' 'pattern' 'visual' 'spike' 'connect' 'signal']
group 18 with 508 candidates ['network' 'train' 'unit' 'output' 'hidden' 'state' 'pattern' 'layer' 'recognition' 'net' 'feature' 'estimate']
group 6 with 455 candidates ['kernel' 'estimate' 'train' 'optim' 'matrix' 'feature' 'class' 'sample' 'bound' 'regular' 'theorem' 'classification']
group 2 with 382 candidates ['state' 'policies' 'action' 'optim' 'reward' 'sample' 'estimate' 'bound' 'control' 'iter' 'converge' 'dynam']
group 3 with 352 candidates ['bound' 'loss' 'optim' 'theorem' 'sample' 'rate' 'convex' 'estimate' 'class' 'train' 'online' 'predict']
groups_years = get_group_years(gmm_21_pred, y_300)
selected_groups = selected_groups
selected_groups_21 = [(i, groups_years[i]) for i in selected_groups]
j=0
for group, years_group in selected_groups_21[:5]:
group_indexes = get_indexes_group(gmm_21_pred, group)
dictionary = X_300.iloc[group_indexes].sum(axis=0)
legend = dictionary.nlargest(12).index.values
plot_timeline(years_group, legend, title='{}'.format(titles[j]))
j+=1
Dessa forma podemos dizer que o melhor resultado e $K$ escolhido, dentro do escopo realizado foi $K = 21$ para um dataset de 300 palavras. Dito isso, tal resultado diferiu do que foi lido na literatura, porém acreditamos que bons resultados foram alcançados e o objetivo sobre o aprendizado para esse problema foi aprendido. Foi adquirido um conhecimento sobre como atacar problemas não supervisionados, como lidar com situações onde não existem labels para os dados e há pouca explicação para o conjunto de dados. Porém, existem pontos onde poderiamos melhorar nossa solução, em um cenário onde o recurso tempo não fosse um atrapalhador, poderiamos gerar mais análises mesmo com baixo recurso computacional, levando assim a possíveis descobertas que não foram possíveis por falta de análise. Outro ponto que poderíamos melhorar é na pesquisa e leitura de mais material da literatura, já que existem muitas fontes e muitos pontos inexplorados como Self Organizing Maps, DBSCAN e demais modelos para aprendizado não supervisionado. Portanto, cremos que foi atingido um bom patamar com o resultado entregue, porém há o que melhorar.