diff --git a/figures/d-cliques-mnist-lenet-comparison-to-non-clustered-topologies.png b/figures/d-cliques-mnist-lenet-comparison-to-non-clustered-topologies.png new file mode 100644 index 0000000000000000000000000000000000000000..7d85a179e582ec549059a53e8314407b2ab27cbd Binary files /dev/null and b/figures/d-cliques-mnist-lenet-comparison-to-non-clustered-topologies.png differ diff --git a/figures/d-cliques-mnist-linear-comparison-to-non-clustered-topologies.png b/figures/d-cliques-mnist-linear-comparison-to-non-clustered-topologies.png index 7c458bc0ed03c7e6dc0212381990f44c5da8192d..b9187576c03690dad7b23a4d0834b19150c1a6e2 100644 Binary files a/figures/d-cliques-mnist-linear-comparison-to-non-clustered-topologies.png and b/figures/d-cliques-mnist-linear-comparison-to-non-clustered-topologies.png differ diff --git a/main.tex b/main.tex index b92d27c292c1919a0c81810e2022497ccb809535..0f75a0bcd39104fd87c56c13e47ed7896d7ee9ec 100644 --- a/main.tex +++ b/main.tex @@ -431,15 +431,24 @@ We solve this problem by decoupling the gradient averaging from the weight avera - \begin{figure}[htbp] - \centering - +\begin{figure}[htbp] + \centering + \begin{subfigure}[htb]{0.7\textwidth} % To regenerate the figure, from directory results/mnist -% python ../../../learn-topology/tools/plot_convergence.py fully-connected-cliques/all/2021-03-10-10:19:44-CET no-init-no-clique-avg/fully-connected-cliques/all/2021-03-12-11:12:49-CET random-10/all/2021-03-17-20:28:12-CET random-10-diverse/all/2021-03-17-20:28:35-CET --labels 'd-clique (fcc)' 'd-clique (fcc) no clique avg. no uniform init.' '10 random edges' '10 random edges (all classes represented)' --add-min-max --legend 'lower right' --ymin 88 --ymax 92.5 --yaxis test-accuracy --save-figure ../../figures/d-cliques-mnist-linear-comparison-to-non-clustered-topologies.png +% python ../../../learn-topology/tools/plot_convergence.py fully-connected-cliques/all/2021-03-10-10:19:44-CET no-init-no-clique-avg/fully-connected-cliques/all/2021-03-12-11:12:49-CET random-10/all/2021-03-17-20:28:12-CET random-10-diverse/all/2021-03-17-20:28:35-CET random-10-diverse-unbiased-grad/all/2021-03-17-20:29:04-CET --labels 'd-clique (fcc)' 'd-clique (fcc) no clique avg. no uniform init.' '10 random edges' '10 random edges (all classes represented)' '10 random edges (all classes repr.) with unbiased grad.' --add-min-max --legend 'lower right' --ymin 88 --ymax 92.5 --yaxis test-accuracy --save-figure ../../figures/d-cliques-mnist-linear-comparison-to-non-clustered-topologies.png \centering - \includegraphics[width=0.6\textwidth]{figures/d-cliques-mnist-linear-comparison-to-non-clustered-topologies} - \caption{\label{fig:d-cliques-mnist-linear-comparison-to-non-clustered-topologies} MNIST: Comparison to non-Clustered Topologies} - \end{figure} + \includegraphics[width=\textwidth]{figures/d-cliques-mnist-linear-comparison-to-non-clustered-topologies} + \caption{\label{fig:d-cliques-mnist-linear-comparison-to-non-clustered-topologies} Linear Model} + \end{subfigure} + + \begin{subfigure}[htb]{0.7\textwidth} +% To regenerate the figure, from directory results/mnist/gn-lenet +% python ../../../../learn-topology/tools/plot_convergence.py no-init/all/2021-03-22-21:39:54-CET no-init-no-clique-avg/all/2021-03-22-21:40:16-CET random-10/all/2021-03-22-21:41:06-CET random-10-diverse/all/2021-03-22-21:41:46-CET random-10-diverse-unbiased-grad/all/2021-03-22-21:42:04-CET --legend 'lower right' --add-min-max --labels 'd-clique (fcc) clique avg.' 'd-clique (fcc) no clique avg.' '10 random edges' '10 random edges (all classes repr.)' '10 random edges (all classes repr.) with unbiased grad.' --ymin 80 --yaxis test-accuracy --save-figure ../../../figures/d-cliques-mnist-lenet-comparison-to-non-clustered-topologies.png + \includegraphics[width=\textwidth]{figures/d-cliques-mnist-lenet-comparison-to-non-clustered-topologies} + \caption{\label{fig:d-cliques-mnist-lenet-comparison-to-non-clustered-topologies} LeNet Model} + \end{subfigure} + \caption{\label{fig:d-cliques-mnist-comparison-to-non-clustered-topologies} MNIST: Comparison to non-Clustered Topologies} +\end{figure} \begin{figure}[htbp] @@ -586,9 +595,9 @@ In addition, it is important that all nodes are initialized with the same model \begin{itemize} \item Test MNIST avec gn-lenet - \item Enlever les mentions à l'initialisation uniforme \item Plot Scattering (Citer l'article décentralisé) \item Test topology en n-log n https://dl.acm.org/doi/10.1145/335305.335325 + \item Enlever les mentions à l'initialisation uniforme \end{itemize}